
Heard a leak from one of the frontier labs (not oai tbh), they reached an unexpected HUGE wall of diminishing returns trying to brute-force better results by training longer & using more and more data.. (more severe than what is published publicly)
Michael Wroczynski
379 posts

@Fidofornia
CEO Samurai Labs

Heard a leak from one of the frontier labs (not oai tbh), they reached an unexpected HUGE wall of diminishing returns trying to brute-force better results by training longer & using more and more data.. (more severe than what is published publicly)

news: OpenAI's upcomning Orion model shows how GPT improvements are slowing down It's prompting OpenAI to bake in reasoning and other tweaks after the initial model training phase.


@Fidofornia, Founder and CEO of Samurai Labs is the laureate “Leaders of the Future” by Forbes Poland. Thank you for the distinction! You can read more in the latest October Edition of Forbes Polska Magazine, Page 186. #SamuraiLabs #LeadersoftheFuture #ForbesPolska #Forbes





It's covered a bit in the above podcast by people like @katecrawford - there's huge implications to industrialization, mostly centering around who gets control of the frontier, when the frontier becomes resource intensive. So far control is accruing to the private sector (uh oh!)









