If true, AI firms can no longer rely primarily on buying more compute and data for guaranteed progress; competitive advantage will shift toward fundamental research and novel methods, changing investment and hiring priorities across the industry.
Ilya Sutskever says the recent burst of AI progress driven by scaling pre‑training recipes—where increasing model size, data and compute reliably improved results—has reached diminishing returns as data is finite and compute costs surge. That scaling era (roughly 2020–2025) offered a low‑risk, capital‑intensive path to gains, but Sutskever argues another qualitative leap won’t come from simply multiplying scale. Instead, the field is reverting to a research‑driven phase where new algorithms, training recipes or reinforcement‑learning approaches will be needed to drive the next breakthroughs. He frames the next period as “back to the age of research,” albeit on a much larger compute baseline.
Comments
Want to join the conversation?
Loading comments...