The Pre-Training Wall and the Treadmill After It

I've been confusing Don with frontier-lab links late at night for a bit. Ilya Sutskever told a NeurIPS audience that pre-training as we know it would unquestionably end. There's only one internet, and the data isn't growing. The frontier labs call this the pre-training wall. A leaked Google memo from 2023 argued they had no moat. R1 is on GitHub. Llama is on Hugging Face. OpenAI's secondary-market valuation has climbed past $850 billion. Don was confused. So he came over and we made an episode about it. Episode Page Support The Show

You can listen to The Pre-Training Wall and the Treadmill After It online on Radio and Podcast. Open the player on this page to stream the available audio.

The Pre-Training Wall and the Treadmill After It is an episode from CoRecursive w/ Adam Bell by Adam Gordon Bell - Software Developer.

This episode is 56:10 long.

This episode was published on May 9, 2026.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from CoRecursive w/ Adam Bell when more episodes are available from the podcast feed.