The Pre-Training Wall and the Treadmill After It

CoRecursive: Coding Stories by Adam Gordon Bell - Software Developer

I've been confusing Don with frontier-lab links late at night for a bit. Ilya Sutskever told a NeurIPS audience that pre-training as we know it would unquestionably end. There's only one internet, and the data isn't grow...View more