#323 David Ha: Why Model Merging Could Be the Next AI Breakthrough

This episode is sponsored by tastytrade. Trade stocks, options, futures, and crypto in one platform with low commissions and zero commission on stocks and crypto. Built for traders who think in probabilities, tastytrade offers advanced analytics, risk tools, and an AI-powered Search feature. Learn more at Artificial intelligence is reaching a turning point. Instead of building bigger and bigger models, what if the real breakthrough comes from letting AI evolve? In this episode of Eye on AI, David Ha, Co-Founder and CEO of Sakana AI, explains why evolutionary strategies and collective intelligence could reshape the future of machine learning. We explore model merging, multi-agent systems, Monte Carlo tree search, and the AI Scientist framework designed to generate and evaluate new research ideas. The conversation dives into open-ended discovery, quality and diversity in AI systems, world models, and whether artificial intelligence can push beyond the boundaries of human knowledge. If you're interested in AGI, evolutionary AI, frontier models, AI research automation, or how AI could start discovering science on its own, this episode offers a clear look at where the field may be heading next. Stay Updated: Craig Smith on X: Eye on A.I. on X: (00:00) AI Should Evolve, Not Just Scale (03:54) David's Journey From Finance to Evolutionary AI (10:18) Why Gradient Descent Gets Stuck (18:12) Model Merging and Collective Intelligence (28:18) Combining Closed Frontier Models (32:56) Inside the AI Scientist Experiment (38:11) Parent Selection, Diversity and Innovation (49:25) Can AI Discover Truly New Knowledge? (53:05) Why Continual Learning Matter

You can listen to #323 David Ha: Why Model Merging Could Be the Next AI Breakthrough online on Radio and Podcast. Open the player on this page to stream the available audio.

#323 David Ha: Why Model Merging Could Be the Next AI Breakthrough is an episode from Eye On A.I. by Craig S. Smith.

This episode is 57:21 long.

This episode was published on Feb 24, 2026.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from Eye On A.I. when more episodes are available from the podcast feed.