How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann)

Nora Ammann is a technical specialist at the Advanced Research and Invention Agency in the UK. She joins the podcast to discuss how to steer a slow AI takeoff toward resilient and cooperative futures. We examine risks of rogue AI and runaway competition, and how scalable oversight, formal guarantees and secure code could support AI-enabled R&D and critical infrastructure. Nora also explains AI-supported bargaining and public goods for stability. LINKS: Nora Ammann site ARIA safeguarded AI program page AI Resilience official site Gradual Disempowerment website CHAPTERS: (00:00) Episode Preview (01:00) Slow takeoff expectations (08:13) Domination versus chaos (17:18) Human-AI coalitions vision (28:14) Scaling oversight and agents (38:45) Formal specs and guarantees (51:10) Resilience in AI era (01:02:21) Defense-favored cyber systems (01:10:37) AI-enabled bargaining and trade PRODUCED BY: SOCIAL LINKS: Website: Twitter (FLI): Twitter (Gus): LinkedIn: YouTube: Apple: Spotify:

You can listen to How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann) online on Radio and Podcast. Open the player on this page to stream the available audio.

How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann) is an episode from Future of Life Institute Podcast by Gus Docker.

This episode is 80:01 long.

This episode was published on Jan 7, 2026.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from Future of Life Institute Podcast when more episodes are available from the podcast feed.