What Could Possibly Go Wrong? Safety Analysis for AI Systems

How can you ever know whether an LLM is safe to use? Even self-host ed LLM system s are vulnerable to adversarial prompt s left on the internet and waiting to be found by system search engines . These at tacks and others exploit the complexity of even seemingly secure AI systems . In our latest podcast from the Carnegie Mellon University Software Engineering Institute (SEI), David Schulker and Matthew Walsh, both senior data scientists in the SEI's CERT Division, sit down with Thomas Scanlon, lead of the CERT Data Science Technical Program, to discuss their work on System Theoretic Process Analysis, or STPA, a hazard-analysis technique uniquely suitable for dealing with AI complexity when assuring AI systems.

You can listen to What Could Possibly Go Wrong? Safety Analysis for AI Systems online on Radio and Podcast. Open the player on this page to stream the available audio.

What Could Possibly Go Wrong? Safety Analysis for AI Systems is an episode from Software Engineering Institute (SEI) Podcast Series by Carnegie Mellon University Software Engineering Institute.

This episode is 36:14 long.

This episode was published on Oct 31, 2025.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from Software Engineering Institute (SEI) Podcast Series when more episodes are available from the podcast feed.