
How to Find the Agent Failures Your Evals Miss with Scott Clark - #767
May 7, 2026 - 53:19
Radio and PodcastLive Radio & Podcasts
In this episode, Rashmi Shetty, senior director of enterprise generative AI platform at Capital One, joins us to explore how the company is designing, deploying, and scaling multi-agent systems in a highly regulated envi...
How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765 is an episode from This Week in Machine Learning & Artificial Intelligence (AI) Podcast by TWIML. In this episode, Rashmi Shetty, senior director of enterprise generativ...
This episode belongs to This Week in Machine Learning & Artificial Intelligence (AI) Podcast.
Use the player on this page to stream the episode online.
Published Apr 16, 2026, 54:18 long, audio available.
In this episode, Rashmi Shetty, senior director of enterprise generative AI platform at Capital One, joins us to explore how the company is designing, deploying, and scaling multi-agent systems in a highly regulated environment. Rashmi walks us through Chat Concierge, a multi-agent chat experience for auto dealerships that handles intent disambiguation, tool invocation, and human handoffs to deliver safer, more personalized customer journeys. We discuss Capital One’s platform-centric approach to AI agents and how it separates design from runtime governance, embedding policies, guardrails, and cyber controls across agent threat boundaries. Rashmi shares how the team approaches the developer experience for agent builders, observability, and evals for stochastic, multi-agent workflows; and strategies for model specialization, including fine-tuning and distillation. We also cover standards and abstraction, closed-loop learning from production telemetry, and key lessons for enterprises building agentic systems. The complete show notes for this episode can be found at
You can listen to How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765 online on Radio and Podcast. Open the player on this page to stream the available audio.
How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765 is an episode from This Week in Machine Learning & Artificial Intelligence (AI) Podcast by TWIML.
This episode is 54:18 long.
This episode was published on Apr 16, 2026.
Yes. Use the heart button on the episode page to add it to your favorite episodes list.
Yes. This page shows related episodes from This Week in Machine Learning & Artificial Intelligence (AI) Podcast when more episodes are available from the podcast feed.
You can listen to How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765 on this page when the episode audio is available from the podcast feed.
How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765 is from This Week in Machine Learning & Artificial Intelligence (AI) Podcast by TWIML.
Published Apr 16, 2026 and 54:18 long