Radio and PodcastRadio and PodcastLive Radio & Podcasts
172: Transformers and Large Language Models artwork
Technology

172: Transformers and Large Language Models

Programming Throwdown by Patrick Wheeler and Jason Gauci

Mar 11, 202486:08Technology

Patrick and Jason explain transformers and large language models from the ground up. They cover attention, encoders and decoders, self-supervised learning, RLHF, and the key architectural ideas that made modern LLMs poss...

About This Episode

172: Transformers and Large Language Models is an episode from Programming Throwdown by Patrick Wheeler and Jason Gauci. Patrick and Jason explain transformers and large language models from the ground up. They cover attention, encoders and...

Podcast

This episode belongs to Programming Throwdown.

Listen Online

Use the player on this page to stream the episode online.

Episode Details

Published Mar 11, 2024, 86:08 long, audio available.

Related Episodes

Continue listening to more episodes from Programming Throwdown.

186: Becoming a Manager

Feb 3, 2026 - 87:30

Patrick and Jason discuss what it means to become a manager and how the role differs from individual engi...

185: Workflow Orchestrators

Nov 4, 2025 - 92:02

Patrick and Jason break down workflow orchestrators and why they matter for batch jobs, long-running task...

184: Asynchronous Programming

Sep 23, 2025 - 90:32

Patrick and Jason explain asynchronous programming and how it differs from traditional multithreading and...

182: AI Assisted Coding

Jun 30, 2025 - 97:36

Patrick and Jason discuss how AI-assisted coding tools can speed up development, answer questions about a...

181: Memory Management

May 12, 2025 - 106:21

Patrick and Jason cover memory management from both the operating-system and language-runtime perspective...

180: Reinforcement Learning

Mar 17, 2025 - 112:22

Patrick and Jason introduce reinforcement learning and place it alongside supervised and unsupervised lea...