172: Transformers and Large Language Models

Patrick and Jason explain transformers and large language models from the ground up. They cover attention, encoders and decoders, self-supervised learning, RLHF, and the key architectural ideas that made modern LLMs possible.

You can listen to 172: Transformers and Large Language Models online on Radio and Podcast. Open the player on this page to stream the available audio.

172: Transformers and Large Language Models is an episode from Programming Throwdown by Patrick Wheeler and Jason Gauci.

This episode is 86:08 long.

This episode was published on Mar 11, 2024.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from Programming Throwdown when more episodes are available from the podcast feed.