129. Amber Teng - Building apps with a new generation of language models

It’s no secret that a new generation of powerful and highly scaled language models is taking the world by storm. Companies like OpenAI, AI21Labs, and Cohere have built models so versatile that they’re powering hundreds of new applications, and unlocking entire new markets for AI-generated text. In light of that, I thought it would be worth exploring the applied side of language modelling — to dive deep into one specific language model-powered tool, to understand what it means to build apps on top of scaled AI systems. How easily can these models be used in the wild? What bottlenecks and challenges do people run into when they try to build apps powered by large language models? That’s what I wanted to find out. My guest today is Amber Teng, and she’s a data scientist who recently published a blog that got quite a bit of attention, about a resume cover letter generator that she created using GPT-3, OpenAI’s powerful and now-famous language model. I thought her project would be make for a great episode, because it exposes so many of the challenges and opportunities that come with the new era of powerful language models that we’ve just entered. So today we’ll be exploring exactly that: looking at the applied side of language modelling and prompt engineering, understanding how large language models have made new apps not only possible but also much easier to build, and the likely future of AI-powered products. *** Intro music : - Artist: Ron Gelinas - Track Title: Daybreak Chill Blend (original mix) - Link to Track: *** Chapters : - 0:00 Intro - 2:30 Amber’s background - 5:30 Using GPT-3 - 14:45 Building prompts up - 18:15 Prompting best practices - 21:45 GPT-3 mistakes - 25:30 Context windows - 30:00 End-to-end time - 34:45 The cost of one cover letter - 37:00 The analytics - 41:45 Dynamics around company-building - 46:00 Commoditization of language modelling - 51:00 Wrap-up

You can listen to 129. Amber Teng - Building apps with a new generation of language models online on Radio and Podcast. Open the player on this page to stream the available audio.

129. Amber Teng - Building apps with a new generation of language models is an episode from Towards Data Science by The TDS team .

This episode is 00:51:21 long.

This episode was published on Oct 5, 2022.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from Towards Data Science when more episodes are available from the podcast feed.