126 - Optimizing Continuous Prompts for Generation, with Lisa Li

We invited Lisa Li to talk about her recent work, Prefix-Tuning: Optimizing Continuous Prompts for Generation. Prefix tuning is a lightweight alternative to finetuning, and the idea is to tune only a fixed-length task-specific continuous vector, and to keep the pretrained transformer parameters frozen. We discussed how prefix tuning compares with finetuning and other efficient alternatives on two tasks in various experimental settings, and in what scenarios prefix tuning is preferable. Lisa is a Phd student at Stanford University. Lisa's webpage: The hosts for this episode are Pradeep Dasigi and Ana Marasović.

You can listen to 126 - Optimizing Continuous Prompts for Generation, with Lisa Li online on Radio and Podcast. Open the player on this page to stream the available audio.

126 - Optimizing Continuous Prompts for Generation, with Lisa Li is an episode from NLP Highlights by NLP Highlights.

This episode is 00:47:38 long.

This episode was published on May 24, 2021.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from NLP Highlights when more episodes are available from the podcast feed.