137 - Nearest Neighbor Language Modeling and Machine Translation, with Urvashi Khandelwal

We invited Urvashi Khandelwal, a research scientist at Google Brain to talk about nearest neighbor language and machine translation models. These models interpolate parametric (conditional) language models with non-parametric distributions over the closest values in some data stores built from relevant data. Not only are these models shown to outperform the usual parametric language models, they also have important implications on memorization and generalization in language models. Urvashi's webpage: Papers discussed: 1) Generalization through memorization: Nearest Neighbor Language Models ( 2)Nearest Neighbor Machine Translation (

You can listen to 137 - Nearest Neighbor Language Modeling and Machine Translation, with Urvashi Khandelwal online on Radio and Podcast. Open the player on this page to stream the available audio.

137 - Nearest Neighbor Language Modeling and Machine Translation, with Urvashi Khandelwal is an episode from NLP Highlights by NLP Highlights.

This episode is 00:35:56 long.

This episode was published on Jan 13, 2023.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from NLP Highlights when more episodes are available from the podcast feed.