138 - Compositional Generalization in Neural Networks, with Najoung Kim

Compositional generalization refers to the capability of models to generalize to out-of-distribution instances by composing information obtained from the training data. In this episode we chatted with Najoung Kim, on how to explicitly evaluate specific kinds of compositional generalization in neural network models of language. Najoung described COGS, a dataset she built for this, some recent results in the space, and why we should be careful about interpreting the results given the current practice of pretraining models of lots of unlabeled text. Najoung's webpage: Papers we discussed: 1. COGS: A Compositional Generalization Challenge Based on Semantic Interpretation (Kim et al., 2020): 2. Compositional Generalization Requires Compositional Parsers (Weissenhorn et al., 2022): 3. Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models (Kim et al., 2022): Note that we referred to the final paper by an earlier name in the discussion.

You can listen to 138 - Compositional Generalization in Neural Networks, with Najoung Kim online on Radio and Podcast. Open the player on this page to stream the available audio.

138 - Compositional Generalization in Neural Networks, with Najoung Kim is an episode from NLP Highlights by NLP Highlights.

This episode is 00:48:22 long.

This episode was published on Jan 20, 2023.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from NLP Highlights when more episodes are available from the podcast feed.