Ben Van Durme

Principal Researcher

论文与出版物

查看方式：

- Jailbreak Distillation: Renewable Safety Benchmarking
  
  Jingyu Zhang, Ahmed Elgohary, Xiawei Wang, A S M Iftekhar, Ahmed Magooda, Ben Van Durme, Daniel Khashabi, Kyle Jackson
  
  Empirical Methods in Natural Language Processing - Findings | November 2025
  
  DOI Publication Publication
- Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting
  
  Michael Y. Hu, Ben Van Durme, Jacob Andreas, Harsh Jhamtani
  
  October 2025
  
  Publication
- All claims are equal, but some claims are more equal than others: Importance-sensitive factuality evaluation of LLM generations
  
  Miriam Wanner, Leif Azzopardi, Paul Thomas, Soham Dan, Ben Van Durme, Nick Craswell
  
  October 2025
  
  preprint arXiv:2510.07083
  
  Publication
- LM Agents for Coordinating Multi-User Information Gathering
  
  Harsh Jhamtani, Jacob Andreas, Ben Van Durme
  
  ACL | July 2025
  
  Publication
- Conformal Linguistic Calibration: Trading-off between Factuality and Specificity
  
  Zhengping Jiang, Anqi Liu, Ben Van Durme
  
  NeurIPS 2025 | February 2025
  
  DOI
- From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering
  
  Nathaniel Weir, Bhavana Dalvi, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, P. Jansen, Ben Van Durme, Peter Clark
  
  ICLR 2025 | December 2024
  
  DOI Publication Publication
- Language-to-Code Translation with a Single Labeled Example
  
  Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
  
  EMNLP | November 2024
  
  Publication
- Ontologically Faithful Generation of Non-Player Character Dialogues
  
  Nathaniel Weir, Ryan Thomas, Randolph D'Amore, Kellie Hill, Ben Van Durme, Harsh Jhamtani
  
  EMNLP | November 2024
  
  Publication
- Learning to Retrieve Iteratively for In-Context Learning
  
  Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
  
  EMNLP | November 2024
  
  Outstanding Paper Award
  
  Publication
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- Multi-Field Adaptive Retrieval
  
  Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
  
  ICLR 2025 | October 2024
  
  Spotlight
  
  DOI Publication Publication
- Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
  
  Jingyu (Jack) Zhang, Ahmed Elgohary, Ahmed Magooda, Daniel Khashabi, Ben Van Durme
  
  ICLR 2025 | October 2024
  
  DOI Publication Publication
- Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
  
  Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
  
  ICLR 2025 | September 2024
  
  DOI Publication Publication
- Natural Language Decomposition and Interpretation of Complex Utterances
  
  Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
  
  IJCAI 2024 | August 2024
  
  DOI Publication
- Interpreting User Requests in the Context of Natural Language Standing Instructions
  
  Nikita Moghe, Patrick Xia, Jacob Andreas, Jason Eisner, Ben Van Durme, Harsh Jhamtani
  
  NAACL | June 2024
  
  Publication
- LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
  
  Boshi Wang, Hao Fang, Jason Eisner, Ben Van Durme, Yu Su
  
  arXiv: Computation and Language | March 2024
  
  Preprint
- Do Androids Know They’re Only Dreaming of Electric Sheep?
  
  Sky CH-Wang, Ben Van Durme, Jason Eisner, Chris Kedzie
  
  arXiv: Computation and Language | December 2023
  
  Preprint
- BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
  
  Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
  
  NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
  
  Publication
- SCREWS: A Modular Framework for Reasoning with Revisions
  
  Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
  
  arXiv: Computation and Language | September 2023
  
  Preprint
- When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
  
  Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
  
  EMNLP 2022 | December 2022
  
  Publication
- Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code
  
  Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Ben Van Durme, Olivia Deng, Akanksha Malhotra, Bill Dolan
  
  Association of Computational Linguistics | July 2022
  
  Publication Github 项目
- Few-Shot Semantic Parsing with Language Models Trained on Code
  
  Richard Shin, Ben Van Durme
  
  NAACL 2022 | July 2022
  
  Publication Publication
- Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
  
  Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
  
  ACL 2022 | May 2022
  
  Publication PDF
- Constrained Language Models Yield Few-Shot Semantic Parsers
  
  Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme
  
  EMNLP 2021 | November 2021
  
  Publication Preprint

- Jailbreak Distillation: Renewable Safety Benchmarking
  
  Jingyu Zhang, Ahmed Elgohary, Xiawei Wang, A S M Iftekhar, Ahmed Magooda, Ben Van Durme, Daniel Khashabi, Kyle Jackson
  
  Empirical Methods in Natural Language Processing - Findings | November 2025
  
  DOI Publication Publication
- Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting
  
  Michael Y. Hu, Ben Van Durme, Jacob Andreas, Harsh Jhamtani
  
  October 2025
  
  Publication
- All claims are equal, but some claims are more equal than others: Importance-sensitive factuality evaluation of LLM generations
  
  Miriam Wanner, Leif Azzopardi, Paul Thomas, Soham Dan, Ben Van Durme, Nick Craswell
  
  October 2025
  
  preprint arXiv:2510.07083
  
  Publication
- LM Agents for Coordinating Multi-User Information Gathering
  
  Harsh Jhamtani, Jacob Andreas, Ben Van Durme
  
  ACL | July 2025
  
  Publication
- From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering
  
  Nathaniel Weir, Bhavana Dalvi, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, P. Jansen, Ben Van Durme, Peter Clark
  
  ICLR 2025 | December 2024
  
  DOI Publication Publication
- Language-to-Code Translation with a Single Labeled Example
  
  Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
  
  EMNLP | November 2024
  
  Publication
- Learning to Retrieve Iteratively for In-Context Learning
  
  Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
  
  EMNLP | November 2024
  
  Outstanding Paper Award
  
  Publication
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- Multi-Field Adaptive Retrieval
  
  Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
  
  ICLR 2025 | October 2024
  
  Spotlight
  
  DOI Publication Publication
- Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
  
  Jingyu (Jack) Zhang, Ahmed Elgohary, Ahmed Magooda, Daniel Khashabi, Ben Van Durme
  
  ICLR 2025 | October 2024
  
  DOI Publication Publication
- Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
  
  Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
  
  ICLR 2025 | September 2024
  
  DOI Publication Publication
- Natural Language Decomposition and Interpretation of Complex Utterances
  
  Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
  
  IJCAI 2024 | August 2024
  
  DOI Publication
- Interpreting User Requests in the Context of Natural Language Standing Instructions
  
  Nikita Moghe, Patrick Xia, Jacob Andreas, Jason Eisner, Ben Van Durme, Harsh Jhamtani
  
  NAACL | June 2024
  
  Publication
- LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
  
  Boshi Wang, Hao Fang, Jason Eisner, Ben Van Durme, Yu Su
  
  arXiv: Computation and Language | March 2024
  
  Preprint
- Do Androids Know They’re Only Dreaming of Electric Sheep?
  
  Sky CH-Wang, Ben Van Durme, Jason Eisner, Chris Kedzie
  
  arXiv: Computation and Language | December 2023
  
  Preprint
- BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
  
  Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
  
  NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
  
  Publication
- SCREWS: A Modular Framework for Reasoning with Revisions
  
  Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
  
  arXiv: Computation and Language | September 2023
  
  Preprint
- When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
  
  Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
  
  EMNLP 2022 | December 2022
  
  Publication
- Few-Shot Semantic Parsing with Language Models Trained on Code
  
  Richard Shin, Ben Van Durme
  
  NAACL 2022 | July 2022
  
  Publication Publication
- Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
  
  Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
  
  ACL 2022 | May 2022
  
  Publication PDF
- LM Agents for Coordinating Multi-User Information Gathering
  
  Harsh Jhamtani, Jacob Andreas, Ben Van Durme
  
  ACL | July 2025
  
  Publication
- Conformal Linguistic Calibration: Trading-off between Factuality and Specificity
  
  Zhengping Jiang, Anqi Liu, Ben Van Durme
  
  NeurIPS 2025 | February 2025
  
  DOI
- Language-to-Code Translation with a Single Labeled Example
  
  Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
  
  EMNLP | November 2024
  
  Publication
- Ontologically Faithful Generation of Non-Player Character Dialogues
  
  Nathaniel Weir, Ryan Thomas, Randolph D'Amore, Kellie Hill, Ben Van Durme, Harsh Jhamtani
  
  EMNLP | November 2024
  
  Publication
- Learning to Retrieve Iteratively for In-Context Learning
  
  Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
  
  EMNLP | November 2024
  
  Outstanding Paper Award
  
  Publication
- Natural Language Decomposition and Interpretation of Complex Utterances
  
  Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
  
  IJCAI 2024 | August 2024
  
  DOI Publication
- BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
  
  Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
  
  NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
  
  Publication
- SCREWS: A Modular Framework for Reasoning with Revisions
  
  Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
  
  arXiv: Computation and Language | September 2023
  
  Preprint
- When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
  
  Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
  
  EMNLP 2022 | December 2022
  
  Publication
- Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code
  
  Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Ben Van Durme, Olivia Deng, Akanksha Malhotra, Bill Dolan
  
  Association of Computational Linguistics | July 2022
  
  Publication Github 项目
- Few-Shot Semantic Parsing with Language Models Trained on Code
  
  Richard Shin, Ben Van Durme
  
  NAACL 2022 | July 2022
  
  Publication Publication
- Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
  
  Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
  
  ACL 2022 | May 2022
  
  Publication PDF
- Constrained Language Models Yield Few-Shot Semantic Parsers
  
  Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme
  
  EMNLP 2021 | November 2021
  
  Publication Preprint
- Multi-Field Adaptive Retrieval
  
  Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
  
  ICLR 2025 | October 2024
  
  Spotlight
  
  DOI Publication Publication
- Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
  
  Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
  
  ICLR 2025 | September 2024
  
  DOI Publication Publication

- Jailbreak Distillation: Renewable Safety Benchmarking
  
  Jingyu Zhang, Ahmed Elgohary, Xiawei Wang, A S M Iftekhar, Ahmed Magooda, Ben Van Durme, Daniel Khashabi, Kyle Jackson
  
  Empirical Methods in Natural Language Processing - Findings | November 2025
  
  DOI Publication Publication
- LM Agents for Coordinating Multi-User Information Gathering
  
  Harsh Jhamtani, Jacob Andreas, Ben Van Durme
  
  ACL | July 2025
  
  Publication
- Conformal Linguistic Calibration: Trading-off between Factuality and Specificity
  
  Zhengping Jiang, Anqi Liu, Ben Van Durme
  
  NeurIPS 2025 | February 2025
  
  DOI
- From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering
  
  Nathaniel Weir, Bhavana Dalvi, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, P. Jansen, Ben Van Durme, Peter Clark
  
  ICLR 2025 | December 2024
  
  DOI Publication Publication
- Language-to-Code Translation with a Single Labeled Example
  
  Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
  
  EMNLP | November 2024
  
  Publication
- Ontologically Faithful Generation of Non-Player Character Dialogues
  
  Nathaniel Weir, Ryan Thomas, Randolph D'Amore, Kellie Hill, Ben Van Durme, Harsh Jhamtani
  
  EMNLP | November 2024
  
  Publication
- Learning to Retrieve Iteratively for In-Context Learning
  
  Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
  
  EMNLP | November 2024
  
  Outstanding Paper Award
  
  Publication
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- Multi-Field Adaptive Retrieval
  
  Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
  
  ICLR 2025 | October 2024
  
  Spotlight
  
  DOI Publication Publication
- Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
  
  Jingyu (Jack) Zhang, Ahmed Elgohary, Ahmed Magooda, Daniel Khashabi, Ben Van Durme
  
  ICLR 2025 | October 2024
  
  DOI Publication Publication
- Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
  
  Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
  
  ICLR 2025 | September 2024
  
  DOI Publication Publication
- Natural Language Decomposition and Interpretation of Complex Utterances
  
  Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
  
  IJCAI 2024 | August 2024
  
  DOI Publication
- Interpreting User Requests in the Context of Natural Language Standing Instructions
  
  Nikita Moghe, Patrick Xia, Jacob Andreas, Jason Eisner, Ben Van Durme, Harsh Jhamtani
  
  NAACL | June 2024
  
  Publication
- When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
  
  Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
  
  EMNLP 2022 | December 2022
  
  Publication
- Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code
  
  Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Ben Van Durme, Olivia Deng, Akanksha Malhotra, Bill Dolan
  
  Association of Computational Linguistics | July 2022
  
  Publication Github 项目
- Few-Shot Semantic Parsing with Language Models Trained on Code
  
  Richard Shin, Ben Van Durme
  
  NAACL 2022 | July 2022
  
  Publication Publication
- Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
  
  Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
  
  ACL 2022 | May 2022
  
  Publication PDF
- Constrained Language Models Yield Few-Shot Semantic Parsers
  
  Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme
  
  EMNLP 2021 | November 2021
  
  Publication Preprint
- Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting
  
  Michael Y. Hu, Ben Van Durme, Jacob Andreas, Harsh Jhamtani
  
  October 2025
  
  Publication
- All claims are equal, but some claims are more equal than others: Importance-sensitive factuality evaluation of LLM generations
  
  Miriam Wanner, Leif Azzopardi, Paul Thomas, Soham Dan, Ben Van Durme, Nick Craswell
  
  October 2025
  
  preprint arXiv:2510.07083
  
  Publication
- LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
  
  Boshi Wang, Hao Fang, Jason Eisner, Ben Van Durme, Yu Su
  
  arXiv: Computation and Language | March 2024
  
  Preprint
- Do Androids Know They’re Only Dreaming of Electric Sheep?
  
  Sky CH-Wang, Ben Van Durme, Jason Eisner, Chris Kedzie
  
  arXiv: Computation and Language | December 2023
  
  Preprint
- BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
  
  Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
  
  NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
  
  Publication
- SCREWS: A Modular Framework for Reasoning with Revisions
  
  Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
  
  arXiv: Computation and Language | September 2023
  
  Preprint

Ben Van Durme

论文与出版物

Jailbreak Distillation: Renewable Safety Benchmarking

Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting

All claims are equal, but some claims are more equal than others: Importance-sensitive factuality evaluation of LLM generations

LM Agents for Coordinating Multi-User Information Gathering

Conformal Linguistic Calibration: Trading-off between Factuality and Specificity

From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering

Language-to-Code Translation with a Single Labeled Example

Ontologically Faithful Generation of Non-Player Character Dialogues

Learning to Retrieve Iteratively for In-Context Learning

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass

Multi-Field Adaptive Retrieval

Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements

Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models

Natural Language Decomposition and Interpretation of Complex Utterances

Interpreting User Requests in the Context of Natural Language Standing Instructions

LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error

Do Androids Know They’re Only Dreaming of Electric Sheep?

BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing

SCREWS: A Modular Framework for Reasoning with Revisions

When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems

Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code

Few-Shot Semantic Parsing with Language Models Trained on Code

Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation

Constrained Language Models Yield Few-Shot Semantic Parsers

Jailbreak Distillation: Renewable Safety Benchmarking

Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting

All claims are equal, but some claims are more equal than others: Importance-sensitive factuality evaluation of LLM generations

LM Agents for Coordinating Multi-User Information Gathering

From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering

Language-to-Code Translation with a Single Labeled Example

Learning to Retrieve Iteratively for In-Context Learning

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass

Multi-Field Adaptive Retrieval

Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements

Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models

Natural Language Decomposition and Interpretation of Complex Utterances

Interpreting User Requests in the Context of Natural Language Standing Instructions

LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error

Do Androids Know They’re Only Dreaming of Electric Sheep?

BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing

SCREWS: A Modular Framework for Reasoning with Revisions

When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems

Few-Shot Semantic Parsing with Language Models Trained on Code

Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation

LM Agents for Coordinating Multi-User Information Gathering

Conformal Linguistic Calibration: Trading-off between Factuality and Specificity

Language-to-Code Translation with a Single Labeled Example

Ontologically Faithful Generation of Non-Player Character Dialogues

Learning to Retrieve Iteratively for In-Context Learning

Natural Language Decomposition and Interpretation of Complex Utterances

BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing

SCREWS: A Modular Framework for Reasoning with Revisions

When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems

Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code

Few-Shot Semantic Parsing with Language Models Trained on Code

Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation

Constrained Language Models Yield Few-Shot Semantic Parsers

Multi-Field Adaptive Retrieval

Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models

Jailbreak Distillation: Renewable Safety Benchmarking

LM Agents for Coordinating Multi-User Information Gathering

Conformal Linguistic Calibration: Trading-off between Factuality and Specificity

From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering

Language-to-Code Translation with a Single Labeled Example

Ontologically Faithful Generation of Non-Player Character Dialogues

Learning to Retrieve Iteratively for In-Context Learning

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass

Multi-Field Adaptive Retrieval

Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements

Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models

Natural Language Decomposition and Interpretation of Complex Utterances

Interpreting User Requests in the Context of Natural Language Standing Instructions

When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems

Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code

Few-Shot Semantic Parsing with Language Models Trained on Code

Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation

Constrained Language Models Yield Few-Shot Semantic Parsers

Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting