Human language technologies
Researching software and systems that bridge the linguistic divide between people and machines to make communicating with computers as natural as speaking with family and friends.
Dataset Source Code
MEGA Multilingual Benchmarking
Official code for the paper published at EMNLP 2023 paper: Multilingual Evaluation of Generative AI (MEGA), a framework to evaluate Large Language Models (LLMs) on various multilingual benchmarks
Microsoft Research Blog
Research Focus: Week of October 23, 2023
In this issue: Kosmos-2.5: A Multimodal Literate Model; Can vine copulas explain complex relationships of weather variables; New system accelerates the adaptive training process; Structural inequalities and relational labor in the influencer industry.
Project
LLMLingua Series
Effectively Deliver Information to LLMs via Prompt Compression LLMLingua Read More (opens in new tab) LongLLMLingua Read More (opens in new tab) LLMLingua-2 Read More (opens in new tab) Large language models (LLMs) have demonstrated remarkable…
Publication
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Podcast
Abstracts: October 9, 2023
Researcher Dr. Sheng Zhang joins “Abstracts”—your source for cutting-edge research in brief—to discuss a recent paper on distilling large language models into smaller, more efficient ones capable of excelling in broad application classes.
Publication
On Surgical Fine-tuning for Language Encoder
Publication