AI Frontiers
News & features
Orca-Math: Demonstrating the potential of SLMs with model specialization
| Arindam Mitra, Hamed Khanpour, Corby Rosset, and Ahmed Awadallah
Microsoft’s Orca-Math, a specialized small language model, outperforms much larger models in solving math problems that require multi-step reasoning and shows the potential of using feedback to improve language models. Learn more.
In the news | Microsoft News Center
3 big AI trends to watch in 2024
2023 was a major year for generative AI, as it went from research labs to real life with millions of people using it through popular tools like ChatGPT and Microsoft Copilot. This year, AI is expected to become more accessible,…
Research Focus: Week of February 5, 2024
Research Focus: New Research Forum series explores bold ideas in the era of AI; LASER improves reasoning in language models; Cache-Efficient Top-k Aggregation over High Cardinality Large Datasets; Six Microsoft researchers named 2023 ACM Fellows.
Microsoft Research Forum: New series explores bold ideas in technology research in the era of AI
Microsoft Research Forum (opens in new tab) is a new series of conversations that explore recent advances, bold new ideas, and important discussions within the global research community. Leading Microsoft researchers will share insights into their work, followed by live…
In the news | The Verge
Microsoft LASERs away LLM inaccuracies
During the January Microsoft Research Forum, Dipendra Misra, a senior researcher at Microsoft Research Lab NYC and AI Frontiers, explained how Layer-Selective Rank Reduction (or LASER) can make large language models more accurate.
Besmira Nushi summarizes timely challenges and ongoing work on evaluating and in-depth understanding of large foundation models as well as agent platforms built upon such models at the Microsoft Research Forum.
Dipendra Misra, Senior Researcher at Microsoft Research New York City and AI Frontiers lightning talk presentation at the Microsoft Research Forum.
Panel Discussion: AI Frontiers
Hosted by Ashley Llorens, VP and Distinguished Scientist, Microsoft AI researchers, Sébastien Bubeck, Ahmed Awadallah, and Ece Kamar discuss frontiers in small language models and where AI research and capabilities are headed next.
Abstracts: January 25, 2024
| Gretchen Huizinga, Jordan Ash, and Dipendra Misra
On “Abstracts,” Jordan Ash & Dipendra Misra discuss the parameter reduction method LASER. Tune in to learn how selective removal of stored data alone can boost LLM performance, then sign up for Microsoft Research Forum for more on LASER &…