Rho-1：基于选择token建模的预训练方法
在自然语言处理领域，预训练语言模型常因大规模噪声数据而面临挑战。对此，微软亚洲研究院的研究员们提出了一种新型的基于选择 token 建模的预训练方法。该方法通过选择性语言建模（Selective Language Modeling, SLM）策略，精准筛选出对模型训练有价值的 token，有效提升了数据效率和模型性能。这一突破不仅优化了模型训练过程，也为自然语言处理技术的进一步发展提供了新思路。本...
NeurIPS上新 | 加强多模态协同，提高行业基础模型精度
编者按：欢迎阅读“科研上新”栏目！“科研上新”汇聚了微软亚洲研究院最新的创新成果与科研动态。在这里，你可以快速浏览研究院的亮点资讯，保持对前沿领域的敏锐嗅觉，同时也能找到先进实用的开源工具。 12月10日至12月15日，全球最负盛名的人工智能盛会之一 NeurIPS 大会在加拿大温哥华举办。因此，我们通过三期“科研上新”为大家带来多篇微软亚洲研究院入选 NeurIPS 2024 的精选论文解读，涉...
In the news | Science News Explores
A new frontier awaits — computing with light
In the guts of a new type of computer, a bunch of tiny LEDs emit a green glow. Those lights have a job to do. They’re performing calculations. Right now, this math is telling the computer how to identify handwritten…
In the news | VentureBeat
Microsoft’s smaller AI model beats the big guys: Meet Phi-4, the efficiency king
Microsoft launched a new artificial intelligence model today that achieves remarkable mathematical reasoning capabilities while using far fewer computational resources than its larger competitors. The 14-billion-parameter Phi-4 frequently outperforms much larger models like Google’s Gemini Pro 1.5, marking a significant…
In the news | Techcrunch
Microsoft launches Phi-4, a new generative AI model, in research preview
Microsoft has revealed the newest addition to its Phi family of generative AI models. Called Phi-4, the model improves in several areas over its predecessors, Microsoft claims, particularly in solving math problems. That’s partly the result of better training data…
In the news | Tech Brew
Microsoft researcher on the future of AI agents in 2025
One of the key questions driving Ece Kamar’s research as managing director of Microsoft’s AI Frontiers Lab is how to coordinate networks of these agents—AI systems that can perform autonomous tasks beyond the scope of chatbots. Late last year, her…
Microsoft Research Asia is pioneering innovations in Media Foundation to advance AI's ability in processing real-world media. As one of the keys focuses of the 2025 StarTrack Scholars Program, this research aims to provide new insights into multimodal large models.…
NeurIPS上新 | 优化生成式AI效能，推进负责任AI实践
编者按：编者按：欢迎阅读“科研上新”栏目！“科研上新”汇聚了微软亚洲研究院最新的创新成果与科研动态。在这里，你可以快速浏览研究院的亮点资讯，保持对前沿领域的敏锐嗅觉，同时也能找到先进实用的开源工具。 12月10日至12月15日，全球最负盛名的人工智能盛会之一 NeurIPS 大会将在加拿大温哥华举办。因此，我们将通过三期“科研上新”为大家带来多篇微软亚洲研究院入选 NeurIPS 2024 的精选...
We’re excited to be a part of #NeurIPS2024! Explore the future of AI with over 100 groundbreaking papers, including oral and spotlight sessions, on reinforcement learning, advanced language model training, and multilingual, culturally inclusive benchmarks.