{"id":1155379,"date":"2025-12-04T04:13:04","date_gmt":"2025-12-04T12:13:04","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&p=1155379"},"modified":"2025-12-15T03:14:42","modified_gmt":"2025-12-15T11:14:42","slug":"towards-robust-generalization-in-agentic-ai-via-environment-scaling","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/towards-robust-generalization-in-agentic-ai-via-environment-scaling\/","title":{"rendered":"Towards Robust Generalization in Agentic AI via Environment Scaling"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\t\t\"background\t\t<\/div>\n\t\t\n\t\t
\n\t\t\t\n\t\t\t
\n\t\t\t\t\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

Towards Robust Generalization in Agentic AI via Environment Scaling<\/h1>\n\n\n\n

<\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n

This project addresses the challenge of enabling AI agents to operate effectively in complex, realistic environments such as web navigation, computer use, and mobile interfaces. While current models excel in structured domains like mathematics and coding, they struggle with tasks requiring long-horizon planning, exploration, and error recovery. The research focuses on building a scalable infrastructure capable of hosting hundreds of virtual environments and advancing reinforcement learning with world-model techniques to improve agents\u2019 understanding and decision-making. The outcome will include an extensible training platform, enhanced RL frameworks, and AI agents that outperform state-of-the-art models on benchmarks for browser, computer, and phone use\u2014laying the foundation for robust, general-purpose agentic AI.<\/p>\n\n\n\n

This research is conducted via\u00a0The Agentic AI Research and Innovation\u00a0<\/a>(AARI) Initiative which focuses on the next frontier of agentic systems through\u00a0Grand Challenges<\/em>\u00a0with the academic community and Microsoft Research.<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"

This project addresses the challenge of enabling AI agents to operate effectively in complex, realistic environments such as web navigation, computer use, and mobile interfaces. While current models excel in structured domains like mathematics and coding, they struggle with tasks requiring long-horizon planning, exploration, and error recovery. The research focuses on building a scalable infrastructure […]<\/p>\n","protected":false},"featured_media":1155698,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-1155379","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Baolin Peng","user_id":43779,"people_section":"Section name 0","alias":"baolinpeng"},{"type":"guest","display_name":"Zhou Yu","user_id":1157408,"people_section":"Section name 0","alias":""},{"type":"guest","display_name":"Xiao Yu","user_id":1157409,"people_section":"Section name 0","alias":""}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/1155379","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":5,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/1155379\/revisions"}],"predecessor-version":[{"id":1158521,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/1155379\/revisions\/1158521"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/1155698"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1155379"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1155379"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1155379"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=1155379"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=1155379"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}