{"id":1136575,"date":"2025-04-15T07:49:06","date_gmt":"2025-04-15T14:49:06","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&p=1136575"},"modified":"2026-03-04T17:36:45","modified_gmt":"2026-03-05T01:36:45","slug":"multimodal-hls-foundation-models","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/multimodal-hls-foundation-models\/","title":{"rendered":"Accelerating healthcare and life sciences discovery with AI"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\t\t\"a\t\t<\/div>\n\t\t\n\t\t
\n\t\t\t\n\t\t\t
\n\t\t\t\t\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

Health and Life Sciences AI Frontiers<\/h1>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n

The Healthcare AI Frontiers group is dedicated to transforming healthcare through the development and deployment of advanced multimodal artificial intelligence solutions. Our work spans frontier research and real\u2011world clinical systems, with a focus on enabling collaborative, agent\u2011driven workflows that support clinicians, care teams, and health systems at scale. By translating breakthroughs in AI into integrated, multi\u2011person experiences embedded in everyday tools, we aim to reduce complexity, improve coordination, and ultimately deliver better outcomes for patients worldwide.<\/p>\n\n\n\n

What We Do<\/h1>\n\n\n\n

Innovative Multimodal Models<\/h3>\n\n\n\n

Microsoft and our partners have made significant investments in the research and development of multi-modal models specifically designed for healthcare and life sciences. Our commitment to innovation is driven by the goal of transforming these critical fields through the implementation of advanced GenAI. See the full catalog of models here: https:\/\/aka.ms\/health-life-sciences (opens in new tab)<\/span><\/a><\/p>\n\n\n\n

Microsoft and partner foundation models are built from the ground up using vast de-identified medical datasets and are ready for fine-tuning to address the unique challenges of healthcare and life sciences. These models are capable of processing and analyzing diverse types of medical data, including images, records, and genomic information, to provide comprehensive insights and support decision-making.<\/p>\n\n\n\n

The versatility of our models allows them to be deployed in a range of scenarios. From enhancing image quality analysis to predicting patient outcomes and identifying potential treatment pathways, our models are designed to support healthcare professionals in delivering better patient care. In life sciences, these models may facilitate groundbreaking research and accelerate the development of new therapies and medical solutions.

Key activities include:
\u2022 Model Development<\/strong>: We develop first-party (1P) models and collaborate with third-party (3P) partners to expand our model catalog. This includes fine-tuning models for specific use cases and integrating them into clinical workflows.
\u2022 Platform Engineering<\/strong>: Our team works on creating production code within AI Foundry, including demo experiences and documentation, to ensure seamless integration and usability for our customers.
\u2022 Customer Engagement<\/strong>: We actively engage with healthcare providers, pharmaceutical companies, and research institutions to understand their needs and tailor our solutions accordingly. This involves structured partner engagement and training sessions to promote our solutions.<\/p>\n\n\n\n

<\/p>\n\n\n\n

Revolutionizing Healthcare with Cutting-edge Agentic Solutions<\/h3>\n\n\n\n

The HLS AI Frontiers team advances agentic AI frameworks purpose\u2011built for the complexity of healthcare, where meaningful outcomes depend on coordination across people, systems, and time. We design AI systems that go beyond single tasks, enabling end\u2011to\u2011end orchestration of complex clinical and operational workflows involving multiple roles, teams, and decision points. Our work emphasizes collaborative intelligence\u2014AI that works alongside clinicians and staff, supporting shared context, accountability, and human\u2011in\u2011the\u2011loop decision\u2011making. Built to integrate seamlessly with the diverse data sources that underpin healthcare\u2014from clinical systems to enterprise tools\u2014our approaches surface the right information at the right moment in the flow of work.<\/p>\n\n\n\n

Building on early explorations in healthcare agent orchestration, HLS AI Frontiers continues to shape how intelligent agents can responsibly and scalably support care delivery across health systems worldwide.<\/p>\n\n\n\n

<\/p>\n\n\n\n

How We Partner<\/h1>\n\n\n\n

The Healthcare AI Frontiers team collaborates with a diverse range of partners to drive innovation and adoption of our AI solutions. Our partnerships span across various sectors, including healthcare providers, pharmaceutical companies, and technology developers.<\/p>\n\n\n\n


Key partnership strategies include:
\u2022 Custom Model Collaborations<\/strong>: We work closely with partners to fine-tune AI models for specific use cases, leveraging custom agreements led by our business development team.
\u2022 Joint Development<\/strong>: We collaborate with partners like Paige, Nvidia, and Providence to onboard their models into our catalog and communicate the value proposition to customers.
\u2022 Structured Engagement<\/strong>: We coordinate with partners like Accenture and Global Logic to kick off engagement and explore potential collaborations.
\u2022 Research and Publication<\/strong>: Our team publishes papers and sample codes in collaboration with research institutions to showcase the capabilities and impact of our AI models.<\/p>\n\n\n\n

Through these partnerships, HLS AI Frontiers aims to create a unified vision that leverages Microsoft’s extensive resources and expertise to reshape modern healthcare. By connecting product, platform, and research, we turn organizational complexity into a strategic force capable of driving positive, human-centered transformation in the healthcare industry.<\/p>\n\n\n\n

\n
<\/div>\n\n\n\n
<\/div>\n<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n
<\/div>\n<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n
<\/div>\n<\/div>\n\n\n\n\n\n

<\/p>\n\n\n\n

The Microsoft healthcare AI models are intended for research and model development exploration. The models are not designed or intended to be deployed in clinical settings as-is nor for use in the diagnosis or treatment of any health or medical condition, and the individual models’ performances for such purposes have not been established. Developers bear sole responsibility and liability for any use of the healthcare AI models, including verification of outputs and incorporation into any product or service intended for a medical purpose or to inform clinical decision-making, compliance with applicable healthcare laws and regulations, and obtaining any necessary clearances or approvals.<\/em><\/p>\n\n\n\n

AI Foundry Model Catalog<\/h3>\n\n\n\n

Filtered to Health and Life Sciences: https:\/\/aka.ms\/health-life-sciences (opens in new tab)<\/span><\/a>.<\/p>\n\n\n\n

We have a rich catalog of in-house developed 1P models and a carefully curated list of 3P models from partners and model providers. <\/p>\n\n\n\n

The HLS AI Frontiers team continues to develop foundation models that are made available for Azure AI customers. Along with deployment access, you can find details on Model Architecture, License, Training Information, Evaluation Results, Sample Inputs\/Outputs, Data and Resource Specs for Deployment, and HW Requirements.<\/p>\n\n\n\n