{"id":978063,"date":"2023-11-24T01:00:00","date_gmt":"2023-11-24T09:00:00","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=978063"},"modified":"2026-02-03T08:28:34","modified_gmt":"2026-02-03T16:28:34","slug":"project-maira","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-maira\/","title":{"rendered":"Project MAIRA"},"content":{"rendered":"<section class=\"mb-3 moray-highlight\">\n\t<div class=\"card-img-overlay mx-lg-0\">\n\t\t<div class=\"card-background  has-background- card-background--full-bleed\">\n\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"1920\" height=\"720\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720.jpg\" class=\"attachment-full size-full\" alt=\"female radiologist analyzing an MRI image of the head\" style=\"object-position: 61% 42%\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720.jpg 1920w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720-300x113.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720-1024x384.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720-768x288.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720-1536x576.jpg 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720-1600x600.jpg 1600w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/MAIRA_header_1920x720-240x90.jpg 240w\" sizes=\"auto, (max-width: 1920px) 100vw, 1920px\" \/>\t\t<\/div>\n\t\t<!-- Foreground -->\n\t\t<div class=\"card-foreground d-flex mt-md-n5 my-lg-5 px-g px-lg-0\">\n\t\t\t<!-- Container -->\n\t\t\t<div class=\"container d-flex mt-md-n5 my-lg-5 \">\n\t\t\t\t<!-- Card wrapper -->\n\t\t\t\t<div class=\"w-100 w-lg-col-5\">\n\t\t\t\t\t<!-- Card -->\n\t\t\t\t\t<div class=\"card material-md-card py-5 px-md-5\">\n\t\t\t\t\t\t<div class=\"card-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n<h1 class=\"wp-block-heading\" id=\"project-maira\">Project MAIRA<\/h1>\n\n\n\n<p>Multimodal AI for Radiology Applications<\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n<p>Project MAIRA is a research project from <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/lab\/microsoft-health-futures\/\">Microsoft Health Futures<\/a> that builds innovative, multimodal AI technology to assist radiologists in delivering effective patient care and to empower them in their work. The goal of the project is to leverage rich healthcare data \u2013 including medical domain knowledge, temporal sequences of medical images and corresponding radiology reports, and other clinical context information \u2013 as inputs to developing multimodal frontier models that can be scaled and fine-tuned to many different radiology applications.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button is-style-outline is-style-outline--1\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/arxiv.org\/pdf\/2401.10815\" target=\"_blank\" rel=\"noreferrer noopener\">Read RAD-DINO technical report<\/a><\/div>\n\n\n\n<div class=\"wp-block-button is-style-outline is-style-outline--2\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/arxiv.org\/abs\/2406.04449\" target=\"_blank\" rel=\"noreferrer noopener\">Read MAIRA-2: Grounded Radiology Report Generation technical report<\/a><\/div>\n<\/div>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-1024x576.png\" alt=\"Schematic illustration of multimodal healthcare data as input to the MAIRA foundation model which enables multiple different user applications such as draft report generation, disease classification or error detection. \" class=\"wp-image-985179\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-1024x576.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-300x169.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-768x432.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-1066x600.png 1066w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-655x368.png 655w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-343x193.png 343w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-240x135.png 240w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-640x360.png 640w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-960x540.png 960w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final-1280x720.png 1280w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/11\/Maira-Technology-V7_final.png 1400w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>New approaches combining various data modalities and their temporal connections enable AI tasks such as: detecting reporting errors; auto-generating draft reports; or improving disease progression assessments and their quantification over time. Such innovations will play a crucial role in detecting missed clinical observations; improving reporting capacity in an already heavily over-burdened radiology workforce; and assisting reporting consistency, accuracy and equity \u2013 all of which serve to reduce shortcomings in existing imaging workflows and to increase patient safety and care quality. &nbsp;<\/p>\n\n\n\n<p>To advance this work requires a human-centred, responsible approach to AI development that places clinical utility and careful workflow integration at its core. This involves close stakeholder engagements and clinical collaborations within real-world healthcare contexts; the creation of a new research frontier in evaluating large multimodal models in a clinically relevant manner; and an overall drive to move from technical AI innovation towards successful healthcare delivery.&nbsp;<\/p>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Multimodal AI for Radiology Applications Project MAIRA is a research project from Microsoft Health Futures that builds innovative, multimodal AI technology to assist radiologists in delivering effective patient care and to empower them in their work. The goal of the project is to leverage rich healthcare data \u2013 including medical domain knowledge, temporal sequences of [&hellip;]<\/p>\n","protected":false},"featured_media":984078,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13553],"msr-locale":[268875],"msr-impact-theme":[261673],"msr-pillar":[],"class_list":["post-978063","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-medical-health-genomics","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[858441,917718,923706,952185,981816,986898,1009149,1012407,1047813,1047834,1051485,1105596,1143010,1157538,1157568],"related-downloads":[],"related-videos":[],"related-groups":[780706,1143270],"related-events":[],"related-opportunities":[],"related-posts":[946080,985488,994098,1048935,1088394,1101105,1142540,1146680],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Shruthi Bannur","user_id":39213,"people_section":"Section name 0","alias":"shbannur"},{"type":"user_nicename","display_name":"Kenza Bouzid","user_id":43290,"people_section":"Section name 0","alias":"kenzabouzid"},{"type":"user_nicename","display_name":"Daniel Coelho de Castro","user_id":39811,"people_section":"Section name 0","alias":"dacoelh"},{"type":"user_nicename","display_name":"Stephanie Hyland","user_id":38458,"people_section":"Section name 0","alias":"sthyland"},{"type":"user_nicename","display_name":"Max Ilse","user_id":41095,"people_section":"Section name 0","alias":"maxilse"},{"type":"user_nicename","display_name":"Fernando P&eacute;rez-Garc&iacute;a","user_id":41473,"people_section":"Section name 0","alias":"fperezgarcia"},{"type":"user_nicename","display_name":"Anton Schwaighofer","user_id":31059,"people_section":"Section name 0","alias":"antonsc"},{"type":"user_nicename","display_name":"Harshita Sharma","user_id":41602,"people_section":"Section name 0","alias":"harssharma"},{"type":"user_nicename","display_name":"Sam Bond-Taylor","user_id":43452,"people_section":"Section name 0","alias":"sbondtaylor"},{"type":"user_nicename","display_name":"Hannah Richardson (nee Murfet)","user_id":37703,"people_section":"Section name 0","alias":"hamurfet"},{"type":"user_nicename","display_name":"Kenji Takeda","user_id":32522,"people_section":"Section name 0","alias":"kenjitak"},{"type":"user_nicename","display_name":"Tristan Lazard","user_id":43910,"people_section":"Section name 0","alias":"t-tlazard"}],"msr_research_lab":[849856],"msr_impact_theme":["Health"],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978063","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":39,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978063\/revisions"}],"predecessor-version":[{"id":1161295,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978063\/revisions\/1161295"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/984078"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=978063"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=978063"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=978063"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=978063"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=978063"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}