{"id":952050,"date":"2023-07-07T22:08:58","date_gmt":"2023-07-08T05:08:58","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/"},"modified":"2024-12-09T19:05:12","modified_gmt":"2024-12-10T03:05:12","slug":"real-world-evidence","status":"publish","type":"msr-group","link":"https:\/\/www.microsoft.com\/en-us\/research\/group\/real-world-evidence\/","title":{"rendered":"Real-world Evidence"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\t\t\"Real-world\t\t<\/div>\n\t\t\n\t\t
\n\t\t\t\n\t\t\t
\n\t\t\t\t\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

Real-world Evidence<\/h1>\n\n\n\n

Advancing health at the speed of AI<\/p>\n\n\n\n

Contact us<\/a><\/div>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n
\n

AI for Precision Health<\/h2>\n\n\n\n

Explore how we leverage real-world observational data to optimize health delivery and accelerate biomedical discovery.<\/p>\n\n\n\n

\n
Watch the video<\/a><\/div>\n<\/div>\n<\/div>
\"Real-world<\/figure><\/div>\n\n\n\n

Our vision<\/h2>\n\n\n\n

At Microsoft, we aspire to advance AI toward developing a continuous learning health system (opens in new tab)<\/span><\/a> that can instantly incorporate any new information to optimize delivery and accelerate discovery. In reality, the health system is mired in overwhelming unstructured data and non-scalable manual processing. Recent advances in generative AI such as large language models (LLMs) offer unprecedented \u201cuniversal structuring\u201d capabilities that can supercharge health information processing and unlock many high-value applications in real-world evidence and precision health.<\/p>\n\n\n\n

\n
\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

What does it mean for patients?<\/h4>\n\n\n\n

In joint work with large health systems, we have attained promising results in applying LLMs to structure clinical notes and other biomedical text at scale, with initial success in real-world applications such as molecular tumor board and clinical trial matching.<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

What does it mean for research & discovery?<\/h4>\n\n\n\n

Structuring longitudinal patient journeys at scale can drastically accelerate biomedical research and discovery. For example, by tallying millions of patients who have taken immunotherapies, we can compare exceptional responders against non-responders, and uncover novel opportunities in precision oncology.<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

What does it mean for clinical practitioners?<\/h4>\n\n\n\n

By structuring the latest research findings and enabling patient-like-me search at scale, health LLMs can greatly empower clinical practitioners in pursuing evidence-based medicine. By accelerating case authoring from real-world use cases and offering learning copilot experience, LLMs can also help transform medical education.<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

The future of precision health<\/h4>\n\n\n\n

Imagine the future when clinical research and care are seamlessly integrated. Every clinical decision is supported by patient-like-me information at the population level. Biomedical researchers can access world-wide real-world evidence in real time. Payors and regulators make approval and value-based care decisions based on comprehensive and up-to-date data.<\/p>\n<\/div>\n<\/div>\n\n\n\n

Foundational research<\/h2>\n\n\n\n

The advent of powerful general LLMs heralds a new era of accelerated progress in precision health AI research and applications. Next-gen models such as GPT-4 provide strong out-of-box performance and can serve as a \u201cuniversal labeler\u201d for evaluation and supervision. However, while these models already have strong health competency from consuming publicly available biomedical text, there are salient growth areas in accuracy, safety, compliance, cost, explainability, to name a few.<\/p>\n\n\n\n

\n
\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Prompt programming<\/h4>\n\n\n\n

LLMs usher in a paradigm shift toward prompt programming, which democratizes programming from programmers to general stakeholders. In health, a major bottleneck for adoption is accuracy. Our research improves safety guarantees via self-verification<\/a>, by leveraging the insight that verification is often easier than generation (akin to P vs NP).<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Model adaptation<\/h4>\n\n\n\n

LLMs such as GPT-4 can serve as a universal annotator to create large-scale synthetic data to distill domain-specific models and self-supervise multimodal instruction tuning<\/a>. We are exploring such health-specific adaptations in structuring, summarization, QA, with significant advantages in cost, efficiency, and white-box model access.<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Multimodal learning<\/h4>\n\n\n\n

For health applications, the biggest blind spot of web-based LLMs is multimodal, longitudinal patient data. We are exploring health-specific generative learning, with promising results using public data such as radiology<\/a>, single-cell<\/a>, biomedical literature (opens in new tab)<\/span><\/a>. A moonshot aspiration is multimodal fusion for predicting immunotherapy drug response.<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Causal reasoning<\/h4>\n\n\n\n

An Achille\u2019s heel of real-world evidence is confounders in observational data. By incorporating causal reasoning state of the art, we have developed a real-world evidence playground for scalable hypothesis generation and testing, such as simulating cancer trials using real-world data in silico.<\/p>\n<\/div>\n<\/div>\n\n\n\n

From research to real-world impact<\/h2>\n\n\n\n

The health system is incredibly complex. Technologies such as generative AI, as powerful as they are, would only serve as the catalyst. Meaningful progress can only be attained by embedding research and development into end-to-end applications, in deep collaboration with all stakeholders, with accuracy, safety, and compliance being first-class citizens. We conduct our research in tight collaboration with key stakeholders from delivery to discovery and are excited to see promising progress along the way.<\/p>\n\n\n\n

\n
\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Unstructured data: \u201cDark Matter\u201d in the RWE universe<\/h4>\n\n\n\n

Prior work in real-world evidence is largely restricted to available structured data, such as claim codes, which severely limits applicability. By accelerating clinical abstraction, we can unlock \u201cdark matter\u201d in the unstructured data and propel real-world evidence generation to the next level.<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Precision health in the age of LLMs<\/h4>\n\n\n\n

The advent of LLMs sets new patterns in precision health: \u201cuniversal structuring\u201d scales real-world evidence generation; \u201cuniversal labeling\u201d scales evaluation and model adaptation; \u201cuniversal translation\u201d lessens burden in interoperability; \u201cuniversal reasoning\u201d provides interpretable rationale, facilitates human-in-the-loop verification, and scales discovery.<\/p>\n<\/div>\n\n\n\n

\n
\"Real-world<\/figure>\n\n\n\n
<\/div>\n\n\n\n

From discovery to delivery<\/h4>\n\n\n\n

Precision health applications can be loosely divided into care\/delivery and research\/discovery. While accuracy is important across the board, the bar is significantly higher in delivery. Our research prioritizes discovery initially, but the same technical advances are equally applicable to delivery.<\/p>\n<\/div>\n<\/div>\n\n\n","protected":false},"excerpt":{"rendered":"

Recent advances in generative AI such as large language models (LLMs) offer unprecedented \u201cuniversal structuring\u201d capabilities that can supercharge health information processing and unlock many high-value applications in real-world evidence and precision health.<\/p>\n","protected":false},"featured_media":952110,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_group_start":"","footnotes":""},"research-area":[13556,13553],"msr-group-type":[243694],"msr-locale":[268875],"msr-impact-theme":[261673],"class_list":["post-952050","msr-group","type-msr-group","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-medical-health-genomics","msr-group-type-group","msr-locale-en_us"],"msr_group_start":"","msr_detailed_description":"","msr_further_details":"","msr_hero_images":[],"msr_research_lab":[849856],"related-researchers":[{"type":"user_nicename","display_name":"Hoifung Poon","user_id":32016,"people_section":"Section name 0","alias":"hoifung"},{"type":"user_nicename","display_name":"Cliff Wong","user_id":38508,"people_section":"Section name 0","alias":"clwon"},{"type":"user_nicename","display_name":"Jass Bagga","user_id":41907,"people_section":"Section name 0","alias":"jabagga"},{"type":"user_nicename","display_name":"Naoto Usuyama","user_id":38670,"people_section":"Section name 0","alias":"naotous"},{"type":"user_nicename","display_name":"Pratik Ghosh","user_id":38245,"people_section":"Section name 0","alias":"prghos"},{"type":"user_nicename","display_name":"Sheng Zhang","user_id":39087,"people_section":"Section name 0","alias":"shezhan"},{"type":"user_nicename","display_name":"Tristan Naumann","user_id":37929,"people_section":"Section name 0","alias":"tristan"},{"type":"user_nicename","display_name":"Zelalem Gero","user_id":41970,"people_section":"Section name 0","alias":"zelalemgero"},{"type":"user_nicename","display_name":"Jeya Maria Jose Valanarasu","user_id":43491,"people_section":"Section name 0","alias":"jevalanarasu"},{"type":"user_nicename","display_name":"Flora Liu","user_id":43488,"people_section":"Section name 0","alias":"qianchuliu"},{"type":"user_nicename","display_name":"Guanghui Qin","user_id":43527,"people_section":"Section name 0","alias":"guanghuiqin"},{"type":"user_nicename","display_name":"Peniel Argaw","user_id":43539,"people_section":"Section name 0","alias":"penielargaw"},{"type":"user_nicename","display_name":"Juanma Zambrano Chaves","user_id":43578,"people_section":"Section name 0","alias":"juanza"}],"related-publications":[952179,981816,970992,959079,959073,952278,952272,952266,952185,987885,952173,952167,952161,949989,941550,900027,872520,1088430,1160963,1122252,1106874,1105104,1101033,1091778,1091721,867762,1088043,1065639,1041447,1014696,1012140,1011621,555921,686880,685335,667233,666873,655824,600900,600891,686895,424533,394742,394730,394715,321194,240110,168666,168505,786535,860637,858657,858441,824440,824416,797179,796259,168499,784804,766183,754396,750208,726751,716989,686901],"related-downloads":[],"related-videos":[738595,795569,882531,930918,955248,1013829,1104894],"related-projects":[855669],"related-events":[965826,695517],"related-opportunities":[1152602],"related-posts":[632745,640449,688002,887736,931617,932016,985488,1160723],"tab-content":[],"msr_impact_theme":["Health"],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group\/952050","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-group"}],"version-history":[{"count":29,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group\/952050\/revisions"}],"predecessor-version":[{"id":1152124,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group\/952050\/revisions\/1152124"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/952110"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=952050"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=952050"},{"taxonomy":"msr-group-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group-type?post=952050"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=952050"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=952050"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}