{"id":1024596,"date":"2024-05-02T15:38:06","date_gmt":"2024-05-02T22:38:06","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-blog-post&#038;p=1024596"},"modified":"2024-06-19T13:16:32","modified_gmt":"2024-06-19T20:16:32","slug":"appropriate-reliance-research-initiative","status":"publish","type":"msr-blog-post","link":"https:\/\/www.microsoft.com\/en-us\/research\/articles\/appropriate-reliance-research-initiative\/","title":{"rendered":"Appropriate Reliance Research Initiative"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9.jpg\" alt=\"New Future of Work - appropriate reliance for trust in AI -| AI-generated graphic of a small and large ball balanced on a bar\" class=\"wp-image-1026810\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9-300x169.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9-768x432.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9-655x368.jpg 655w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9-240x135.jpg 240w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9-640x360.jpg 640w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2024\/04\/NFW_AI-Reliance_balance-v2_16-9-960x540.jpg 960w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>The Appropriate Reliance research initiative focuses on advancing research and creating practical solutions for fostering appropriate reliance on AI.&nbsp;<\/p>\n\n\n\n<p>Through <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/aka.ms\/genAI_reliance\" target=\"_blank\" rel=\"noopener noreferrer\">appropriate reliance<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, we aim to help people who use AI systems find a balance between over-trusting AI outputs and accepting them even when they are incorrect (aka <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/aka.ms\/overreliance_review\" target=\"_blank\" rel=\"noopener noreferrer\">overreliance on AI<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>) and under-trusting\u2014not accepting, or not using AI systems even when they perform well (aka underreliance on AI).&nbsp;<\/p>\n\n\n\n<p>Both over- and under-reliance on AI can have negative consequences such as harms resulting from poor performance of the human+AI team, or product abandonment.&nbsp;<\/p>\n\n\n\n<p>The research initiative brings together researchers and practitioners from across the company, with the goal of delivering:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Applied research on the nature of these phenomena and ways to mitigate them;<\/li>\n\n\n\n<li>Guidance for AI practitioners;<\/li>\n\n\n\n<li>Specific solutions such as UX\/UI patterns. See guidelines, patterns, and examples for effective human-AI interaction, including appropriate reliance, in the <a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/library\/\" target=\"_blank\" rel=\"noreferrer noopener\">HAX Toolkit Design Library<\/a>.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<div class=\"wp-block-columns alignwide are-vertically-aligned-top is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\">\n<div class=\"annotations \" data-bi-aN=\"citation\">\n\t<article class=\"annotations__list card depth-16 bg-body p-4 \">\n\t\t<div class=\"annotations__list-item\">\n\t\t\t\t\t\t<span class=\"annotations__type d-block text-uppercase font-weight-semibold text-neutral-300 small\">Publication<\/span>\n\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/appropriate-reliance-on-generative-ai-research-synthesis\/\" data-bi-cN=\"Appropriate reliance on Generative AI: Research synthesis\" data-external-link=\"false\" data-bi-aN=\"citation\" data-bi-type=\"annotated-link\" class=\"annotations__link font-weight-semibold text-decoration-none\"><span>Appropriate reliance on Generative AI: Research synthesis<\/span>&nbsp;<span class=\"glyph-in-link glyph-append glyph-append-chevron-right\" aria-hidden=\"true\"><\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n<div class=\"annotations \" data-bi-aN=\"citation\">\n\t<article class=\"annotations__list card depth-16 bg-body p-4 \">\n\t\t<div class=\"annotations__list-item\">\n\t\t\t\t\t\t<span class=\"annotations__type d-block text-uppercase font-weight-semibold text-neutral-300 small\">Publication<\/span>\n\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/ai-transparency-in-the-age-of-llms-a-human-centered-research-roadmap\/\" data-bi-cN=\"AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap\" data-external-link=\"false\" data-bi-aN=\"citation\" data-bi-type=\"annotated-link\" class=\"annotations__link font-weight-semibold text-decoration-none\"><span>AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap<\/span>&nbsp;<span class=\"glyph-in-link glyph-append glyph-append-chevron-right\" aria-hidden=\"true\"><\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n<div class=\"annotations \" data-bi-aN=\"citation\">\n\t<article class=\"annotations__list card depth-16 bg-body p-4 \">\n\t\t<div class=\"annotations__list-item\">\n\t\t\t\t\t\t<span class=\"annotations__type d-block text-uppercase font-weight-semibold text-neutral-300 small\">Publication<\/span>\n\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/comparing-traditional-and-llm-based-search-for-consumer-choice-a-randomized-experiment\/\" data-bi-cN=\"Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experiment\" data-external-link=\"false\" data-bi-aN=\"citation\" data-bi-type=\"annotated-link\" class=\"annotations__link font-weight-semibold text-decoration-none\"><span>Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experiment<\/span>&nbsp;<span class=\"glyph-in-link glyph-append glyph-append-chevron-right\" aria-hidden=\"true\"><\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n<div class=\"annotations \" data-bi-aN=\"citation\">\n\t<article class=\"annotations__list card depth-16 bg-body p-4 \">\n\t\t<div class=\"annotations__list-item\">\n\t\t\t\t\t\t<span class=\"annotations__type d-block text-uppercase font-weight-semibold text-neutral-300 small\">Publication<\/span>\n\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/im-not-sure-but-examining-the-impact-of-large-language-models-uncertainty-expression-on-user-reliance-and-trust\/\" data-bi-cN=\"\u201cI\u2019m Not Sure, But\u2026\u201d: Examining the Impact of Large Language Models\u2019 Uncertainty Expression on User Reliance and Trust\" data-external-link=\"false\" data-bi-aN=\"citation\" data-bi-type=\"annotated-link\" class=\"annotations__link font-weight-semibold text-decoration-none\"><span>\u201cI\u2019m Not Sure, But\u2026\u201d: Examining the Impact of Large Language Models\u2019 Uncertainty Expression on User Reliance and Trust<\/span>&nbsp;<span class=\"glyph-in-link glyph-append glyph-append-chevron-right\" aria-hidden=\"true\"><\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\">\n<div class=\"annotations \" data-bi-aN=\"citation\">\n\t<article class=\"annotations__list card depth-16 bg-body p-4 \">\n\t\t<div class=\"annotations__list-item\">\n\t\t\t\t\t\t<span class=\"annotations__type d-block text-uppercase font-weight-semibold text-neutral-300 small\">Publication<\/span>\n\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/overreliance-on-ai-literature-review\/\" data-bi-cN=\"Overreliance on AI: Literature Review\" data-external-link=\"false\" data-bi-aN=\"citation\" data-bi-type=\"annotated-link\" class=\"annotations__link font-weight-semibold text-decoration-none\"><span>Overreliance on AI: Literature Review<\/span>&nbsp;<span class=\"glyph-in-link glyph-append glyph-append-chevron-right\" aria-hidden=\"true\"><\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n<div class=\"annotations \" data-bi-aN=\"citation\">\n\t<article class=\"annotations__list card depth-16 bg-body p-4 \">\n\t\t<div class=\"annotations__list-item\">\n\t\t\t\t\t\t<span class=\"annotations__type d-block text-uppercase font-weight-semibold text-neutral-300 small\">Publication<\/span>\n\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/designing-for-responsible-trust-in-ai-systems-a-communication-perspective\/\" data-bi-cN=\"Designing for Responsible Trust in AI Systems: A Communication Perspective\" data-external-link=\"false\" data-bi-aN=\"citation\" data-bi-type=\"annotated-link\" class=\"annotations__link font-weight-semibold text-decoration-none\"><span>Designing for Responsible Trust in AI Systems: A Communication Perspective<\/span>&nbsp;<span class=\"glyph-in-link glyph-append glyph-append-chevron-right\" aria-hidden=\"true\"><\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n<div class=\"annotations \" data-bi-aN=\"citation\">\n\t<article class=\"annotations__list card depth-16 bg-body p-4 \">\n\t\t<div class=\"annotations__list-item\">\n\t\t\t\t\t\t<span class=\"annotations__type d-block text-uppercase font-weight-semibold text-neutral-300 small\">Publication<\/span>\n\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/the-rise-of-the-ai-co-pilot-lessons-for-design-from-aviation-and-beyond\/\" data-bi-cN=\"The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond\" data-external-link=\"false\" data-bi-aN=\"citation\" data-bi-type=\"annotated-link\" class=\"annotations__link font-weight-semibold text-decoration-none\"><span>The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond<\/span>&nbsp;<span class=\"glyph-in-link glyph-append glyph-append-chevron-right\" aria-hidden=\"true\"><\/span><\/a>\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"leads\">Leads<\/h3>\n\n\n\n<div class=\"wp-block-columns are-vertically-aligned-top is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image aligncenter size-thumbnail is-style-rounded\"><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"150\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-150x150.jpg\" alt=\"Mihaela Vorvoreanu is a caucasian woman in her forties with chin-length reddish hair and glasses\" class=\"wp-image-815509\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-150x150.jpg 150w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-300x300.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-1024x1024.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-768x768.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-1536x1536.jpg 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-2048x2048.jpg 2048w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-180x180.jpg 180w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/01\/Mickey-360x360.jpg 360w\" sizes=\"auto, (max-width: 150px) 100vw, 150px\" \/><\/figure>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h5 class=\"wp-block-heading has-text-align-center\" id=\"mihaela-vorvoreanu\"><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/mivorvor\/\">Mihaela Vorvoreanu<\/a><\/h5>\n\n\n\n<p class=\"has-text-align-center\">Director, UX Research and Education, Aether<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"researchers\">Researchers<\/h3>\n\n\n\n<p>There are dozens of researchers and practitioners across Microsoft working on this initiative, including:<\/p>\n\n\n\n<div class=\"wp-block-columns are-vertically-aligned-top is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\">\n<ul class=\"wp-block-list\">\n<li>Aisha Han&nbsp;<\/li>\n\n\n\n<li>Aleksandar Ilic&nbsp;<\/li>\n\n\n\n<li>Alice Lu&nbsp;<\/li>\n\n\n\n<li>Amy Heger&nbsp;<\/li>\n\n\n\n<li>Ana Beatriz F de Souza&nbsp;<\/li>\n\n\n\n<li>Annika Ushio&nbsp;<\/li>\n\n\n\n<li>August Niehaus&nbsp;<\/li>\n\n\n\n<li>Bobby Bernethy&nbsp;<\/li>\n\n\n\n<li>Brent Hecht&nbsp;<\/li>\n\n\n\n<li>Bujuanes Livermore&nbsp;<\/li>\n\n\n\n<li>Camille Basilio&nbsp;<\/li>\n\n\n\n<li>Cale Darling&nbsp;<\/li>\n\n\n\n<li>Chris Quirk&nbsp;<\/li>\n\n\n\n<li>Christian Poelitz<\/li>\n\n\n\n<li>Christian Seifert&nbsp;<\/li>\n\n\n\n<li>Dan Goldstein&nbsp;<\/li>\n\n\n\n<li>Daniel Escapa&nbsp;<\/li>\n\n\n\n<li>Danny Lee&nbsp;<\/li>\n\n\n\n<li>David Rothschild&nbsp;<\/li>\n\n\n\n<li>Eleanor Huynh&nbsp;<\/li>\n\n\n\n<li>Eric Lewallen&nbsp;<\/li>\n\n\n\n<li>Esra Gokgoz&nbsp;<\/li>\n\n\n\n<li>Gaetan Issombo&nbsp;&nbsp;<\/li>\n<\/ul>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\">\n<ul class=\"wp-block-list\">\n<li>Hagar Moshe<\/li>\n\n\n\n<li>Han-Shen Chen&nbsp;<\/li>\n\n\n\n<li>Helen Liang&nbsp;<\/li>\n\n\n\n<li>Hugh North&nbsp;<\/li>\n\n\n\n<li>Ian Drosos<\/li>\n\n\n\n<li>Irena Berezovsky&nbsp;<\/li>\n\n\n\n<li>Irina Nikulina&nbsp;<\/li>\n\n\n\n<li>Jack Williams&nbsp;<\/li>\n\n\n\n<li>Jaclyn Knapp&nbsp;<\/li>\n\n\n\n<li>Jake Hofman&nbsp;<\/li>\n\n\n\n<li>Jenna Butler&nbsp;<\/li>\n\n\n\n<li>Jenn Wortman Vaughan&nbsp;<\/li>\n\n\n\n<li>Jenny Chen&nbsp;<\/li>\n\n\n\n<li>Jen Sillik&nbsp;<\/li>\n\n\n\n<li>Jonathan Foster&nbsp;<\/li>\n\n\n\n<li>JP Hernandez&nbsp;<\/li>\n\n\n\n<li>Kathleen Walker&nbsp;<\/li>\n\n\n\n<li>Kurtis Beavers&nbsp;<\/li>\n\n\n\n<li>Lauren Bryant&nbsp;<\/li>\n\n\n\n<li>Lea Bachmann&nbsp;<\/li>\n\n\n\n<li>Lev Tankelevitch&nbsp;<\/li>\n\n\n\n<li>Loredana Cerrato&nbsp;<\/li>\n\n\n\n<li>Mar Gines Marin&nbsp;<\/li>\n<\/ul>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\">\n<ul class=\"wp-block-list\">\n<li>Matt Murry&nbsp;<\/li>\n\n\n\n<li>Matthew Vogel&nbsp;<\/li>\n\n\n\n<li>Meg Grounds&nbsp;<\/li>\n\n\n\n<li>Michael Bentley<\/li>\n\n\n\n<li>Naz Mirzaie<\/li>\n\n\n\n<li>Neil Coles&nbsp;<\/li>\n\n\n\n<li>Neil Toronto&nbsp;<\/li>\n\n\n\n<li>Nick Wilson&nbsp;<\/li>\n\n\n\n<li>Ryan Nadel&nbsp;<\/li>\n\n\n\n<li>Richard Banks<\/li>\n\n\n\n<li>Samir Passi&nbsp;<\/li>\n\n\n\n<li>Sarah Lee&nbsp;<\/li>\n\n\n\n<li>Shamsi Iqbal&nbsp;<\/li>\n\n\n\n<li>Shelley Bjornstad&nbsp;<\/li>\n\n\n\n<li>Shipi Dhanorkar&nbsp;<\/li>\n\n\n\n<li>Steph Ballard&nbsp;<\/li>\n\n\n\n<li>Stacy Molitor&nbsp;<\/li>\n\n\n\n<li>Sutton Wunderle&nbsp;<\/li>\n\n\n\n<li>Tanya Pinto&nbsp;<\/li>\n\n\n\n<li>Valentyna Filimonova&nbsp;<\/li>\n\n\n\n<li>Vera Liao&nbsp;<\/li>\n\n\n\n<li>Yvonne Chien&nbsp;<\/li>\n<\/ul>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>The Appropriate Reliance research initiative focuses on advancing research and creating practical solutions for fostering appropriate reliance on AI.&nbsp; Through appropriate reliance (opens in new tab), we aim to help people who use AI systems find a balance between over-trusting AI outputs and accepting them even when they are incorrect (aka overreliance on AI (opens [&hellip;]<\/p>\n","protected":false},"author":36804,"featured_media":1026810,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-content-parent":717493,"msr_hide_image_in_river":0,"footnotes":""},"research-area":[],"msr-locale":[268875],"msr-post-option":[],"class_list":["post-1024596","msr-blog-post","type-msr-blog-post","status-publish","has-post-thumbnail","hentry","msr-locale-en_us"],"msr_assoc_parent":{"id":717493,"type":"project"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1024596","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-blog-post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/36804"}],"version-history":[{"count":10,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1024596\/revisions"}],"predecessor-version":[{"id":1048626,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1024596\/revisions\/1048626"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/1026810"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1024596"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1024596"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1024596"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=1024596"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}