{"id":33,"date":"2021-04-03T16:24:33","date_gmt":"2021-04-03T16:24:33","guid":{"rendered":"https:\/\/aitoolkit.test\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/"},"modified":"2023-05-24T19:24:08","modified_gmt":"2023-05-25T02:24:08","slug":"make-clear-how-well-the-system-can-do-what-it-can-do","status":"publish","type":"guideline","link":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/","title":{"rendered":"Make clear how well the system can do what it can&nbsp;do"},"content":{"rendered":"<div class=\"toolkit-heading-with-image-block\">\n\t\n\n<h2 class=\"wp-block-heading\">Guideline 2: Make clear how well the system can do what it can do<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"10\" src=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png\" alt=\"blue header bar\" class=\"wp-image-8823\" srcset=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png 1024w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-300x3.png 300w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-768x8.png 768w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1536x16.png 1536w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-2048x21.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading h4\" id=\"do\">Help the user understand how often the AI system may make mistakes.<\/h2>\n\n\n\n<p>Set expectations about how well the AI system will perform.&nbsp;People often over- or under-estimate how many mistakes an AI system may make, even for tasks it is designed for.&nbsp;For example, a fitness tracker designed to track steps&nbsp;while walking or running&nbsp;may still miss some (e.g., it may not work as well on hills or stairs) or detect spurious&nbsp;steps (e.g., mistaking&nbsp;sitting in a swing as steps).&nbsp;Unrealistic expectations of performance can lead to&nbsp;disappointment and product abandonment.&nbsp;&nbsp;<\/p>\n\n\n\n<p>In some cases, over-trusting an AI even when it could be wrong (automation bias) or under-trusting an AI when it could be right (algorithm aversion)&nbsp;can also lead to harms.&nbsp;For example,&nbsp;judges using AI systems to&nbsp;help make sentencing decisions&nbsp;may unknowingly make harmful sentencing decisions if&nbsp;they over-trust&nbsp;the AI\u2019s recommendations even&nbsp;when it could be wrong or biased (as in the&nbsp;well-known COMPAS examples).<\/p>\n\n\n\n<p>Use Guideline 2 design patterns to set expectations about system performance:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g2-a-match-the-level-of-precision-in-ui-communication-with-the-system-performance-language\/\">G2-A: Match the level of precision in UI communication with the system performance&#8211;Language<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g2-b-match-the-level-of-precision-in-ui-communication-with-the-system-performance-numbers\/\">G2-B: Match the level of precision in UI communication with the system performance&#8211;Numbers<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g2-c-report-system-performance-information\/\">G2-C: Report system performance information<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g2-d-provide-low-performance-alerts\/\">G2-D: Provide low performance alerts<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Help the user understand how often the AI system may make mistakes.<\/p>\n","protected":false},"menu_order":2,"template":"","meta":{"toolkit_pattern_number":"","ep_exclude_from_search":false,"footnotes":""},"application-type":[68,61,57,96,60,99,56,55,69,29,58,30,59],"goal":[114,126,123],"guideline-term":[4],"product-category":[71,70,23,64,62,26,66,28,65,31,32,63],"class_list":["post-33","guideline","type-guideline","status-publish","hentry","application-type-classification","application-type-facial-recognition","application-type-filtering-and-ranking","application-type-gen-ai","application-type-image-recognition","application-type-llm","application-type-natural-language-processing-text","application-type-natural-language-processing-voice","application-type-prediction","application-type-recommendation","application-type-route-planning","application-type-search","application-type-text-generation","goal-appropriate-reliance","goal-reliability","goal-transparency","guideline-term-make-clear-how-well-the-system-can-do-what-it-can-do","product-category-advertising","product-category-chatbot","product-category-e-commerce","product-category-email","product-category-health-and-wellness","product-category-navigation","product-category-media-entertainment","product-category-productivity","product-category-search-engine","product-category-social-networks","product-category-voice-assistants","product-category-writing-and-editing"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Make clear how well the system can do what it can do - Microsoft HAX Toolkit<\/title>\n<meta name=\"description\" content=\"Human-AI Interaction Guideline No. 2: Make clear how well the system can do what it can do. Help the user understand how often the AI system may make mistakes.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Human-AI Interaction Guideline No. 2\" \/>\n<meta property=\"og:description\" content=\"Help the user understand how often the AI system may make mistakes.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-25T02:24:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/10\/G-2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"298\" \/>\n\t<meta property=\"og:image:height\" content=\"442\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Human-AI Interaction Guideline No. 2\" \/>\n<meta name=\"twitter:description\" content=\"Help the user understand how often the AI system may make mistakes.\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2021\/10\/G-2.png\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/\",\"name\":\"Make clear how well the system can do what it can do - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2023\\\/05\\\/blue-header-bar-1536x14-5-23-1024x10.png\",\"datePublished\":\"2021-04-03T16:24:33+00:00\",\"dateModified\":\"2023-05-25T02:24:08+00:00\",\"description\":\"Human-AI Interaction Guideline No. 2: Make clear how well the system can do what it can do. Help the user understand how often the AI system may make mistakes.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2023\\\/05\\\/blue-header-bar-1536x14-5-23-1024x10.png\",\"contentUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2023\\\/05\\\/blue-header-bar-1536x14-5-23-1024x10.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Make clear how well the system can do what it can&nbsp;do\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#website\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"contentUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Make clear how well the system can do what it can do - Microsoft HAX Toolkit","description":"Human-AI Interaction Guideline No. 2: Make clear how well the system can do what it can do. Help the user understand how often the AI system may make mistakes.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/","og_locale":"en_US","og_type":"article","og_title":"Human-AI Interaction Guideline No. 2","og_description":"Help the user understand how often the AI system may make mistakes.","og_url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2023-05-25T02:24:08+00:00","og_image":[{"width":298,"height":442,"url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/10\/G-2.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_title":"Human-AI Interaction Guideline No. 2","twitter_description":"Help the user understand how often the AI system may make mistakes.","twitter_image":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2021\/10\/G-2.png","twitter_misc":{"Est. reading time":"2 minutes","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/","name":"Make clear how well the system can do what it can do - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png","datePublished":"2021-04-03T16:24:33+00:00","dateModified":"2023-05-25T02:24:08+00:00","description":"Human-AI Interaction Guideline No. 2: Make clear how well the system can do what it can do. Help the user understand how often the AI system may make mistakes.","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"Make clear how well the system can do what it can&nbsp;do"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline\/33","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/guideline"}],"version-history":[{"count":9,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline\/33\/revisions"}],"predecessor-version":[{"id":8832,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline\/33\/revisions\/8832"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=33"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=33"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=33"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=33"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=33"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}