{"id":11610,"date":"2025-01-17T15:25:37","date_gmt":"2025-01-17T23:25:37","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?post_type=example&#038;p=11610"},"modified":"2025-02-03T09:53:53","modified_gmt":"2025-02-03T17:53:53","slug":"ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do","status":"publish","type":"example","link":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","title":{"rendered":"AI Critiques | G2: Make clear how well the system can do what it can&nbsp;do"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"10\" src=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png\" alt=\"blue header bar\" class=\"wp-image-8823\" srcset=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png 1024w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-300x3.png 300w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-768x8.png 768w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1536x16.png 1536w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-2048x21.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n\n\n<p>AI critiques (<a href=\"https:\/\/doi.org\/10.48550\/arXiv.2206.05802\" target=\"_blank\" rel=\"noreferrer noopener\">Saunders et al., 2022<\/a>) make clear how well the system can do what it can do (<a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/\" target=\"_blank\" rel=\"noreferrer noopener\">Guideline 2<\/a>) by presenting evidence, descriptions, or solutions for specific flaws in the generated AI output.<\/p>\n\n\n\n<p>The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in mind that overreliance mitigations can backfire. Be sure to test such mitigations in context, with your AI system\u2019s actual users. Learn more about\u00a0<a href=\"https:\/\/aka.ms\/overreliance_review\" target=\"_blank\" rel=\"noreferrer noopener\">overreliance on AI<\/a> and\u00a0<a href=\"https:\/\/aka.ms\/genAI_reliance\" target=\"_blank\" rel=\"noreferrer noopener\">appropriate reliance on generative AI<\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"251\" src=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques-1024x251.png\" alt=\"Alphabetize Given a list of 18 words, sort them in alphabetical order Either a missing\/extra word in the resulting list, or a pair of adjacent words in the wrong order Question: Alphabetize the following words: growing prompts determining recreation evolve payable ruled patrols estimate emergency fate shrimp urges intoxicated narrator revert players pharmaceutical Answer: determining emergency evolve estimate fate growing intoxicated narrator patrols pharmaceutical payable players prompts recreation revert ruled shrimp urges Critique: Words misordered: evolve comes alphabetically after estimate\" class=\"wp-image-11679\" style=\"width:840px;height:auto\" srcset=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques-1024x251.png 1024w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques-300x73.png 300w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques-768x188.png 768w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques-1536x376.png 1536w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques-2048x502.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>Image captured February 2024.<\/em><\/figcaption><\/figure>\n","protected":false},"featured_media":11679,"menu_order":0,"template":"","meta":{"toolkit_pattern_number":"","ep_exclude_from_search":false,"footnotes":""},"application-type":[96,99,56,59],"goal":[114,123],"guideline-term":[4],"product-category":[70,64,28,65,63],"class_list":["post-11610","example","type-example","status-publish","has-post-thumbnail","hentry","application-type-gen-ai","application-type-llm","application-type-natural-language-processing-text","application-type-text-generation","goal-appropriate-reliance","goal-transparency","guideline-term-make-clear-how-well-the-system-can-do-what-it-can-do","product-category-chatbot","product-category-email","product-category-productivity","product-category-search-engine","product-category-writing-and-editing"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>AI Critiques | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI Critiques | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit\" \/>\n<meta property=\"og:description\" content=\"AI critiques (Saunders et al., 2022) make clear how well the system can do what it can do (Guideline 2) by presenting evidence, descriptions, or solutions for specific flaws in the generated AI output. The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in mind [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-03T17:53:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2025\/01\/AI-Critiques.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2695\" \/>\n\t<meta property=\"og:image:height\" content=\"660\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/\",\"name\":\"AI Critiques | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2025\\\/01\\\/AI-Critiques.png\",\"datePublished\":\"2025-01-17T23:25:37+00:00\",\"dateModified\":\"2025-02-03T17:53:53+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2025\\\/01\\\/AI-Critiques.png\",\"contentUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2025\\\/01\\\/AI-Critiques.png\",\"width\":2695,\"height\":660,\"caption\":\"Alphabetize Given a list of 18 words, sort them in alphabetical order Either a missing\\\/extra word in the resulting list, or a pair of adjacent words in the wrong order Question: Alphabetize the following words: growing prompts determining recreation evolve payable ruled patrols estimate emergency fate shrimp urges intoxicated narrator revert players pharmaceutical Answer: determining emergency evolve estimate fate growing intoxicated narrator patrols pharmaceutical payable players prompts recreation revert ruled shrimp urges Critique: Words misordered: evolve comes alphabetically after estimate\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"G2: Make clear how well the system can do what it can do.\",\"item\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"AI Critiques | G2: Make clear how well the system can do what it can&nbsp;do\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#website\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"contentUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI Critiques | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","og_locale":"en_US","og_type":"article","og_title":"AI Critiques | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","og_description":"AI critiques (Saunders et al., 2022) make clear how well the system can do what it can do (Guideline 2) by presenting evidence, descriptions, or solutions for specific flaws in the generated AI output. The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in mind [&hellip;]","og_url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2025-02-03T17:53:53+00:00","og_image":[{"width":2695,"height":660,"url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2025\/01\/AI-Critiques.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","name":"AI Critiques | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques.png","datePublished":"2025-01-17T23:25:37+00:00","dateModified":"2025-02-03T17:53:53+00:00","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2025\/01\/AI-Critiques.png","width":2695,"height":660,"caption":"Alphabetize Given a list of 18 words, sort them in alphabetical order Either a missing\/extra word in the resulting list, or a pair of adjacent words in the wrong order Question: Alphabetize the following words: growing prompts determining recreation evolve payable ruled patrols estimate emergency fate shrimp urges intoxicated narrator revert players pharmaceutical Answer: determining emergency evolve estimate fate growing intoxicated narrator patrols pharmaceutical payable players prompts recreation revert ruled shrimp urges Critique: Words misordered: evolve comes alphabetically after estimate"},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/ai-critiques-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"G2: Make clear how well the system can do what it can do.","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/"},{"@type":"ListItem","position":3,"name":"AI Critiques | G2: Make clear how well the system can do what it can&nbsp;do"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11610","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/example"}],"version-history":[{"count":7,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11610\/revisions"}],"predecessor-version":[{"id":11814,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11610\/revisions\/11814"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media\/11679"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=11610"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=11610"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=11610"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=11610"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=11610"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}