{"id":759193,"date":"2021-10-19T08:13:55","date_gmt":"2021-10-19T15:13:55","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=759193"},"modified":"2023-04-12T14:11:49","modified_gmt":"2023-04-12T21:11:49","slug":"project-maia","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-maia\/","title":{"rendered":"Project Maia"},"content":{"rendered":"<section class=\"mb-3 moray-highlight\">\n\t<div class=\"card-img-overlay mx-lg-0\">\n\t\t<div class=\"card-background  has-background- card-background--full-bleed\">\n\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"1920\" height=\"720\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720.png\" class=\"attachment-full size-full\" alt=\"Maia - AI chessboard\" style=\"object-position: 70% 48%\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720.png 1920w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720-300x113.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720-1024x384.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720-768x288.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720-1536x576.png 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720-1600x600.png 1600w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/Maia_AI_header_09-2021_1920x720-240x90.png 240w\" sizes=\"auto, (max-width: 1920px) 100vw, 1920px\" \/>\t\t<\/div>\n\t\t<!-- Foreground -->\n\t\t<div class=\"card-foreground d-flex mt-md-n5 my-lg-5 px-g px-lg-0\">\n\t\t\t<!-- Container -->\n\t\t\t<div class=\"container d-flex mt-md-n5 my-lg-5 align-self-center\">\n\t\t\t\t<!-- Card wrapper -->\n\t\t\t\t<div class=\"w-100 w-lg-col-5\">\n\t\t\t\t\t<!-- Card -->\n\t\t\t\t\t<div class=\"card material-md-card py-5 px-md-5\">\n\t\t\t\t\t\t<div class=\"card-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n<h1 id=\"project-maia\" class=\"wp-block-heading h2\">Project Maia<\/h1>\n\n\n\n<p>A human-like neural network chess engine<\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n<figure class=\"wp-block-image alignright size-large is-style-default\"><img decoding=\"async\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2020\/11\/1400x788_AiChess_nologo.gif\" alt=\"Maia Chess animation\"\/><\/figure>\n\n\n\n<p>Maia is a human-oriented chess engine that tries to understand human play, rather than optimal play. Whereas existing chess engines ask: \u201cWhat is the best move to play in this position?\u201d, Maia instead asks: \u201cWhat would a human play in this position?\u201d Maia can answer this question for humans of a particular skill level, or even for the specific individual who is playing. By understanding human decisions at a granular level, Maia can help identify a player\u2019s strengths and weaknesses, with the goal of helping them learn and improve their gameplay.<\/p>\n\n\n\n<p>To learn how Maia works, a good starting point is this <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/the-human-side-of-ai-for-chess\/\">blog post<\/a>. For more technical details, please refer to our <a href=\"#publications\">papers<\/a>. For an overview of Maia\u2019s capabilities and a more hands-on experience, check out this <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-maia\/technical-deep-dive\/\">deep dive<\/a>. Because of its fundamentally different approach, Maia feels more human-like than any other chess engine.<\/p>\n\n\n\n<p>Maia grew out of a simple conversation between MSR researcher <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/sidsen\/\">Siddhartha Sen<\/a> and Professor <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.cs.toronto.edu\/~ashton\/\" target=\"_blank\" rel=\"noopener noreferrer\">Ashton Anderson<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (lead PI of the Maia project, and former postdoc in the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/lab\/microsoft-research-new-york\/\">Microsoft Research New York City<\/a> lab), who both shared a passion for chess. Given that chess AI has surpassed human abilities since 2005, Ashton and Siddhartha wondered if humans could have a more productive relationship with this AI, rather than simply being beaten by it all the time and being told what move to make without any explanation. In particular, they wondered if this AI could be redirected to help humans, by understanding how they play and showing them how to improve.<\/p>\n\n\n\n<p>Maia is the first step towards a much larger vision of creating AI that is compatible with humans and synergistic with their goals. We believe that AI can be a partner in advancing human education. To learn more about this vision, listen to this <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.youtube.com\/watch?v=ujIubpCDyEI\" target=\"_blank\" rel=\"noopener noreferrer\">podcast<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. Maia researchers are also active in the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.uschesstrust.org\/international-koltanowski-conference-on-chess-in-education\/\" target=\"_blank\" rel=\"noopener noreferrer\">chess education <span class=\"sr-only\"> (opens in new tab)<\/span><\/a><font color=\"#005ba3\"><span style=\"font-size: 18px;\">community an<\/span><\/font>d have been working with chess educators and pioneers to amplify and diversify chess outreach in primary education.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button is-style-outline is-style-outline--1\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/lichess.org\/team\/maia-bots\" target=\"_blank\" rel=\"noreferrer noopener\">Play our bots on Lichess<\/a><\/div>\n\n\n\n<div class=\"wp-block-button is-style-outline is-style-outline--2\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/maiachess.com\" target=\"_blank\" rel=\"noreferrer noopener\">Explore Maia Chess<\/a><\/div>\n<\/div>\n\n\n\n\n\n<h2 id=\"why-chess\" class=\"wp-block-heading\">Why Chess?<\/h2>\n\n\n\n<p>Chess is an ideal game to study when it comes to artificial intelligence because it is popular, has well-defined rules, and has not yet been fully solved.<\/p>\n\n\n\n<p>The game emerged in the 15th century and is played between two players controlling the black and white pieces, respectively. Many people know the game and AI researchers use it as a &#8220;model system&#8221; to study new ideas or techniques.<\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<h2 id=\"what-is-project-maia\" class=\"wp-block-heading\">What is Project Maia?<\/h2>\n\n\n\n<p>Maia is a deep learning framework that learns from online human games, with the goal of understanding how humans play. The larger vision of Maia is to use chess to investigate the relationship between humans and AI. Previous AI systems for chess focus on finding the optimal sequence of moves. But it&#8217;s more complex to use AI to understand what move a human should make. For example, it&#8217;s not always clear that every person will understand a specific move: suggesting an advanced move to a novice player may be dangerous, because the player may not understand the board position that results from that move.<\/p>\n\n\n\n<p>With this vision in mind, the Maia Project aims to develop an AI engine that holistically understands human play.<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Developer Tech Minutes: A human-like neural network chess engine\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube-nocookie.com\/embed\/cTCgYN_3Mhw?feature=oembed&rel=0\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h2 id=\"how-does-maia-work\" class=\"wp-block-heading\">How does Maia work?<\/h2>\n\n\n\n<p>We developed Maia by taking a deep reinforcement learning neural network, previously used to predict the optimal move for a given board position and retraining it to instead predict what a human player would do.<\/p>\n\n\n\n<p>Chess players have their own playing styles, so predicting their moves is hard: most positions that people reach are unique\u2014due to the astronomical number of possible chess positions\u2014and even the same player may not make the same move on a position they&#8217;ve previously seen!<\/p>\n\n\n\n<p>Each Maia is trained on games played by players at a particular skill level and can accurately predict moves made by players at that skill level. In fact, the Maias do noticeably worse at predicting moves that are higher or lower than their target skill level, which means they have captured the \u201cplaying style\u201d of players at that level.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button is-style-outline is-style-outline--3\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/lichess.org\/team\/maia-bots\" target=\"_blank\" rel=\"noreferrer noopener\">Play our bots on Lichess<\/a><\/div>\n\n\n\n<div class=\"wp-block-button is-style-outline is-style-outline--4\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/maiachess.com\" target=\"_blank\" rel=\"noreferrer noopener\">Explore Maia Chess<\/a><\/div>\n<\/div>\n\n\n\n<h2 id=\"beyond-chess\" class=\"wp-block-heading\">Beyond Chess<\/h2>\n\n\n\n<p>As artificial intelligence becomes increasingly intelligent\u2014in some cases, achieving superhuman performance\u2014there is growing potential for humans to learn from and collaborate with algorithms. However, the ways in which AI systems approach problems are often different from the ways people do.<\/p>\n\n\n\n<p>A crucial step in bridging this gap between human and artificial intelligence is modeling the granular actions that constitute human behavior, rather than simply matching aggregate human performance. Maia predicts human moves at a granular and individual level, forming the foundation for a teaching tool that can help each individual understand their weaknesses and improve their chess play. The larger vision of Maia is to create a more productive relationship between humans and AI in chess, with the hope of applying these learnings to other domains.<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"<p>By understanding human decisions at a granular level, Maia can help identify a player\u2019s strengths and weaknesses, with the goal of helping them learn and improve their gameplay.<\/p>\n","protected":false},"featured_media":774937,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-759193","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[706345,797143,863784,934545,1029813],"related-downloads":[],"related-videos":[794027,794036],"related-groups":[144947],"related-events":[],"related-opportunities":[],"related-posts":[708031,712588],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Siddhartha Sen","user_id":33656,"people_section":"Section name 0","alias":"sidsen"},{"type":"guest","display_name":"Ashton Anderson","user_id":785884,"people_section":"Section name 0","alias":""},{"type":"guest","display_name":"Jon Kleinberg","user_id":785887,"people_section":"Section name 0","alias":""},{"type":"guest","display_name":"Reid McIlroy-Young","user_id":785881,"people_section":"Section name 0","alias":""}],"msr_research_lab":[199571],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/759193","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":22,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/759193\/revisions"}],"predecessor-version":[{"id":934554,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/759193\/revisions\/934554"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/774937"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=759193"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=759193"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=759193"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=759193"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=759193"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}