{"id":551052,"date":"2018-11-19T08:42:00","date_gmt":"2018-11-19T16:42:00","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=551052"},"modified":"2018-11-19T08:42:00","modified_gmt":"2018-11-19T16:42:00","slug":"challenge-accepted-marlo-competition-among-conference-highlights","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/challenge-accepted-marlo-competition-among-conference-highlights\/","title":{"rendered":"Challenge accepted\u2014MARL\u00d6 competition among conference highlights"},"content":{"rendered":"

\"Malmo\"<\/p>\n

With the latest Project Malmo competition, we\u2019re calling on researchers and engineers to test the limits of their thinking as it pertains to artificial intelligence, particularly multi-task, multi-agent reinforcement learning. Last week, a group of attendees at the 14th Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE’18) (opens in new tab)<\/span><\/a> participated in a one-day workshop featuring the competition, exchanging ideas on the unique challenges of the research area with some of the field\u2019s leading minds.<\/p>\n

Learning to Play: The Multi-Agent Reinforcement Learning in Malm\u00d6 (MARL\u00d6) Competition (opens in new tab)<\/span><\/a> requires participants to design learning agents capable of collaborating with or competing against other agents to complete tasks of varying difficulty across 3D games.\u00a0It is the second competition affiliated with Project Malmo<\/a>, which is an open-ended platform designed for the experimentation of artificial intelligence. Last year\u2019s Malmo Collaborative AI Challenge<\/a> yielded a diversity and creativity in approach that exceeded expectations, and we look forward to the same this time around.<\/p>\n

The competition, co-hosted by Microsoft, Queen Mary University of London, and CrowdAI, is open to participants worldwide through December 31 (submit your entries here (opens in new tab)<\/span><\/a>).<\/em><\/p>\n

Sam Devlin<\/a>, a game AI researcher from the Machine Intelligence and Perception group at Microsoft Research Cambridge, organized the MARL\u00d6 AIIDE 2018 Workshop (opens in new tab)<\/span><\/a> in collaboration with our academic partners Diego Perez-Liebana (opens in new tab)<\/span><\/a> of Queen Mary and Sharada Mohanty (opens in new tab)<\/span><\/a> of \u00c9cole Polytechnique F\u00e9d\u00e9rale de Lausanne, Switzerland.<\/p>\n

The workshop included a short tutorial of MARL\u00d6 that allowed attendees to experiment with competition agents and keynote addresses from two distinguished speakers. There were also a series of short contributed talks and a panel session to encourage attendees to share ideas around the application of reinforcement learning in modern commercial video games.<\/p>\n

\"Jesse

Jesse Cluff, Principal Engineering Lead, The Coalition<\/p><\/div>\n

The first keynote speaker was Jesse Cluff, Principal Engineering Lead with The Coalition. Jesse has more than 20 years of experience in the industry, working on many exciting game titles, including Jackie Chan Stuntmaster, The Simpsons: Hit & Run, Bully, <\/em>and Gears of War 4<\/em>. During the workshop, he explored two aspects of game AI\u2014the hardware side in discussing how we run programs in real time with limited resources and the emotional side in discussing how we maximize the enjoyment of players while controlling difficulty. He also talked about how AI techniques are actually used in commercial game products and the challenges he\u2019s facing that still need further research.<\/p>\n

\"Martin

Martin Schmid, Research Scientist, DeepMind<\/p><\/div>\n

Martin Schmid, a research scientist with DeepMind, was the second keynote speaker. He is the lead author of DeepStack, the first computer program to outplay human professionals at heads-up no-limit Texas Hold\u2019em poker (opens in new tab)<\/span><\/a>, and he spoke about the program as an example of how successful AI methods used in complex games of perfect information like Go can advance AI application in imperfect-information games like poker. The work has huge practical significance since we regularly have to deal with imperfect information in the real world. These two keynotes were inspiring for faculty, researchers, and graduate students in attendance.<\/p>\n

\"From

From left: Mobchase, Buildbattle, and Treasurehunt<\/em><\/p><\/div>\n

The workshop also featured the MARL\u00d6 competition\u2019s kickoff tournament. Agents of the participating teams competed in a round robin to achieve the highest scores across three different games\u2014Mobchase, Buildbattle, and Treasurehunt<\/em>. At the end of the day, we announced the rankings of the enrolled teams. The top three eligible teams will each be presented with the Progress Award, a travel grant worth up to $2,500 for use toward a relevant conference at which they can publish their competition results. The MARL\u00d6 competition is open until December 31 (opens in new tab)<\/span><\/a>, after which the final tournament will be held offline. We hope to see more participants join.<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

With the latest Project Malmo competition, we\u2019re calling on researchers and engineers to test the limits of their thinking as it pertains to artificial intelligence, particularly multi-task, multi-agent reinforcement learning. Last week, a group of attendees at the 14th Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE’18) participated in a one-day workshop featuring the […]<\/p>\n","protected":false},"author":37074,"featured_media":551055,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"user_nicename","value":"Noboru Sean Kuno","user_id":"33122"}],"msr_hide_image_in_river":0,"footnotes":""},"categories":[241770,194480],"tags":[],"research-area":[13556],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-551052","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-graphics-and-multimedia","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[346139],"related-groups":[],"related-projects":[235753],"related-events":[],"related-researchers":[],"msr_type":"Post","featured_image_thumbnail":"\"Malmo","byline":"Noboru Sean Kuno","formattedDate":"November 19, 2018","formattedExcerpt":"With the latest Project Malmo competition, we\u2019re calling on researchers and engineers to test the limits of their thinking as it pertains to artificial intelligence, particularly multi-task, multi-agent reinforcement learning. Last week, a group of attendees at the 14th Conference on Artificial Intelligence and Interactive…","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/551052","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/37074"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=551052"}],"version-history":[{"count":6,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/551052\/revisions"}],"predecessor-version":[{"id":551613,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/551052\/revisions\/551613"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/551055"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=551052"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=551052"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=551052"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=551052"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=551052"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=551052"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=551052"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=551052"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=551052"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=551052"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=551052"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}