{"id":440229,"date":"2017-11-13T11:29:34","date_gmt":"2017-11-13T19:29:34","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=440229"},"modified":"2018-03-15T09:57:15","modified_gmt":"2018-03-15T16:57:15","slug":"autonomous-car-research","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/autonomous-car-research\/","title":{"rendered":"Microsoft extends AirSim to include autonomous car research"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-440382\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/air-sim-featured-image-1-1000x450.jpg\" alt=\"\" width=\"1000\" height=\"450\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/air-sim-featured-image-1-1000x450.jpg 1000w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/air-sim-featured-image-1-1000x450-300x135.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/air-sim-featured-image-1-1000x450-768x346.jpg 768w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" \/><\/p>\n<p>Earlier this year, we open-sourced a research project called <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/airsim\">AirSim<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a high-fidelity system for testing the safety of artificial intelligence systems. AirSim provides realistic environments, vehicle dynamics and sensing for research into how autonomous vehicles that use AI that can operate safely in the open world.<\/p>\n<p>Today, we are sharing an update to AirSim: We have extended the system to include car simulation, which will help advance the research and development of self-driving vehicles. The latest version is available now <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/Microsoft\/AirSim\">on GitHub<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> as an open-source, cross-platform offering.<\/p>\n<p>The updated version of AirSim also includes many other features and enhancements, including additional tools for testing airborne vehicles. We have made it easier for people to simulate flying drones by adding a built-in flight controller, called simple_flight, that simplifies the setup process. This allows rapid experimentation with control and state estimation algorithms without requiring expensive debugging and development in the embedded world.<\/p>\n<p><strong>Building and testing cars in simulation<br \/>\n<\/strong>Developing algorithms for self-driving cars is an expensive proposition. It requires infrastructure to build expensive hardware platforms, large amounts data and the ability to quickly test and benchmark results. We aim to make these various aspects of developing self-driving cars available to a broader group of researchers by providing an open, community-driven platform for testing those algorithms. The new version of AirSim includes car simulations, new environments, APIs to ease programming and ready-to-run scripts to jump start your research.<\/p>\n<p><strong>Rapidly building richer environments<br \/>\n<\/strong>AirSim comes with a detailed 3D urban environment that includes a variety of diverse conditions, including traffic lights, parks, lakes and construction sites. Users can test their systems in several types of neighborhoods, including downtown, semi-urban, vegetation and industrial environments. The simulation contains more than 12 kilometers of drivable roads spanning more than 20 city blocks.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/CauKo089zm0?rel=0\" width=\"900\" height=\"506\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>AirSim has been developed as a plugin for <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.unrealengine.com\/en-US\/blog\">Unreal Engine<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a popular tool for game development. This means that the car simulation is decoupled from the environment it runs in. You can <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/video\/importing-3rd-party-environments-in-unreal-engine-for-airsim\/\">create an environment<\/a> for your specific needs, such as a city or rural road, or choose from a variety of environments available online, and then simply drop in the AirSim plugin to test your self-driving algorithms in that environment. AirSim extensibility also allows researchers and developers to incorporate new sensors, vehicles or even use different physics engines.<\/p>\n<p><strong>Turnkey AI research<br \/>\n<\/strong>AirSim provides APIs that can be used in a wide variety of languages, including C++ and Python. This makes it easy to use AirSim with various machine learning tool chains. For example, you can use <a href=\"https:\/\/www.microsoft.com\/en-us\/cognitive-toolkit\/\">Microsoft Cognitive Toolkit (CNTK)<\/a> with AirSim to do <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/Microsoft\/AirSim\/blob\/master\/docs\/reinforcement_learning.md\">deep reinforcement learning<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. We also see significant opportunities with running multiple instances on AirSim with <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/azure.microsoft.com\">Microsoft Azure<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> to scale up the training for modern, data-hungry machine learning algorithms.<\/p>\n<p>Finally, we have made AirSim available as compiled binary release, which means you can now <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/Microsoft\/AirSim\/releases\">download<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and start calling its <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/Microsoft\/AirSim\/blob\/master\/docs\/apis.md\">Python APIs<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> to control the vehicle in just minutes.<\/p>\n<p><strong>Looking forward<\/strong><\/p>\n<p>We have been fortunate to have great support and ideas from a growing community and\u00a0 a <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/Microsoft\/AirSim\/blob\/master\/docs\/who_is_using.md\">number<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> of users of AirSim all over the world. The Microsoft Deep Learning and Robotics Garage Chapter from our own backyard also collaborated with Microsoft Research with several important contributions<strong><br \/>\n<\/strong><\/p>\n<p>In future releases, we hope to add new sensors, better vehicle physics, weather modeling and even more detailed realistic environments. We are looking forward to community input to help guide our efforts and prioritize these improvements.<\/p>\n<p><em><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/shitals\/\">Shital Shah<\/a> is a principal research software engineer at Microsoft, and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/akapoor\/\">Ashish Kapoor<\/a> is a principal researcher at Microsoft.<\/em><\/p>\n<p><strong>Related:<\/strong><\/p>\n<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/Microsoft\/AirSim\">Try AirSim on GitHub<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/blogs.microsoft.com\/ai\/2017\/02\/15\/microsoft-shares-open-source-system-training-drones-gadgets-move-safely\/\">Microsoft shares open source system for training drones, other gadgets<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/news.microsoft.com\/features\/science-mimics-nature-microsoft-researchers-test-ai-controlled-soaring-machine\/\">Science mimics nature: Microsoft researchers test AI-controlled soaring machine<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Earlier this year, we open-sourced a research project called AirSim, a high-fidelity system for testing the safety of artificial intelligence systems. AirSim provides realistic environments, vehicle dynamics and sensing for research into how autonomous vehicles that use AI that can operate safely in the open world. Today, we are sharing an update to AirSim: We [&hellip;]<\/p>\n","protected":false},"author":36509,"featured_media":440418,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"user_nicename","value":"Ashish Kapoor","user_id":"30903"},{"type":"user_nicename","value":"Shital Shah","user_id":"35435"}],"msr_hide_image_in_river":0,"footnotes":""},"categories":[194467],"tags":[],"research-area":[13556,13562],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-440229","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artifical-intelligence","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[199565],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[144633,237595],"related-projects":[359810],"related-events":[],"related-researchers":[{"type":"user_nicename","value":"Shital Shah","user_id":35435,"display_name":"Shital Shah","author_link":"<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/shitals\/\" aria-label=\"Visit the profile page for Shital Shah\">Shital Shah<\/a>","is_active":false,"last_first":"Shah, Shital","people_section":0,"alias":"shitals"}],"msr_type":"Post","featured_image_thumbnail":"<img width=\"655\" height=\"280\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/air-sim-featured-image-1-655x280.jpg\" class=\"img-object-cover\" alt=\"\" decoding=\"async\" loading=\"lazy\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/air-sim-featured-image-1-655x280.jpg 655w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/air-sim-featured-image-1-655x280-300x128.jpg 300w\" sizes=\"auto, (max-width: 655px) 100vw, 655px\" \/>","byline":"Ashish Kapoor and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/shitals\/\" title=\"Go to researcher profile for Shital Shah\" aria-label=\"Go to researcher profile for Shital Shah\" data-bi-type=\"byline author\" data-bi-cN=\"Shital Shah\">Shital Shah<\/a>","formattedDate":"November 13, 2017","formattedExcerpt":"Earlier this year, we open-sourced a research project called AirSim, a high-fidelity system for testing the safety of artificial intelligence systems. AirSim provides realistic environments, vehicle dynamics and sensing for research into how autonomous vehicles that use AI that can operate safely in the open&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/440229","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/36509"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=440229"}],"version-history":[{"count":30,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/440229\/revisions"}],"predecessor-version":[{"id":473637,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/440229\/revisions\/473637"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/440418"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=440229"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=440229"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=440229"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=440229"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=440229"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=440229"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=440229"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=440229"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=440229"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=440229"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=440229"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}