{"id":607743,"date":"2019-09-08T02:51:15","date_gmt":"2019-09-08T09:51:15","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=607743"},"modified":"2023-12-05T13:32:49","modified_gmt":"2023-12-05T21:32:49","slug":"airsim-high-fidelity-visual-and-physical-simulation-for-autonomous-vehicles","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/airsim-high-fidelity-visual-and-physical-simulation-for-autonomous-vehicles\/","title":{"rendered":"AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles"},"content":{"rendered":"<table class=\"highlight tab-size js-file-line-container\" style=\"border-spacing: inherit; border-collapse: collapse;\" data-tab-size=\"8\">\n<tbody>\n<tr>\n<td id=\"LC71\" class=\"blob-code blob-code-inner js-file-line\" style=\"padding: inherit; border: inherit;\">\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/AirSim\">GitHub<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of annotated training data in a variety of conditions and environments. We present a new simulator built on Unreal Engine that offers physically and visually realistic simulations for both of these goals. Our simulator includes a physics engine that can operate at a high frequency for real-time hardware-in-the-loop (HITL) simulations with support for popular protocols (e.g. MavLink). The simulator is designed from the ground up to be extensible to accommodate new types of vehicles, hardware platforms and software protocols. In addition, the modular design enables various components to be easily usable independently in other projects. We demonstrate the simulator by first implementing a quadrotor as an autonomous vehicle and then experimentally comparing the software components with real-world flights.<\/td>\n<\/tr>\n<tr>\n<td id=\"L72\" class=\"blob-num js-line-number\" style=\"padding: inherit; border: inherit;\" data-line-number=\"72\"><\/td>\n<td id=\"LC72\" class=\"blob-code blob-code-inner js-file-line\" style=\"padding: inherit; border: inherit;\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>GitHub Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of annotated training data in a variety of conditions and environments. We present a new simulator built [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":true,"_classifai_error":"","footnotes":""},"research-area":[13556,13562],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-607743","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[607764,729763],"related-downloads":[],"related-videos":[608556,739828,861960,989736],"related-groups":[],"related-events":[667596],"related-opportunities":[],"related-posts":[550065,624378,641841,669336,683157,720673],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Ade Famoti","user_id":43005,"people_section":"People of AirSim","alias":"adfamoti"},{"type":"guest","display_name":"Ratnesh Madaan","user_id":624729,"people_section":"People of AirSim","alias":""},{"type":"user_nicename","display_name":"Shital Shah","user_id":35435,"people_section":"People of AirSim","alias":"shitals"}],"msr_research_lab":[199565],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/607743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":4,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/607743\/revisions"}],"predecessor-version":[{"id":989697,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/607743\/revisions\/989697"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=607743"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=607743"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=607743"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=607743"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=607743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}