{"id":739828,"date":"2020-07-09T10:20:38","date_gmt":"2020-07-09T17:20:38","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=739828"},"modified":"2021-05-26T19:57:28","modified_gmt":"2021-05-27T02:57:28","slug":"harnessing-high-fidelity-simulation-for-autonomous-systems-through-airsim","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/harnessing-high-fidelity-simulation-for-autonomous-systems-through-airsim\/","title":{"rendered":"Harnessing high-fidelity simulation for autonomous systems through AirSim"},"content":{"rendered":"<p>Robots and autonomous systems are playing a significant role in modern times, in both academic research and industrial applications. Handling the constant variability and uncertainty present in the real world is a major challenge for autonomous systems as their areas of usage expand. Recently, machine learning techniques, such as deep neural networks, have shown promise as building blocks for improving robot intelligence, and high visual and physical fidelity simulation has the potential to address the needs of data-driven autonomy algorithms.<\/p>\n<p>In this webinar, Sai Vemprala, a Microsoft researcher, will introduce\u202fMicrosoft AirSim, an open-source, high-fidelity robotics simulator, and he demonstrates how it can help to train robust and generalizable algorithms for autonomy. He will explain the features of Microsoft AirSim while giving an overview of some research projects that have benefited from AirSim, particularly focusing on robotics and how these algorithms are trained with simulated data but are capable of working in real life. He will also introduce AirSim Drone Racing Lab, an enhancement of AirSim aimed at enabling robotics and machine learning researchers to tackle the specific domain of autonomous drone racing.<\/p>\n<p>Together, you\u2019ll explore:<\/p>\n<ul>\n<li>How simulation can address the needs of data-driven autonomy algorithms<\/li>\n<li>General features and usage of Microsoft AirSim<\/li>\n<li>How robotics research projects have employed AirSim for training AI models capable of sim-to-real transfer<\/li>\n<li>How you can get started with the AirSim Drone Racing Lab and use it to generate data for perception, planning, and control algorithms for autonomous drones<\/li>\n<\/ul>\n<p><strong>Resource list:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/airsim-drone-racing-lab\/\">AirSim Drone Racing Lab<\/a> (publication)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/Microsoft\/AutonomousDrivingCookbook\">Microsoft\u2019s Autonomous Driving cookbook<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (GitHub)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/ai\/ai-lab-airsim-drones\">AirSim @ Microsoft AI Labs<\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/dev.px4.io\/v1.9.0\/en\/simulation\/airsim.html\">PX4 simulation with AirSim<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/airsim\">Microsoft AirSim<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (GitHub)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/airsim-drone-racing-lab\">AirSim Drone Racing Lab<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (Github)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/airsim-drone-racing-vae-imitation\">VAE and imitation learning for drone navigation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u200b (GitHub)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/microsoft.github.io\/AirSim-NeurIPS2019-Drone-Racing\">Microsoft Game of Drones (NeurIPS 2019 competition)\u200b<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/drone-detection-using-depth-maps\/\">Drone Detection through Depth maps<\/a> (publication)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/onboard-detection-and-localization-of-drones-using-depth-maps\/\">Onboard detection and localization of drones using depth maps<\/a> (publication)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/video\/onboard-detection-and-localization-of-drones-using-depth-maps-video\/\">Onboard detection and localization of drones using depth maps<\/a> (video)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.cs.cmu.edu\/~rbonatti\/files\/bonatti_jfr.pdf\">Autonomous aerial cinematography in unstructured environments<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n<p>*This on-demand webinar features a previously recorded Q&A session and open captioning.<\/p>\n<p>Explore more Microsoft Research webinars: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/aka.ms\/msrwebinars\">https:\/\/aka.ms\/msrwebinars<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Robots and autonomous systems are playing a significant role in modern times, in both academic research and industrial applications. Handling the constant variability and uncertainty present in the real world is a major challenge for autonomous systems as their areas of usage expand. Recently, machine learning techniques, such as deep neural networks, have shown promise [&hellip;]<\/p>\n","protected":false},"featured_media":739831,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_hide_image_in_river":0,"footnotes":""},"research-area":[13561,13556,13562,13551,13552,13554],"msr-video-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-session-type":[],"msr-impact-theme":[],"msr-pillar":[],"msr-episode":[],"msr-research-theme":[],"class_list":["post-739828","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-algorithms","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-graphics-and-multimedia","msr-research-area-hardware-devices","msr-research-area-human-computer-interaction","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/A7B6ijIhKao","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/739828","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/739828\/revisions"}],"predecessor-version":[{"id":739855,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/739828\/revisions\/739855"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/739831"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=739828"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=739828"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=739828"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=739828"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=739828"},{"taxonomy":"msr-session-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-session-type?post=739828"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=739828"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=739828"},{"taxonomy":"msr-episode","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-episode?post=739828"},{"taxonomy":"msr-research-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-theme?post=739828"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}