AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles

Field and Service Robotics | , pp. 621-635

View Publication | View Publication

Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of annotated training data in a variety of conditions and environments. We present a new simulator built on Unreal Engine that offers physically and visually realistic simulations for both of these goals. Our simulator includes a physics engine that can operate at a high frequency for real-time hardware-in-the-loop (HITL) simulations with support for popular protocols (e.g. MavLink). The simulator is designed from the ground up to be extensible to accommodate new types of vehicles, hardware platforms and software protocols. In addition, the modular design enables various components to be easily usable independently in other projects. We demonstrate the simulator by first implementing a quadrotor as an autonomous vehicle and then experimentally comparing the software components with real-world flights.

Autonomous car research with AirSim

AirSim, a Microsoft research project for developing autonomous vehicles, now includes car simulation. The new version is available now on GitHub as an open-source, cross-platform offering. Related: Autonomous car research with AirSim Microsoft shares open source system for training drones, other gadgets Science mimics nature: Microsoft researchers test AI-controlled soaring machine

Importing 3rd Party Environments in Unreal Engine for AirSim

This video by Jim Piavis shows how you can take off-the-self environments available on websites such as TurboSquid.com or cgitrader.com and import into Unreal Engine. Once that's done you can follow the instructions for using AirSim with that environment. Related: Autonomous car research with AirSim Microsoft shares open source system for training drones, other gadgets Science mimics nature: Microsoft researchers test AI-controlled soaring machine