Bridging the simulator-to-reality gap with Aerial Informatics and Robotics platform Machine learning is becoming an increasingly important artificial intelligence approach to building autonomous and robotic systems. One of the key challenges with machine learning is the need for many samples — the amount of data needed to learn useful behaviors is prohibitively high. In addition, the robotic system is often non-operational during the training phase. This requires debugging to occur in real-world experiments with an unpredictable robot. The…
I am a researcher with the Adaptive Systems and Interaction Group at Microsoft Research, Redmond. These days I am focusing on Aerial Informatics and Robotics. I am interested in building intelligent and autonomous flying agents that are safe and enable applications that can positively influence our society. The core technology builds upon cutting edge research in machine intelligence, robotics and human-centered computation in order to enable an entire fleet of flying robots that range from micro-UAVs to commercial jetliners. Various application scenarios include Weather Sensing, Monitoring for Precision Agriculture, Safe Cyber-Physical Systems etc.
More broadly, I am interested in Machine Learning, Quantum Computation and Computer Vision with applications in User Modelling, Affective Computing and HCI scenarios. I did a PhD at the MIT Media Lab and my Doctoral thesis looked at building Discriminative Models for Pattern Recognition with incomplete information (semi-supervised learning, imputation, noisy data etc.). A significant part of that work involved automatic analysis of non-verbal behavior (e.g. Facial Action Analysis, see Master's thesis) and physiological responses. The earliest part of my research career tackled the problem of photorealistic facial animations.
I am also an avid aviator and hold FAA Commercial Pilot certificate (SEL), FAA Flight Instructor certificate (Airplane Single Engine and Instrument Airplane). I am an active amateur aircraft builder and recently finished building an RV-8 Aircraft (see : RV-8 build blog ).
The best available weather forecasts in the United States—from the federal government’s Winds Aloft program—have been based largely on data from instrumented weather balloons released twice a day, providing forecasts for 176 stations across the United States. Winds Aloft is often not accurate and uses time and fuel resources. The Windflow project explores the research question: Could airplanes in flight be employed as a vast sensor network to determine atmospheric conditions? Could data available today be used…
The goal of this project is to build a generalized vehicle-agnostic system that can provide safety guarantees in the face of an uncertain world. We are defining what “safe” means, and building a theoretical framework that treats uncertainty in perception and control systems a key design parameter.
Established: May 14, 2015
Several studies have demonstrated the need to significantly increase the world’s food production by 2050. However, there is limited amount of additional arable land, and water levels have also been receding. Although technology could help the farmer, its adoption is limited because the farms usually do not have power, or Internet connectivity, and the farmers are typically not technology savvy. We are working towards an end-to-end approach, from sensors to the cloud, to solve the…
Scalable Semisupervised Functional Neurocartography Reveals Canonical Neurons in Behavioral NetworksE. Paxon Frady, Ashish Kapoor, Eric Horvitz, William B. Kristan Jr., in Neural Computation, August 1, 2016,
A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in CrowdsourcingChengjiang Long, Gang Hua, Ashish Kapoor, in International Journal of Computer Vision, January 1, 2015,
Joint People, Event, and Location Recognition in Personal Photo Collections using Cross-Domain ContextDahua Lin, Ashish Kapoor, Gang Hua, Simon Baker, in Proceedings of the European Conference on Computer Vision, Springer Verlag, September 1, 2010,
People, Quakes, and Communications: Inferences from Call Dynamics about a Seismic Event and its Influences on a PopulationAshish Kapoor, Nathan Eagle, Eric Horvitz, in Workshop on Artificial Intelligence for Development (AI-D), AAAI Spring Symposiumg 2010, Microsoft Research, January 26, 2010,
Utility-Theoretic Considerations in Classification: Extensions for Efficient Computation of ROC CurvesAshish Kapoor, Eric Horvitz, December 1, 2006,
Semi-Supervised Analysis of Gene Expression Profiles for Lineage-Specific Development in the Caenorhabditis Elegans EmbryoYuan (Alan) Qi, Patrycja E. Missiuro, Ashish Kapoor, Craig P. Hunter, Tommi S. Jaakkola, David K. Gifford, Hui Ge, in International Conference on Intelligent Systems for Molecular Biology, ISMB 2006, Oxford University Press, August 6, 2006,
February 15, 2017
June 24, 2016
June 23, 2016
June 3, 2014
September 13, 2011
January 18, 2006
MIT Media Laboratory
November 30, 2005
MIT Media Laboratory