Project InnerEye – Democratizing Medical Imaging AI

Project InnerEye – Democratizing Medical Imaging AI


News & features

News & features

News & features


InnerEye is a research project that uses state of the art machine learning technology to build innovative tools for the automatic, quantitative analysis of three-dimensional medical images. The goal of Project InnerEye is to democratize AI for medical image analysis and empower researchers, hospitals, life science organizations, and healthcare providers to build medical imaging AI models using Microsoft Azure.

…We are pursuing AI so that we can empower every person and every institution that people build with tools of AI so that they can go on to solve the most pressing problems of our society and our economy. That’s the pursuit.

Satya Nadella, keynote at Microsoft IGNITE 2016

man sitting in an imaging room interacting with a scan on a monitorProject InnerEye Technology

Project InnerEye develops machine learning techniques to augment and make clinicians productive to be able to cope with the growing demand on healthcare; help deliver precision medicine for better patient outcomes, and; understanding how we can combine medical imaging features with other types of data to change the way we do medicine today, with the goal of enabling personalized medicine. In practice, Project InnerEye turns multi-dimensional radiological images into measuring devices.

Project InnerEye builds upon many years of research in computer vision and machine learning. It employs algorithms such as Deep Decision Forests (as used already in Kinect and Hololens) as well as the latest Convolutional Neural Networks for the automatic, voxel-wise segmentation of medical images.

The technology is being designed with the guidance of expert medical practitioners. The results of our machine learning operations can be readily refined and adjusted by expert clinical researchers until they are completely satisfied with the results. They maintain full control of the results at all times.


Project InnerEye and Novartis are working together to develop image segmentation & analysis for smart and personalized delivery of therapies through the AI Exploration program.

Project InnerEye works closely with the University of Cambridge and Cambridge University Hospitals NHS Foundation Trust.

“This collaboration between the InnerEye team at Microsoft, and the Department of Oncology at Addenbrooke’s is an example of the type of innovation that we wish to promote within the NHS. It is a good example of what can be achieved when the Trust works in collaboration with industry and the University in order to produce cutting edge technologies with real-world applications in patient care, to benefit the UK.”

Roland Sinker, Chief Executive Officer, Cambridge University Hospitals NHS Foundation Trust

Project InnerEye is working with Azure Stack to make machine learning capabilities available at the edge to allow healthcare providers and ISVs to provide low latency medical image analysis and comply with data handling regulations.


Please send an email to if you would like further information about this project, including opportunities for using Azure Stack.