Project InnerEye – Medical Imaging AI to Empower Clinicians

Project InnerEye – Medical Imaging AI to Empower Clinicians





InnerEye is a research project that uses state of the art machine learning technology to build innovative tools for the automatic, quantitative analysis of three-dimensional radiological images. Project InnerEye turns radiological images into measuring devices.

…We are pursuing AI so that we can empower every person and every institution that people build with tools of AI so that they can go on to solve the most pressing problems of our society and our economy. That’s the pursuit.”.

Satya Nadella, keynote at Microsoft IGNITE 2016.

Project description

Project InnerEye develops machine learning techniques for the automatic delineation of tumors as well as healthy anatomy in 3D radiological images. The InnerEye technology may enable: 1. extraction of targeted radiomics measurements for quantitative radiology, 2. efficient contouring for radiotherapy planning, 3. precise surgery planning and navigation. In practice, Project InnerEye turns multi-dimensional radiological images into measuring devices.

Project InnerEye builds upon many years of research in computer vision and machine learning. It employs algorithms such as Deep Decision Forests (as used already in Kinect and Hololens) as well as Convolutional Neural Networks (as available in CNTK) for the automatic, voxel-wise segmentation of medical images.

The technology is being designed with the guidance of expert medical practitioners. The results of our machine learning operations can be readily refined and adjusted by expert clinical researchers until they are completely satisfied with the results. They maintain full control of the results at all times.

Further Material



“This collaboration between the InnerEye team at Microsoft, and the Department of Oncology at Addenbrooke’s is an example of the type of innovation that we wish to promote within the NHS. It is a good example of what can be achieved when the Trust works in collaboration with industry and the University in order to produce cutting edge technologies with real-world applications in patient care, to benefit the UK.”

Roland Sinker, Chief Executive Officer, Cambridge University Hospitals NHS Foundation Trust.


Please send an email to if you would like further information on this project.