AI Lab projects

Virtual Stage is a background matting experiment to create high-quality videos from anywhere, improving current virtual green screening techniques with Azure Kinect depth camera.

Microsoft Math uses optical character recognition (OCR) for handwriting to extract a math equation from a student’s photo of their notes. The problem is then standardized, classified, solved, and returned with solution steps and similar problems.

Celebs Like Me uses facial recognition to match the user’s photo to similar-looking celebrities. Powered by a Deep Neural Net (DNN) model, it was trained using Bing Satori Knowledge Graph and Bing Image Graph.

Pix2Story uses Natural Language Processing (NLP) for storytelling. AI scans a picture, applies a writing style, and generates a story—demonstrating how AI can drive creativity.

Snip Insights helps users find intelligent insights from a snip or screenshot. AI services convert a captured image to translated text, automatically detecting and tagging image content.

Machine Reading Comprehension (MRC) answers questions about written text. Using a neural network, MRC mimics the process of human readers. Ask a question and MRC reads a document until an answer is formed.

Sketch2Code converts hand-written drawings to HTML prototypes. Designers share ideas on a whiteboard, then changes are shown instantly in the browser—helping improve collaboration between the designer, developer, and customer.

Gen Studio is a prototype created with collaborators from The Metropolitan Museum of Art, Microsoft, and MIT. Gen Studio uses AI to visually navigate The Met’s art collection.

Altran developed a machine learning classifier that predicts source code files carrying a higher risk of a bug. Developers are presented with explanation and factors used in making the specific prediction.

Unlock insights and discover intelligent connections in unstructured data. The Insights and Discovery Accelerator uses Microsoft AI to speed and scale investigations and research by helping journalists find critical content in a sea of data.

Make search more accurate and capable by using vector search. It leverages approximate nearest neighbor (ANN) algorithms to search through billions of deep learning model insights in milliseconds.

JFK Files takes 34,000 complex files including photos, handwriting, government documents, and more, then extracts readable information. This knowledge is organized to enable new ways to explore the information.

PoseTracker uses deep learning to track the position and orientation of objects. This solution will use your phone camera to measure and track the angle, orientation, and distance of an item in real time.

Spektacom uses a mini sticker sensor on a cricket bat to gather data on the quality, speed, twist, and swing of the bat. This data is used to analyze the quality of the shot to help professionals, amateurs, and coaches improve their game.

Gen Studio is a prototype created with collaborators from The Metropolitan Museum of Art, Microsoft, and MIT. Gen Studio uses AI to visually navigate The Met’s art collection.

PoseTracker uses deep learning to track the position and orientation of objects. This solution will use your phone camera to measure and track the angle, orientation, and distance of an item in real time.

The Snow Leopard Trust uses AI to study snow leopards in the wild. Camera traps capture hundreds of thousands of photos of rare snow leopards; machine learning and cognitive services are used to accelerate photo analysis and to map areas of activity.

AirSim is a simulation tool that creates a 3D version of a real environment. A simulated drone “flies” to capture images, building a custom vision model. AI uses the vision model to identify objects or people.

Intelligent robotics uses AI to increase collaboration between people and devices. Microsoft AI enables the next generation of robots to adapt to dynamic situations and communicate naturally with people.

Explore the concepts of machine teaching, allowing developers or subject matter experts with little AI expertise to provide abstract concepts to an intelligent system.

Differential privacy is crucial for machine learning and data privacy. Safeguarding the privacy of people while enabling deeper analysis will empower health research innovations.

HE technology allows computations to be performed directly on encrypted data. Using state-of-the-art cryptology, you can run machine learning on anonymized datasets without losing context.

Conversational AI is a new way for companies to interact with their customers across any channel, like digital assistants, chat or social media. To be effective, conversational bots need to be developed in a way that earns people’s trust.