Celebs Like Me
Using Bing Visual Search, the Celebs Like Me experiment can match the user’s photo to similar-looking celebrities - powered by a Deep Neural Net (DNN) model that was trained using Bing Knowledge Graph and Bing Image Graph.Experiment with Celebs Like Me
Movies and celebrities are big part of pop culture, and the Academy Awards® are a top event for cinema fans. Bing worked on a dedicated experience to celebrate Oscar® nominees and build buzz around the potential for this technology.
Movie fans can upload a photo to Celebs Like Me and find their celebrity doppelgangers. Using face detection and image matching, the service helps users to discover new celebrities and actors at the Oscars.
The Celebs Like Me experiment uses face detection to match the user’s photo to similar-looking celebrities by using a DNN model that was trained using Bing Knowledge Graph and Bing Image Graph. Celebs Like Me is one of the many capabilities of Bing Visual Search.
Architecture of Celebs Like Me
A user uploads a photo to Celebs Like Me. The service detects faces, then aligns and crops the image before passing it into a DNN, trained using the Bing Knowledge Graph with Bing Image Graph. The service matches similar facial characteristics such as jawline, eye spacing, and nose shape, then returns a list of celebrities.
Technical details for Celebs Like Me
A user uploads a photo to the Celebs Like Me Service. The service looks for faces in the image. For each face that is found, the service aligns, straightens, and crops the face before passing the cropped face image into a Deep Neural Net (DNN). The DNN model outputs a ranked list of celebrities by matching similar facial characteristics such as jawline, eye spacing, nose shape, and more. The DNN model is trained using the rich and extensive knowledge contained in the Bing Knowledge Graph along with Bing Image Graph.
The experiment with Celebs Like Me provided insight into how to join Bing Knowledge graph with Image Graph to recognize the world with just a picture along with infrastructure we would need to build to lead to Bing Visual Search. Bing Visual Search empowers users to search and learn about the world around them by taking a picture. We have built a broad set of capabilities for Visual Search including shopping for fashion and home furniture; recognition of flowers, animals, landmarks, and celebrities; and even solving complex math problem by taking a picture.
- Learn more about Bing Visual Search
- Integrate Bing Visual Search within your application with Cognitive Services
- Learn about image services at AI School
- Learn about AI on Azure
- Learn about The Microsoft Cognitive Toolkit
Note: “OSCAR®,” “OSCARS®,” “ACADEMY AWARD®,” “ACADEMY AWARDS®,” are trademarks and service marks of the Academy of Motion Picture Arts and Sciences.
Microsoft Math uses optical character recognition (OCR) for handwriting to extract a math equation from a student’s photo of their notes. The problem is then standardized, classified, solved, and returned with solution steps and similar problems.
Make search more accurate and capable by using vector search. It leverages approximate nearest neighbor (ANN) algorithms to search through billions of deep learning model insights in milliseconds.
Pix2Story uses Natural Language Processing (NLP) for storytelling. AI scans a picture, applies a writing style, and generates a story—demonstrating how AI can drive creativity.
Style Transfer creates new images by starting with a source photo, then applying a new visual style—similar to filters in other applications. Style Transfer demonstrates how to build a simple style transfer application with AI.
Explore the possibilities of AI
Jumpstart your own AI innovations with learning resources and development solutions from Microsoft AI.
Learn to create your own AI experiences with courses in AI technology. Engage with learning paths in conversational AI, machine learning, AI for devices, cognitive services, autonomous systems, AI business strategies, and responsible AI.
Start building AI solutions with powerful tools and services. Microsoft AI is a robust framework for developing AI solutions in conversational AI, machine learning, data sciences, robotics, IoT, and more.