The need

Movies and celebrities are big part of pop culture, and the Academy Awards® are a top event for cinema fans. Bing created a dedicated experience to celebrate Oscar® Nominees and demonstrate the potential for Bing Visual Search and AI.

The idea

Celebs Like Me let movie fans to upload their photos and find their celebrity doppelgangers. Using face detection and image matching, the service helped fans discover new celebrities and actors at the Oscars.

The solution

The Celebs Like Me experiment used face detection to match a photo to similar-looking celebrities by using a DNN model that was trained using Bing Knowledge Graph and Bing Image Graph. Celebs Like Me was one of the many capabilities of Bing Visual Search.

Technical details for Celebs Like Me

A user uploads a photo to the Celebs Like Me Service. The service looks for faces in the image. For each face that is found, the service aligns, straightens, and crops the face before passing the cropped face image into a Deep Neural Net (DNN). The DNN model outputs a ranked list of celebrities by matching similar facial characteristics such as jawline, eye spacing, nose shape, and more. The DNN model is trained using the rich and extensive knowledge contained in the Bing Knowledge Graph along with Bing Image Graph.

The experiment with Celebs Like Me provided insight into how to join Bing Knowledge graph with Image Graph to recognize the world with just a picture along with infrastructure we would need to build to lead to Bing Visual Search. Bing Visual Search empowers users to search and learn about the world around them by taking a picture. We have built a broad set of capabilities for Visual Search including shopping for fashion and home furniture; recognition of flowers, animals, landmarks, and celebrities; and even solving complex math problem by taking a picture.

Resources:

Note: “OSCAR®,” “OSCARS®,” “ACADEMY AWARD®,” “ACADEMY AWARDS®,” are trademarks and service marks of the Academy of Motion Picture Arts and Sciences.

Projects related to Celebs Like Me

Browse more innovation sandbox projects

Explore the possibilities of AI

Jumpstart your own AI innovations with learning resources and development solutions from Microsoft AI.