Making art accessible to global audiences through artificial intelligence
The Metropolitan Museum of Art teamed up with Microsoft and MIT to find ways to transform the museum experience using Microsoft AI.
Two years ago, The Metropolitan Museum of Art launched their Open Access platform, making all images and data relating to public-domain artworks in its collection available to everyone online. The goal was to scale the reach and relevance of its collection on a global level. On the second anniversary of this initiative, the team at The Met now wants to help audiences better discover the artworks and find meaningful connections between them.
- Max Hollein, Director of The Metropolitan Museum of ArtOur task is really to share The Met's collection, to disseminate our knowledge, to as many people as possible.
To realize this goal, curators from The Met teamed up with engineers and data scientists from Microsoft along with students and faculty from MIT for an ambitious 48-hour hackathon. The collaboration was hosted over a two-day period at the Garage in Microsoft’s New England Research & Development (NERD) center in Cambridge, Massachusetts. The teams used their creativity along with latest tools from Microsoft’s AI platform to develop new prototype experiences which enhance the public’s discovery of—and connections to—The Met’s Open Access collection. As Loic Tallon, the Chief Digital Officer of The Met put it, “At The Met, we believe we have one object that can inspire every single person on the planet. Now we’re asking ourselves, using AI technologies, what can [these teams] build? How can we reduce the distance each of those people and the object that will inspire them?”
At the hackathon, Microsoft engineer and seasoned mentor Noelle LaCharite was on hand to guide teams through the various Microsoft AI tools and plugins that the teams were using to build out their apps.
- Noelle LaCharite, Principal PM, Applied AI at MicrosoftWe can create experiences around art that have really never been seen before. Because the AI we have today has never been available before.
The Met x Microsoft x MIT Open Access Hack
Noelle LaCharite from Microsoft (right) mentors Lara Baladi from MIT (left) on Microsoft AI capabilities.
Chief Digital Officer of The Met, Loic Tallon, briefs participants on The Met's Open Access platform.
Hackathon participants collaborate to find ways of using Microsoft AI to make The Met's collection even more accessible to art fans around the world.
The Storyteller team brainstorms pathways for their experience.
Five impressive prototypes were born out of the event that have the potential to help global audiences better connect with The Met’s iconic collection.
My Life, My Met
Using Microsoft AI, My Life, My Met will turn an Instagram feed into a work of art. While still in development, the concept is to have the AI analyze posts from Instagram and substitutes the images with the closest matching artworks from The Met’s Open Access collection. For example, a photo of a fancy dinner may get replaced by Ryūryūkyo Shinsai’s print of Sushi (Vinegared Fish and Rice) Food. My Life, My Met will enable users to bring art into the everyday interactions of life. Prototype is in development.See the concept
Gen Studio uses AI to allow users to creatively navigate the shared features and dimensions underlying the 5,000+ years of human creation represented in The Met collection. The user is placed within a map-like model representing the organization of the existing artworks in The Met. Within that model, people can explore a sequence of dreamlike images that exposes them to a host of possibilities. Artworks are recombined in new ways, synthesizing possibilities that draw on the styles, materials, and forms found in the collection, and pointing audiences to unfamiliar artworks that share similar characteristics.Explore the project
- Gillian Belton, MIT Undergraduate, Microsoft externWhat made this experience so valuable and rewarding for me was the visual aspect of the system we were building... It was a unique experience to work at the intersection of art and engineering, and to build such a powerful creative experience.
While underpinned by some impressive technology, these hackathon prototypes offer a poetic glimpse into how AI and human creativity can come together to, bring art to the world, at scale.
The ambition is for these AI prototypes to inspire, invite, and empower new communities to use The Met collection API and Microsoft’s AI platform to create new forms of engagement with art that can be scaled around the world.