Project Malmo

Project Malmo

Established: June 1, 2015




Microsoft Research blog


How can we develop artificial intelligence that learns to make sense of complex environments? That learns from others, including humans, how to interact with the world? That learns transferable skills throughout its existence, and applies them to solve new, challenging problems?

Project Malmo sets out to address these core research challenges, addressing them by integrating (deep) reinforcement learning, cognitive science, and many ideas from artificial intelligence.

Project malmo

The Malmo platform is a sophisticated AI experimentation platform built on top of Minecraft, and designed to support fundamental research in artificial intelligence.

The Project Malmo platform consists of a mod for the Java version, and code that helps artificial intelligence agents sense and act within the Minecraft environment. The two components can run on Windows, Linux, or Mac OS, and researchers can program their agents in any programming language they’re comfortable with.

Minecraft is ideal for artificial intelligence research for the same reason it is addictively appealing to the millions of fans who enter its virtual world every day. Unlike other computer games, Minecraft offers its users endless possibilities, ranging from simple tasks, like walking around looking for treasure, to complex ones, like building a structure with a group of teammates.

Get a glimpse of what’s possible with Project Malmo using Minecraft to build intelligent technology on our blog >

Are you interested in accelerating the path of innovation in AI? Then make the Malmo platform your choice.

Try Project Malmo today

Project Malmo is now open source, available on GitHub. Try it today:

Learning to Play: The Multi-Agent Reinforcement Learning in MalmO (MARLO) Competition in 2018

The second competition around Malmo platform is open now. Please go to the competition site of our academic partner, crowdAI:

The Malmo Collaborative AI Challenge in 2017

The first competition around Malmo platform was done in 2017. The documents are available on the competition site. Please take a look:

Join the community:
A channel for questions and discussion is now live on

Follow the latest information:
Be the first to know what’s going on around Malmo to follow twitter account @Project_Malmo

Read more about our open source release:


In the Media