Project Paidia: a Microsoft Research & Ninja Theory Collaboration

Project Paidia: a Microsoft Research & Ninja Theory Collaboration

Publications

News & features

News & features

News & features

News & features

Overview

Project Paidia is a research project in close collaboration between Microsoft Research Cambridge and Ninja Theory. Its focus is to drive state of the art research in reinforcement learning to enable novel applications in modern video games, in particular: agents that learn to collaborate with human players.

In contrast to traditional approaches to crafting the behavior of bots, non-player characters, or other in-game characters, reinforcement learning does not require a game developer to anticipate a wide range of possible game situations and map out and code all required behaviors. Instead, with reinforcement learning, game developers control a reward signal which the game character then learns to optimize while responding fluidly to all aspects of a game’s dynamics. The result is nuanced situation and player-aware emergent behavior that would be challenging or prohibitive to achieve using traditional Game AI.

Project Paidia demo - Learning to collaborate in Bleeding Edge, footage of trained Project Paidia agents. Not representative of final game gameplay or visuals.

Project Paidia demo – Learning to collaborate in Bleeding Edge, footage of trained Project Paidia agents. Not representative of final game gameplay or visuals.

Project Paidia focuses on learning a particularly challenging type of behavior: collaboration with human players. Because human players are notoriously creative and hard to predict, creating the experience of genuine collaboration towards shared goals has long been elusive. Together with colleagues at Ninja Theory, the MSR team identified a perfect test bed for driving this research, Ninja Theory’s latest game Bleeding Edge. Bleeding Edge is a team-based game, and includes a range of characters that have to work together to score points and defeat their opponents. In their latest demo, the team showcases how reinforcement learning enables agents to learn to coordinate their actions.

Learn more

Read the latest research publications >

See how recent research can lead to AI Innovations >

Check out the Game Stack Live blog post >

 

People

Microsoft Researcher team

Former collaborators

  • Portrait of Jacob Beck

    Jacob Beck

    Research Intern

  • Portrait of Sebastian Dziadzio

    Sebastian Dziadzio

    Research SDE

    Microsoft Cloud & AI

  • Portrait of Vincent Fortuin

    Vincent Fortuin

    Research Intern

  • Portrait of Jayesh Gupta

    Jayesh Gupta

    Research Intern

  • Portrait of Maximilian Igl

    Maximilian Igl

    Research Intern

  • Portrait of Andre Kramer

    Andre Kramer

    Research Engineer

  • Portrait of Cristiana Pacheco

    Cristiana Pacheco

  • Portrait of Quan  Vuong

    Quan Vuong

    Research Intern

  • Portrait of Luisa Zintgraf

    Luisa Zintgraf

    Research Intern