{"id":768724,"date":"2021-08-30T16:52:41","date_gmt":"2021-08-30T23:52:41","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&p=768724"},"modified":"2021-09-03T15:41:51","modified_gmt":"2021-09-03T22:41:51","slug":"project-galena","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-galena\/","title":{"rendered":"Project Galena"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\t\t\"Project\t\t<\/div>\n\t\t\n\t\t
\n\t\t\t\n\t\t\t
\n\t\t\t\t\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

Project Galena<\/h1>\n\n\n\n

Improving gaming with imitation learning<\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n

In project Galena, we\u2019re asking how imitation learning can make gaming better.  <\/p>\n\n\n\n

Imitation learning starts from demonstrations of how to do a task, or from a teacher who knows how to do it. By analyzing the demonstrations or by asking for examples from the teacher, we train an AI agent to do the same thing. The key benefit of imitation learning is that it lets us easily design and edit complex behaviors for AI agents: we just have to show the agent a few examples of what to do, instead of trying to tell the agent what to do by writing code or scripts. <\/p>\n\n\n\n

We\u2019re currently using imitation learning to help reduce the effects of lag in cloud gaming. When a player\u2019s connection is poor, it can take too long for actions, like joystick movements and button presses, to reach the game server, leading to a poor gaming experience. We are training an AI agent that can smooth over occasional lag problems by interpolating actions that aren\u2019t received in time.  <\/p>\n\n\n\n

We\u2019re also looking at other uses of imitation learning. For example, imitation learning can help game designers develop believable non-player characters–imitation makes it easier to understand and edit complex non-player character (NPC) behaviors.<\/p>\n\n\n\n

Related work<\/h3>\n\n\n\n