{"id":3951,"date":"2010-09-27T08:22:00","date_gmt":"2010-09-27T08:22:00","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/msr_er\/2010\/09\/27\/surface-robotics-life-saving-possibilities\/"},"modified":"2016-08-22T16:22:52","modified_gmt":"2016-08-22T23:22:52","slug":"surface-robotics-life-saving-possibilities","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/surface-robotics-life-saving-possibilities\/","title":{"rendered":"Surface + Robotics = Life-Saving Possibilities"},"content":{"rendered":"

<\/p>\n

In the realm of applied research, perhaps nothing is more satisfying than working on projects that can help save lives.\u00a0 Such is the case with a unique project at the University of Massachusetts Lowell (opens in new tab)<\/span><\/a> that combines Microsoft Surface<\/a> and Microsoft Robotics Developer Studio<\/a> in a Human-Robot Interaction (HRI) application to create novel remote controls for rescue robots.\u00a0 To the best of our knowledge, this is the first time these two technologies have been used together\u2014tell us if you know of others! Once perfected, this approach could enable emergency responders to safely maneuver rescue robots through buildings damaged by earthquakes, fire, or even terrorist attacks.<\/p>\n

The groundbreaking work was dramatically presented on the Web in August, when doctoral candidate Mark Micire posted a live video of his PhD defense showing how to control swarms of robots using the Surface table as a touch controller.\u00a0 A new, higher quality video of the thesis defense (opens in new tab)<\/span><\/a> and an overview video (opens in new tab)<\/span><\/a> have recently been posted online.\u00a0 The overview shows how a team of rescue robots could be controlled remotely by using the Surface table and a<\/p>\n

http:\/\/www.youtube.com\/watch?v=HSOziHgQedA<\/p>\n

The system could be a tremendous boon for emergency responders, who now must often wait 12 to 24 hours to obtain geo-referenced data that combine notes from rescue workers in the field with paper maps and building plans. During Hurricane Katrina, for example, many response groups were still using hand-drawn paper maps.\u00a0 Additionally, robot cameras sent video only to the site operators\u2014not immediately to the command staff.<\/p>\n

The proposed system would obviate these problems by creating a common computing platform that would bring all this information to the command staff, enabling them to more effectively utilize rescue robots. As Micire describes in his presentation, “A single-robot operator control unit and a multi-robot command and control interface [can be] used to monitor and interact with all of the robots deployed at a disaster response. Users can tap and drag commands for individual or multiple robots through a gesture set designed to maximize ease of learning.”<\/p>\n

An example of the burgeoning research field of NUI\u2014or Natural User Interaction\u2014this work “illustrates just one of the many exciting new directions enabled by advanced technologies in the human-computer interface,” says ER’s NUI Theme Director, Kristin Tolle. The project, which was supervised by UMass Lowell’s renowned robotics expert, Professor Holly Yanco (opens in new tab)<\/span><\/a>, also demonstrates the great synergy that can arise from collaborations between Microsoft Research and leading academic institutions.\u00a0 By empowering Yanco and Micire’s research with cutting-edge tools, a potentially life-saving technology is in the offing.<\/p>\n

This work was partly supported by a grant from Microsoft Research under our Human-Robot Interaction RFP (opens in new tab)<\/span><\/a> (Request For Proposals).<\/p>\n

\u2014Stewart Tansley, senior research program manager, External Research, a division of Microsoft Research<\/em><\/p>\n

Learn more<\/strong><\/p>\n