{"id":327746,"date":"2016-11-28T09:20:29","date_gmt":"2016-11-28T17:20:29","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=327746"},"modified":"2021-05-09T12:02:44","modified_gmt":"2021-05-09T19:02:44","slug":"humantenna-sensing-gestures-using-body-antenna","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/humantenna-sensing-gestures-using-body-antenna\/","title":{"rendered":"Humantenna: Sensing Gestures Using the Body as an Antenna"},"content":{"rendered":"<p>Computer vision and inertial measurement have made it possible for people to interact with computers using whole-body gestures. Although there has been rapid growth in the uses and applications of these systems, their ubiquity has been limited by the high cost of heavily instrumenting either the environment or the user. In this paper, we use the human body as an antenna for sensing whole-body gestures. Such an approach requires no instrumentation to the environment, and only minimal instrumentation to the user, thus enabling truly mobile applications. We show robust gesture recognition with an average accuracy of 93% across 12 whole-body gestures, and promising results for robust location classification within a building. In addition, we demonstrate a real-time interactive system which allows a user to interact with a computer using whole-body gestures.<\/p>\n<div class=\"yt-consent-placeholder\" role=\"region\" aria-label=\"Video playback requires cookie consent\" data-video-id=\"7lRnm2oFGdc\" data-poster=\"https:\/\/img.youtube.com\/vi\/7lRnm2oFGdc\/maxresdefault.jpg\"><iframe aria-hidden=\"true\" tabindex=\"-1\" title=\"Humantenna: Using the Body as an Antenna for Real-Time Whole-Body Interaction\" width=\"500\" height=\"375\" data-src=\"https:\/\/www.youtube-nocookie.com\/embed\/7lRnm2oFGdc?feature=oembed&rel=0&enablejsapi=1\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<div class=\"yt-consent-placeholder__overlay\"><button class=\"yt-consent-placeholder__play\"><svg width=\"42\" height=\"42\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-hidden=\"true\" focusable=\"false\"><g fill=\"none\" fill-rule=\"evenodd\"><circle fill=\"#000\" opacity=\".556\" cx=\"21\" cy=\"21\" r=\"21\"\/><path stroke=\"#FFF\" d=\"M27.5 22l-12 8.5v-17z\"\/><\/g><\/svg><span class=\"yt-consent-placeholder__label\">Video playback requires cookie consent<\/span><\/button><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>We use the human body as an antenna for sensing whole-body gestures. Such an approach requires no instrumentation to the environment, and only minimal instrumentation to the user, thus enabling truly mobile applications.<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13552,13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-327746","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-research-area-hardware-devices","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[317684,317699,317840],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[{"id":0,"name":"Additional news","content":"<p class=\"presstitle\" style=\"margin-top: 0px;margin-bottom: 0px\"><a href=\"http:\/\/www.youtube.com\/watch?v=em-nvzxzC68&amp;feature=BFa&amp;list=UU7iialY1qmmcyFWilHAEVpA\"><span class=\"publink\">Microsoft Research Projects Offer New Takes on Gesture Sensing<\/span><\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 5px\">IDG News Service, 9 May 2012<\/p>\r\n<p class=\"presstitle\" style=\"margin-top: 0px;margin-bottom: 0px\"><a href=\"http:\/\/www.newscientist.com\/article\/mg21428645.500-beyond-kinect-gestural-computer-spells-keyboard-death.html?\"><span class=\"publink\">Beyond Kinect: Gestural Computer Spells Keyboard Death<\/span><\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 5px\">New Scientist, 9 May 2012<\/p>\r\n<p class=\"presstitle\" style=\"margin-top: 0px;margin-bottom: 0px\"><a href=\"http:\/\/www.pcworld.com\/article\/255310\/gesture_sensing_alternatives_use_radio_interference_doppler_effect.html\"><span class=\"publink\">Gesture Sensing Alternatives Use Radio Interference, Doppler Effect<\/span><\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 5px\">PC World, 9 May 2012<\/p>\r\n<p class=\"presstitle\" style=\"margin-top: 0px;margin-bottom: 0px\"><a href=\"http:\/\/news.discovery.com\/tech\/human-antenna-electromagnetic-interference-110512.html\"><span class=\"publink\">How to Make a Human Antenna<\/span><\/a> (<a href=\"http:\/\/abcnews.go.com\/Technology\/make-human-antenna\/story?id=13600329\"><span class=\"publink\">at ABC News<\/span><\/a>) (<a href=\"http:\/\/www.msnbc.msn.com\/id\/43009449\"><span class=\"publink\">at MSNBC<\/span><\/a>)<\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 5px\">Discovery News, 12 May 2011<\/p>\r\n<p class=\"presstitle\" style=\"margin-top: 0px;margin-bottom: 0px\"><a href=\"http:\/\/www.newscientist.com\/blogs\/onepercent\/2011\/05\/jim-giles-contributor-vancouve.html\"><span class=\"publink\">Turn your entire home into a game controller<\/span><\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 5px\">New Scientist, 10 May 2011<\/p>\r\n<p class=\"presstitle\" style=\"margin-top: 0px;margin-bottom: 0px\"><a href=\"http:\/\/www.technologyreview.com\/computing\/37514\/page1\/\"><span class=\"publink\">Talking to the Wall<\/span><\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 5px\">Technology Review, 3 May 2011<\/p>"}],"slides":[],"related-researchers":[{"type":"user_nicename","value":"gabe","display_name":"Gabe Cohn","author_link":"<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/gabe\/\" aria-label=\"Visit the profile page for Gabe Cohn\">Gabe Cohn<\/a>","is_active":false,"user_id":31836,"last_first":"Cohn, Gabe","people_section":0,"alias":"gabe"}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/327746","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":2,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/327746\/revisions"}],"predecessor-version":[{"id":654882,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/327746\/revisions\/654882"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=327746"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=327746"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=327746"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=327746"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=327746"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}