{"id":327728,"date":"2016-11-28T06:50:50","date_gmt":"2016-11-28T14:50:50","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=327728"},"modified":"2021-05-09T12:02:54","modified_gmt":"2021-05-09T19:02:54","slug":"soundwave-using-the-doppler-effect-to-sense-gestures","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/soundwave-using-the-doppler-effect-to-sense-gestures\/","title":{"rendered":"SoundWave: Using the Doppler Effect to Sense Gestures"},"content":{"rendered":"<p>Gesture is becoming an increasingly popular means of interacting with computers. However, it is still relatively costly to deploy robust gesture recognition sensors in existing mobile platforms. We present SoundWave, a technique that leverages the speaker and microphone already embedded in most commodity devices to sense in-air gestures around the device. To do this, we generate an inaudible tone, which gets frequency-shifted when it reflects off moving objects like the hand. We measure this shift with the microphone to infer various gestures. In this note, we describe the phenomena and detection algorithm, demonstrate a variety of gestures, and present an informal evaluation on the robustness of this approach across different devices and people.<\/p>\n<p><iframe loading=\"lazy\" title=\"SoundWave: Using the Doppler Effect to Sense Gestures\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube-nocookie.com\/embed\/wK_u8-UQmOs?feature=oembed&rel=0\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We present SoundWave, a technique that leverages the speaker and microphone already embedded in most commodity devices to sense in-air gestures around the device.<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,243062,13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-327728","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-research-area-audio-acoustics","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[317708],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[{"id":0,"name":"Additional news","content":"<p class=\"presstitle\" style=\"margin-bottom: 0px;margin-top: 0px\"><a href=\"http:\/\/www.youtube.com\/watch?v=em-nvzxzC68&amp;feature=BFa&amp;list=UU7iialY1qmmcyFWilHAEVpA\">Microsoft Research Projects Offer New Takes on Gesture Sensing\r\n<\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 10px\">IDG News Service, 9 May 2012<\/p>\r\n<p class=\"presstitle\" style=\"margin-bottom: 0px;margin-top: 0px\"><a href=\"http:\/\/www.newscientist.com\/article\/mg21428645.500-beyond-kinect-gestural-computer-spells-keyboard-death.html?\">Beyond Kinect: Gestural Computer Spells Keyboard Death<\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 10px\">New Scientist, 9 May 2012<\/p>\r\n<p class=\"presstitle\" style=\"margin-bottom: 0px;margin-top: 0px\"><a href=\"http:\/\/www.pcworld.com\/article\/255310\/gesture_sensing_alternatives_use_radio_interference_doppler_effect.html\">Gesture Sensing Alternatives Use Radio Interference, Doppler Effect<\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 10px\">PC World, 9 May 2012<\/p>\r\n<p class=\"presstitle\" style=\"margin-bottom: 0px;margin-top: 0px\"><a href=\"http:\/\/news.discovery.com\/tech\/soundwave-gesture-control-120509.html#mkcpgn=rssnws1\">Laptop Uses Sound for Gesture Control\r\n<\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 10px\">Discovery News, 9 May 2012<\/p>\r\n<p class=\"presstitle\" style=\"margin-bottom: 0px;margin-top: 0px\"><a href=\"http:\/\/www.technologyreview.com\/web\/40368\/?p1=A1\">Gesture Control System Uses Sound Alone<\/a><\/p>\r\n<p class=\"presscitation\" style=\"margin-top: 0px;margin-bottom: 10px\">Technology Review, 7 May 2012<\/p>"}],"slides":[],"related-researchers":[{"type":"guest","display_name":"Shwetak Patel","user_id":434253,"people_section":"Group 1","alias":""}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/327728","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":4,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/327728\/revisions"}],"predecessor-version":[{"id":654888,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/327728\/revisions\/654888"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=327728"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=327728"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=327728"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=327728"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=327728"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}