{"id":171349,"date":"2014-04-26T08:37:01","date_gmt":"2014-04-26T08:37:01","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/project\/a-low-cost-transparent-electric-field-sensor-for-3d-interaction-on-mobile-devices\/"},"modified":"2017-05-31T12:10:54","modified_gmt":"2017-05-31T19:10:54","slug":"a-low-cost-transparent-electric-field-sensor-for-3d-interaction-on-mobile-devices","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/a-low-cost-transparent-electric-field-sensor-for-3d-interaction-on-mobile-devices\/","title":{"rendered":"A Low-cost Transparent Electric Field Sensor for 3D Interaction on Mobile Devices"},"content":{"rendered":"<p class=\"asset-content\">We contribute a thin, transparent, and low-cost design for electric field sensing, allowing for 3D finger and hand tracking, as well as in-air gestures on mobile devices. Our approach requires no direct instrumentation of the hand or body, and is non-optical, allowing for a compact form-factor that is resilient to ambient illumination. Our simple driver electronics are based on an off-the-shelf chip that removes the need for building custom analog electronics. We describe the design of our transparent electrode array, and present a machine learning algorithm for mapping from signal measurements at the receivers to 3D positions. We demonstrate non-contact motion gestures, and precise 3D hand and finger localization. We conclude by discussing limitations and future work.<\/p>\n<div class=\"yt-consent-placeholder\" role=\"region\" aria-label=\"Video playback requires cookie consent\" data-video-id=\"DThJDAPxtxM\" data-poster=\"https:\/\/img.youtube.com\/vi\/DThJDAPxtxM\/maxresdefault.jpg\"><iframe aria-hidden=\"true\" tabindex=\"-1\" title=\"3D Sensing on Phones\" width=\"500\" height=\"281\" data-src=\"https:\/\/www.youtube-nocookie.com\/embed\/DThJDAPxtxM?feature=oembed&rel=0&enablejsapi=1\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<div class=\"yt-consent-placeholder__overlay\"><button class=\"yt-consent-placeholder__play\"><svg width=\"42\" height=\"42\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-hidden=\"true\" focusable=\"false\"><g fill=\"none\" fill-rule=\"evenodd\"><circle fill=\"#000\" opacity=\".556\" cx=\"21\" cy=\"21\" r=\"21\"\/><path stroke=\"#FFF\" d=\"M27.5 22l-12 8.5v-17z\"\/><\/g><\/svg><span class=\"yt-consent-placeholder__label\">Video playback requires cookie consent<\/span><\/button><\/div>\n<\/div>\n<h1>Image Gallery<\/h1>\n<ul id='gallery-1' class='gallery galleryid-171349 gallery-columns-4 gallery-size-grid-third stripped ms-row fixed-small'><li class='s-col-6-24 xs-margin-bottom-sp1 s-margin-bottom-sp2'><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000001.jpg\" data-mfp-src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000001.jpg\" data-caption=\"\" class=\"gallery-item\"><img decoding=\"async\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000001-480x280.jpg\" alt=\"a circuit board\" class=\"db full-width\" \/><\/a><\/li><li class='s-col-6-24 xs-margin-bottom-sp1 s-margin-bottom-sp2'><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000002.jpg\" data-mfp-src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000002.jpg\" data-caption=\"\" class=\"gallery-item\"><img decoding=\"async\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000002-480x280.jpg\" alt=\"\" class=\"db full-width\" \/><\/a><\/li><li class='s-col-6-24 xs-margin-bottom-sp1 s-margin-bottom-sp2'><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000003.jpg\" data-mfp-src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000003.jpg\" data-caption=\"\" class=\"gallery-item\"><img decoding=\"async\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000003-480x280.jpg\" alt=\"\" class=\"db full-width\" \/><\/a><\/li><li class='s-col-6-24 xs-margin-bottom-sp1 s-margin-bottom-sp2'><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000004.jpg\" data-mfp-src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000004.jpg\" data-caption=\"\" class=\"gallery-item\"><img decoding=\"async\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/transparentelectricfield_214498-000004-480x280.jpg\" alt=\"\" class=\"db full-width\" \/><\/a><\/li><br style=\"clear: both\" \/>\n\t\t<\/ul>\n\n<div class=\"asset-content\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>We contribute a thin, transparent, and low-cost design for electric field sensing, allowing for 3D finger and hand tracking, as well as in-air gestures on mobile devices. Our approach requires no direct instrumentation of the hand or body, and is non-optical, allowing for a compact form-factor that is resilient to ambient illumination. Our simple driver [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-171349","msr-project","type-msr-project","status-publish","hentry","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2014-04-26","related-publications":[166525],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171349","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171349\/revisions"}],"predecessor-version":[{"id":213172,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171349\/revisions\/213172"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=171349"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=171349"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=171349"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=171349"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=171349"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}