{"id":171337,"date":"2014-04-11T16:58:42","date_gmt":"2014-04-11T16:58:42","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/project\/viiboard-vision-enhanced-immersive-interaction-with-touch-board\/"},"modified":"2019-08-19T10:58:48","modified_gmt":"2019-08-19T17:58:48","slug":"viiboard-vision-enhanced-immersive-interaction-with-touch-board","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/viiboard-vision-enhanced-immersive-interaction-with-touch-board\/","title":{"rendered":"ViiBoard: Vision-enhanced Immersive Interaction with Touch Board"},"content":{"rendered":"<div class=\"asset-content\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-213184\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_viiboard.png\" alt=\"mic_viiboard_viiboard\" width=\"700\" height=\"352\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_viiboard.png 981w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_viiboard-300x151.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_viiboard-768x386.png 768w\" sizes=\"auto, (max-width: 700px) 100vw, 700px\" \/><\/p>\n<p>ViiBoard uses vision techniques to significantly enhance the user experience on large touch displays (e.g. Microsoft Perceptive Pixel) in two areas: human computer interaction and immersive remote collaboration.<\/p>\n<\/div>\n<div id=\"en-usprojectsmic_viiboarddefault\" class=\"page-content\">\n<h2>Simple Setup<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-213187 alignnone\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_hardwaresetup-300x169.jpg\" alt=\"mic_viiboard_hardwaresetup\" width=\"300\" height=\"169\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_hardwaresetup-300x169.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_hardwaresetup-768x432.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_hardwaresetup-1024x575.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_hardwaresetup-343x193.jpg 343w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>ViiBoard uses only an RGBD camera (Microsoft Kinect), mounted on the side of a large touch display, to enhance user interaction and enable 3D immersive collaboration in a desirable form factor, practical for home or office use.<\/p>\n<\/div>\n<div id=\"en-usprojectsmic_viiboarddefault\" class=\"page-content\">\n<h2>Part I: Vision-enhanced Interaction<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-213190\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_vtouch-300x238.jpg\" alt=\"mic_viiboard_vtouch\" width=\"350\" height=\"277\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_vtouch-300x238.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_vtouch-768x608.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_vtouch.jpg 927w\" sizes=\"auto, (max-width: 350px) 100vw, 350px\" \/><\/p>\n<p>ViiBoard augments the touch input with visual understanding to improve the interaction with a large touch-sensitive display. Through visual analysis, the system understands where the user is, who the user is, and what the user is doing even before the user touches the display. Using these information, ViiBoard provides a set of powerful tools for designing and developing applications with better user experience around large touch displays. ViiBoard enables the following six features: (a) user distinction, (b) body centered UI\u00a0, (c) hand distinction, (d) hand gesture, (e) hand hover, and (f) pointing.<\/p>\n<p>Video: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" title=\"\" href=\"http:\/\/www.youtube.com\/watch?v=-xM1rEhOw00\" target=\"_blank\" rel=\"noopener noreferrer\">ViiBoard (Part I)<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<\/div>\n<div id=\"en-usprojectsmic_viiboarddefault\" class=\"page-content\">\n<h2>Part II: Immersive Remote Collaboration<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-213193 alignnone\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_immerse-1024x229.png\" alt=\"mic_viiboard_immerse\" width=\"800\" height=\"179\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_immerse-1024x229.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_immerse-300x67.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_immerse-768x172.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2014\/04\/mic_viiboard_immerse.png 1873w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/p>\n<p>ViiBoard also provides an immersive telepresence experience around remote whiteboard collaboration. Using 3D processing of the depth images, life-sized rendering, and novel visualizations, ViiBoard emulates writing side-by-side on a physical whiteboard, or alternatively on a mirror. User studies involving four different tasks show that compared to standard video conferencing with a digital whiteboard, ViiBoard provides participants with a quantitatively better ability to estimate their remote partners&#8217; eye gaze direction, gesture direction, intention, and level of agreement. Moreover, these quantitative capabilities translate qualitatively into a heightened sense of being together and a more enjoyable experience.<\/p>\n<p>Video: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" title=\"\" href=\"http:\/\/www.youtube.com\/watch?v=pBny6KfGreU\" target=\"_blank\" rel=\"noopener noreferrer\">ViiBoard (Part II)<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>ViiBoard uses vision techniques to significantly enhance the user experience on large touch displays (e.g. Microsoft Perceptive Pixel) in two areas: human computer interaction and immersive remote collaboration. Simple Setup ViiBoard uses only an RGBD camera (Microsoft Kinect), mounted on the side of a large touch display, to enhance user interaction and enable 3D immersive [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13562,13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-171337","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2014-04-11","related-publications":[],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171337","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":2,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171337\/revisions"}],"predecessor-version":[{"id":604278,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171337\/revisions\/604278"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=171337"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=171337"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=171337"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=171337"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=171337"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}