{"id":637092,"date":"2020-02-18T08:52:40","date_gmt":"2020-02-18T16:51:50","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-event&#038;p=637092"},"modified":"2025-08-06T11:53:28","modified_gmt":"2025-08-06T18:53:28","slug":"hololens-2-kinect-for-azure-as-tools-for-computer-vision-research-tutorial-eccv-2020","status":"publish","type":"msr-event","link":"https:\/\/www.microsoft.com\/en-us\/research\/event\/hololens-2-kinect-for-azure-as-tools-for-computer-vision-research-tutorial-eccv-2020\/","title":{"rendered":"Microsoft HoloLens 2 and Azure Kinect DK as tools for computer vision research \u2013 Tutorial @ ECCV 2020"},"content":{"rendered":"\n\n<p><strong>Conference URL:<\/strong> <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/eccv2020.eu\/\" target=\"_blank\" rel=\"noopener noreferrer\">ECCV 2020<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<p>Microsoft HoloLens 2 is a holographic computer, but it\u2019s also a potent computer vision research device. Applications can access audio and video streams and surface meshes, all in a world coordinate space maintained by HoloLens\u2019 highly accurate head-tracking. This tutorial will dive into the new \u201cResearch Mode\u201d capability of HoloLens 2 and the open source SDK of Azure Kinect DK. For HoloLens 2, we will show you how to access all the raw streams on device, including depth and IMU, and combine them with the hand tracking and eye gaze tracking capabilities offered by the device.<\/p>\n<p>We will also show how to use the open source SDK of Azure Kinect DK to synchronize and calibrate multiple cameras, extract extrinsic and intrinsic camera information and extract sound source information from the 7-microphone array. The tutorial will be illustrated by multiple example applications.<\/p>\n<p><strong>Program Committee Members<\/strong><\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/mapoll\/\">Marc Pollefeys<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/jamiesho\/\">Jamie Shotton<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/sigallia\/\">Silvano Galliani<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/febogo\/\">Federica Bogo<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/joschonb\/\">Johannes Sch\u00f6nberger<\/a><br \/>\nDorin Ungureanu<br \/>\nPooja Sama<\/p>\n<p><strong>Program<\/strong><\/p>\n<p>1. Microsoft HoloLens 2 and Azure Kinect DK as tools for computer vision research. M. Pollefeys<br \/>\n2. HoloLens 2 Research Mode: API overview. D. Ungureanu, P. Sama<br \/>\n3. The HoloLens2ForCV Repository. F. Bogo<br \/>\n4. Azure Kinect DK SDK for computer vision research. S. Galliani<br \/>\n5. Azure Kinect DK demo. S. Galliani<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Microsoft HoloLens 2 and Kinect for Azure as tools for computer vision research \u2013 Tutorial @ ECCV 2020<\/p>\n","protected":false},"featured_media":581437,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_startdate":"2020-08-28","msr_enddate":"2020-08-28","msr_location":"Virtual\/Online","msr_expirationdate":"","msr_event_recording_link":"","msr_event_link":"","msr_event_link_redirect":false,"msr_event_time":"Live sessions: 9.30-11 and 17.30-19 (UTC +1)","msr_hide_region":false,"msr_private_event":false,"msr_hide_image_in_river":0,"footnotes":""},"research-area":[13556,13562,13551,13552,13554],"msr-region":[239178],"msr-event-type":[197941,197944],"msr-video-type":[],"msr-locale":[268875],"msr-program-audience":[],"msr-post-option":[],"msr-impact-theme":[],"class_list":["post-637092","msr-event","type-msr-event","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-graphics-and-multimedia","msr-research-area-hardware-devices","msr-research-area-human-computer-interaction","msr-region-europe","msr-event-type-conferences","msr-event-type-hosted-by-microsoft","msr-locale-en_us"],"msr_about":"<!-- wp:msr\/event-details {\"title\":\"Microsoft HoloLens 2 and Azure Kinect DK as tools for computer vision research \u2013 Tutorial @ ECCV 2020\",\"backgroundColor\":\"grey\",\"image\":{\"id\":581437,\"url\":\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/04\/CHI-2019_HCC_header_04_2019_1920x720.jpg\",\"alt\":\"\"}} \/-->\n\n<!-- wp:msr\/content-tabs --><!-- wp:msr\/content-tab {\"title\":\"About\"} --><!-- wp:freeform --><p><strong>Conference URL:<\/strong> <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/eccv2020.eu\/\" target=\"_blank\" rel=\"noopener noreferrer\">ECCV 2020<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<p>Microsoft HoloLens 2 is a holographic computer, but it\u2019s also a potent computer vision research device. Applications can access audio and video streams and surface meshes, all in a world coordinate space maintained by HoloLens\u2019 highly accurate head-tracking. This tutorial will dive into the new \u201cResearch Mode\u201d capability of HoloLens 2 and the open source SDK of Azure Kinect DK. For HoloLens 2, we will show you how to access all the raw streams on device, including depth and IMU, and combine them with the hand tracking and eye gaze tracking capabilities offered by the device.<\/p>\n<p>We will also show how to use the open source SDK of Azure Kinect DK to synchronize and calibrate multiple cameras, extract extrinsic and intrinsic camera information and extract sound source information from the 7-microphone array. The tutorial will be illustrated by multiple example applications.<\/p>\n<p><strong>Program Committee Members<\/strong><\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/mapoll\/\">Marc Pollefeys<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/jamiesho\/\">Jamie Shotton<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/sigallia\/\">Silvano Galliani<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/febogo\/\">Federica Bogo<\/a><br \/>\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/joschonb\/\">Johannes Sch\u00f6nberger<\/a><br \/>\nDorin Ungureanu<br \/>\nPooja Sama<\/p>\n<p><strong>Program<\/strong><\/p>\n<p>1. Microsoft HoloLens 2 and Azure Kinect DK as tools for computer vision research. M. Pollefeys<br \/>\n2. HoloLens 2 Research Mode: API overview. D. Ungureanu, P. Sama<br \/>\n3. The HoloLens2ForCV Repository. F. Bogo<br \/>\n4. Azure Kinect DK SDK for computer vision research. S. Galliani<br \/>\n5. Azure Kinect DK demo. S. Galliani<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<!-- \/wp:freeform --><!-- \/wp:msr\/content-tab --><!-- \/wp:msr\/content-tabs -->","tab-content":[{"id":0,"name":"About","content":"Microsoft HoloLens 2 is a holographic computer, but it\u2019s also a potent computer vision research device. Applications can access audio and video streams and surface meshes, all in a world coordinate space maintained by HoloLens\u2019 highly accurate head-tracking. This tutorial will dive into the new \u201cResearch Mode\u201d capability of HoloLens 2 and the open source SDK of Azure Kinect DK. For HoloLens 2, we will show you how to access all the raw streams on device, including depth and IMU, and combine them with the hand tracking and eye gaze tracking capabilities offered by the device.\r\n\r\nWe will also show how to use the open source SDK of Azure Kinect DK to synchronize and calibrate multiple cameras, extract extrinsic and intrinsic camera information and extract sound source information from the 7-microphone array. The tutorial will be illustrated by multiple example applications.\r\n\r\n<strong>Program Committee Members<\/strong>\r\n\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/mapoll\/\">Marc Pollefeys<\/a>\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/jamiesho\/\">Jamie Shotton<\/a>\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/sigallia\/\">Silvano Galliani<\/a>\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/febogo\/\">Federica Bogo<\/a>\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/joschonb\/\">Johannes Sch\u00f6nberger<\/a>\r\nDorin Ungureanu\r\nPooja Sama\r\n\r\n<strong>Program<\/strong>\r\n\r\n1. Microsoft HoloLens 2 and Azure Kinect DK as tools for computer vision research. M. Pollefeys\r\n2. HoloLens 2 Research Mode: API overview. D. Ungureanu, P. Sama\r\n3. The HoloLens2ForCV Repository. F. Bogo\r\n4. Azure Kinect DK SDK for computer vision research. S. Galliani\r\n5. Azure Kinect DK demo. S. Galliani"}],"msr_startdate":"2020-08-28","msr_enddate":"2020-08-28","msr_event_time":"Live sessions: 9.30-11 and 17.30-19 (UTC +1)","msr_location":"Virtual\/Online","msr_event_link":"","msr_event_recording_link":"","msr_startdate_formatted":"August 28, 2020","msr_register_text":"Watch now","msr_cta_link":"","msr_cta_text":"","msr_cta_bi_name":"","featured_image_thumbnail":"<img width=\"960\" height=\"360\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/04\/CHI-2019_HCC_header_04_2019_1920x720.jpg\" class=\"img-object-cover\" alt=\"Sunset photo of the Clyde Arc in Glasgow, UK\" decoding=\"async\" loading=\"lazy\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/04\/CHI-2019_HCC_header_04_2019_1920x720.jpg 1920w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/04\/CHI-2019_HCC_header_04_2019_1920x720-300x113.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/04\/CHI-2019_HCC_header_04_2019_1920x720-768x288.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/04\/CHI-2019_HCC_header_04_2019_1920x720-1024x384.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/04\/CHI-2019_HCC_header_04_2019_1920x720-1600x600.jpg 1600w\" sizes=\"auto, (max-width: 960px) 100vw, 960px\" \/>","event_excerpt":"Microsoft HoloLens 2 and Kinect for Azure as tools for computer vision research \u2013 Tutorial @ ECCV 2020","msr_research_lab":[602418],"related-researchers":[{"type":"user_nicename","display_name":"Marc Pollefeys","user_id":36191,"people_section":"Section name 0","alias":"mapoll"},{"type":"user_nicename","display_name":"Silvano Galliani","user_id":38601,"people_section":"Section name 0","alias":"sigallia"}],"msr_impact_theme":[],"related-academic-programs":[],"related-groups":[],"related-projects":[708502],"related-opportunities":[],"related-publications":[],"related-videos":[],"related-posts":[687813],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event\/637092","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-event"}],"version-history":[{"count":9,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event\/637092\/revisions"}],"predecessor-version":[{"id":1146994,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event\/637092\/revisions\/1146994"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/581437"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=637092"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=637092"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=637092"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=637092"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=637092"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=637092"},{"taxonomy":"msr-program-audience","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-program-audience?post=637092"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=637092"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=637092"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}