{"id":170869,"date":"2011-11-16T03:23:17","date_gmt":"2011-11-16T03:23:17","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/project\/touchless-interaction-in-medical-imaging\/"},"modified":"2022-09-07T10:57:24","modified_gmt":"2022-09-07T17:57:24","slug":"touchless-interaction-in-medical-imaging","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/touchless-interaction-in-medical-imaging\/","title":{"rendered":"Touchless Interaction in Medical Imaging"},"content":{"rendered":"<p>This project explores the use of new touchless technology in medical practice.<\/p>\n<p>With advances in medical imaging over the years, surgical procedures have become increasingly reliant on a range of digital imaging systems for navigation, reference, diagnosis and documentation. The need to interact with images in these surgical settings offers particular challenges arising from the need to maintain boundaries between sterile and non-sterile aspects of the surgical environment and practices. Traditional input devices such as keyboard, mouse and touch screen surfaces are reliant physical contact. Such contact-based interaction introduces the possibility for contaminated material to be transferred between the sterile and non-sterile. This constraint creates difficulties for surgical staff who are scrubbed up and are dependent upon others to manipulate images on their behalf. This can create inefficiencies, which in turn can entail potential medical complications. Additionally, it can interfere with the surgeon\u2019s interpretive and analytic use of the images.<\/p>\n<p>The aim of the project then is to explore the use of touchless interaction within surgical settings, allowing images to be viewed, controlled and manipulated without contact through the use of camera-based gesture recognition technology. In particular, the project seeks to understand the challenges of these environments for the design and deployment of such systems, as well as articulate the ways in which these technologies may alter surgical practice. While our primary concerns here are with maintaining conditions of asepsis, the use of these touchless gesture-based technologies offers other potential uses. For example, such systems offer interesting possibilities for interacting with emerging 3D imaging technologies. They also enable new possibilities for how the surgeons spatially configure themselves with respect to the various screens within surgical settings by enabling interaction at a distance. Such technologies then also offer potential to re-imagine the spatial environments within which image-based surgery takes place.<\/p>\n\t<div data-wp-context='{\"items\":[]}' data-wp-interactive=\"msr\/accordion\">\n\t\t\t\t\t<div class=\"clearfix\">\n\t\t\t\t<div\n\t\t\t\t\tclass=\"btn-group align-items-center mb-g float-sm-right\"\n\t\t\t\t\tdata-bi-aN=\"accordion-collapse-controls\"\n\t\t\t\t>\n\t\t\t\t\t<button\n\t\t\t\t\t\tclass=\"btn btn-link m-0\"\n\t\t\t\t\t\tdata-bi-cN=\"Expand all\"\n\t\t\t\t\t\tdata-wp-bind--aria-controls=\"state.ariaControls\"\n\t\t\t\t\t\tdata-wp-bind--aria-expanded=\"state.ariaExpanded\"\n\t\t\t\t\t\tdata-wp-bind--disabled=\"state.isAllExpanded\"\n\t\t\t\t\t\tdata-wp-class--inactive=\"state.isAllExpanded\"\n\t\t\t\t\t\tdata-wp-on--click=\"actions.onExpandAll\"\n\t\t\t\t\t\ttype=\"button\"\n\t\t\t\t\t>\n\t\t\t\t\t\tExpand all\t\t\t\t\t<\/button>\n\t\t\t\t\t<span aria-hidden=\"true\"> | <\/span>\n\t\t\t\t\t<button\n\t\t\t\t\t\tclass=\"btn btn-link m-0\"\n\t\t\t\t\t\tdata-bi-cN=\"Collapse all\"\n\t\t\t\t\t\tdata-wp-bind--aria-controls=\"state.ariaControls\"\n\t\t\t\t\t\tdata-wp-bind--aria-expanded=\"state.ariaExpanded\"\n\t\t\t\t\t\tdata-wp-bind--disabled=\"state.isAllCollapsed\"\n\t\t\t\t\t\tdata-wp-class--inactive=\"state.isAllCollapsed\"\n\t\t\t\t\t\tdata-wp-on--click=\"actions.onCollapseAll\"\n\t\t\t\t\t\ttype=\"button\"\n\t\t\t\t\t>\n\t\t\t\t\t\tCollapse all\t\t\t\t\t<\/button>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t\t<ul class=\"msr-accordion\">\n\t\t\t\t\t\t\t\t<li class=\"m-0\" data-wp-context='{\"id\":\"accordion-content-2\"}' data-wp-init=\"callbacks.init\">\n\t\t<div class=\"accordion-header\">\n\t\t\t<button\n\t\t\t\taria-controls=\"accordion-content-2\"\n\t\t\t\tclass=\"btn btn-collapse\"\n\t\t\t\tdata-wp-bind--aria-expanded=\"state.isExpanded\"\n\t\t\t\tdata-wp-on--click=\"actions.onClick\"\n\t\t\t\tid=\"accordion-button-1\"\n\t\t\t\ttype=\"button\"\n\t\t\t>\n\t\t\t\tNews Coverage\t\t\t<\/button>\n\t\t<\/div>\n\t\t<div\n\t\t\taria-labelledby=\"accordion-button-1\"\n\t\t\tclass=\"msr-accordion__content\"\n\t\t\tdata-wp-bind--inert=\"!state.isExpanded\"\n\t\t\tdata-wp-run=\"callbacks.run\"\n\t\t\tid=\"accordion-content-2\"\n\t\t>\n\t\t\t<div class=\"msr-accordion__body\">\n\t\t\t\t<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.bbc.co.uk\/news\/health-18238356\" target=\"_blank\" rel=\"noopener noreferrer\">Trial of &#8220;touchless&#8221; gaming technology in surgery<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, Adam Brimelow, BBC News Health (May 31, 2012)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.bbc.co.uk\/news\/uk-18276049\" target=\"_blank\" rel=\"noopener noreferrer\">Touchless technology put to test by surgeons<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0(video), Adam Brimelow, BBC News (May 31, 2012)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.newscientist.com\/article\/mg21428655.200-kinect-imaging-lets-surgeons-keep-their-focus.html\" target=\"_blank\" rel=\"noopener noreferrer\">Kinect imaging lets surgeons keep their focus<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, MacGregor Campbell, New Scientist, Tech (May 17, 2012)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.youtube.com\/watch?v=ee4E5Yg3y98&list=PL49696C121A3AB1C2&index=1&feature=plcp\" target=\"_blank\" rel=\"noopener noreferrer\">\u0628\u0631\u0646\u0627\u0645\u062c 4 \u062a\u0643 &#8211; \u0627\u0644\u062d\u0644\u0642\u0629<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.youtube.com\/watch?v=ee4E5Yg3y98&list=PL49696C121A3AB1C2&index=1&feature=plcp\" target=\"_blank\" rel=\"noopener noreferrer\">&#8211; Tech program 4 &#8211; Episode 73<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> &#8211;\u00a0BBCArabicNews (May 11, 2012) [in Arabic]<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/blogs.technet.com\/b\/inside_microsoft_research\/archive\/2012\/03\/08\/interacting-without-touching.aspx\">Interacting without Touching<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, Inside Microsoft Research (March 8, 2012)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/seattletimes.nwsource.com\/html\/businesstechnology\/2017681928_microsofttechfest07.html?cmpid=2628\">Microsoft&#8217;s TechFest Trots Out &#8216;What is Now Possible&#8217; for Computers<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, The Seattle Times, Business\/Technology (March 7, 2012)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/pro.01net.com\/editorial\/560920\/microsoft-installe-kinect-dans-les-salles-doperation\/\">Microsoft Installe Kinect Dans les Salles D&#8217;operation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, 01net (March 7, 2012) [in French]<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/thetechjournal.com\/tech-news\/microsoft-shows-off-kinect-based-projects-at-techfest-research-fair.xhtml\">Microsoft Shows Off Kinect-Based Projects at TechFest Research Fair<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, The Tech Journal (March 6, 2012)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.zdnet.com\/blog\/microsoft\/microsoft-showcases-new-kinect-centric-projects-at-its-techfest-research-fair\/12131\">Microsoft showcases new Kinect-centric projects at its TechFest Research Fair<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, ZDNet (March 6, 2012)<\/li>\n<\/ul>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/li>\n\t\t<li class=\"m-0\" data-wp-context='{\"id\":\"accordion-content-4\"}' data-wp-init=\"callbacks.init\">\n\t\t<div class=\"accordion-header\">\n\t\t\t<button\n\t\t\t\taria-controls=\"accordion-content-4\"\n\t\t\t\tclass=\"btn btn-collapse\"\n\t\t\t\tdata-wp-bind--aria-expanded=\"state.isExpanded\"\n\t\t\t\tdata-wp-on--click=\"actions.onClick\"\n\t\t\t\tid=\"accordion-button-3\"\n\t\t\t\ttype=\"button\"\n\t\t\t>\n\t\t\t\tRelated projects\t\t\t<\/button>\n\t\t<\/div>\n\t\t<div\n\t\t\taria-labelledby=\"accordion-button-3\"\n\t\t\tclass=\"msr-accordion__content\"\n\t\t\tdata-wp-bind--inert=\"!state.isExpanded\"\n\t\t\tdata-wp-run=\"callbacks.run\"\n\t\t\tid=\"accordion-content-4\"\n\t\t>\n\t\t\t<div class=\"msr-accordion__body\">\n\t\t\t\t<p align=\"left\">See also the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/medical-image-analysis\/\">Medical Image Analysis<\/a> project page.<\/p>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/li>\n\t\t<li class=\"m-0\" data-wp-context='{\"id\":\"accordion-content-6\"}' data-wp-init=\"callbacks.init\">\n\t\t<div class=\"accordion-header\">\n\t\t\t<button\n\t\t\t\taria-controls=\"accordion-content-6\"\n\t\t\t\tclass=\"btn btn-collapse\"\n\t\t\t\tdata-wp-bind--aria-expanded=\"state.isExpanded\"\n\t\t\t\tdata-wp-on--click=\"actions.onClick\"\n\t\t\t\tid=\"accordion-button-5\"\n\t\t\t\ttype=\"button\"\n\t\t\t>\n\t\t\t\tOur collaborators\t\t\t<\/button>\n\t\t<\/div>\n\t\t<div\n\t\t\taria-labelledby=\"accordion-button-5\"\n\t\t\tclass=\"msr-accordion__content\"\n\t\t\tdata-wp-bind--inert=\"!state.isExpanded\"\n\t\t\tdata-wp-run=\"callbacks.run\"\n\t\t\tid=\"accordion-content-6\"\n\t\t>\n\t\t\t<div class=\"msr-accordion__body\">\n\t\t\t\t<p>This project is funded by MS Connections.\u00a0We are working with a number of key clinical and reserach partners:<\/p>\n<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.scc.lancs.ac.uk\/\">Lancaster University<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.kcl.ac.uk\/medicine\/research\/divisions\/imaging\/index.aspx\" target=\"_blank\" rel=\"noopener noreferrer\">King&#8217;s College London<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" title=\"\" href=\"http:\/\/www.guysandstthomas.nhs.uk\/\" target=\"_blank\" rel=\"noopener noreferrer\">Guy&#8217;s and St Thomas&#8217; NHS Trust<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, London<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.cuh.org.uk\/addenbrookes\/addenbrookes_index.html\" target=\"_blank\" rel=\"noopener noreferrer\">Addenbrooke&#8217;s Hospital<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, Cambridge<\/li>\n<\/ul>\n<p style=\"padding-left: 60px;\"><span id=\"3176be95-32c6-4001-ab61-ece7c8d5458c\" class=\"ImageBlock fn\"><img decoding=\"async\" id=\"Image3176be95-32c6-4001-ab61-ece7c8d5458c\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/02\/touchlessinteractionmedical-logos.png\" alt=\"\" \/><\/span><\/p>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/li>\n\t\t\t\t\t\t<\/ul>\n\t<\/div>\n\t\n","protected":false},"excerpt":{"rendered":"<p>This project explores the use of new touchless technology in medical practice. With advances in medical imaging over the years, surgical procedures have become increasingly reliant on a range of digital imaging systems for navigation, reference, diagnosis and documentation. The need to interact with images in these surgical settings offers particular challenges arising from the [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13554,13553,13559],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-170869","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-research-area-human-computer-interaction","msr-research-area-medical-health-genomics","msr-research-area-social-sciences","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2011-11-16","related-publications":[160722,161784,162162,162366,164911,168365],"related-downloads":[],"related-videos":[187408],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[303590],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Antonio Criminisi","user_id":41790,"people_section":"Section name 0","alias":"acriminisi"}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/170869","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":3,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/170869\/revisions"}],"predecessor-version":[{"id":876000,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/170869\/revisions\/876000"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=170869"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=170869"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=170869"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=170869"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=170869"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}