{"id":576045,"date":"2019-03-28T03:44:56","date_gmt":"2019-03-28T10:44:56","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=576045"},"modified":"2022-09-06T09:59:49","modified_gmt":"2022-09-06T16:59:49","slug":"assessing-multiple-sclerosis-with-kinect","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/assessing-multiple-sclerosis-with-kinect\/","title":{"rendered":"Assessing Multiple Sclerosis with Kinect"},"content":{"rendered":"<p>\t\t\t<div class=\"ms-grid \">\n\t\t\t<div class=\"ms-row\">\n\t\t\t\t\t<div  class=\"l-col-16-24 center\" >\n\t\t<p>Multiple Sclerosis is a neuro-degenerative condition that causes physical and cognitive impairment over an unpredictable timeframe, making the ability to detect disease change very important. Currently disease tracking is done through clinical examination, in which a neurologist watches a patient perform a number of exercises, such as touching the finger to the nose, and then rates the level of motor abnormality. However, the high variance in judgements between neurologists, or the same neurologist at different time points, makes reliably tracking disease progression problematic. The high variance in current tools requires large number of patients to be included in clinical trials, making the discovery and evaluation of new treatments a slow and expensive process.<\/p><p>ASSESS MS addresses this by providing a consistent, quantified measure of motor ability using Kinect that is both inexpensive and non-invasive. Using Kinect, the system captures depth videos of neuro-assessment movements performed by patients in a clinical setting with the support of the health professional. The videos are then processed offline and a classification of specific aspects of motor ability is provided based on the Expanded Disability Severity Score (EDSS). These are then presented back to the health professional through a series of visualisations that compare data over time. The project is a collaboration between the Human Experience & Design group and the Machine Learning and Perception group at Microsoft Research Cambridge, as well as Novartis Pharma AG (Basel, Switzerland) and three large research hospitals in Europe (Basel, Bern, Amsterdam).<\/p><p><iframe loading=\"lazy\" title=\"AssessMS\" src=\"https:\/\/player.vimeo.com\/video\/166190405?dnt=1&app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-576069 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS3.png\" alt=\"\" width=\"1044\" height=\"450\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS3.png 1044w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS3-300x129.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS3-768x331.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS3-1024x441.png 1024w\" sizes=\"auto, (max-width: 1044px) 100vw, 1044px\" \/><\/p><p>The Human Experience & Design team has contributed to the project through ensuring the system works appropriately in a clinical setting. A key challenge has been the standardization of data need for optimal machine learning. This includes movement standardization, such as starting a Finger Nose test with arm outstretched to the side versus the front, as well as image standardization, such as ensuring the patient is centred in the image without any clutter behind. This project has demonstrated that standardization is a slippery concept that is highly dependent on the particularities that arise in real-world use. It is created through trade-offs between technical possibility, human interaction, and clinical need. Key contributions from our research are documented in the paper: Assessing Multiple Sclerosis with Kinect: Designing computer vision systems for real-world use.<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-576072 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS4.png\" alt=\"\" width=\"1044\" height=\"450\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS4.png 1044w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS4-300x129.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS4-768x331.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/03\/AssessMS4-1024x441.png 1024w\" sizes=\"auto, (max-width: 1044px) 100vw, 1044px\" \/><\/p><div class=\"content-inset\"><p>We designed a prototype system, both physical and software, to enable effective recording of depth videos in a standardized manner that is sensitive to the needs of those who use it \u2013 both patients and health professionals. An evaluation of the system, published in the paper: <em>Usability and acceptability of ASSESS MS: a system to support the assessment of motor dysfunction in Multiple Sclerosis using depth-sensing computer vision<\/em> has shown excellent results. The system is usable and supports the acquisition of highly standardized data. We are currently carrying out further research on the visualisation of the machine learning results for health professionals. We are particularly interested in how temporal representations can enable health professionals to gain new insights into the motor ability of their patients.<\/p><\/div><div class=\"content-inset\"><h4>Press Coverage<\/h4><p><strong>Bloomberg Business<\/strong><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.bloomberg.com\/news\/articles\/2016-02-09\/fight-against-multiple-sclerosis-gains-a-tech-ally\"><em>How Microsoft&#8217;s Video Game Tech Could Help MS Patients<\/em><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p><p><strong>Phys.org<\/strong><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/phys.org\/news\/2016-02-microsoft-novartis-kinect-based-ms-diagnostic.html\"><em>How Microsoft and Novartis created Kinect-based MS diagnostic tool<\/em><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p><p><strong>Brand Channel<\/strong><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.brandchannel.com\/2016\/02\/09\/microsoft-novartis-ms-020916\/\"><em>Microsoft and Novartis team up to tackle multiple sclerosis<\/em><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p><p><strong>Multiple Sclerosis News Today<\/strong><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/multiplesclerosisnewstoday.com\/2016\/02\/11\/assess-ms-new-therapy-assessment-tool-developed-microsoft-novartis-collaboration\/\"><em>Assess MS: A new Theraphy Assessment Tool developed by Microsoft &#8211; Novartis Collaboration<\/em><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p><p><span style=\"display: inline !important; float: none; background-color: #ffffff; color: #333333; cursor: text; font-family: Georgia,'Times New Roman','Bitstream Charter',Times,serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: left; text-decoration: none; text-indent: 0px; text-transform: none; -webkit-text-stroke-width: 0px; white-space: normal; word-spacing: 0px;\">\t<\/div>\n\t<\/span><\/p><\/div>\t\t\t<\/div>\n\t\t<\/div>\n\t\t<\/span><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>ASSESS MS enables a consistent, quantified measure of motor ability using Kinect that is both inexpensive and non-invasive. Using Kinect, the system captures depth videos of neuro-assessment movements performed by patients in a clinical setting with the support of the health professional.<\/p>\n","protected":false},"featured_media":576090,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-576045","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[168700,168400,168376,166427,168359,167701,648579],"related-downloads":[],"related-videos":[191539,287021],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Cecily Morrison","user_id":31356,"people_section":"Section name 1","alias":"cecilym"},{"type":"user_nicename","display_name":"Abigail Sellen","user_id":31112,"people_section":"Section name 1","alias":"asellen"},{"type":"user_nicename","display_name":"Antonio Criminisi","user_id":41790,"people_section":"Section name 1","alias":"acriminisi"}],"msr_research_lab":[199561],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/576045","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":6,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/576045\/revisions"}],"predecessor-version":[{"id":589495,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/576045\/revisions\/589495"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/576090"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=576045"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=576045"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=576045"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=576045"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=576045"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}