{"id":735667,"date":"2021-01-28T07:28:45","date_gmt":"2021-01-28T15:28:45","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=735667"},"modified":"2021-03-23T07:41:39","modified_gmt":"2021-03-23T14:41:39","slug":"project-innereye-augmenting-cancer-radiotherapy-workflows-with-deep-learning-and-open-source","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/project-innereye-augmenting-cancer-radiotherapy-workflows-with-deep-learning-and-open-source\/","title":{"rendered":"Project InnerEye: Augmenting cancer radiotherapy workflows with deep learning and open source"},"content":{"rendered":"<p>Medical images offer vast opportunities to improve clinical workflows and outcomes. Specifically, in the context of cancer radiotherapy, clinicians need to go through computer tomography (CT) scans and manually segment (contour) anatomical structures. This is an extremely time-consuming task that puts a large burden on care providers. Deep learning (DL) models can help with these segmentation tasks. However, more understanding is needed regarding these models\u2019 clinical utility, generalizability, and safety in existing workflows. Building these models also requires techniques that are not easily accessible to researchers and care providers.<\/p>\n<p>In this webinar, Dr. Ozan Oktay and Dr. Anton Schwaighofer will analyze these challenges within the context of image-guided radiotherapy procedures and will present the latest research outputs of\u202fProject InnerEye\u202fin tackling these challenges. The first part of the webinar will focus on a research study that evaluates the potential clinical impact of DL models within the context of radiotherapy planning procedures. The discussion will also include the performance analysis of state-of-the-art DL models on datasets from different hospitals and cancer types, and we\u2019ll explore how they compare with manual contours annotated by three clinical experts.<\/p>\n<p>The second part of the talk will introduce the open-source InnerEye Deep Learning Toolkit and how it can provide tools to help enable users to build state-of-the-art medical image segmentation models in Microsoft Azure. There will be examples illustrating step-by-step how the toolkit can be used in different segmentation applications within Azure Machine Learning (Azure ML) infrastructure. This includes model specification, training run analysis, performance reporting, and model comparison.<\/p>\n<p>In this webinar, we will explore:<\/p>\n<ul>\n<li>The performance of DL segmentation models across images from multiple clinical sites and different radiotherapy domains, and how it compares with levels of inter-expert variability in radiotherapy contouring tasks.<\/li>\n<li>The potential clinical impact of such models in terms of time savings, by augmenting existing radiotherapy dose planning procedures.<\/li>\n<li>The features of the InnerEye Deep Learning Toolkit and how it can be used by developers to aid in building their own in-house medical image segmentation models from scratch.<\/li>\n<li>Exploring the potential benefits of Azure ML cloud integration and model development process in Azure ML.<\/li>\n<\/ul>\n<p><strong>Resource list:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/medical-image-analysis\/\">InnerEye<\/a> (Project page)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/microsoft\/InnerEye-DeepLearning\">InnerEye on Github<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/evaluation-of-deep-learning-to-augment-image-guided-radiotherapy-for-head-and-neck-and-prostate-cancers\">InnerEye JAMA<\/a> (publication)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/project-innereye-open-source-deep-learning-toolkit-democratizing-medical-imaging-ai\/\">Open-source announcement<\/a> (MSR Blog)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/project-innereye-evaluation-shows-how-ai-can-augment-and-accelerate-clinicians-ability-to-perform-radiotherapy-planning-13-times-faster\/\">Research outcomes<\/a> (MSR Blog)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/innovation.microsoft.com\/en-us\/tech-minutes-project-innereye\">Tech Minutes &#8211; Project InnerEye<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/ozoktay\">Ozan Oktay<\/a> (Researcher profile)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/antonsc\">Anton Schwaighofer<\/a> (Researcher profile)<\/li>\n<\/ul>\n<p>*This on-demand webinar features a previously recorded Q&A session and open captioning.<\/p>\n<p>Explore more Microsoft Research webinars: https:\/\/aka.ms\/msrwebinars<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Medical images offer vast opportunities to improve clinical workflows and outcomes. Specifically, in the context of cancer radiotherapy, clinicians need to go through computer tomography (CT) scans and manually segment (contour) anatomical structures. This is an extremely time-consuming task that puts a large burden on care providers. Deep learning (DL) models can help with these [&hellip;]<\/p>\n","protected":false},"featured_media":735670,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_hide_image_in_river":0,"footnotes":""},"research-area":[13556,13562,13553],"msr-video-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-session-type":[],"msr-impact-theme":[],"msr-pillar":[],"msr-episode":[],"msr-research-theme":[],"class_list":["post-735667","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-medical-health-genomics","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/CRr9Xtwq9k4","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/735667","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/735667\/revisions"}],"predecessor-version":[{"id":735673,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/735667\/revisions\/735673"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/735670"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=735667"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=735667"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=735667"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=735667"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=735667"},{"taxonomy":"msr-session-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-session-type?post=735667"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=735667"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=735667"},{"taxonomy":"msr-episode","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-episode?post=735667"},{"taxonomy":"msr-research-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-theme?post=735667"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}