{"id":239354,"date":"2016-06-16T19:25:58","date_gmt":"2016-06-17T02:25:58","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=239354"},"modified":"2017-05-17T15:08:25","modified_gmt":"2017-05-17T22:08:25","slug":"cloud-computing-changes-way-practice-public-speaking","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/cloud-computing-changes-way-practice-public-speaking\/","title":{"rendered":"Cloud computing changes the way we practice public speaking"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6616\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/2016\/06\/PublicSpeaking_WebGraphics_Blog_900x300.jpg\" alt=\"Overcoming the fear of public speaking using cloud-based technology\" width=\"900\" height=\"300\" \/><\/p>\n<p><em>By\u00a0<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/vanim\/\">Vani Mandava<\/a>, Senior Program Manager, Microsoft Research<\/em><\/p>\n<p>People often rank public speaking as the number one fear that they face. New cloud-based technology from researchers at the University of Rochester lets speakers polish and practice at home in front of their computer camera, while the analysis provides instant feedback about improvement.<\/p>\n<p>Leading this effort known as ROC Speak is <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/web.media.mit.edu\/~mehoque\/\" target=\"_blank\">M. Ehsan Hoque<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, an assistant professor of computer science\u00a0and electrical and computer engineering at University of Rochester, where he codirects the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"https:\/\/www.cs.rochester.edu\/hci\/\" target=\"_blank\">Rochester Human-Computer Interaction (ROC HCI) Lab<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n<p>Hoque has more than one motivation for helping people improve their communication. He has a brother\u00a0with a severe social deficit who isn\u2019t able to communicate well. Hoque also has heard from the public in\u00a0more than 2,000 emails that some wish they could practice public speaking on computers in the privacy of their homes. Social speaking ability is valued by everyone, from academics who lecture to business\u00a0leaders and students. With the donation of <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/microsoft-azure-for-research\/\" target=\"_blank\">Microsoft Azure for Research tools<\/a>, Hoque has explored and designed a new platform to help speakers.<\/p>\n<p>At a conference a few years ago, a man walked up to Hoque and said he feared social stigma because his\u00a0speaking style was monotonous and he had difficulty making eye contact with people. Hoque was inspired by that encounter to further develop what is now <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"https:\/\/www.machinteraction.com\/rocspeak\/\" target=\"_blank\">ROC Speak<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. It\u2019s possible that in the future, ROC Speak will help people overcome speaking issues and might smooth social difficulties for people with Asperger\u2019s Syndrome.<\/p>\n<p>Among those testing the tool has been Valentina Kutyifa, a research cardiologist and former president of the Toastmasters Club at the University of Rochester. She has helped build a collaboration between the nonprofit Toastmaster\u2019s International, which also helps people practice speaking, and ROC Speak. \u201cI have used the ROC Speak product for some of my speeches, and I felt it&#8217;s very useful and helpful for preparing speeches and providing instant feedback,\u201d she said.<\/p>\n<p>Hoque explains that communication is much more complex than we realize, especially the nonverbal\u00a0elements. The ROC Speak platform works by measuring many forms of nonverbal behavior\u00a0simultaneously. Using the video camera and audio recording on the user\u2019s laptop, the program\u00a0measures eye gaze, word use, voice level, and hand gestures. ROC Speak uses techniques that\u00a0automatically analyze these subtle human behaviors. In addition, the system provides feedback,\u00a0which allows users to explore the nuances of their behavior during practice of a speech.<\/p>\n<p>\u201cThe human face has 43 muscles. Using 43 muscles, we can create 10,000 unique facial expressions. To\u00a0model nonverbal behavior, we need to get a lot of data and collect it in a naturalistic environment,\u201d Hoque said. To facilitate capturing and handling that data, Microsoft Azure for Research lent the project access to cloud resources with advanced tools in the <a href=\"https:\/\/www.microsoft.com\/en-us\/cloud-platform\/cortana-intelligence-suite\" target=\"_blank\">Cortana Intelligence<\/a> suite, tools such as Azure Machine Learning and Microsoft Cognitive Services. This enabled the ROC Speak team to make the platform broadly available, capture and store participant data, and synthesize it.<\/p>\n<p style=\"text-align: center;\"><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/VFcOpSTwncA\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>Hoque and his lab used Azure-based tools to analyze user videos by scoring automated visual features\u00a0such as smile intensity and movement, and audio features like pitch and loudness. After users record\u00a0a 2-minute video, they are given immediate feedback by the machine\u2013learning-based analysis. The feedback is presented in visually appealing graphs that show, for example, voice level for every few seconds of the speech. Word use\u2014both the speed of talking and the sophistication of language\u2014is analyzed. Gestures are tracked as well. The user can choose to share the video with other users and receive ratings on such elements as friendliness and gestures, as well as an overall rating.<\/p>\n<p>Azure has helped his team, Hoque said, because it has an intuitive user interface and has allowed his\u00a0students to use it without prior experience in cloud computing. One of his students is Vivian Li, who is an undergraduate research assistant. Li was surprised by the sense of community that developed among ROC Speak users who were rating other users on their videos. She and Kutyifa also were inspired by how dramatically people improved as they practiced.<\/p>\n<p>Hoque sees further developments for the ROC Speak project, especially as they gather more and more\u00a0data from participants. \u201cIt is one of the largest datasets on nonverbal communication captured from people practicing public speaking in front of a computer,\u201d he said. Because it is cloud based, there is enormous potential to grow even further and collect even more data.<\/p>\n<p>One of the great advantages he sees to cloud computing is that he is able to tweak and improve his\u00a0algorithms as users keep using the program. His next step is to deploy ROC Speak widely in the world.\u00a0\u201cSocial skills are fundamental to who you are &#8230; So I think if there is a platform out there that helps you\u00a0to be better with communication, it can change the way we communicate.\u201d<\/p>\n<p><strong>Learn more <\/strong><\/p>\n<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.machinteraction.com\/rocspeak\/\">ROC Speak<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.cs.rochester.edu\/u\/mehoque\/Publications\/2015\/2015-ubicomp_rocspeak_Fung-etal.pdf\">ROC Speak white paper<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.cs.rochester.edu\/hci\/\">Rochester Human Computer Interaction Lab<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.toastmasters.org\/\">Toastmasters International<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/server-cloud\/cortana-intelligence-suite\/overview.aspx\">Cortana Intelligence Suite<\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/azure.microsoft.com\/en-us\/services\/machine-learning\/\">Azure Machine Learning<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/research.microsoft.com\/en-us\/projects\/azure\/default.aspx\">Microsoft Azure for Research<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/azure.microsoft.com\/en-us\/\">Microsoft Azure<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>By\u00a0Vani Mandava, Senior Program Manager, Microsoft Research People often rank public speaking as the number one fear that they face. New cloud-based technology from researchers at the University of Rochester lets speakers polish and practice at home in front of their computer camera, while the analysis provides instant feedback about improvement. Leading this effort known [&hellip;]<\/p>\n","protected":false},"author":39507,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[205399,197938,194481,194455,194456],"tags":[205586,205437,205589,205592,205595,204419],"research-area":[13556,13545],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-239354","post","type-post","status-publish","format-standard","hentry","category-azure","category-case-studies","category-human-centered-computing","category-machine-learning","category-natural-language-processing","tag-aspergers-syndrome","tag-cortana-intelligence-suite","tag-public-speaking","tag-roc-speak","tag-rochester-human-computer-interaction-roc-hci-lab","tag-university-of-rochester","msr-research-area-artificial-intelligence","msr-research-area-human-language-technologies","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[204065,204068],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"June 16, 2016","formattedExcerpt":"By\u00a0Vani Mandava, Senior Program Manager, Microsoft Research People often rank public speaking as the number one fear that they face. New cloud-based technology from researchers at the University of Rochester lets speakers polish and practice at home in front of their computer camera, while the&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/239354","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/39507"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=239354"}],"version-history":[{"count":5,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/239354\/revisions"}],"predecessor-version":[{"id":241550,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/239354\/revisions\/241550"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=239354"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=239354"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=239354"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=239354"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=239354"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=239354"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=239354"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=239354"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=239354"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=239354"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=239354"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}