{"id":616587,"date":"2019-10-23T08:00:13","date_gmt":"2019-10-23T15:00:13","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=616587"},"modified":"2022-11-07T11:41:52","modified_gmt":"2022-11-07T19:41:52","slug":"machine-teaching-luis-and-the-democratization-of-custom-ai-with-dr-riham-mansour","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/podcast\/machine-teaching-luis-and-the-democratization-of-custom-ai-with-dr-riham-mansour\/","title":{"rendered":"Machine teaching, LUIS and the democratization of custom AI with Dr. Riham Mansour"},"content":{"rendered":"<h3><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-616812 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-1024x576.png\" alt=\"headshot of Riham Mansour for the Microsoft Research podcast\" width=\"1024\" height=\"576\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-1024x576.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-300x169.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-768x432.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-1066x600.png 1066w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-655x368.png 655w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-343x193.png 343w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-640x360.png 640w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-960x540.png 960w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-1280x720.png 1280w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788.png 1400w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/h3>\n<h3>Episode&nbsp;95,&nbsp;October 16, 2019<\/h3>\n<p><span data-contrast=\"auto\">Machine learning is a powerful tool that enables conversational agents to provide general question-answer services. But in domains with more specific taxonomies \u2013 or simply for requests that are longer and more complicated than \u201cPlay Baby Shark\u201d \u2013 custom conversational AI has long been the province of large enterprises with big budgets. But not for long, thanks to the work of <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/rihamma\/\">Dr. Riham Mansour<\/a>, a Principal Software Engineering Manager for Microsoft\u2019s Language Understanding Service, or LUIS. She and her colleagues are using the emerging science of machine teaching to help domain experts build bespoke AI models with little data and no machine learning expertise.<\/span><\/p>\n<p><span data-contrast=\"auto\">On today\u2019s podcast, Dr. Mansour gives us a brief history of conversational machines at Microsoft; tells us all about LUIS, one of the first Microsoft products to deploy machine teaching concepts in real world verticals; and explains how an unlikely combination of engineering skills, science skills, entrepreneurial skills \u2013 and not taking no for an answer \u2013 helped make automated customer engagement and business functions more powerful, more accessible and more intelligent!<\/span><\/p>\n<h3>Related:<\/h3>\n<ul type=\"disc\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/podcast\">Microsoft Research Podcast<\/a>: View more podcasts on Microsoft.com<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/itunes.apple.com\/us\/podcast\/microsoft-research-a-podcast\/id1318021537?mt=2\">iTunes<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Subscribe and listen to new podcasts each week on iTunes<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/subscribebyemail.com\/www.blubrry.com\/feeds\/microsoftresearch.xml\">Email<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Subscribe and listen by email<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/subscribeonandroid.com\/www.blubrry.com\/feeds\/microsoftresearch.xml\">Android<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Subscribe and listen on Android<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/open.spotify.com\/show\/4ndjUXyL0hH1FXHgwIiTWU\">Spotify<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Listen on Spotify<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.blubrry.com\/feeds\/microsoftresearch.xml\">RSS feed<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/note.microsoft.com\/ww-registration-microsoft-research-newsletter-s.html?wt.mc_id=S-webpage_podcast\">Microsoft Research Newsletter<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Sign up to receive the latest news from Microsoft Research<\/li>\n<\/ul>\n<hr>\n<h3>Transcript<\/h3>\n<p><span data-contrast=\"auto\">Riham Mansour:<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">I don\u2019t really care where I start in the research spectrum. I might start completely solving the problem from scratch, I might start by capitalizing on other people\u2019s work, I might put pieces together to make it work\u2026 The important goal to me is to have something that works for the purpose of the customer.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host:&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">You\u2019re listening to the Microsoft Research Podcast, a show that brings you closer to the cutting-edge of technology research and the scientists behind it. I\u2019m your host, Gretchen Huizinga.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Machine learning is a powerful tool that enables conversational agents to provide general question-answer services. But in domains with more specific taxonomies \u2013 or simply for requests that are longer and more complicated than \u201cPlay Baby Shark\u201d \u2013 custom conversational AI has long been the province of large enterprises with big budgets. But not for long, thanks to the work of Dr. Riham Mansour, a Principal Software Engineering Manager for Microsoft\u2019s Language Understanding Service, or LUIS. She and her colleagues are using the emerging science of machine teaching to help domain experts build bespoke AI models with little data and no machine learning expertise.<\/span><\/b><span data-ccp-props=\"{}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">On today\u2019s podcast, Dr. Mansour gives us a brief history of conversational machines at Microsoft; tells us all about LUIS, one of the first Microsoft products to deploy machine teaching concepts in real world verticals; and explains how an unlikely combination of engineering skills, science skills, entrepreneurial skills \u2013 and not taking no for an answer \u2013 helped make automated customer engagement and business functions more powerful, more accessible and more intelligent!<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">That and much more on this episode of the Microsoft Research Podcast.<\/span><\/b><span data-ccp-props=\"{}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Riham Mansour, welcome to the podcast.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Thank you.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host:<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">I love situating my guests at the beginning of every podcast<\/span><\/b><b><span data-contrast=\"auto\">. It\u2019s&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">such a research-y term. So let\u2019s situate you: you\u2019re a Principal Software Engineering Manager and you run the Language Understanding Service, aka LUIS. And I\u2019m absolutely going to have you tell us about LUIS in&nbsp;<\/span><\/b><b><span data-contrast=\"none\">a bit<\/span><\/b><b><span data-contrast=\"none\">,&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">but let\u2019s start with the macro view of who you are and what you do. What big problems are you trying to address and what gets you up in the morning?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"auto\">Hmmm.&nbsp;<\/span><span data-contrast=\"auto\">I\u2019v<\/span><span data-contrast=\"auto\">e<\/span><span data-contrast=\"auto\">&nbsp;started that effort of the Language Understanding Service with the Machine Teaching Innovation Group almost five years ago. And we\u2019re trying to solve a very interesting problem which is, how can we get people<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and domain experts<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;who don\u2019t have a lot of machine learning expertise or even don\u2019t have data<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;or don\u2019t know what are the pieces that they need to put together to build an AI model<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"none\">S<\/span><span data-contrast=\"none\">o we\u2019re trying to get those people&nbsp;<\/span><span data-contrast=\"auto\">on board to the AI world<\/span><span data-contrast=\"auto\">\u2026<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Okay.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">\u2026<\/span><span data-contrast=\"none\">because those people have lots of problems that AI can help&nbsp;<\/span><span data-contrast=\"none\">them with<\/span><span data-contrast=\"none\">.&nbsp;<\/span><span data-contrast=\"none\">So<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;we\u2019re trying to meet<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">those people where they are today, helping them with AI<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">solutions<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;powerful solutions to their problems<\/span><span data-contrast=\"none\">.<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">In the past, AI was only coming from the giant tech companies that can afford having the AI experts and they have enough data, but&nbsp;<\/span><span data-contrast=\"none\">then<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;like<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">now, enterprises and developers who want to build intelligent systems, how can they unlock the power of AI? I think this is the exact problem we\u2019re trying to solve.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Before we get technical<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;I want to talk a little more about you<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;because you bring what I would call&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">\u2018<\/span><\/b><b><span data-contrast=\"auto\">hybrid vigor<\/span><\/b><b><span data-contrast=\"auto\">\u2019<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;to the research party. You have roots across the tech spectrum from academic research to applied research to product and engineering\u2026&nbsp;<\/span><\/b><b><span data-contrast=\"none\">And not necessarily in that order<\/span><\/b><b><span data-contrast=\"none\">!<\/span><\/b><b><span data-contrast=\"none\">&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">So tell us a bit about how all these parts make up your unified whole<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;and how it speaks to the work you do.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"auto\">Yeah, s<\/span><span data-contrast=\"auto\">o, actually,&nbsp;<\/span><span data-contrast=\"auto\">I didn\u2019t mean to be all over the place! I think the journey of my career has&nbsp;<\/span><span data-contrast=\"none\">pushed&nbsp;<\/span><span data-contrast=\"auto\">me into starting in engineering&nbsp;<\/span><span data-contrast=\"none\">and, back in the time<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;I was<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">very interested&nbsp;<\/span><span data-contrast=\"auto\">in doing software development, coding, and design<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and all that. That was my passion back then and then working in the product brings a lot of rigor and you see all the real world problems and what can be done, what cannot be done and so forth. But all throughout my career in engineering<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I always<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">had the science appetite. I like to clarify things and play with the ambiguous. And being an engineer has part of that because you need to figure things out<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;but there\u2019s more to the dimension of science than just being an engineer because you start with a bunch of hypotheses<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">w<\/span><span data-contrast=\"auto\">here<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;we know nothing about how to solve that problem, and then we start tackling the problem through the scientific method. So I always knew, during my engineering career, that at one point I want to explore the science aspect of life and, when the right time came, I joined&nbsp;<\/span><span data-contrast=\"auto\">a<\/span><span data-contrast=\"auto\">&nbsp;PhD program. But then<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;when I was done with my PhD, the question<\/span><span data-contrast=\"auto\">&nbsp;came<\/span><span data-contrast=\"auto\">&nbsp;to my mind, what should I be doing?&nbsp;<\/span><span data-contrast=\"auto\">And then,&nbsp;<\/span><span data-contrast=\"auto\">I worked a little bit as a professor because this is the thing I didn\u2019t do before my PhD. I did the engineering part. So I tried to explore options<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">T<\/span><span data-contrast=\"auto\">hat was not a job for me<\/span><span data-contrast=\"auto\">!<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"none\">Uh<\/span><span data-contrast=\"none\">\u2026<\/span><span data-contrast=\"none\">&nbsp;I<\/span><span data-contrast=\"none\">, l<\/span><span data-contrast=\"none\">ike<\/span><span data-contrast=\"none\">, t<\/span><span data-contrast=\"auto\">he job of a professor is to make a delta change in the student life<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and I love working at a fast pace with the smartest people in the world. So, this is why<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;a professor job was not for me<\/span><span data-contrast=\"auto\">!<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Move me to a faster lane.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Exactly, get me to a faster lane<\/span><span data-contrast=\"auto\">!<\/span><span data-contrast=\"auto\">&nbsp;So I joined Microsoft Research and I started exploring that sweet spot for me and that\u2019s exactly where I found my real passion. So yes, engineering\u2019s great, academic research is awesome, but what\u2019s more awesome for me was, how can I build something that solves a scientific problem but yet<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;it\u2019s useful to people?<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: You joined Microsoft Research in 2012 and you came as a senior NLP applied researcher\u2026<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yes.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: \u2026in the Advanced Technology Lab in Cairo.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yes.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: And you worked on several language innovations that ended up actually shipping in products. So tell us a bit, in turn, about the work you did in sentiment analysis, topic detection and key phrase extraction, because those are some of your big innovations.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yes<\/span><span data-contrast=\"auto\">. Back in the time,<\/span><span data-contrast=\"auto\">&nbsp;when I joined the Advanced Technology Lab in Cairo, my mission was to focus on making an impact out of whatever innovations that we work on. So<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I always start with the customer. I don\u2019t like to start with the problem that interests me, it has to be a problem that interests me and solves a problem. So at first I went and<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;talked to multiple groups who are either doing NLP at the moment, or have plans to do NLP like the&nbsp;<\/span><span data-contrast=\"auto\">Azure<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">M<\/span><span data-contrast=\"auto\">achine&nbsp;<\/span><span data-contrast=\"auto\">L<\/span><span data-contrast=\"auto\">earning team<\/span><span data-contrast=\"auto\">.&nbsp;<\/span><span data-contrast=\"auto\">So<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;when we started talking<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;then I wanted to come up with my research agenda. And at that time, like, I figured out a bunch of problems that have to do with, I would say, the basic fundamental blocks of building NLP stacks.&nbsp;<\/span><span data-contrast=\"none\">So&nbsp;<\/span><span data-contrast=\"auto\">I started abstracting the different problems I got from the different groups and tr<\/span><span data-contrast=\"auto\">ied<\/span><span data-contrast=\"auto\">&nbsp;to put it in<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">one technology that can serve multiple groups so that we can<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;really make an impact on multiple ones. And back in the time, those were the three key pieces that we landed as important across multiple groups, and they ended up landing in production for many of these groups. These are very classic NLP problems<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">that many people in the company have kind of tackled. The other main activity I did was looking at who<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;in the company<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;is doing that, right? Who in MSR or non-MSR groups<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">that are working on that actively. And then I started a bunch of collaborations. So, for example, the sentiment analysis, I found that there were two main players in that area, and I found that they are already talking, but kind of each of them is working on a different approach. And my goal was always to solve what the product group wants.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Right.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: So I was the person among the three who played that role with that collaboration between the two groups and myself. There\u2019s that example, but then there was another example of topic detection which was completely something that, for example, Bing News wanted to<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">tag their news data with topics that might not necessarily be mentioned in the news articles but<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;by finding the semantic relatedness between the content of the article and other web data, we can get to that level of detecting the topic but that is not mentioned. That work was not available in other groups and that was something we started working on and moved forward. I don\u2019t really care where I start in the research spectrum. I might start completely solving the problem from scratch, I might start by capitalizing on other people\u2019s work<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I might put pieces together to make it work\u2026 The important goal to me is to have something that works for the purpose of the customer.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Well, your work now falls under the big umbrella of Human Language Technologies, which many have called the&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">\u201cC<\/span><\/b><b><span data-contrast=\"auto\">rown&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">J<\/span><\/b><b><span data-contrast=\"auto\">ewel of AI.<\/span><\/b><b><span data-contrast=\"auto\">\u201d<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;Give us a brief overview of the HLT landscape right now, specifically this movement toward Conversational AI. What\u2019s state<\/span><\/b><b><span data-contrast=\"auto\">&#8211;<\/span><\/b><b><span data-contrast=\"auto\">of<\/span><\/b><b><span data-contrast=\"auto\">&#8211;<\/span><\/b><b><span data-contrast=\"auto\">the<\/span><\/b><b><span data-contrast=\"auto\">&#8211;<\/span><\/b><b><span data-contrast=\"auto\">art right now, and how\u2019s your work situated in it?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: So, I think I\u2019ve been, in general, interested in human languages and how to get machines to understand human languages, to maybe do more for humans in their day<\/span><span data-contrast=\"auto\">&#8211;<\/span><span data-contrast=\"auto\">to<\/span><span data-contrast=\"auto\">&#8211;<\/span><span data-contrast=\"auto\">day. So,&nbsp;<\/span><span data-contrast=\"auto\">part of that has been the Conversational AI space. This is one vertical I would say that emerged from the fact that we can make it possible for machines to understand human languages. Then that unlocks a bunch of opportunities. For example, how do we do customer support today? Customer support is all about agents talking to humans trying to solve their problems. If we can automate pieces, we can save those enterprises a lot of money, right? There\u2019s other verticals within Conversational AI like finance and banking and you need to do more task completion. So between<\/span><span data-contrast=\"auto\">, like,&nbsp;<\/span><span data-contrast=\"auto\">customer support, question answering, and task completion that is very specific to the business, I think that\u2019s where the HLT comes into play in the Conversational AI space. Because businesses have started paying attention to the fact that that can help them a lot with changing the way they do business today<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">T<\/span><span data-contrast=\"auto\">here was a lot of traction to that space and that<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;right away<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;rang a bell for me. And I think this is the part I love to play at. Like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;this is where I bring in my engineering skills, my science skills, and I would say<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;even<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;my entrepreneurial skills into<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;looking at<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;how can we take that technology and make it work for that specific vertical to solve that specific problem?<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><i><span data-contrast=\"auto\">(music plays)<\/span><\/i><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: I want to turn our attention specifically to machine teaching for a second because it\u2019s the technical foundation of what we\u2019ll spend most of our time talking about today. I recently had your colleague<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;Patrice Simard<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;on the podcast, and he gave us a fantastic overview of machine teaching. But for those people who didn\u2019t hear that podcast (and they can go back and hear it if they want<\/span><\/b><b><span data-contrast=\"auto\">!<\/span><\/b><b><span data-contrast=\"auto\">) and even for those who might have heard it but can\u2019t remember everything<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;let\u2019s review. What is machine teaching and how is it different from traditional machine learning?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: The goal of machine teaching and traditional machine learning is to build an accurate model<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">S<\/span><span data-contrast=\"auto\">ame goal<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;right<\/span><span data-contrast=\"auto\">?<\/span><span data-contrast=\"auto\">&nbsp;So a user who\u2019s using either<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;would have the goal in mind to build a model, a good model, right? But then, the&nbsp;<\/span><span data-contrast=\"auto\">\u2018<\/span><span data-contrast=\"auto\">what<\/span><span data-contrast=\"auto\">\u2019<\/span><span data-contrast=\"auto\">&nbsp;and&nbsp;<\/span><span data-contrast=\"auto\">\u2018<\/span><span data-contrast=\"auto\">how<\/span><span data-contrast=\"auto\">\u2019<\/span><span data-contrast=\"auto\">&nbsp;is what\u2019s different. So usually to build any model from data you need to have some knowledge that exists somewhere. In machine teaching, it\u2019s about extracting the knowledge from the teacher<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;so it has the human-in-the-loop providing the necessary knowledge about the domain, so that we can build an AI model specific to that domain. Traditional machine learning is about extracting knowledge from data. So<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;using the compute power to extract the knowledge from huge amounts of data<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and that\u2019s where deep learning and other key words<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">transferred lea<\/span><span data-contrast=\"auto\">r<\/span><span data-contrast=\"auto\">ning<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;come into play. So when and why machine teaching can be useful<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I would say, in situations where there isn\u2019t enough label<\/span><span data-contrast=\"auto\">ed<\/span><span data-contrast=\"auto\">&nbsp;data already available and you want to build&nbsp;<\/span><span data-contrast=\"auto\">a<\/span><span data-contrast=\"auto\">&nbsp;custom AI model that\u2019s specific to your domain, but you don\u2019t have machine learning expertise. Between the three pillars that I just mentioned, this is when machine teaching shines as a good solution versus traditional machine learning. If a problem has lots of label<\/span><span data-contrast=\"auto\">ed<\/span><span data-contrast=\"auto\">&nbsp;data<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;just go on with traditional machine learning because deep learning would shine way better, but machine teaching is when you don\u2019t have data, you don\u2019t have machine learning expertise<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and you want to build a custom model.&nbsp;<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host:&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">Mmm<\/span><\/b><b><span data-contrast=\"auto\">-hmm.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"none\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"none\">So machine teaching is all about custom AI when you don\u2019t have labels or when you don\u2019t have machine lea<\/span><span data-contrast=\"none\">r<\/span><span data-contrast=\"none\">ning expertise<\/span><span data-contrast=\"none\">.<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">T<\/span><span data-contrast=\"none\">his is exactly the problem we\u2019re solving. And&nbsp;<\/span><span data-contrast=\"none\">we\u2019re providing the first programming language of AI. What we\u2019re providing is a teaching language for humans to teach the machine so that we can build an AI model in the background. So the way we extract the knowledge from the teacher is basically by offering some language they can communicate to the tool with and we translate that language that humans provide into a model. And that\u2019s exactly where the customization part comes into play. So<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;for example<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;you have a bunch of vocabulary that\u2019s very specific to the domain. And, in machine teaching, we give you a venue to provide that specific vocabulary\u2026<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"none\">Host: To feed those words in.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"none\">Riham Mansour: Exactly. And it\u2019s not only words<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;because in machine teaching we have a lot of analogy between machine teaching and programming<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;so we\u2019re trying to learn from the six decades of programming<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;how to build AI models<\/span><span data-contrast=\"none\">.<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">W<\/span><span data-contrast=\"none\">e look into programming and we see how developers build their programs. The first thing they do is they design and decompose<\/span><span data-contrast=\"none\">, right?<\/span><span data-contrast=\"none\">&nbsp;So it\u2019s hard to solve a complex problem<\/span><span data-contrast=\"none\">. W<\/span><span data-contrast=\"none\">e have to divide and conquer so that we can share pieces of code, re-use pieces of code<\/span><span data-contrast=\"none\">\u2026<\/span><span data-contrast=\"none\">&nbsp;that\u2019s exactly the core of machine teaching.&nbsp;<\/span><span data-contrast=\"none\">And that\u2019s why w<\/span><span data-contrast=\"none\">e\u2019re building custom AI models in a different way, different from traditional machine learning.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Let\u2019s talk about LUIS<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;Microsoft\u2019s, what you call, entry point into the machine teaching market.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yes.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: You founded it in collaboration with the Machine Teaching group in Microsoft Research in 2015\u2026<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yes.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: \u2026and then it moved from research to product landing in Office just this year.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yes.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: So this is sort of multi<\/span><\/b><b><span data-contrast=\"auto\">&#8211;<\/span><\/b><b><span data-contrast=\"auto\">level, progressive question<\/span><\/b><b><span data-contrast=\"auto\">\u2026<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;forgive me for that<\/span><\/b><b><span data-contrast=\"auto\">?<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">A<\/span><\/b><b><span data-contrast=\"auto\">nd I\u2019ll circle back if necessary<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;but tell us the story of how LUIS was born, how it grew, where it is now, and what aspirations it has for the future.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"auto\">Mm-hmm. Mm-hmm.&nbsp;<\/span><span data-contrast=\"auto\">So back in 2014, the Advanced Technology Lab where I was working got re<\/span><span data-contrast=\"auto\">&#8211;<\/span><span data-contrast=\"auto\">orged<\/span><span data-contrast=\"auto\">&nbsp;to Xuedong Huang, XD,<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">who is running the speech services in the company. And XD was fascinated by solving real<\/span><span data-contrast=\"auto\">&#8211;<\/span><span data-contrast=\"auto\">life problems. And we had that expertise in natural language processing<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;but then he wanted us to do a bigger impact, by kind of taking the technology even further to adopt millions of users. Back in the time<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;we were looking at Wit.ai that Facebook acquired. And Microsoft was looking at the technology and started saying oh, the virtual assistan<\/span><span data-contrast=\"auto\">ts<\/span><span data-contrast=\"auto\">&nbsp;space, that\u2019s where we need the kind of Wit.ai technology<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">A<\/span><span data-contrast=\"auto\">nd then we looked around and we said, hey, why don\u2019t we build it ourselves? And XD, back then, believed that we have the right talent to build that.&nbsp;<\/span><span data-contrast=\"none\">So the task was basically<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;we need to put Microsoft in that space of virtual assistants. How can we build a bunch of tools that can enable<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">different&nbsp;<\/span><span data-contrast=\"none\">enterprises to build their own virtual assistant<\/span><span data-contrast=\"none\">s?&nbsp;<\/span><span data-contrast=\"none\">But then, w<\/span><span data-contrast=\"none\">hat if<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">an enterprise company or a bank wants to build their own assistant to help their customers or to serve their internal employees<\/span><span data-contrast=\"none\">?<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">T<\/span><span data-contrast=\"none\">hen we need a bunch of tools, right<\/span><span data-contrast=\"none\">?<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">So language understanding has been a key part in the speech stack, so speech comes as an audio<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;translated into text using the Automatic Speech Recognition (ASR)<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and then out of that text, we need to apply language understanding, right? To extract what is the user intention, what are the key entities or key words in the utterance.&nbsp;<\/span><span data-contrast=\"none\">But then<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;understanding the content of the utterance is very important, right<\/span><span data-contrast=\"none\">?<\/span><span data-contrast=\"none\">&nbsp;Translating the<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">unstructured data<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;or human language<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;into a structure that the machine can understand and act upon is the stage what we call language understanding.&nbsp;<\/span><span data-contrast=\"auto\">So, XD started tasking us with that and then&nbsp;<\/span><span data-contrast=\"none\">we looked around in the company, like, with my practical mentality, should we just go ahead and<\/span><span data-contrast=\"none\">&nbsp;uh,&nbsp;<\/span><span data-contrast=\"none\">like, uh,&nbsp;<\/span><span data-contrast=\"none\">build something from scratch, because there isn\u2019t any technology that we can leverage, or should we just leverage something? And<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;back in the time, I got to know Patrice Simard, who is, like, I would say, the godfather of machine teaching, and we figured out that that technology can, with more tweaking, can work really well in building a third<\/span><span data-contrast=\"none\">&#8211;<\/span><span data-contrast=\"none\">party offering for language understanding.&nbsp;<\/span><span data-contrast=\"none\">B<\/span><span data-contrast=\"none\">ut&nbsp;<\/span><span data-contrast=\"none\">w<\/span><span data-contrast=\"auto\">hen we started the journey, we didn\u2019t have really in mind that we were building that product that I can see today. We were testing the water, I would say, because the whole market was new, there wasn\u2019t any of the tech giants playing in that space. Back in 2014 even, bots were not trendy, right? So we didn\u2019t know what\u2019s possible, why that technology is useful. We knew that Microsoft needs to play a key role in the virtual assistant space, right? Or the Conversational AI space\u2026<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Yeah.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: \u2026but we didn\u2019t know how that would look like, what the shape of the market or any of that. So we tested the water, we took some baby steps<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I would say,<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">so we got the technology, catered it for the Conversational AI space.&nbsp;<\/span><span data-contrast=\"none\">We branded it LUIS, and it became one of the early cognitive services when&nbsp;<\/span><span data-contrast=\"none\">c<\/span><span data-contrast=\"none\">ognitive services went out.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"none\">Host:&nbsp;<\/span><\/b><b><span data-contrast=\"none\">J<\/span><\/b><b><span data-contrast=\"none\">ust to clarify<\/span><\/b><b><span data-contrast=\"none\">,<\/span><\/b><b><span data-contrast=\"none\">&nbsp;LUIS stood for Language Understanding Intelligence Service and you still call it LUIS but you\u2019ve dropped the&nbsp;<\/span><\/b><b><span data-contrast=\"none\">\u201c<\/span><\/b><b><span data-contrast=\"none\">intellige<\/span><\/b><b><span data-contrast=\"none\">nt.\u201d<\/span><\/b><b><span data-contrast=\"none\">&nbsp;<\/span><\/b><b><span data-contrast=\"none\">I<\/span><\/b><b><span data-contrast=\"none\">t\u2019s just Language Understanding Service?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"none\">Riham Mansour: Ye<\/span><span data-contrast=\"none\">s,&nbsp;<\/span><span data-contrast=\"none\">becaus<\/span><span data-contrast=\"none\">e&nbsp;<\/span><span data-contrast=\"auto\">back in the time, we just launched the Language Understanding Intelligence Service, acronym LUIS, and then<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;later on, with the marketing team and the branding team, we dropped the word \u2018intelligent\u2019 and we kept the Language Understanding Service, but the acronym LUIS had a lot of mindshare by th<\/span><span data-contrast=\"auto\">at<\/span><span data-contrast=\"auto\">&nbsp;time and we kept it. So, LUIS, when we launched it in 2015<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;in private preview, we were only lining up<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I would say<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">two hundred<\/span><span data-contrast=\"auto\">&nbsp;developers. We just wanted&nbsp;<\/span><span data-contrast=\"auto\">two hundred&nbsp;<\/span><span data-contrast=\"auto\">developers to come and use the system so that we can understand how they can use it, why it\u2019s useful and so forth. And then we got a queue of 10K developers!<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Ten thousand\u2026<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"auto\">Ask\u2026&nbsp;<\/span><span data-contrast=\"auto\">Yeah<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;ten thousand! Asking&nbsp;<\/span><span data-contrast=\"none\">for the service,&nbsp;<\/span><span data-contrast=\"auto\">to access the service. And the problem back then is, we needed a lot of engineering work to make it scale and really work<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;but the traction we got in the market<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and the fact that other companies are investing in that\u2026 so&nbsp;<\/span><span data-contrast=\"auto\">because of that traction, XD and Harry Shum said<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;okay, we need to invest more in making this a product. So I got a little bit more engineering resources and I worked closely with Patrice and his Machine Teaching Group to move that forward with more features, build it at scale, and make it work for enterprise. And then, in Ignite in 2015, it was the first time to support a non-English language in LUIS.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Oh, wow.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"none\">Riham Mansour: So we supported Chinese. So, XD and Harry announced the Chinese support for LUIS in China. And then<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;we started landing more and more customers<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;over time<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;and we\u2019re<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;today<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;at hundreds of thousands of customers using our platform. And now, Conversational AI is a thing<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;and all the giant companies are players in this space and, interesting enough, at first<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;we wanted to enable speech interfaces to some devices. Later on, there was a text-based chat bot. But then even<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;I would say<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;interactive gaming is coming into play. So there were scenarios we haven\u2019t thought through when we built the product, but then we found that some of the customers are using it just for that, right? So, see? This is exactly what gets me up in the morning, coming to the office. You feel like you\u2019re doing something that is very leading in the market. We\u2019re creating that new market, we\u2019re drawing the features of that new market, we\u2019re defining it right? So, that is, like, lots of fun! But then<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;the journey of LUIS didn\u2019t stop there. We took it all the way to general availability on Azure, and it became<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;like<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;a generally available service with an SLA and all that, right? So it became<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;really<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;a more mature product, I would say, towards the end of 2017. At some point<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;we said, okay, here\u2019s the machine teaching technology in the form of a technology that serves Conversational AI, but machine teaching is a way of doing custom AI models<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;and the input could be a signal, or image, or text. LUIS is very focused on text, but then we wanted to look into how can we make even a bigger scope of LUIS to solve other problems in the text space, because that\u2019s my area of expertise.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Right.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Uh, right? So I\u2019m kind of biased<\/span><span data-contrast=\"auto\">\u2026<\/span><span data-contrast=\"auto\">&nbsp;but then, in March 2018, we put together a proposal for growing the scope of LUIS to be able to use machine teaching<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;but to do processing of long documents. So basically, enabling customers to build custom document classifiers, entity extractors, which are very key to the document processing pipelines, but custom models, right? And that\u2019s the reason behind the recent re-org, first unifying the Machine Teaching Science Group with the product<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;which is LUIS, and putting them together in one group in Office. So now we\u2019re serving Conversational AI over Azure and Office and we\u2019re serving document understanding in Office and Azure as well.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><i><span data-contrast=\"auto\">(music plays)<\/span><\/i><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: This is the part of the podcast where I ask what keeps you up at night<\/span><\/b><b><span data-contrast=\"auto\">\u2026<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"auto\">Mmmm<\/span><span data-contrast=\"auto\">!<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: \u2026a<\/span><\/b><b><span data-contrast=\"auto\">nd we\u2019ve been talking about a couple of ideas that could have unintended consequences<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;like giving machines human language capabilities<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;and giving humans who have no expertise in ML&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">the&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">tools to build their own models.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: You know, when we\u2019re creating a new market<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;or redefining the way people do businesses \u2013 and this is not specific to that area but<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;in general<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;on the edge between science and product \u2013 there exists a lot of unknowns<\/span><span data-contrast=\"auto\">, right?<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Right.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: And a lot of questions and assumptions that we make on the way because of who we are, right? But then, how much would that resonate with real people when we meet them where they are, is a different question. So what keeps me up at night is the general question of<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;would that product be successful or not? How can we make it useful? What problems is it trying to solve that it\u2019s not solving today, and it\u2019s supposed to be solving? These unanswered questions<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and those assumptions that we take from the technology putting it in the product<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;is what keeps me up at night<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">B<\/span><span data-contrast=\"auto\">ecause if we do it right, if we keep validating<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and be humble to take feedback from customers<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and do&nbsp;<\/span><span data-contrast=\"none\">that<\/span><span data-contrast=\"none\">,&nbsp;<\/span><span data-contrast=\"auto\">that is<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;kind of a solution to this anxiety that I might have. But I figured out that process of how to collect feedback, how to speak to customers, what language are we speaking to customers<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and so forth. So you can translate that into a science problem that you communicate back to the science team to solve it. So I think this is exactly the dynamic I\u2019m kind of good at, or the thing I\u2019m doing day to day, is like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;speaking to the science people, speaking to my engineering team, and speaking to the customers<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">T<\/span><span data-contrast=\"auto\">hose three key stakeholders<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;you need to do a lot of translation in the loop to get it right. That kind of loop<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and these kind of questions<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and the input I get from customers<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;is what keeps me up at night: how to put it together, how to translate it into a problem that I give back to the science team and say<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;hey, this is what we need to solve.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: You\u2019ve an interesting<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;and somewhat peripatetic<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;story. I love that I could use that word in a podcast. How did you get started in computer science, where has your journey taken you, and how did you end up at Microsoft doing the work you\u2019re doing today?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: It\u2019s pretty interesting. So, uh, when I, um finished high school<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I wasn\u2019t really sure what I wanted to do. Yeah, I wasn\u2019t sure. Today I know what I want really well<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;but back in the time<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;I didn\u2019t know what I want. And computer science<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;in the 90s<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;it was like&nbsp;<\/span><span data-contrast=\"auto\">a&nbsp;<\/span><span data-contrast=\"auto\">pretty new field<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">L<\/span><span data-contrast=\"auto\">ike, students didn\u2019t major in computer science a lot, it was pretty trendy, but nobody figured out<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;what should we do with it.<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"auto\">Only a couple of companies that existed back then, out of the giants, were Microsoft and IBM<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;right<\/span><span data-contrast=\"auto\">?<\/span><span data-contrast=\"auto\">&nbsp;There wasn\u2019t Facebook, there wasn\u2019t Google, so we didn\u2019t even know the size of the job market as a student in high school. So I grew in Cairo, in Egypt, and, back in the time,&nbsp;<\/span><span data-contrast=\"auto\">there was&nbsp;<\/span><span data-contrast=\"auto\">Microsoft and there was an IBM<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;and this is all what I knew about the world back then, right? But when I went in college, at first I decided to go to<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">medical school because my parents wanted me to go to medical school. But this didn\u2019t resonate well with me, so\u2026 so because I have a lot of passion to science and physics and math and all that\u2026 and my dad is a mathematician, so I had a lot of passion towards math since I was a kid, and problem<\/span><span data-contrast=\"auto\">&#8211;<\/span><span data-contrast=\"auto\">solving and all that. But you know, at that age, I didn\u2019t know what I really love and it\u2019s hard to recognize yourself at the time. So I get in college and then I decided not to do&nbsp;<\/span><span data-contrast=\"auto\">medicine and then I started exploring. I explored accounting, I explored the economics, I explored marketin<\/span><span data-contrast=\"auto\">g, I explored a bunch of things\u2026<\/span><span data-contrast=\"auto\">&nbsp;and computer science. And, from the very first computer science class, it was awesome<\/span><span data-contrast=\"auto\">!<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">T<\/span><span data-contrast=\"auto\">his is the thing I want<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">P<\/span><span data-contrast=\"auto\">roblem solving, right? It resonated a lot with me, but I liked the fact that I did the homework of exploring other options so<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;when I went in computer science, lots of people said it\u2019s a hard field, like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;you will work day and night, you will only deal with machines, and that stuff, right? But I loved it.&nbsp;<\/span><span data-contrast=\"auto\">And&nbsp;<\/span><span data-contrast=\"auto\">when I graduated<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;the last semester, it\u2019s interesting<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;because Microsoft, back in the time, was sending recruiters to Cairo to recruit people from my college.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Which college was that?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: American University in&nbsp;<\/span><span data-contrast=\"auto\">Cairo<\/span><span data-contrast=\"auto\">.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Okay.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: And it was kind of interesting because&nbsp;<\/span><span data-contrast=\"none\">the top people in class used to go to Microsoft<\/span><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\">&nbsp;so it was kind of a good prestige if you get an offer from Microsoft<\/span><span data-contrast=\"none\">&nbsp;<\/span><span data-contrast=\"none\">but<\/span><span data-contrast=\"none\">,&nbsp;<\/span><span data-contrast=\"auto\">back in the time, me and another colleague of mine<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;are the only people in our class who got an offer from Microsoft here in Redmond. But my parents didn\u2019t want me to come here by myself and leave them.&nbsp;<\/span><span data-contrast=\"none\">I started my career \u2013&nbsp;<\/span><span data-contrast=\"none\">because&nbsp;<\/span><span data-contrast=\"auto\">I stayed back in Cairo<\/span><span data-contrast=\"auto\">&nbsp;\u2013&nbsp;<\/span><span data-contrast=\"auto\">I started my career in IBM, alternatively, and&nbsp;<\/span><span data-contrast=\"auto\">that\u2019s where&nbsp;<\/span><span data-contrast=\"auto\">I started as a full stack developer and later, a dev manager. That\u2019s how I started my journey in computer science. But in IBM, I learned lots of rigor, lots of discipline, the corporate world, and<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;like<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;it was a good learning that prepared me a lot to where I am today.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Tell us something we don\u2019t know about you Riham.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Okay.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Any interesting or defining moments in life, an epiphany<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;experience, a characteristic, that has defined your direction, personally?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"auto\">T<\/span><span data-contrast=\"auto\">here are two things I love to do. I love to build dreams and achieve them! So I love to live the dream first before I achieve it. That\u2019s me, yeah, that\u2019s why I\u2019m into that business. I think the one thing that keeps me going is, I don\u2019t take no as an answer. So I always try to find another path to my dream<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">&nbsp;<\/span><span data-contrast=\"auto\">A<\/span><span data-contrast=\"auto\">nd I have to build the dream, embrace it myself, so that I can get my team to execute on it. Those are the two key things that I would say characterize me or define who I am.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Have you been like that since you were little?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yes, I would say, yes<\/span><span data-contrast=\"auto\">!<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: How did that go with your mom and dad?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: You know it\u2019s interesting, because I was not a&nbsp;<\/span><span data-contrast=\"auto\">\u2018<\/span><span data-contrast=\"auto\">no<\/span><span data-contrast=\"auto\">\u2019<\/span><span data-contrast=\"auto\">&nbsp;person to my parents.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: Okay.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Yeah, not at all. And I\u2019m not a&nbsp;<\/span><span data-contrast=\"auto\">\u2018<\/span><span data-contrast=\"auto\">no<\/span><span data-contrast=\"auto\">\u2019<\/span><span data-contrast=\"auto\">&nbsp;person in general, but I don\u2019t take no as an answer. So if I want something, I want it so much that you might tell me no in one door, but I will go try to open another door so that I get a yes. So, I keep trying and, you know, I\u2019ve learned in life that there isn\u2019t anybody who wanted something very much and they didn\u2019t get it. You always get what you really want so much.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: At the end of every podcast I give my guests the proverbial last word and our audience is a really eclectic mix of researchers and&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">devs<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;and other interested parties<\/span><\/b><b><span data-contrast=\"auto\">\u2026 S<\/span><\/b><b><span data-contrast=\"auto\">o here\u2019s your chance to give some parting advice or thoughts to anyone across the tech spectrum who might be interested in joining the effort to build natural language capabilities into talking machines.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour:&nbsp;<\/span><span data-contrast=\"auto\">Mmm<\/span><span data-contrast=\"auto\">-hmmm.&nbsp;<\/span><span data-contrast=\"auto\">I would say the first thing<\/span><span data-contrast=\"auto\">,<\/span><span data-contrast=\"auto\">&nbsp;you have to have the passion for that because it\u2019s not a straightforward domain. It\u2019s not well<\/span><span data-contrast=\"auto\">&#8211;<\/span><span data-contrast=\"auto\">defined yet, so it will be a journey for you. And the other thing is, embrace the signs. You need to learn what\u2019s going on in that space, learn about the state-of-the-art, get to know what other people did well and succeeded in and failed at because that\u2019s very key right. And then, watch for real problems to solve. Don\u2019t try to just go with the crowd, after a trend, a technology<\/span><span data-contrast=\"auto\">, or\u2026 no. Y<\/span><span data-contrast=\"auto\">ou need to do a lot of thinking around, like, how can I leverage whatever I get as input from the science world into solving a problem? I would encourage everyone to&nbsp;<\/span><span data-contrast=\"none\">kind of&nbsp;<\/span><span data-contrast=\"auto\">be very practical, look at real world problems and then work it backwards. So instead of starting by the excitement to the technology, start by the problem and see what technology would solve that problem.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host: All right. So let\u2019s just extrapolate there as we finish up. What\u2019s next for Riham and what\u2019s next for LUIS?<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"none\">Riham Mansour: So the dream is to have millions of teachers using our AI programming language to build custom&nbsp;<\/span><span data-contrast=\"none\">AI&nbsp;<\/span><span data-contrast=\"none\">models<\/span><span data-contrast=\"none\">!<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host:<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;And not taking no for an answer.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: And not taking no for an answer<\/span><span data-contrast=\"auto\">!<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><span data-contrast=\"auto\">Host:<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;Riham Mansour<\/span><\/b><b><span data-contrast=\"auto\">,<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;it\u2019s been so great having you in the booth today<\/span><\/b><b><span data-contrast=\"auto\">.<\/span><\/b><b><span data-contrast=\"auto\">&nbsp;<\/span><\/b><b><span data-contrast=\"auto\">T<\/span><\/b><b><span data-contrast=\"auto\">hanks for coming on.<\/span><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\">Riham Mansour: Thank you.<\/span><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><i><span data-contrast=\"auto\">(music plays)<\/span><\/i><\/b><span data-ccp-props=\"{\"201341983\":0,\"335559685\":720,\"335559740\":240,\"335559991\":720,\"469777462\":[1620],\"469777927\":[0],\"469777928\":[1]}\">&nbsp;<\/span><\/p>\n<p><b><i><span data-contrast=\"auto\">Host:&nbsp;<\/span><\/i><\/b><b><i><span data-contrast=\"auto\">To learn more about Dr. Riham Mansour, and the world of bespoke AI powered by machine teaching, visit Microsoft.com\/research<\/span><\/i><\/b><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Machine learning is a powerful tool that enables conversational agents to provide general question-answer services. But in domains with more specific taxonomies \u2013 or simply for requests that are longer and more complicated than \u201cPlay Baby Shark\u201d \u2013 custom conversational AI has long been the province of large enterprises with big budgets. But not for long, thanks to the work of Dr. Riham Mansour, a Principal Software Engineering Manager for Microsoft\u2019s Language Understanding Service, or LUIS. She and her colleagues are using the emerging science of machine teaching to help domain experts build bespoke AI models with little data and no machine learning expertise.<\/p>\n<p>On today\u2019s podcast, Dr. Mansour gives us a brief history of conversational machines at Microsoft; tells us all about LUIS, one of the first Microsoft products to deploy machine teaching concepts in real world verticals; and explains how an unlikely combination of engineering skills, science skills, entrepreneurial skills \u2013 and not taking no for an answer \u2013 helped make automated customer engagement and business functions more powerful, more accessible and more intelligent!<\/p>\n","protected":false},"author":39507,"featured_media":616812,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"https:\/\/player.blubrry.com\/id\/50869289","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[240054],"tags":[243822,187404,243813,243819,243831,243816,202491,202511,243834,243825,243828],"research-area":[13556,13545,13554],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-616587","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-msr-podcast","tag-automated-customer-engagement","tag-conversational-agents","tag-conversational-ai","tag-conversational-machines","tag-custom-ai","tag-language-understanding-service","tag-luis","tag-machine-teaching","tag-microsoft-research-podcast","tag-question-answer-services","tag-riham-mansour","msr-research-area-artificial-intelligence","msr-research-area-human-language-technologies","msr-research-area-human-computer-interaction","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"https:\/\/player.blubrry.com\/id\/50869289","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","featured_image_thumbnail":"<img width=\"960\" height=\"540\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-960x540.png\" class=\"img-object-cover\" alt=\"headshot of Riham Mansour for the Microsoft Research podcast\" decoding=\"async\" loading=\"lazy\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-960x540.png 960w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-300x169.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-768x432.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-1024x576.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-1066x600.png 1066w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-655x368.png 655w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-343x193.png 343w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-640x360.png 640w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788-1280x720.png 1280w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2019\/10\/Riham-Mansour-_Podcast__Site_10_2019_1400x788.png 1400w\" sizes=\"auto, (max-width: 960px) 100vw, 960px\" \/>","byline":"","formattedDate":"October 23, 2019","formattedExcerpt":"Machine learning is a powerful tool that enables conversational agents to provide general question-answer services. But in domains with more specific taxonomies \u2013 or simply for requests that are longer and more complicated than \u201cPlay Baby Shark\u201d \u2013 custom conversational AI has long been the&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/616587","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/39507"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=616587"}],"version-history":[{"count":6,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/616587\/revisions"}],"predecessor-version":[{"id":896319,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/616587\/revisions\/896319"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/616812"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=616587"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=616587"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=616587"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=616587"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=616587"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=616587"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=616587"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=616587"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=616587"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=616587"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=616587"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}