{"id":235463,"date":"2015-02-18T06:00:00","date_gmt":"2015-02-18T06:00:00","guid":{"rendered":"https:\/\/blogs.technet.microsoft.com\/inside_microsoft_research\/2015\/02\/18\/2015-oscars-prediction-model-navigates-backlash-outrage-shifting-sentiment\/"},"modified":"2016-07-20T07:29:30","modified_gmt":"2016-07-20T14:29:30","slug":"2015-oscars-prediction-model-navigates-backlash-outrage-shifting-sentiment","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/2015-oscars-prediction-model-navigates-backlash-outrage-shifting-sentiment\/","title":{"rendered":"2015 Oscars Prediction Model Navigates Backlash, Outrage, Shifting Sentiment"},"content":{"rendered":"<p class=\"posted-by\">Posted by <span class=\"author\">George Thomas Jr.<\/span><\/p>\n<table style=\"width:100%\" border=\"0\">\n<tbody>\n<tr>\n<td><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/Ava-DuVernay-by-Atsushi-Nishijima_550.png\"><img decoding=\"async\" alt=\" \" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/Ava-DuVernay-by-Atsushi-Nishijima_550.png\" border=\"0\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/td>\n<\/tr>\n<tr>\n<td>\n<p><span style=\"font-size:x-small\"><strong>\"Selma\" director Ava DuVernay wasn't nominated, but she still could affect who wins the Oscar.<\/strong><br \/>(Photo by Atsushi-Nishijima. &copy;2014 Paramount Pictures)<\/span><\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>(<strong>Editor's Note<\/strong>: <em>Researcher David Rothschild is receiving <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" title=\"significant press coverage \" href=\"http:\/\/www.bing.com\/news\/search?q=david+rothschild+microsoft&qs=LS&form=NWBQBN&pq=david+rothschild&sc=8-16&sp=1&sk=\">significant press coverage <span class=\"sr-only\"> (opens in new tab)<\/span><\/a>the day after the Oscars as he correctly predicted 20 of 24 awards<\/em>) <\/p>\n<p>While it may be difficult to name a year in which <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"The Oscars\" href=\"http:\/\/oscar.go.com\/nominees\" target=\"_blank\">The Oscars<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> were not embroiled in some controversy regarding nominees, this year seems particularly pronounced, with <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"widespread criticism spanning numerous categories\" href=\"http:\/\/talkingpointsmemo.com\/livewire\/oakland-tribune-oscar-best-caucasian\" target=\"_blank\">widespread criticism spanning numerous categories<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, mainly objecting to the lack of nominations for &ldquo;<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Selma\" href=\"http:\/\/www.imdb.com\/title\/tt1020072\/\" target=\"_blank\">Selma<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>,&rdquo; and, on a light-hearted note, incredulity about &ldquo;<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"The Lego Movie\" href=\"http:\/\/www.imdb.com\/title\/tt1490017\/\" target=\"_blank\">The Lego Movie<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>&rdquo; not receiving an Animated Feature Film nomination.<\/p>\n<table align=\"right\" style=\"width:275px\" border=\"0\">\n<tbody>\n<tr>\n<td><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/Alejandro-inarritu-emmanuel-lubezki_265.jpg\"><img decoding=\"async\" alt=\" \" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/Alejandro-inarritu-emmanuel-lubezki_265.jpg\" border=\"0\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/td>\n<\/tr>\n<tr>\n<td>\n<p><span style=\"font-size:x-small\"><strong>\"Birdman\" director and co-writer&nbsp;Alejandro Gonz&aacute;lez I&ntilde;&aacute;rritu with cinematographer Emmanuel Lubezki.&nbsp;<\/strong>&nbsp;(Photo by Alison Rosa. &copy;2014 Fox Searchlight)<\/span><\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>To mis-paraphrase a song from that excluded film, everything is not awesome in Oscar-nomination land.<\/p>\n<p>Yet, as Microsoft researcher <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"David Rothschild\" href=\"http:\/\/researchdmr.com\/\" target=\"_blank\">David Rothschild<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"@DavMicRot\" href=\"https:\/\/x.com\/DavMicRot\" target=\"_blank\">@DavMicRot<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>) notes, that doesn&rsquo;t mean the un-nominated can&rsquo;t affect the Oscar winners in those &ldquo;disputed&rdquo; categories. &ldquo;Absence in the category makes a difference in the distribution of votes for the remaining choices,&rdquo; he says.<\/p>\n<p>Rothschild, an economist with <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Microsoft&rsquo;s New York City research lab\" href=\"http:\/\/research.microsoft.com\/en-us\/labs\/newyork\/\" target=\"_blank\">Microsoft&rsquo;s New York City research lab<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, specializes in predictive analytics. His model correctly predicted 21 of 24 Oscar winners last year and 19 of 24 winners in 2013. But he says the &ldquo;Selma&rdquo; controversy is having a &ldquo;particularly interesting&rdquo; effect on this year&rsquo;s predictions.<\/p>\n<p>&ldquo;As this controversy ebbed and flowed over the last few weeks, we had to make sure to take into account how it may affect the final votes,&rdquo; he says, noting some key factors that affect the prediction model:<\/p>\n<ul>\n<li>The Oscars governing body, the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Academy of Motion Picture Arts and Sciences\" href=\"http:\/\/en.wikipedia.org\/wiki\/Academy_of_Motion_Picture_Arts_and_Sciences\" target=\"_blank\">Academy of Motion Picture Arts and Sciences<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, has a complicated nomination and voting structure with subsets of voters who can nominate in specific categories while being able to vote for winners in most categories.\n<\/li>\n<li>Voting starts February 15, and lasts until the night Oscars are announced, making final voter decisions elusive.<\/li>\n<\/ul>\n<p>So how can a prediction model successfully account for voters&rsquo; shifting sentiment?<\/p>\n<p>&ldquo;Whenever I create predictions I focus on several attributes beyond accuracy, including flexibility, scalability, and timeliness,&rdquo; Rothschild says, noting timeliness &#8212; ensuring the prediction is constantly updated with the latest information &#8212; as particularly problematic.<\/p>\n<p>But what among the &ldquo;latest information&rdquo; is reliably predictive? &ldquo;One way to take this into account is to follow the public opinion on the topic and assume that public opinion will translate into pressure on the voters,&rdquo; Rothschild says. However, he notes, &ldquo;public opinion is only loosely related to winners in the Oscars, because the sentiment and expectations of the general public is closely tied to name recognition and popularity.&rdquo;<\/p>\n<table align=\"right\" style=\"width:275px\" border=\"0\">\n<tbody>\n<tr>\n<td><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/david-rothschild_265.png\"><img decoding=\"async\" alt=\" \" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/david-rothschild_265.png\" border=\"0\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/td>\n<\/tr>\n<tr>\n<td>\n<p><strong><span style=\"font-size:x-small\">Microsoft researcher David Rothschild says prediction markets are reliable indicators of how people will vote.<\/span>&nbsp;<\/strong>&nbsp;<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Rothschild says it&rsquo;s also difficult to match public opinion to a specific category, and, further complicating matters, &ldquo;there are not even many alternatives to express dissatisfaction in the nomination process in that there is no clear movie for people to support in lieu of Selma&rsquo;s lack of nominations.&rdquo;<\/p>\n<p>Which is why once the Oscar voting starts his focus shifts to prediction markets.<\/p>\n<p>&ldquo;Prediction markets follow a select group of people who have high levels of information on what voters will do and are willing to wager real-money on the outcomes,&rdquo; he says. &ldquo;And, prediction market-based forecasts have been incredibly accurate,&rdquo; hence the aforementioned successful predictions of previous years&rsquo; Oscar winners.<\/p>\n<p>So, aside from what is relatively unpredictable, what is the model predicting now?<\/p>\n<ul>\n<li>Best Film: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Birdman\" href=\"http:\/\/www.bing.com\/search?q=birdman\" target=\"_blank\">Birdman<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li>Best Director: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Alejandro Gonz&aacute;lez I&ntilde;&aacute;rritu\" href=\"http:\/\/www.bing.com\/search?q=alejandro+gonzalez+inarritu\" target=\"_blank\">Alejandro Gonz&aacute;lez I&ntilde;&aacute;rritu<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (Birdman)<\/li>\n<li>Best Actress: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Julianne Moore\" href=\"http:\/\/www.bing.com\/search?q=julianne%20moore\" target=\"_blank\">Julianne Moore<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Still Alice\" href=\"http:\/\/www.bing.com\/search?q=still%20alice&qs=n&form=QBRE&pq=still%20alice\" target=\"_blank\">Still Alice<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>)<\/li>\n<li>Best Actor: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Eddie Redmayne\" href=\"http:\/\/www.bing.com\/search?q=Eddie+Redmayne&qs=n&form=QBLH&pq=eddie+redmayne\" target=\"_blank\">Eddie Redmayne<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"The Theory of Everything\" href=\"http:\/\/www.bing.com\/search?q=The%20Theory%20of%20Everything&qs=n&form=QBRE&pq=the%20theory%20of%20everything\" target=\"_blank\">The Theory of Everything<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>)<\/li>\n<li>Best Supporting Actress: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Patricia Arquette\" href=\"http:\/\/www.bing.com\/search?q=Patricia%20Arquette&qs=n&form=QBRE&pq=patricia%20arquette\" target=\"_blank\">Patricia Arquette<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Boyhood\" href=\"http:\/\/www.bing.com\/search?q=Boyhood&qs=n&form=QBRE&pq=boyhood\" target=\"_blank\">Boyhood<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>)<\/li>\n<li>Best Supporting Actor: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"J.K. Simmons\" href=\"http:\/\/www.bing.com\/search?q=J.K.%20Simmons&qs=n&form=QBRE&pq=j.k.%20simmons\" target=\"_blank\">J.K. Simmons<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Whiplash\" href=\"http:\/\/www.bing.com\/search?q=Whiplash&qs=n&form=QBRE&pq=whiplash\" target=\"_blank\">Whiplash<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>)<\/li>\n<\/ul>\n<p>Of course, that&rsquo;s at the time of the publishing this post, with timeliness not factored into the equation. \"Had you asked me about the likely winners in the top six categories last week, two of them would have been different,\" Rothschild says. Visit <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"predictwise.com\" href=\"http:\/\/www.predictwise.com\/\" target=\"_blank\">predictwise.com<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> to see the up-to-date full list of the Oscar nominees most likely to win, as well as predictions about politics, sports, and economic and financial topics.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Posted by George Thomas Jr. &#8220;Selma&#8221; director Ava DuVernay wasn&#8217;t nominated, but she still could affect who wins the Oscar.(Photo by Atsushi-Nishijima. &copy;2014 Paramount Pictures) (Editor&#8217;s Note: Researcher David Rothschild is receiving significant press coverage the day after the Oscars as he correctly predicted 20 of 24 awards) While it may be difficult to name [&hellip;]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[1],"tags":[200157,200707,200757,201249,202771,203343,203735,204049,204205,204225,204557],"research-area":[],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-235463","post","type-post","status-publish","format-standard","hentry","category-research-blog","tag-2015-oscars","tag-birdman","tag-boyhood","tag-david-rothschild","tag-microsoft-research-new-york-city","tag-predictions-markets","tag-selma","tag-still-alice","tag-the-lego-movie","tag-the-theory-of-everything","tag-whiplash","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"February 18, 2015","formattedExcerpt":"Posted by George Thomas Jr. &quot;Selma&quot; director Ava DuVernay wasn&#039;t nominated, but she still could affect who wins the Oscar.(Photo by Atsushi-Nishijima. &copy;2014 Paramount Pictures) (Editor&#039;s Note: Researcher David Rothschild is receiving significant press coverage the day after the Oscars as he correctly predicted 20&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/235463","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=235463"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/235463\/revisions"}],"predecessor-version":[{"id":260865,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/235463\/revisions\/260865"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=235463"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=235463"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=235463"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=235463"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=235463"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=235463"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=235463"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=235463"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=235463"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=235463"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=235463"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}