{"id":171277,"date":"2014-01-30T11:59:05","date_gmt":"2014-01-30T11:59:05","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/project\/interpoll\/"},"modified":"2017-06-16T10:37:53","modified_gmt":"2017-06-16T17:37:53","slug":"interpoll","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/interpoll\/","title":{"rendered":"InterPoll"},"content":{"rendered":"<p class=\"asset-content\">Crowd-sourcing is increasingly being used for providing answers to online polls and surveys. However, existing systems, while taking care of the mechanics of attracting crowd workers, poll building, and payment, provide little that would help the survey-maker or pollster to obtain statistically significant results devoid of even the obvious selection biases.<\/p>\n<div id=\"en-usprojectsinterpolldefault\" class=\"page-content\">\n<p>InterPoll is a platform for programming of crowd-sourced polls. Polls are expressed as embedded LINQ queries, whose results are provided to the developer. InterPoll supports reasoning about uncertainty, enabling t-tests, etc. on random variables obtained from the crowd. InterPoll performs query optimization, as well as bias correction and power analysis, among other features. Making InterPoll queries part of the surrounding program allows for optimizations that take advantage of the surrounding code context. The goal of InterPoll is to provide a system that can be reliably used for research into marketing, social and political science questions.<\/p>\n<p>Our ultimate goal is to make self-service crowd-sourced opinion polling available and affordable. To do this well, we are exploring ideas that come from programming languages, crowd-sourcing, databases, statistics, as well as security and privacy.<br \/>\n<span id=\"a3027881-eb1f-4ffb-b109-6ff7e2f4bef6\" class=\"ImageBlock fn\"><img decoding=\"async\" id=\"Imagea3027881-eb1f-4ffb-b109-6ff7e2f4bef6\" class=\"alignnone\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/02\/interpoll-process.png\" alt=\"\" \/><span id=\"ImageCaptiona3027881-eb1f-4ffb-b109-6ff7e2f4bef6\" class=\"ImageCaptionCoreCss ImageCaption\"><\/span><\/span><\/p>\n<\/div>\n<div id=\"en-usprojectsinterpolldefault\" class=\"page-content\">\n<h1>Samples<\/h1>\n<h5>Data collection<\/h5>\n<div style=\"border: 1px solid lightgray; padding: 10px;\">\n<p>The code below shows how to get answers to the question <i>&#8220;Do you think using a cell phone to make a call on an airplane during flight should be allowed or not?&#8221;<\/i>. Along with the answer, we also collect extra demographic information about the user, including their gender, ethnicity, age, and education.<\/p>\n<pre class=\"prettyprint lang-java\" style=\"border: 2px solid lightgray; margin: 5px; padding: 5px;\">var people = GetPeople(\"Should cell phones on the plane be allowed?\", 10, false, true, GetBackground());\r\nvar frame = from person in people\r\n  select new\r\n  {\r\n    Answer = person.PoseQuestion(\r\n    \"Do you think using a cell phone to make a call on an airplane during flight should be allowed or not?\",\r\n    \"Should be allowed\", \"Should not be allowed\", \"Unsure\"),\r\n    Gender = person.Gender,\r\n    Ethnicity = person.Ethnicity,\r\n    Age = person.Age,\r\n    Education = person.Education,\r\n};\r\n<\/pre>\n<\/div>\n<\/div>\n<div id=\"en-usprojectsinterpolldefault\" class=\"page-content\">\n<h5>Hypothesis testing with power analysis<\/h5>\n<div style=\"border: 1px solid lightgray; padding: 10px;\">\n<p>The code below shows how to use the data we collect from the crowd for <i>hypothesis testing<\/i>. In this case, we are trying to decide whether people generally (with a probability of .5) believe that we should break up big banks. Power analysis is used to determine how many samples (human opinions) to collect.<\/p>\n<pre class=\"prettyprint lang-java\" style=\"border: 2px solid lightgray; margin: 5px; padding: 5px;\">var people = GetPeople(\"Should we break up the big banks?\", 10, false, true, GetBackground());\r\nvar frame = (from person in people\r\n  select new\r\n  {\r\n    BreakUpTheBigBanks = person.PoseQuestion(\r\n      \"Do you believe that we should break up the big banks?\"),\r\n    Gender = person.Gender,\r\n    Ethnicity = person.Ethnicity,\r\n    Age = person.Age,\r\n    Education = person.Education,\r\n});\r\nvar answer = from person in frame select person.BreakUpTheBigBanks;\r\n\r\nif (answer.ToRandomVariable(false).Pr(.5)) {\r\n  Console.WriteLine(\"Outcome: We should break up big banks\", );\r\n} else {\r\n  Console.WriteLine(\"Outcome: We should not break up big banks);\r\n}\r\n<\/pre>\n<\/div>\n<\/div>\n<div id=\"en-usprojectsinterpolldefault\" class=\"page-content\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Crowd-sourcing is increasingly being used for providing answers to online polls and surveys. However, existing systems, while taking care of the mechanics of attracting crowd workers, poll building, and payment, provide little that would help the survey-maker or pollster to obtain statistically significant results devoid of even the obvious selection biases. InterPoll is a platform [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13554,13560,13558,13559],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-171277","msr-project","type-msr-project","status-publish","hentry","msr-research-area-human-computer-interaction","msr-research-area-programming-languages-software-engineering","msr-research-area-security-privacy-cryptography","msr-research-area-social-sciences","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2014-01-30","related-publications":[166062,166116,167123,167717],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[{"id":0,"name":"Presentations","content":"<ul>\r\n \t<li>Short slide deck\u00a0(5 slides)<\/li>\r\n \t<li>Longer slide deck with videos (21 slides)<\/li>\r\n \t<li>From a recent summer school, a talk entitled\u00a0Programming for Social Scientists\u00a0(long presentation, about 70 slides)<\/li>\r\n<\/ul>"}],"slides":[],"related-researchers":[],"msr_research_lab":[199565],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171277","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171277\/revisions"}],"predecessor-version":[{"id":213538,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171277\/revisions\/213538"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=171277"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=171277"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=171277"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=171277"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=171277"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}