{"id":357179,"date":"2017-01-24T13:55:17","date_gmt":"2017-01-24T21:55:17","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-event&#038;p=357179"},"modified":"2025-08-06T11:58:21","modified_gmt":"2025-08-06T18:58:21","slug":"ossm17","status":"publish","type":"msr-event","link":"https:\/\/www.microsoft.com\/en-us\/research\/event\/ossm17\/","title":{"rendered":"OSSM17: Observational Studies Through Social Media"},"content":{"rendered":"\n\n<p><strong>Abstract submissions are due March 24th.\u00a0 Our <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" target=\"_blank\" href=\"https:\/\/easychair.org\/conferences\/?conf=ossm2017\">submission site <span class=\"sr-only\"> (opens in new tab)<\/span><\/a>is open.<\/strong><\/p>\n<p>People\u2019s usage of mobile devices, Internet services, and applications creates a rich repository of data across many domains. As explorations and applications by the ICWSM community become more focused on understanding mechanisms and addressing societal and individual-level problems through policy- and individual-level interventions, the importance of careful studies and causal reasoning methods is becoming more critical. The <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/icwsm.org\/2017\/index.php\" target=\"_blank\">ICWSM<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> workshop on Observational Studies in Social Media and other human-generated content (OSSM, pronounced \u201cawesome\u201d), brings together social scientists, computer scientists, and others who are investigating observational studies of these interactions and data across many areas, including public health, medicine, sociology, education and others. The goal of the workshop is to foster discussion and brainstorming in this area.<\/p>\n<h2><\/h2>\n<p>&nbsp;<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<table class=\" msr-table-schedule all-borders\" style=\"border-collapse: collapse;border-spacing: inherit\" width=\"636\">\n<tbody>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>11:00am-12:30pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Keynote: <strong>Matching Methods and Natural Experiments: Examples of Causal Inferences from Social Media.\u00a0<\/strong> <em>Ingmar Weber, QCRI<\/em><\/p>\n<p>Invited Talk.\u00a0 <strong>Estimating causal effects at scale. <\/strong>Amit Sharma (Microsoft Research)<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>12:30-2:00pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\"><em>Lunch (on your own)<\/em><\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>2:00-3:30pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Tutorial: <strong>Intuition and basic methods for causal inference over social media data<\/strong>.\u00a0 <em>Emre K\u0131c\u0131man<\/em><\/p>\n<p>Talks<\/p>\n<ul>\n<li><strong>Estimating the Effect of Exercising on Users\u2019 Online Behavior.<\/strong> <em>Amin Mirlohi, Hawre Hosseini, Zeinab Noorian and Ebrahim Bagheri<\/em><\/li>\n<li><strong>Qualitative Exploration and Early Discovery of Prior-Information for Causal Inference<\/strong> <em>Pablo Paredes<\/em><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>3:30-4:00pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\"><em>Afternoon break<\/em><\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>4:00-5:00pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Keynote: <strong>Ruffled Feathers: When Can Gender Be Predicted on Social Networks?<\/strong>\u00a0<em>Johan Ugander, Stanford<\/em><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<h2>Details<\/h2>\n<p><strong>Matching Methods and Natural Experiments: Examples of Causal Inferences from Social Media<\/strong><br \/>\nIngmar Weber (QCRI)<\/p>\n<p>Abstract: This talk will feature a mix of own and others\u2019 work, and will be part tutorial and part experience report on how to use two causal inference methodologies: natural experiments and matching methods. On the topic of natural experiments, I\u2019ll present three bits of work that use weather and its randomness as an instrumental variable to study social influence in social networks. First, we\u2019ll look how emotional contagion on Facebook can be studied in an non-intrusive matter [Coviello et al., PLoS ONE, 2014]. Next, we\u2019ll discuss recent work that looks at social contagion in a large physical fitness social network [Aral & Nicolaides, Nature Communications, 2017]. Finally, I\u2019ll present ongoing work in which we use weather to study the social contagion of ice-cream consumption [Mejova et al., ongoing]. For matching methods, we first present work that uses propensity score matching to look at how feedback on news comments affects the commenter\u2019s future behavior in the community [Cheng et al., ICWSM, 2014]. Next I\u2019ll present work that studies the effect of receiving social support in a weight loss forum in Reddit on the actual weight loss reported in the end [Cunha et al., WWW-WebSci, 2017]. The presentations of all papers, including our own, will in particular focus on particular shortcomings, hopefully leading to a lively discussion on both the promises and limitations of causal inference from observational data.<\/p>\n<p>About Ingmar Weber:\u00a0 Ingmar is the Research Director of the Social Computing Group at the Qatar Computing Research Institute (QCRI). His interdisciplinary research uses large amounts of online data from social media and other sources to study human behavior at scale. Particular topics of interest include studying lifestyle diseases and population health, quantifying international migration using digital methods, and looking at political polarization and extremism. He has published over 100 peer-reviewed articles and his work is frequently featured in popular press. Since 2016 he has been selected as an ACM Distinguished Speaker.<\/p>\n<p>As an undergraduate Ingmar studied mathematics at Cambridge University (1999-2003), before pursuing a PhD at the Max-Planck Institute for Computer Science (2003-2007). He subsequently held positions at the Ecole Polytechnique Federale de Lausanne (2007-2009) and Yahoo Research Barcelona (2009-2012), as well as a visiting researcher position at Microsoft Research Cambridge (summer 2008). He serves on a number of program committees for top-tier conferences in the domain of web data mining and social media analysis including ICWSM, KDD, WWW, ACL, ASONAM, WSDM, SDM, VLDB and WebSci, as well as on the editorial board for the Journal of Web Science.<\/p>\n<hr \/>\n<p><strong>Ruffled Feathers: When Can Gender Be Predicted on Social Networks?<\/strong><br \/>\nJohan Ugander (Stanford University)<\/p>\n<p>Abstract: Homophily, or &#8220;love of the same,&#8221; is a prominent and well-studied structural feature of social networks. Modern machine learning methods have exploited the empirical ubiquity of homophily to predict the private traits of individuals in social networks, with broad implications for both privacy research and statistical matching methods. However, gender inference on large-scale online networks introduces a unique challenge to conventional prediction methods as gender homophily can be weak or nonexistent. In this work we identify another useful structural property we call monophily that is characterized by an overdispersion of gender preferences beyond what can be explained by homophily. We jointly characterize the statistical structure of homophily and monophily in social networks in terms of preference bias and variance, and demonstrate that monophily can drive surprisingly accurate predictions in graphs where weak homophily might otherwise suggest a difficult classification problem. These findings offer an alternative perspective on network trait inference in general and gender in particular, complicating the already difficult task of protecting privacy in social networks, and introducing new considerations regarding any study of social network covariates. This is joint work with Kristen M. Altenburger.<\/p>\n<p>About Johan Ugander: Johan Ugander is an Assistant Professor at Stanford University in the Department of Management Science & Engineering, within the School of Engineering. His research develops algorithmic and statistical frameworks for analyzing social networks, social systems, and other large-scale social data, with an emphasis on methods for causal inference. Prior to joining the Stanford faculty he was a post-doctoral researcher at Microsoft Research Redmond 2014-2015 and held an affiliation with the Facebook Data Science team 2010-2014. He obtained his Ph.D. in Applied Mathematics from Cornell University in 2014.<\/p>\n<hr \/>\n<p><strong>Estimating causal effects at scale<\/strong><br \/>\nAmit Sharma (Microsoft Research)<\/p>\n<p>Abstract: As an increasing amount of daily activity&#8212;ranging from what we purchase to whom we talk to&#8212;shifts to online platforms, it is only natural to ask how those platforms impact our behavior. Estimating the causal impact of digital systems, however, is non-trivial without the luxury of doing randomized experiments. In this talk, I will present methods for estimating the impact of systems from observed usage data, combining principles from statistical data mining and causal inference literature. The first method provides an algorithm for automating the search for natural experiments, whenever we can find a suitable auxiliary control variable. Using it on Amazon&#8217;s recommender system, I find that the causal impact of recommendations is less than half of the metrics typically reported for online systems. The second method utilizes the scale of online systems to compute causal effect using extreme events. I will show its application to Bing, where it was used to investigate causal differences in user satisfaction for people from different demographics.<\/p>\n<p>About Amit Sharma: Amit Sharma is a postdoctoral researcher at Microsoft Research, New York. His research focuses on understanding the underlying mechanisms that shape people&#8217;s activities online, with a particular emphasis on the effect of recommendation systems and social influence. More generally, his work contributes to methods for causal inference from large-scale data. He completed his Ph.D. in computer science at Cornell University. He has received a Best Paper Honorable Mention Award at the 2016 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW), the 2012 Yahoo! Key Scientific Challenges Award and the 2009 Honda Young Engineer and Scientist Award.<\/p>\n<hr \/>\n<p><strong>Estimating the Effect of Exercising on Users\u2019 Online Behavior<\/strong><br \/>\nAmin Mirlohi, Hawre Hosseini, Zeinab Noorian and Ebrahim Bagheri<\/p>\n<p>Abstract: This study aims to estimate the influence of offline activity on users\u2019 online behavior, relying on a matching method to reduce the effect of confounding variables. We analyze activities of 850 users who are active on both Twitter and Foursquare social networks. Users\u2019 offline activity is extracted from Foursquare posts and users\u2019 online behavior is extracted from Twitter posts. Users\u2019 interests, representing their online behavior, are extracted with regards to a set of topics in several subsequent time intervals. The shift of users\u2019 interests across different time intervals is taken as a measure of user behavior change on the social network. On the other hand, we employ user check-ins at a gym or fitness center as a sign of exercise and consider it to be an offline activity. In order to find the effect of exercise on online behavior, we identify users who did not go to the gym for at least two months but did so at least nine times in the next three months. We show that shift in interest reduces significantly for users after they start exercising, which implies that the offline activity of exercising can influence how users\u2019 interests are shaped and change on the social network over time.<\/p>\n<hr \/>\n<p><strong>Qualitative Exploration and Early Discovery of Prior-Information for Causal Inference<\/strong><br \/>\nPablo Paredes, Philipp Dowling, Vasilis Oikonomou, Biye Jiang, Coye Cheshire, John Canny and James Landay<\/p>\n<p>Abstract: In this paper, we propose a set of qualitative temporal exploration features for Inquire [Paredes, et al.] to support observational studies and causal inference. Inquire is a system that supports qualitative or mixed-methods researchers across different fields in their insight discovery and ideation processes. Inquire enables its users to access large-scale corpora of text, and perform sophisticated searches and exploration on this data through semantic vector space models that allow rich exploratory methods far beyond simple text search. When applied to the LiveJournal.com dataset, which consists of millions of anonymous journal entries, our system can help researchers compile data sets of users and their posts that capture specific semantic criteria. For instance, a researcher can create a data set of people who write about both \u201cbeing stressed\u201d and \u201cfeeling lonely,\u201d to attempt to subsequently establish a temporal relationship between stress and loneliness (or vice-versa). Inquire enables the researcher to perform interactive qualitative temporal analysis of these users can lead to the discovery of case-studies. Furthermore, individual or aggregated analysis of these cases could result in the discovery of less-obvious covariates. For example, a group of people under \u201cstress\u201d who feel \u201clonely\u201d could potentially also have expressed in their journal entries some elements associated with \u201cburnout\u201d or \u201cfamily conflicts.\u201d In summary, we propose a tool for exploration of social-media data to expand the discovery of counterfactuals and covariates that would strengthen the theoretical and empirical informational space needed to develop robust causal inference studies. <!--more--><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<p><b>News! <\/b>We are happy to announce our two keynote speakers, <strong>Johan Ugander <\/strong>and<strong> Ingmar Weber<\/strong>!<\/p>\n<p>The OSSM workshop will focus on observational studies (namely, causal analyses) of data traces created by people, whether directly or indirectly, through their interactions with social networks, messaging services, and other applications and devices.<\/p>\n<p>Human generated content in general, including social media, has been shown to be a rich repository of data for observational studies across many areas:\u00a0 public health, with research on prevalence of disease and on the effects of media on the development of disease; medicine, showing the ability to detect mental disease in individual using social media; education, to optimize teaching and exams; and sociology, to prove theories previously tested on very small populations. These studies have been conducted from data including social media, search engine logs, location traces, and other forms of human generated content.<\/p>\n<p>While many past studies showed a correlation between variables of interest, some studies were able to show causal relationships through natural experiments and careful analyses. Natural experiments are empirical studies in which people are assigned to control or experimental conditions according to factors not under the control of investigators, where these factors resemble a random assignment. With Internet data, natural experiments occur frequently through policy changes, outside influences, and A\/B testing. Our workshop will focus on all aspects of causal inference from human generated content, with studies that developed novel methods of identifying and using natural experiments or other methods for inferring causality.<\/p>\n<p>Studies based on human generated content require investigators to preserve the privacy of users and abide by proper ethical codes. We will encourage discussion of how these goals may be attained in secondary analysis of data such as that used in the aforementioned studies.<\/p>\n<p>We are soliciting participation both from domain-experts interested in specific applications of methods, as well as methods-experts.<\/p>\n<p>Topics of interest broadly include:<\/p>\n<ul>\n<li>Applications and domain-specific explorations<\/li>\n<li>Interpreting user-generated data, including text, structured data, and temporal data.<\/li>\n<li>Causal analyses in social media, for example, through conditioning analyses, instrumental variables or regression discontinuity analysis.<\/li>\n<li>Identifying natural experiments and using them to understand causal inferences<\/li>\n<li>Identifying and\/or mitigating population, behavioral and other systematic biases in social media<\/li>\n<li>Novel methods for preserving privacy in such experimentation<\/li>\n<li>Ethical implications of such experiments<\/li>\n<li>Qualitative, experimental and other evaluation and validation methods for observational study results<\/li>\n<\/ul>\n<h2>General Format<\/h2>\n<p>The core of the workshop will consist of structured discussion and breakouts on topics preselected by participants.\u00a0 Broad discussion topics will be chosen based on initial submissions, and refined during a pre-workshop video chat open to all workshop participants several weeks prior to the workshop.\u00a0 Potential outcomes of these breakouts will include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists. We will support breakout groups with a facilitator as well as a scribe.<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<h2>Important dates<\/h2>\n<ul>\n<li><del datetime=\"2017-04-21T06:20:41+00:00\">March 24, 2017: Deadline for abstract\/paper submissions<\/del><\/li>\n<li><del datetime=\"2017-04-21T06:20:41+00:00\">April 14, 2017: Notification of acceptance<\/del><\/li>\n<li>May 15, 2017: Workshop day, at ICWSM 2017, Montreal, Canada<\/li>\n<\/ul>\n<h2>Abstract details<\/h2>\n<p>Submission should be <b>extended abstracts of up to 4 pages<\/b> and will be published on the workshop webpage and optionally (depending on the authors&#8217; choice) in the ICWSM\/AAAI workshop proceedings.\u00a0 Submissions will be evaluated by the program committee based on the quality of the work and its fit to the workshop themes.\u00a0 We explicitly encourage the submission of preliminary work.<\/p>\n<p>Authors whose papers are accepted to the workshop will be able to give a talk about their work (10min) and have the opportunity to participate in a poster session. In addition, the workshop will consist of structured discussion and breakout groups on topics pre-selected by participants. Potential outcomes of these discussions include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists.<\/p>\n<p>Authors are encouraged to use the AAAI-17 formatting guidelines.\u00a0 The author kit is available at <b><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" target=\"_blank\" href=\"http:\/\/www.aaai.org\/Publications\/Templates\/AuthorKit17.zip\">http:\/\/www.aaai.org\/Publications\/Templates\/AuthorKit17.zip<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/b>.<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<h2>Organizing Committee<\/h2>\n<ul>\n<li>Tim Althoff (Stanford University, <a href=\"mailto:althoff@cs.stanford.edu\">althoff@cs.stanford.edu<\/a>)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/eladyt\/\" target=\"_blank\">Elad Yom-Tov<\/a> (Microsoft Research, <a href=\"mailto:eladyt@microsoft.com\">eladyt@microsoft.com<\/a>)<\/li>\n<li>Munmun De Choudhury (Georgia Tech, <a href=\"mailto:munmund@gatech.edu\">munmund@gatech.edu<\/a>)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/emrek\/\" target=\"_blank\">Emre K\u0131c\u0131man<\/a> (Microsoft Research, <a href=\"mailto:emrek@microsoft.com\">emrek@microsoft.com<\/a>)<\/li>\n<\/ul>\n<p><em>Please contact us if you have any questions.<\/em><\/p>\n<h2>Program Committee<\/h2>\n<ul>\n<li>Carlos Castilllo, Eurecat<\/li>\n<li>Ingemar Cox, University College London<\/li>\n<li>Aron Culotta, Illinois Institute of Technology<\/li>\n<li>Luis Fernandez Luque, Qatar Computing Research Institute<\/li>\n<li>Shawndra Hill, Microsoft Research<\/li>\n<li>Brian Keegan, University of Colorado Boulder<\/li>\n<li>Alexandra Olteanu, IBM Research<\/li>\n<li>Daniel Romero, University of Michigan<\/li>\n<li>Amit Sharma, Microsoft Research<\/li>\n<li>Ingmar Weber, Qatar Computing Research Institute<\/li>\n<\/ul>\n<p><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<p>Held at <strong>ICWSM 2017<\/strong> (International AAAI Conference on Web and Social Media), Montreal, Canada, May 15, 2017<\/p>\n<p>Workshop webpage: <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ossm17\/\">https:\/\/www.microsoft.com\/en-us\/research\/event\/ossm17\/<\/a><\/p>\n<h3>CALL FOR CONTRIBUTIONS<\/h3>\n<p>The OSSM workshop will focus on observational studies (namely, causal analyses) of data traces created by people, whether directly or indirectly, through their interactions with social networks, messaging services, and other applications and devices.<\/p>\n<p>Human generated content in general, including social media, has been shown to be a rich repository of data for observational studies across many areas: public health, with research on prevalence of disease and on the effects of media on the development of disease; medicine, showing the ability to detect mental disease in individual using social media; education, to optimize teaching and exams; and sociology, to prove theories previously tested on very small populations. These studies have been conducted from data including social media, search engine logs, location traces, and other forms of human generated content.<\/p>\n<p>While many past studies showed a correlation between variables of interest, some studies were able to show causal relationships through natural experiments and careful analyses. Natural experiments are empirical studies in which people are assigned to control or experimental conditions according to factors not under the control of investigators, where these factors resemble a random assignment. With Internet data, natural experiments occur frequently through policy changes, outside influences, and A\/B testing. Our workshop will focus on all aspects of causal inference from human generated content, with studies that developed novel methods of identifying and using natural experiments or other methods for inferring causality.<\/p>\n<p>Studies based on human generated content require investigators to preserve the privacy of users and abide by proper ethical codes. We will encourage discussion of how these goals may be attained in secondary analysis of data such as that used in the aforementioned studies.<\/p>\n<p>We are soliciting participation both from domain-experts interested in specific applications of methods, as well as methods-experts.<\/p>\n<p>Topics of interest include, but are not limited to<\/p>\n<ul>\n<li>Applications and domain-specific explorations<\/li>\n<li>Interpreting user-generated data, including text, structured data, and temporal data<\/li>\n<li>Causal analyses in social media, for example, through conditioning analyses, instrumental variables or regression discontinuity analysis<\/li>\n<li>Identifying natural experiments and using them to understand causal inferences<\/li>\n<li>Identifying and\/or mitigating population, behavioral and other systematic biases in social media<\/li>\n<li>Novel methods for preserving privacy in such experimentation<\/li>\n<li>Ethical implications of such experiments<\/li>\n<li>Qualitative, experimental and other evaluation and validation methods for observational study results<\/li>\n<\/ul>\n<p>Submission should be extended abstracts of up to 4 pages and and will be published on the workshop webpage and optionally (depending on the author&#8217;s&#8217; choice) in the ICWSM\/AAAI workshop proceedings. We explicitly encourage the submission of preliminary work.<\/p>\n<p>Authors whose papers are accepted to the workshop will be able to give a talk about their work (10min) and have the opportunity to participate in a poster session. In addition, the workshop will consist of structured discussion and breakout groups on topics pre-selected by participants. Potential outcomes of these discussions include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists.<\/p>\n<h3>KEY DATES<\/h3>\n<ul>\n<li>Submission deadline:<strong> March 24, 2017<\/strong><\/li>\n<li>Author feedback: April 14, 2017<\/li>\n<li>Workshop event (Montreal, Canada): May 15, 2017<\/li>\n<\/ul>\n<p>Please see workshop webpage for formatting and submission instructions.<\/p>\n<h3>ORGANIZATION<\/h3>\n<p>Tim Althoff, Stanford University<\/p>\n<p>Elad Yom-Tov, Microsoft Research<\/p>\n<p>Munmun De Choudhury, Georgia Tech<\/p>\n<p>Emre K\u0131c\u0131man, Microsoft Research<\/p>\n<h3>CONTACT<\/h3>\n<p>Please direct your questions to <a href=\"mailto:ossm-workshop@googlegroups.com\">ossm-workshop@googlegroups.com<\/a><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The ICWSM workshop on Observational Studies in Social Media and other human-generated content (OSSM, pronounced \u201cawesome\u201d), brings together social scientists, computer scientists, and others who are investigating observational studies of digital interactions and data traces across many areas, including public health, medicine, sociology, education and others.<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_startdate":"2017-05-15","msr_enddate":"2017-05-15","msr_location":"Montreal, Canada","msr_expirationdate":"","msr_event_recording_link":"","msr_event_link":"","msr_event_link_redirect":false,"msr_event_time":"","msr_hide_region":false,"msr_private_event":false,"msr_hide_image_in_river":0,"footnotes":""},"research-area":[13563,13559],"msr-region":[197900],"msr-event-type":[197941],"msr-video-type":[],"msr-locale":[268875],"msr-program-audience":[],"msr-post-option":[],"msr-impact-theme":[],"class_list":["post-357179","msr-event","type-msr-event","status-publish","hentry","msr-research-area-data-platform-analytics","msr-research-area-social-sciences","msr-region-north-america","msr-event-type-conferences","msr-locale-en_us"],"msr_about":"<!-- wp:msr\/event-details {\"title\":\"OSSM17: Observational Studies Through Social Media\",\"backgroundColor\":\"grey\"} \/-->\n\n<!-- wp:msr\/content-tabs --><!-- wp:msr\/content-tab {\"title\":\"Program\"} --><!-- wp:freeform --><p><strong>Abstract submissions are due March 24th.\u00a0 Our <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" target=\"_blank\" href=\"https:\/\/easychair.org\/conferences\/?conf=ossm2017\">submission site <span class=\"sr-only\"> (opens in new tab)<\/span><\/a>is open.<\/strong><\/p>\n<p>People\u2019s usage of mobile devices, Internet services, and applications creates a rich repository of data across many domains. As explorations and applications by the ICWSM community become more focused on understanding mechanisms and addressing societal and individual-level problems through policy- and individual-level interventions, the importance of careful studies and causal reasoning methods is becoming more critical. The <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/icwsm.org\/2017\/index.php\" target=\"_blank\">ICWSM<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> workshop on Observational Studies in Social Media and other human-generated content (OSSM, pronounced \u201cawesome\u201d), brings together social scientists, computer scientists, and others who are investigating observational studies of these interactions and data across many areas, including public health, medicine, sociology, education and others. The goal of the workshop is to foster discussion and brainstorming in this area.<\/p>\n<h2><\/h2>\n<p>&nbsp;<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<table class=\" msr-table-schedule all-borders\" style=\"border-collapse: collapse;border-spacing: inherit\" width=\"636\">\n<tbody>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>11:00am-12:30pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Keynote: <strong>Matching Methods and Natural Experiments: Examples of Causal Inferences from Social Media.\u00a0<\/strong> <em>Ingmar Weber, QCRI<\/em><\/p>\n<p>Invited Talk.\u00a0 <strong>Estimating causal effects at scale. <\/strong>Amit Sharma (Microsoft Research)<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>12:30-2:00pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\"><em>Lunch (on your own)<\/em><\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>2:00-3:30pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Tutorial: <strong>Intuition and basic methods for causal inference over social media data<\/strong>.\u00a0 <em>Emre K\u0131c\u0131man<\/em><\/p>\n<p>Talks<\/p>\n<ul>\n<li><strong>Estimating the Effect of Exercising on Users\u2019 Online Behavior.<\/strong> <em>Amin Mirlohi, Hawre Hosseini, Zeinab Noorian and Ebrahim Bagheri<\/em><\/li>\n<li><strong>Qualitative Exploration and Early Discovery of Prior-Information for Causal Inference<\/strong> <em>Pablo Paredes<\/em><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>3:30-4:00pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\"><em>Afternoon break<\/em><\/td>\n<\/tr>\n<tr>\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>4:00-5:00pm<\/strong><\/td>\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Keynote: <strong>Ruffled Feathers: When Can Gender Be Predicted on Social Networks?<\/strong>\u00a0<em>Johan Ugander, Stanford<\/em><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<h2>Details<\/h2>\n<p><strong>Matching Methods and Natural Experiments: Examples of Causal Inferences from Social Media<\/strong><br \/>\nIngmar Weber (QCRI)<\/p>\n<p>Abstract: This talk will feature a mix of own and others\u2019 work, and will be part tutorial and part experience report on how to use two causal inference methodologies: natural experiments and matching methods. On the topic of natural experiments, I\u2019ll present three bits of work that use weather and its randomness as an instrumental variable to study social influence in social networks. First, we\u2019ll look how emotional contagion on Facebook can be studied in an non-intrusive matter [Coviello et al., PLoS ONE, 2014]. Next, we\u2019ll discuss recent work that looks at social contagion in a large physical fitness social network [Aral &amp; Nicolaides, Nature Communications, 2017]. Finally, I\u2019ll present ongoing work in which we use weather to study the social contagion of ice-cream consumption [Mejova et al., ongoing]. For matching methods, we first present work that uses propensity score matching to look at how feedback on news comments affects the commenter\u2019s future behavior in the community [Cheng et al., ICWSM, 2014]. Next I\u2019ll present work that studies the effect of receiving social support in a weight loss forum in Reddit on the actual weight loss reported in the end [Cunha et al., WWW-WebSci, 2017]. The presentations of all papers, including our own, will in particular focus on particular shortcomings, hopefully leading to a lively discussion on both the promises and limitations of causal inference from observational data.<\/p>\n<p>About Ingmar Weber:\u00a0 Ingmar is the Research Director of the Social Computing Group at the Qatar Computing Research Institute (QCRI). His interdisciplinary research uses large amounts of online data from social media and other sources to study human behavior at scale. Particular topics of interest include studying lifestyle diseases and population health, quantifying international migration using digital methods, and looking at political polarization and extremism. He has published over 100 peer-reviewed articles and his work is frequently featured in popular press. Since 2016 he has been selected as an ACM Distinguished Speaker.<\/p>\n<p>As an undergraduate Ingmar studied mathematics at Cambridge University (1999-2003), before pursuing a PhD at the Max-Planck Institute for Computer Science (2003-2007). He subsequently held positions at the Ecole Polytechnique Federale de Lausanne (2007-2009) and Yahoo Research Barcelona (2009-2012), as well as a visiting researcher position at Microsoft Research Cambridge (summer 2008). He serves on a number of program committees for top-tier conferences in the domain of web data mining and social media analysis including ICWSM, KDD, WWW, ACL, ASONAM, WSDM, SDM, VLDB and WebSci, as well as on the editorial board for the Journal of Web Science.<\/p>\n<hr \/>\n<p><strong>Ruffled Feathers: When Can Gender Be Predicted on Social Networks?<\/strong><br \/>\nJohan Ugander (Stanford University)<\/p>\n<p>Abstract: Homophily, or &#8220;love of the same,&#8221; is a prominent and well-studied structural feature of social networks. Modern machine learning methods have exploited the empirical ubiquity of homophily to predict the private traits of individuals in social networks, with broad implications for both privacy research and statistical matching methods. However, gender inference on large-scale online networks introduces a unique challenge to conventional prediction methods as gender homophily can be weak or nonexistent. In this work we identify another useful structural property we call monophily that is characterized by an overdispersion of gender preferences beyond what can be explained by homophily. We jointly characterize the statistical structure of homophily and monophily in social networks in terms of preference bias and variance, and demonstrate that monophily can drive surprisingly accurate predictions in graphs where weak homophily might otherwise suggest a difficult classification problem. These findings offer an alternative perspective on network trait inference in general and gender in particular, complicating the already difficult task of protecting privacy in social networks, and introducing new considerations regarding any study of social network covariates. This is joint work with Kristen M. Altenburger.<\/p>\n<p>About Johan Ugander: Johan Ugander is an Assistant Professor at Stanford University in the Department of Management Science &amp; Engineering, within the School of Engineering. His research develops algorithmic and statistical frameworks for analyzing social networks, social systems, and other large-scale social data, with an emphasis on methods for causal inference. Prior to joining the Stanford faculty he was a post-doctoral researcher at Microsoft Research Redmond 2014-2015 and held an affiliation with the Facebook Data Science team 2010-2014. He obtained his Ph.D. in Applied Mathematics from Cornell University in 2014.<\/p>\n<hr \/>\n<p><strong>Estimating causal effects at scale<\/strong><br \/>\nAmit Sharma (Microsoft Research)<\/p>\n<p>Abstract: As an increasing amount of daily activity&#8212;ranging from what we purchase to whom we talk to&#8212;shifts to online platforms, it is only natural to ask how those platforms impact our behavior. Estimating the causal impact of digital systems, however, is non-trivial without the luxury of doing randomized experiments. In this talk, I will present methods for estimating the impact of systems from observed usage data, combining principles from statistical data mining and causal inference literature. The first method provides an algorithm for automating the search for natural experiments, whenever we can find a suitable auxiliary control variable. Using it on Amazon&#8217;s recommender system, I find that the causal impact of recommendations is less than half of the metrics typically reported for online systems. The second method utilizes the scale of online systems to compute causal effect using extreme events. I will show its application to Bing, where it was used to investigate causal differences in user satisfaction for people from different demographics.<\/p>\n<p>About Amit Sharma: Amit Sharma is a postdoctoral researcher at Microsoft Research, New York. His research focuses on understanding the underlying mechanisms that shape people&#8217;s activities online, with a particular emphasis on the effect of recommendation systems and social influence. More generally, his work contributes to methods for causal inference from large-scale data. He completed his Ph.D. in computer science at Cornell University. He has received a Best Paper Honorable Mention Award at the 2016 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW), the 2012 Yahoo! Key Scientific Challenges Award and the 2009 Honda Young Engineer and Scientist Award.<\/p>\n<hr \/>\n<p><strong>Estimating the Effect of Exercising on Users\u2019 Online Behavior<\/strong><br \/>\nAmin Mirlohi, Hawre Hosseini, Zeinab Noorian and Ebrahim Bagheri<\/p>\n<p>Abstract: This study aims to estimate the influence of offline activity on users\u2019 online behavior, relying on a matching method to reduce the effect of confounding variables. We analyze activities of 850 users who are active on both Twitter and Foursquare social networks. Users\u2019 offline activity is extracted from Foursquare posts and users\u2019 online behavior is extracted from Twitter posts. Users\u2019 interests, representing their online behavior, are extracted with regards to a set of topics in several subsequent time intervals. The shift of users\u2019 interests across different time intervals is taken as a measure of user behavior change on the social network. On the other hand, we employ user check-ins at a gym or fitness center as a sign of exercise and consider it to be an offline activity. In order to find the effect of exercise on online behavior, we identify users who did not go to the gym for at least two months but did so at least nine times in the next three months. We show that shift in interest reduces significantly for users after they start exercising, which implies that the offline activity of exercising can influence how users\u2019 interests are shaped and change on the social network over time.<\/p>\n<hr \/>\n<p><strong>Qualitative Exploration and Early Discovery of Prior-Information for Causal Inference<\/strong><br \/>\nPablo Paredes, Philipp Dowling, Vasilis Oikonomou, Biye Jiang, Coye Cheshire, John Canny and James Landay<\/p>\n<p>Abstract: In this paper, we propose a set of qualitative temporal exploration features for Inquire [Paredes, et al.] to support observational studies and causal inference. Inquire is a system that supports qualitative or mixed-methods researchers across different fields in their insight discovery and ideation processes. Inquire enables its users to access large-scale corpora of text, and perform sophisticated searches and exploration on this data through semantic vector space models that allow rich exploratory methods far beyond simple text search. When applied to the LiveJournal.com dataset, which consists of millions of anonymous journal entries, our system can help researchers compile data sets of users and their posts that capture specific semantic criteria. For instance, a researcher can create a data set of people who write about both \u201cbeing stressed\u201d and \u201cfeeling lonely,\u201d to attempt to subsequently establish a temporal relationship between stress and loneliness (or vice-versa). Inquire enables the researcher to perform interactive qualitative temporal analysis of these users can lead to the discovery of case-studies. Furthermore, individual or aggregated analysis of these cases could result in the discovery of less-obvious covariates. For example, a group of people under \u201cstress\u201d who feel \u201clonely\u201d could potentially also have expressed in their journal entries some elements associated with \u201cburnout\u201d or \u201cfamily conflicts.\u201d In summary, we propose a tool for exploration of social-media data to expand the discovery of counterfactuals and covariates that would strengthen the theoretical and empirical informational space needed to develop robust causal inference studies. <!--more--><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<!-- \/wp:freeform --><!-- \/wp:msr\/content-tab --><!-- wp:msr\/content-tab {\"title\":\"Description\"} --><!-- wp:freeform --><p><b>News! <\/b>We are happy to announce our two keynote speakers, <strong>Johan Ugander <\/strong>and<strong> Ingmar Weber<\/strong>!<\/p>\n<p>The OSSM workshop will focus on observational studies (namely, causal analyses) of data traces created by people, whether directly or indirectly, through their interactions with social networks, messaging services, and other applications and devices.<\/p>\n<p>Human generated content in general, including social media, has been shown to be a rich repository of data for observational studies across many areas:\u00a0 public health, with research on prevalence of disease and on the effects of media on the development of disease; medicine, showing the ability to detect mental disease in individual using social media; education, to optimize teaching and exams; and sociology, to prove theories previously tested on very small populations. These studies have been conducted from data including social media, search engine logs, location traces, and other forms of human generated content.<\/p>\n<p>While many past studies showed a correlation between variables of interest, some studies were able to show causal relationships through natural experiments and careful analyses. Natural experiments are empirical studies in which people are assigned to control or experimental conditions according to factors not under the control of investigators, where these factors resemble a random assignment. With Internet data, natural experiments occur frequently through policy changes, outside influences, and A\/B testing. Our workshop will focus on all aspects of causal inference from human generated content, with studies that developed novel methods of identifying and using natural experiments or other methods for inferring causality.<\/p>\n<p>Studies based on human generated content require investigators to preserve the privacy of users and abide by proper ethical codes. We will encourage discussion of how these goals may be attained in secondary analysis of data such as that used in the aforementioned studies.<\/p>\n<p>We are soliciting participation both from domain-experts interested in specific applications of methods, as well as methods-experts.<\/p>\n<p>Topics of interest broadly include:<\/p>\n<ul>\n<li>Applications and domain-specific explorations<\/li>\n<li>Interpreting user-generated data, including text, structured data, and temporal data.<\/li>\n<li>Causal analyses in social media, for example, through conditioning analyses, instrumental variables or regression discontinuity analysis.<\/li>\n<li>Identifying natural experiments and using them to understand causal inferences<\/li>\n<li>Identifying and\/or mitigating population, behavioral and other systematic biases in social media<\/li>\n<li>Novel methods for preserving privacy in such experimentation<\/li>\n<li>Ethical implications of such experiments<\/li>\n<li>Qualitative, experimental and other evaluation and validation methods for observational study results<\/li>\n<\/ul>\n<h2>General Format<\/h2>\n<p>The core of the workshop will consist of structured discussion and breakouts on topics preselected by participants.\u00a0 Broad discussion topics will be chosen based on initial submissions, and refined during a pre-workshop video chat open to all workshop participants several weeks prior to the workshop.\u00a0 Potential outcomes of these breakouts will include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists. We will support breakout groups with a facilitator as well as a scribe.<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<!-- \/wp:freeform --><!-- \/wp:msr\/content-tab --><!-- wp:msr\/content-tab {\"title\":\"Submissions\"} --><!-- wp:freeform --><h2>Important dates<\/h2>\n<ul>\n<li><del datetime=\"2017-04-21T06:20:41+00:00\">March 24, 2017: Deadline for abstract\/paper submissions<\/del><\/li>\n<li><del datetime=\"2017-04-21T06:20:41+00:00\">April 14, 2017: Notification of acceptance<\/del><\/li>\n<li>May 15, 2017: Workshop day, at ICWSM 2017, Montreal, Canada<\/li>\n<\/ul>\n<h2>Abstract details<\/h2>\n<p>Submission should be <b>extended abstracts of up to 4 pages<\/b> and will be published on the workshop webpage and optionally (depending on the authors&#8217; choice) in the ICWSM\/AAAI workshop proceedings.\u00a0 Submissions will be evaluated by the program committee based on the quality of the work and its fit to the workshop themes.\u00a0 We explicitly encourage the submission of preliminary work.<\/p>\n<p>Authors whose papers are accepted to the workshop will be able to give a talk about their work (10min) and have the opportunity to participate in a poster session. In addition, the workshop will consist of structured discussion and breakout groups on topics pre-selected by participants. Potential outcomes of these discussions include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists.<\/p>\n<p>Authors are encouraged to use the AAAI-17 formatting guidelines.\u00a0 The author kit is available at <b><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" target=\"_blank\" href=\"http:\/\/www.aaai.org\/Publications\/Templates\/AuthorKit17.zip\">http:\/\/www.aaai.org\/Publications\/Templates\/AuthorKit17.zip<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/b>.<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<!-- \/wp:freeform --><!-- \/wp:msr\/content-tab --><!-- wp:msr\/content-tab {\"title\":\"Organization\"} --><!-- wp:freeform --><h2>Organizing Committee<\/h2>\n<ul>\n<li>Tim Althoff (Stanford University, <a href=\"mailto:althoff@cs.stanford.edu\">althoff@cs.stanford.edu<\/a>)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/eladyt\/\" target=\"_blank\">Elad Yom-Tov<\/a> (Microsoft Research, <a href=\"mailto:eladyt@microsoft.com\">eladyt@microsoft.com<\/a>)<\/li>\n<li>Munmun De Choudhury (Georgia Tech, <a href=\"mailto:munmund@gatech.edu\">munmund@gatech.edu<\/a>)<\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/emrek\/\" target=\"_blank\">Emre K\u0131c\u0131man<\/a> (Microsoft Research, <a href=\"mailto:emrek@microsoft.com\">emrek@microsoft.com<\/a>)<\/li>\n<\/ul>\n<p><em>Please contact us if you have any questions.<\/em><\/p>\n<h2>Program Committee<\/h2>\n<ul>\n<li>Carlos Castilllo, Eurecat<\/li>\n<li>Ingemar Cox, University College London<\/li>\n<li>Aron Culotta, Illinois Institute of Technology<\/li>\n<li>Luis Fernandez Luque, Qatar Computing Research Institute<\/li>\n<li>Shawndra Hill, Microsoft Research<\/li>\n<li>Brian Keegan, University of Colorado Boulder<\/li>\n<li>Alexandra Olteanu, IBM Research<\/li>\n<li>Daniel Romero, University of Michigan<\/li>\n<li>Amit Sharma, Microsoft Research<\/li>\n<li>Ingmar Weber, Qatar Computing Research Institute<\/li>\n<\/ul>\n<p><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<!-- \/wp:freeform --><!-- \/wp:msr\/content-tab --><!-- wp:msr\/content-tab {\"title\":\"Call for Contributions\"} --><!-- wp:freeform --><p>Held at <strong>ICWSM 2017<\/strong> (International AAAI Conference on Web and Social Media), Montreal, Canada, May 15, 2017<\/p>\n<p>Workshop webpage: <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ossm17\/\">https:\/\/www.microsoft.com\/en-us\/research\/event\/ossm17\/<\/a><\/p>\n<h3>CALL FOR CONTRIBUTIONS<\/h3>\n<p>The OSSM workshop will focus on observational studies (namely, causal analyses) of data traces created by people, whether directly or indirectly, through their interactions with social networks, messaging services, and other applications and devices.<\/p>\n<p>Human generated content in general, including social media, has been shown to be a rich repository of data for observational studies across many areas: public health, with research on prevalence of disease and on the effects of media on the development of disease; medicine, showing the ability to detect mental disease in individual using social media; education, to optimize teaching and exams; and sociology, to prove theories previously tested on very small populations. These studies have been conducted from data including social media, search engine logs, location traces, and other forms of human generated content.<\/p>\n<p>While many past studies showed a correlation between variables of interest, some studies were able to show causal relationships through natural experiments and careful analyses. Natural experiments are empirical studies in which people are assigned to control or experimental conditions according to factors not under the control of investigators, where these factors resemble a random assignment. With Internet data, natural experiments occur frequently through policy changes, outside influences, and A\/B testing. Our workshop will focus on all aspects of causal inference from human generated content, with studies that developed novel methods of identifying and using natural experiments or other methods for inferring causality.<\/p>\n<p>Studies based on human generated content require investigators to preserve the privacy of users and abide by proper ethical codes. We will encourage discussion of how these goals may be attained in secondary analysis of data such as that used in the aforementioned studies.<\/p>\n<p>We are soliciting participation both from domain-experts interested in specific applications of methods, as well as methods-experts.<\/p>\n<p>Topics of interest include, but are not limited to<\/p>\n<ul>\n<li>Applications and domain-specific explorations<\/li>\n<li>Interpreting user-generated data, including text, structured data, and temporal data<\/li>\n<li>Causal analyses in social media, for example, through conditioning analyses, instrumental variables or regression discontinuity analysis<\/li>\n<li>Identifying natural experiments and using them to understand causal inferences<\/li>\n<li>Identifying and\/or mitigating population, behavioral and other systematic biases in social media<\/li>\n<li>Novel methods for preserving privacy in such experimentation<\/li>\n<li>Ethical implications of such experiments<\/li>\n<li>Qualitative, experimental and other evaluation and validation methods for observational study results<\/li>\n<\/ul>\n<p>Submission should be extended abstracts of up to 4 pages and and will be published on the workshop webpage and optionally (depending on the author&#8217;s&#8217; choice) in the ICWSM\/AAAI workshop proceedings. We explicitly encourage the submission of preliminary work.<\/p>\n<p>Authors whose papers are accepted to the workshop will be able to give a talk about their work (10min) and have the opportunity to participate in a poster session. In addition, the workshop will consist of structured discussion and breakout groups on topics pre-selected by participants. Potential outcomes of these discussions include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists.<\/p>\n<h3>KEY DATES<\/h3>\n<ul>\n<li>Submission deadline:<strong> March 24, 2017<\/strong><\/li>\n<li>Author feedback: April 14, 2017<\/li>\n<li>Workshop event (Montreal, Canada): May 15, 2017<\/li>\n<\/ul>\n<p>Please see workshop webpage for formatting and submission instructions.<\/p>\n<h3>ORGANIZATION<\/h3>\n<p>Tim Althoff, Stanford University<\/p>\n<p>Elad Yom-Tov, Microsoft Research<\/p>\n<p>Munmun De Choudhury, Georgia Tech<\/p>\n<p>Emre K\u0131c\u0131man, Microsoft Research<\/p>\n<h3>CONTACT<\/h3>\n<p>Please direct your questions to <a href=\"mailto:ossm-workshop@googlegroups.com\">ossm-workshop@googlegroups.com<\/a><span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span><\/p>\n<!-- \/wp:freeform --><!-- \/wp:msr\/content-tab --><!-- \/wp:msr\/content-tabs -->","tab-content":[{"id":0,"name":"Program","content":"<table class=\" msr-table-schedule all-borders\" style=\"border-collapse: collapse;border-spacing: inherit\" width=\"636\">\r\n<tbody>\r\n<tr>\r\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>11:00am-12:30pm<\/strong><\/td>\r\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Keynote: <strong>Matching Methods and Natural Experiments: Examples of Causal Inferences from Social Media.\u00a0<\/strong> <em>Ingmar Weber, QCRI<\/em>\r\n\r\nInvited Talk.\u00a0 <strong>Estimating causal effects at scale. <\/strong>Amit Sharma (Microsoft Research)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>12:30-2:00pm<\/strong><\/td>\r\n<td style=\"padding: inherit;border: inherit\" width=\"492\"><em>Lunch (on your own)<\/em><\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>2:00-3:30pm<\/strong><\/td>\r\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Tutorial: <strong>Intuition and basic methods for causal inference over social media data<\/strong>.\u00a0 <em>Emre K\u0131c\u0131man<\/em>\r\n\r\nTalks\r\n<ul>\r\n \t<li><strong>Estimating the Effect of Exercising on Users\u2019 Online Behavior.<\/strong> <em>Amin Mirlohi, Hawre Hosseini, Zeinab Noorian and Ebrahim Bagheri<\/em><\/li>\r\n \t<li><strong>Qualitative Exploration and Early Discovery of Prior-Information for Causal Inference<\/strong> <em>Pablo Paredes<\/em><\/li>\r\n<\/ul>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>3:30-4:00pm<\/strong><\/td>\r\n<td style=\"padding: inherit;border: inherit\" width=\"492\"><em>Afternoon break<\/em><\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"padding: inherit;border: inherit\" width=\"144\"><strong>4:00-5:00pm<\/strong><\/td>\r\n<td style=\"padding: inherit;border: inherit\" width=\"492\">Keynote: <strong>Ruffled Feathers: When Can Gender Be Predicted on Social Networks?<\/strong>\u00a0<em>Johan Ugander, Stanford<\/em><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n&nbsp;\r\n<h2>Details<\/h2>\r\n<strong>Matching Methods and Natural Experiments: Examples of Causal Inferences from Social Media<\/strong>\r\nIngmar Weber (QCRI)\r\n\r\nAbstract: This talk will feature a mix of own and others\u2019 work, and will be part tutorial and part experience report on how to use two causal inference methodologies: natural experiments and matching methods. On the topic of natural experiments, I\u2019ll present three bits of work that use weather and its randomness as an instrumental variable to study social influence in social networks. First, we\u2019ll look how emotional contagion on Facebook can be studied in an non-intrusive matter [Coviello et al., PLoS ONE, 2014]. Next, we\u2019ll discuss recent work that looks at social contagion in a large physical fitness social network [Aral &amp; Nicolaides, Nature Communications, 2017]. Finally, I\u2019ll present ongoing work in which we use weather to study the social contagion of ice-cream consumption [Mejova et al., ongoing]. For matching methods, we first present work that uses propensity score matching to look at how feedback on news comments affects the commenter\u2019s future behavior in the community [Cheng et al., ICWSM, 2014]. Next I\u2019ll present work that studies the effect of receiving social support in a weight loss forum in Reddit on the actual weight loss reported in the end [Cunha et al., WWW-WebSci, 2017]. The presentations of all papers, including our own, will in particular focus on particular shortcomings, hopefully leading to a lively discussion on both the promises and limitations of causal inference from observational data.\r\n\r\n\r\n\r\nAbout Ingmar Weber:\u00a0 Ingmar is the Research Director of the Social Computing Group at the Qatar Computing Research Institute (QCRI). His interdisciplinary research uses large amounts of online data from social media and other sources to study human behavior at scale. Particular topics of interest include studying lifestyle diseases and population health, quantifying international migration using digital methods, and looking at political polarization and extremism. He has published over 100 peer-reviewed articles and his work is frequently featured in popular press. Since 2016 he has been selected as an ACM Distinguished Speaker.\r\n\r\nAs an undergraduate Ingmar studied mathematics at Cambridge University (1999-2003), before pursuing a PhD at the Max-Planck Institute for Computer Science (2003-2007). He subsequently held positions at the Ecole Polytechnique Federale de Lausanne (2007-2009) and Yahoo Research Barcelona (2009-2012), as well as a visiting researcher position at Microsoft Research Cambridge (summer 2008). He serves on a number of program committees for top-tier conferences in the domain of web data mining and social media analysis including ICWSM, KDD, WWW, ACL, ASONAM, WSDM, SDM, VLDB and WebSci, as well as on the editorial board for the Journal of Web Science.\r\n\r\n<hr \/>\r\n\r\n<strong>Ruffled Feathers: When Can Gender Be Predicted on Social Networks?<\/strong>\r\nJohan Ugander (Stanford University)\r\n\r\nAbstract: Homophily, or ``love of the same,'' is a prominent and well-studied structural feature of social networks. Modern machine learning methods have exploited the empirical ubiquity of homophily to predict the private traits of individuals in social networks, with broad implications for both privacy research and statistical matching methods. However, gender inference on large-scale online networks introduces a unique challenge to conventional prediction methods as gender homophily can be weak or nonexistent. In this work we identify another useful structural property we call monophily that is characterized by an overdispersion of gender preferences beyond what can be explained by homophily. We jointly characterize the statistical structure of homophily and monophily in social networks in terms of preference bias and variance, and demonstrate that monophily can drive surprisingly accurate predictions in graphs where weak homophily might otherwise suggest a difficult classification problem. These findings offer an alternative perspective on network trait inference in general and gender in particular, complicating the already difficult task of protecting privacy in social networks, and introducing new considerations regarding any study of social network covariates. This is joint work with Kristen M. Altenburger.\r\n\r\nAbout Johan Ugander: Johan Ugander is an Assistant Professor at Stanford University in the Department of Management Science &amp; Engineering, within the School of Engineering. His research develops algorithmic and statistical frameworks for analyzing social networks, social systems, and other large-scale social data, with an emphasis on methods for causal inference. Prior to joining the Stanford faculty he was a post-doctoral researcher at Microsoft Research Redmond 2014-2015 and held an affiliation with the Facebook Data Science team 2010-2014. He obtained his Ph.D. in Applied Mathematics from Cornell University in 2014.\r\n\r\n<hr \/>\r\n\r\n<strong>Estimating causal effects at scale<\/strong>\r\nAmit Sharma (Microsoft Research)\r\n\r\nAbstract: As an increasing amount of daily activity---ranging from what we purchase to whom we talk to---shifts to online platforms, it is only natural to ask how those platforms impact our behavior. Estimating the causal impact of digital systems, however, is non-trivial without the luxury of doing randomized experiments. In this talk, I will present methods for estimating the impact of systems from observed usage data, combining principles from statistical data mining and causal inference literature. The first method provides an algorithm for automating the search for natural experiments, whenever we can find a suitable auxiliary control variable. Using it on Amazon's recommender system, I find that the causal impact of recommendations is less than half of the metrics typically reported for online systems. The second method utilizes the scale of online systems to compute causal effect using extreme events. I will show its application to Bing, where it was used to investigate causal differences in user satisfaction for people from different demographics.\r\n\r\nAbout Amit Sharma: Amit Sharma is a postdoctoral researcher at Microsoft Research, New York. His research focuses on understanding the underlying mechanisms that shape people's activities online, with a particular emphasis on the effect of recommendation systems and social influence. More generally, his work contributes to methods for causal inference from large-scale data. He completed his Ph.D. in computer science at Cornell University. He has received a Best Paper Honorable Mention Award at the 2016 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW), the 2012 Yahoo! Key Scientific Challenges Award and the 2009 Honda Young Engineer and Scientist Award.\r\n\r\n<hr \/>\r\n\r\n<strong>Estimating the Effect of Exercising on Users\u2019 Online Behavior<\/strong>\r\nAmin Mirlohi, Hawre Hosseini, Zeinab Noorian and Ebrahim Bagheri\r\n\r\nAbstract: This study aims to estimate the influence of offline activity on users\u2019 online behavior, relying on a matching method to reduce the effect of confounding variables. We analyze activities of 850 users who are active on both Twitter and Foursquare social networks. Users\u2019 offline activity is extracted from Foursquare posts and users\u2019 online behavior is extracted from Twitter posts. Users\u2019 interests, representing their online behavior, are extracted with regards to a set of topics in several subsequent time intervals. The shift of users\u2019 interests across different time intervals is taken as a measure of user behavior change on the social network. On the other hand, we employ user check-ins at a gym or fitness center as a sign of exercise and consider it to be an offline activity. In order to find the effect of exercise on online behavior, we identify users who did not go to the gym for at least two months but did so at least nine times in the next three months. We show that shift in interest reduces significantly for users after they start exercising, which implies that the offline activity of exercising can influence how users\u2019 interests are shaped and change on the social network over time.\r\n\r\n<hr \/>\r\n\r\n<strong>Qualitative Exploration and Early Discovery of Prior-Information for Causal Inference<\/strong>\r\nPablo Paredes, Philipp Dowling, Vasilis Oikonomou, Biye Jiang, Coye Cheshire, John Canny and James Landay\r\n\r\nAbstract: In this paper, we propose a set of qualitative temporal exploration features for Inquire [Paredes, et al.] to support observational studies and causal inference. Inquire is a system that supports qualitative or mixed-methods researchers across different fields in their insight discovery and ideation processes. Inquire enables its users to access large-scale corpora of text, and perform sophisticated searches and exploration on this data through semantic vector space models that allow rich exploratory methods far beyond simple text search. When applied to the LiveJournal.com dataset, which consists of millions of anonymous journal entries, our system can help researchers compile data sets of users and their posts that capture specific semantic criteria. For instance, a researcher can create a data set of people who write about both \u201cbeing stressed\u201d and \u201cfeeling lonely,\u201d to attempt to subsequently establish a temporal relationship between stress and loneliness (or vice-versa). Inquire enables the researcher to perform interactive qualitative temporal analysis of these users can lead to the discovery of case-studies. Furthermore, individual or aggregated analysis of these cases could result in the discovery of less-obvious covariates. For example, a group of people under \u201cstress\u201d who feel \u201clonely\u201d could potentially also have expressed in their journal entries some elements associated with \u201cburnout\u201d or \u201cfamily conflicts.\u201d In summary, we propose a tool for exploration of social-media data to expand the discovery of counterfactuals and covariates that would strengthen the theoretical and empirical informational space needed to develop robust causal inference studies. <!--more-->"},{"id":1,"name":"Description","content":"<b>News! <\/b>We are happy to announce our two keynote speakers, <strong>Johan Ugander <\/strong>and<strong> Ingmar Weber<\/strong>!\r\n\r\nThe OSSM workshop will focus on observational studies (namely, causal analyses) of data traces created by people, whether directly or indirectly, through their interactions with social networks, messaging services, and other applications and devices.\r\n\r\nHuman generated content in general, including social media, has been shown to be a rich repository of data for observational studies across many areas:\u00a0 public health, with research on prevalence of disease and on the effects of media on the development of disease; medicine, showing the ability to detect mental disease in individual using social media; education, to optimize teaching and exams; and sociology, to prove theories previously tested on very small populations. These studies have been conducted from data including social media, search engine logs, location traces, and other forms of human generated content.\r\n\r\nWhile many past studies showed a correlation between variables of interest, some studies were able to show causal relationships through natural experiments and careful analyses. Natural experiments are empirical studies in which people are assigned to control or experimental conditions according to factors not under the control of investigators, where these factors resemble a random assignment. With Internet data, natural experiments occur frequently through policy changes, outside influences, and A\/B testing. Our workshop will focus on all aspects of causal inference from human generated content, with studies that developed novel methods of identifying and using natural experiments or other methods for inferring causality.\r\n\r\nStudies based on human generated content require investigators to preserve the privacy of users and abide by proper ethical codes. We will encourage discussion of how these goals may be attained in secondary analysis of data such as that used in the aforementioned studies.\r\n\r\nWe are soliciting participation both from domain-experts interested in specific applications of methods, as well as methods-experts.\r\n\r\nTopics of interest broadly include:\r\n<ul>\r\n \t<li>Applications and domain-specific explorations<\/li>\r\n \t<li>Interpreting user-generated data, including text, structured data, and temporal data.<\/li>\r\n \t<li>Causal analyses in social media, for example, through conditioning analyses, instrumental variables or regression discontinuity analysis.<\/li>\r\n \t<li>Identifying natural experiments and using them to understand causal inferences<\/li>\r\n \t<li>Identifying and\/or mitigating population, behavioral and other systematic biases in social media<\/li>\r\n \t<li>Novel methods for preserving privacy in such experimentation<\/li>\r\n \t<li>Ethical implications of such experiments<\/li>\r\n \t<li>Qualitative, experimental and other evaluation and validation methods for observational study results<\/li>\r\n<\/ul>\r\n<h2>General Format<\/h2>\r\nThe core of the workshop will consist of structured discussion and breakouts on topics preselected by participants.\u00a0 Broad discussion topics will be chosen based on initial submissions, and refined during a pre-workshop video chat open to all workshop participants several weeks prior to the workshop.\u00a0 Potential outcomes of these breakouts will include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists. We will support breakout groups with a facilitator as well as a scribe."},{"id":2,"name":"Submissions","content":"<h2>Important dates<\/h2>\r\n<ul>\r\n \t<li><del datetime=\"2017-04-21T06:20:41+00:00\">March 24, 2017: Deadline for abstract\/paper submissions<\/del><\/li>\r\n \t<li><del datetime=\"2017-04-21T06:20:41+00:00\">April 14, 2017: Notification of acceptance<\/del><\/li>\r\n \t<li>May 15, 2017: Workshop day, at ICWSM 2017, Montreal, Canada<\/li>\r\n<\/ul>\r\n<h2>Abstract details<\/h2>\r\n\r\nSubmission should be <b>extended abstracts of up to 4 pages<\/b> and will be published on the workshop webpage and optionally (depending on the authors' choice) in the ICWSM\/AAAI workshop proceedings.\u00a0 Submissions will be evaluated by the program committee based on the quality of the work and its fit to the workshop themes.\u00a0 We explicitly encourage the submission of preliminary work.\r\n\r\nAuthors whose papers are accepted to the workshop will be able to give a talk about their work (10min) and have the opportunity to participate in a poster session. In addition, the workshop will consist of structured discussion and breakout groups on topics pre-selected by participants. Potential outcomes of these discussions include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists.\r\n\r\nAuthors are encouraged to use the AAAI-17 formatting guidelines.\u00a0 The author kit is available at <b><a href=\"http:\/\/www.aaai.org\/Publications\/Templates\/AuthorKit17.zip\">http:\/\/www.aaai.org\/Publications\/Templates\/AuthorKit17.zip<\/a><\/b>."},{"id":3,"name":"Organization","content":"<h2>Organizing Committee<\/h2>\r\n<ul>\r\n \t<li>Tim Althoff (Stanford University, <a href=\"mailto:althoff@cs.stanford.edu\">althoff@cs.stanford.edu<\/a>)<\/li>\r\n \t<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/eladyt\/\" target=\"_blank\">Elad Yom-Tov<\/a> (Microsoft Research, <a href=\"mailto:eladyt@microsoft.com\">eladyt@microsoft.com<\/a>)<\/li>\r\n \t<li>Munmun De Choudhury (Georgia Tech, <a href=\"mailto:munmund@gatech.edu\">munmund@gatech.edu<\/a>)<\/li>\r\n \t<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/emrek\/\" target=\"_blank\">Emre K\u0131c\u0131man<\/a> (Microsoft Research, <a href=\"mailto:emrek@microsoft.com\">emrek@microsoft.com<\/a>)<\/li>\r\n<\/ul>\r\n<em>Please contact us if you have any questions.<\/em>\r\n<h2>Program Committee<\/h2>\r\n<ul>\r\n \t<li>Carlos Castilllo, Eurecat<\/li>\r\n \t<li>Ingemar Cox, University College London<\/li>\r\n \t<li>Aron Culotta, Illinois Institute of Technology<\/li>\r\n \t<li>Luis Fernandez Luque, Qatar Computing Research Institute<\/li>\r\n \t<li>Shawndra Hill, Microsoft Research<\/li>\r\n \t<li>Brian Keegan, University of Colorado Boulder<\/li>\r\n \t<li>Alexandra Olteanu, IBM Research<\/li>\r\n \t<li>Daniel Romero, University of Michigan<\/li>\r\n \t<li>Amit Sharma, Microsoft Research<\/li>\r\n \t<li>Ingmar Weber, Qatar Computing Research Institute<\/li>\r\n<\/ul>"},{"id":4,"name":"Call for Contributions","content":"Held at <strong>ICWSM 2017<\/strong> (International AAAI Conference on Web and Social Media), Montreal, Canada, May 15, 2017\r\n\r\nWorkshop webpage: <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ossm17\/\">https:\/\/www.microsoft.com\/en-us\/research\/event\/ossm17\/<\/a>\r\n<h3>CALL FOR CONTRIBUTIONS<\/h3>\r\nThe OSSM workshop will focus on observational studies (namely, causal analyses) of data traces created by people, whether directly or indirectly, through their interactions with social networks, messaging services, and other applications and devices.\r\n\r\nHuman generated content in general, including social media, has been shown to be a rich repository of data for observational studies across many areas: public health, with research on prevalence of disease and on the effects of media on the development of disease; medicine, showing the ability to detect mental disease in individual using social media; education, to optimize teaching and exams; and sociology, to prove theories previously tested on very small populations. These studies have been conducted from data including social media, search engine logs, location traces, and other forms of human generated content.\r\n\r\nWhile many past studies showed a correlation between variables of interest, some studies were able to show causal relationships through natural experiments and careful analyses. Natural experiments are empirical studies in which people are assigned to control or experimental conditions according to factors not under the control of investigators, where these factors resemble a random assignment. With Internet data, natural experiments occur frequently through policy changes, outside influences, and A\/B testing. Our workshop will focus on all aspects of causal inference from human generated content, with studies that developed novel methods of identifying and using natural experiments or other methods for inferring causality.\r\n\r\nStudies based on human generated content require investigators to preserve the privacy of users and abide by proper ethical codes. We will encourage discussion of how these goals may be attained in secondary analysis of data such as that used in the aforementioned studies.\r\n\r\nWe are soliciting participation both from domain-experts interested in specific applications of methods, as well as methods-experts.\r\n\r\nTopics of interest include, but are not limited to\r\n<ul>\r\n \t<li>Applications and domain-specific explorations<\/li>\r\n \t<li>Interpreting user-generated data, including text, structured data, and temporal data<\/li>\r\n \t<li>Causal analyses in social media, for example, through conditioning analyses, instrumental variables or regression discontinuity analysis<\/li>\r\n \t<li>Identifying natural experiments and using them to understand causal inferences<\/li>\r\n \t<li>Identifying and\/or mitigating population, behavioral and other systematic biases in social media<\/li>\r\n \t<li>Novel methods for preserving privacy in such experimentation<\/li>\r\n \t<li>Ethical implications of such experiments<\/li>\r\n \t<li>Qualitative, experimental and other evaluation and validation methods for observational study results<\/li>\r\n<\/ul>\r\nSubmission should be extended abstracts of up to 4 pages and and will be published on the workshop webpage and optionally (depending on the author's' choice) in the ICWSM\/AAAI workshop proceedings. We explicitly encourage the submission of preliminary work.\r\n\r\nAuthors whose papers are accepted to the workshop will be able to give a talk about their work (10min) and have the opportunity to participate in a poster session. In addition, the workshop will consist of structured discussion and breakout groups on topics pre-selected by participants. Potential outcomes of these discussions include a position paper, or potential research directions\/ideas that could lead to interdisciplinary collaborations, particularly between computer and social scientists.\r\n<h3>KEY DATES<\/h3>\r\n<ul>\r\n \t<li>Submission deadline:<strong> March 24, 2017<\/strong><\/li>\r\n \t<li>Author feedback: April 14, 2017<\/li>\r\n \t<li>Workshop event (Montreal, Canada): May 15, 2017<\/li>\r\n<\/ul>\r\nPlease see workshop webpage for formatting and submission instructions.\r\n<h3>ORGANIZATION<\/h3>\r\nTim Althoff, Stanford University\r\n\r\nElad Yom-Tov, Microsoft Research\r\n\r\nMunmun De Choudhury, Georgia Tech\r\n\r\nEmre K\u0131c\u0131man, Microsoft Research\r\n<h3>CONTACT<\/h3>\r\nPlease direct your questions to <a href=\"mailto:ossm-workshop@googlegroups.com\">ossm-workshop@googlegroups.com<\/a>"}],"msr_startdate":"2017-05-15","msr_enddate":"2017-05-15","msr_event_time":"","msr_location":"Montreal, Canada","msr_event_link":"","msr_event_recording_link":"","msr_startdate_formatted":"May 15, 2017","msr_register_text":"Watch now","msr_cta_link":"","msr_cta_text":"","msr_cta_bi_name":"","featured_image_thumbnail":null,"event_excerpt":"The ICWSM workshop on Observational Studies in Social Media and other human-generated content (OSSM, pronounced \u201cawesome\u201d), brings together social scientists, computer scientists, and others who are investigating observational studies of digital interactions and data traces across many areas, including public health, medicine, sociology, education and others.","msr_research_lab":[],"related-researchers":[{"type":"user_nicename","value":"emrek","display_name":"Emre Kiciman","author_link":"<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/emrek\/\" aria-label=\"Visit the profile page for Emre Kiciman\">Emre Kiciman<\/a>","is_active":false,"user_id":31739,"last_first":"Kiciman, Emre","people_section":0,"alias":"emrek"}],"msr_impact_theme":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-opportunities":[],"related-publications":[],"related-videos":[],"related-posts":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event\/357179","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-event"}],"version-history":[{"count":3,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event\/357179\/revisions"}],"predecessor-version":[{"id":1147192,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event\/357179\/revisions\/1147192"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=357179"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=357179"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=357179"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=357179"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=357179"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=357179"},{"taxonomy":"msr-program-audience","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-program-audience?post=357179"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=357179"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=357179"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}