{"id":772372,"date":"2021-09-09T07:36:05","date_gmt":"2021-09-09T14:36:05","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-blog-post&#038;p=772372"},"modified":"2021-09-22T10:12:17","modified_gmt":"2021-09-22T17:12:17","slug":"the-leaf-blower-problem-and-the-importance-of-helping-our-users-find-common-ground-in-hybrid-work","status":"publish","type":"msr-blog-post","link":"https:\/\/www.microsoft.com\/en-us\/research\/articles\/the-leaf-blower-problem-and-the-importance-of-helping-our-users-find-common-ground-in-hybrid-work\/","title":{"rendered":"The \u201cLeaf Blower Problem\u201d and the importance of common ground"},"content":{"rendered":"<h4>How the \u201cLeaf Blower Problem\u201d highlights the importance of helping our users find <em>common ground<\/em> in hybrid work<\/h4>\n<p><em>By <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/brhecht\/\">Brent Hecht<\/a>, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/teevan\/\">Jaime Teevan<\/a>, and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/asellen\/\">Abi Sellen<\/a><\/em><\/p>\n<p>In the past year, leaf blowers, barking dogs, and fussy children have all become staples of our online meetings. This is a case where technology has seemed to come to the rescue, and one of the more impressive AI features in Teams and online meeting software is <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/support.microsoft.com\/en-us\/office\/reduce-background-noise-in-teams-meetings-1a9c6819-137d-4b3b-a1c8-4ab20b234c0d\" target=\"_blank\" rel=\"noopener noreferrer\">background noise reduction<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. Noise reduction capabilities, however, have become so good that they have introduced a new issue, which we call the \u201cLeaf Blower Problem.\u201d And the Leaf Blower Problem is about more than just leaf blowers (or dogs or children): it highlights the importance of designing for \u201ccommon ground\u201d, one of the more critical design challenges in developing technologies for remote and hybrid work.<\/p>\n<p>Put simply, the Leaf Blower Problem occurs during online meetings when there is a very loud background noise for one participant and a background noise reduction system successfully eliminates that noise for the other participants. Problem solved, right? Nope! While the noise reduction minimizes distraction for other participants, it does not do so for the person collocated with loud noise. This creates a gap in the shared experience of the participants. The people who can\u2019t hear the noise may wonder why the person who can is distracted or not paying attention. And the person who can hear the noise may not know that the noise has been eliminated for the others, causing that person to apologize into the silence for \u201cAll that noise that\u2019s coming through!\u201d<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-772462 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/NFW_leafblowerproblem.jpg\" alt=\"New future of work - distracted woman in a remote meeting\" width=\"932\" height=\"588\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/NFW_leafblowerproblem.jpg 932w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/NFW_leafblowerproblem-300x189.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/NFW_leafblowerproblem-768x485.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2021\/09\/NFW_leafblowerproblem-240x151.jpg 240w\" sizes=\"auto, (max-width: 932px) 100vw, 932px\" \/><\/p>\n<p>The Leaf Blower Problem is a new manifestation of an old problem in human-centered AI and UX design. Specifically, the problem is a version of a grounding error, a well-known issue among the class of those in human-centered AI and UX trained in psycholinguistics. Grounding errors get in the way of a key requirement for effective conversations: common ground.<\/p>\n<p>Prof. Darren Gergle at Northwestern University and his colleagues provide a good summary of the role of common ground in communication.<\/p>\n<p>\u201c<em>Successful communication relies on a foundation of mutual knowledge or common ground. Conversational grounding is the process of establishing that common ground. Speakers form utterances based on an expectation of what a listener is likely to know and then monitor that the utterances are understood, whereas listeners have a responsibility to demonstrate their level of understanding.<\/em>\u201d (<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/collablab.northwestern.edu\/pubs\/HCI2013-GergleKrautFussell-UsingVisualInformationforGroundingandAwarenessinCollaborativeTasks.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Gergle et al. 2013<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>)<\/p>\n<p>Through the lens of Gergle\u2019s description, we can understand a ground error as something that prevents all the people in a conversation from having the same understanding of what\u2019s going on, and \u2013 critically &#8211; knowing that they all have that same understanding. In other words, a grounding error is something that negatively affects a group\u2019s ability to achieve common ground. Without common ground, significant miscommunications, team-wide failures, and even serious conflict can occur, in addition to other problems like the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/en.wikipedia.org\/wiki\/Actor%E2%80%93observer_asymmetry\" target=\"_blank\" rel=\"noopener noreferrer\">actor-observer effect<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n<p>Some examples are illustrative. If Maria, a programmer, uses an acronym like \u201cRESTful\u201d with Nell, who is not a programmer, and Nell doesn\u2019t ask for clarification, a grounding error has occurred. Maria and Nell don\u2019t have the same understanding of the key entity being discussed, and they don\u2019t know they don\u2019t have that same understanding. The conversation may be derailed until common ground around the entity Maria is talking about can be established. A related example comes from AI systems that translate between languages: if Maria says the word \u201cred\u201d, but an AI system translates that to \u201cpurple\u201d in Chinese, it will be very difficult for all participants in the conversation to have the same understanding of what\u2019s being discussed and know that each is having the same understanding. The conversation will be disrupted until all participants are able to reestablish a common ground around the color that Maria is discussing.<\/p>\n<p>The exact same dynamic occurs in the Leaf Blower Problem. Maria might hear a horrendously loud noise, but Maria doesn\u2019t know if the others in the meeting hear that noise as well. In other words, Maria doesn\u2019t know if the noise is common ground. Similarly, if the noise is not audible to Maria\u2019s colleagues, Maria\u2019s colleagues do not know why Maria might be acting distracted; the reason Maria is acting distracted is another piece of information that is not the common ground of the meeting. The desire to re-establish common ground in any conversation is the reason why Maria feels the urge to explain that she can hear a leaf blower (or crying baby, or vacuum cleaner\u2026) and to tell folks that is why she is feeling distracted.<\/p>\n<p>Grounding errors that are caused by technology can usually be mitigated or addressed with better technology design that prioritizes common ground. How can meeting software support the participants in a call in achieving common ground in the presence of background noise reduction? One approach might be to use an icon similar to the mute indicator to let others on a call know that one person is experiencing significant background noise, and thus may be distracted. Another design might detect whether a loud background sound is present on the other ends of a call and provide a pop-up notifying the person who is experiencing the background sound, e.g., \u201cNoise reduction successfully eliminated the background noise you are experiencing\u201d (or the inverse). This could appear in a banner at the top of the screen similar to recording notifications.<\/p>\n<p>More generally, as we increasingly build systems for hybrid settings, we have to <strong>ensure that we minimize the amount of time it takes for all participants to successfully achieve common ground<\/strong>. This means either designing common ground into meeting software (by making sure, for example, visual and auditory experiences are shared). When that is not possible \u2013 e.g., when there is a leaf blower present \u2013 every effort should be made to scaffold the grounding process so that each participant is aware of the other\u2019s situation.<\/p>\n<p>People will have many other grounding challenges as we enter a world of hybrid work. Some examples include:<\/p>\n<ul>\n<li>We already see people wanting to know if others can see a shared document after they\u2019ve shared it. The common \u201cCan you see my screen?\u201d utterance emerges out of the desire to ensure common ground in a conversation.<\/li>\n<li>Common ground is undermined in the default \u201cBrady Bunch\u201d video call layout because the layout is different for each person. An obvious manifestation of this occurs when we \u201cgo around the table\u201d to introduce people and there is no shared ordering to allow us all to know who should go next. Likewise, pointing or head turning towards someone doesn\u2019t work (unlike in the opening credits of the Brady Bunch) due to the lack of this mutually shared frame of reference. This is one reason why Together Mode in Teams has benefits: everyone knows that everyone else see the same view.<\/li>\n<li>When a person sends an emoji on Teams or Slack in Windows and it shows up on Teams or Slack in iOS, the emoji will be rendered differently (i.e. using Apple emoji instead of Microsoft emoji). This can create grounding challenges similar to the machine translation example above (see Miller et al. 2016).<\/li>\n<li>In hybrid settings, collocated meeting participants will struggle to know if remote participants have heard side conversations, and the inverse is true with parallel chat. This also extends to shared artifacts: remote people will often not see or understand how in-room participants are viewing shared whiteboards, documents, or other objects, including gestures around them.<\/li>\n<li>Grounding is a key reason why self-view has become a mandatory feature for video calls. People want to see what others see when they look at their box. In hybrid work, this will be more difficult for collocated participants.<\/li>\n<\/ul>\n<p>Grounding covers a huge range of issues from &#8220;in-the-moment&#8221; shared understanding, through to shared history and knowledge, to shared culture. All of this is fundamental to our ability to communicate and collaborate together. Those who are particularly interested in learning more about grounding in communication can read <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.cambridge.org\/core\/books\/using-language\/4E7EBC4EC742C26436F6CF187C43F239\" target=\"_blank\" rel=\"noopener noreferrer\">Prof. Herb Clark\u2019s foundational book<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> on the topic. If you\u2019d like a quicker summary, Gergle and colleagues\u2019 <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/collablab.northwestern.edu\/pubs\/HCI2013-GergleKrautFussell-UsingVisualInformationforGroundingandAwarenessinCollaborativeTasks.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">2013 paper on grounding in video calls<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (read to the end of Section 2) and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/ojs.aaai.org\/index.php\/ICWSM\/article\/view\/14901\/14751\" target=\"_blank\" rel=\"noopener noreferrer\">Miller et al.\u2019s 2017 paper on grounding and emoji<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (read to the end of the introduction) are great places to start.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In the past year, leaf blowers, barking dogs, and fussy children have all become staples of our online meetings. This is a case where technology has seemed to come to the rescue, and one of the more impressive AI features in Teams and online meeting software is background noise reduction. Noise reduction capabilities, however, have become so good that they have introduced a new issue, which we call the \u201cLeaf Blower Problem.\u201d<\/p>\n","protected":false},"author":40306,"featured_media":772462,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-content-parent":717493,"msr_hide_image_in_river":0,"footnotes":""},"research-area":[],"msr-locale":[268875],"msr-post-option":[],"class_list":["post-772372","msr-blog-post","type-msr-blog-post","status-publish","has-post-thumbnail","hentry","msr-locale-en_us"],"msr_assoc_parent":{"id":717493,"type":"project"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/772372","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-blog-post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/40306"}],"version-history":[{"count":7,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/772372\/revisions"}],"predecessor-version":[{"id":777358,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/772372\/revisions\/777358"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/772462"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=772372"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=772372"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=772372"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=772372"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}