Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
CHI 2024 | May 2024
Adam Fourney
Principal Researcher
Publications
Publications by Year
-
When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
January 2024
-
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ArXiv Preprint | February 2023
-
Understanding questions that arise when working with business documents
FARNAZ JAHANBAKHSH, Elnaz Nouri, Robert Sim, Ryen W. White, Adam Fourney
Human-Computer Interaction | November 2022
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
Two Birds with One Phone: The Role of Mobile Use in the Daily Practices of Remote Information Work
Vedant Das Swain, Shane Williams, Adam Fourney, Shamsi Iqbal
CHIWORK 2022 | June 2022
Exploring Interactive Sound Design for Auditory Websites
Lotus Zhang, Jingyao Shao, Augustina Ao Liu, Lucy Jiang, Abigale Stangl, Adam Fourney, Meredith Ringel Morris, Leah Findlater
CHI 2022 | April 2022
-
Social Media through Voice: Synthesized Voice Qualities and Self-presentation
Lotus Zhang, Lucy Jiang, Nicole Washington, Augustina Ao Liu, Jingyao Shao, Adam Fourney, Meredith Ringel Morris, Leah Findlater
CSCW 2021 | October 2021
NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction
Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah
NAACL 2021 | June 2021
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
DIY: Assessing the Correctness of Natural Language to SQL Systems
Arpit Narechania, Adam Fourney, Bongshin Lee, Gonzalo Ramos
IUI | April 2021
-
Leveraging Structured Metadata for Improving Question Answering on the Web
Xinya Du, Adam Fourney, Robert Sim, Paul Bennett, Claire Cardie, Ahmed Awadallah
AACL 2020 | December 2020
An Eye Tracking Study of Web Search by People with and without Dyslexia
Srishti Palani, Adam Fourney, Shane Williams, Kevin Larson, Irina Spiridonova, Meredith Ringel Morris
SIGIR 2020 | July 2020
Proactive Suggestion Generation: Data and Methods for Stepwise Task Assistance
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
Proceedings of the 43 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020) | July 2020
Characterizing Search-Engine Traffic to Internet Research Agency Web Properties
Alexander Spangher, Gireeja Ranade, Besmira Nushi, Adam Fourney, Eric Horvitz
The Web Conference (TheWebConf '20) | April 2020
On How People Navigate Through Their Personal Web of Things
Dhivya Eswaran, Shamsi Iqbal, Adam Fourney, Shane Williams, Paul Bennett
CHI 2020 Workshop on Speculative Designs for Emergent Personal Data Trails | April 2020
Conversations with Documents: An Exploration of Document-Centered Assistance
Maartje ter Hoeve, Robert Sim, Elnaz Nouri, Adam Fourney, Maarten de Rijke, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Step-wise Recommendation for Complex Task Support
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Toward Activity Discovery in the Personal Web
Tara Safavi, Adam Fourney, Robert Sim, Marcin Juraszek, Shane Williams, Ned Friend, Danai Koutra, Paul Bennett
The 13th ACM International Conference on Web Search and Data Mining (WSDM) | February 2020
-
VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Alexandra Vtyurina, Adam Fourney, Meredith Ringel Morris, Leah Findlater, Ryen W. White
ASSETS 2019 | October 2019
Best Paper Nominee
Mercury: Empowering Programmers’ Mobile Work Practices with Microproductivity
Alex Williams, Harmanpreet Kaur, Shamsi Iqbal, Ryen W. White, Jaime Teevan, Adam Fourney
UIST 2019 | October 2019
Multi-device digital assistance
Ryen W. White, Adam Fourney, Allen Herring, Paul Bennett, Nirupama Chandrasekaran, Robert Sim, Elnaz Nouri, Mark Encarnación
Communications of the ACM | July 2019
Studying Preferences and Concerns about Information Disclosure in Email Notifications
Yongsung Kim, Adam Fourney, Ece Kamar
The Web Conference (WWW '19) | May 2019
The Impact of Web Browser Reader Views on Reading Speed and User Experience
Qisheng Li, Meredith Ringel Morris, Adam Fourney, Kevin Larson, Katherina Reinecke
CHI 2019 | May 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Supporting Complex Tasks Using Multiple Devices
Elnaz Nouri, Adam Fourney, Robert Sim, Ryen W. White
Task Intelligence Workshop @ WSDM 2019 Conference | January 2019
-
Assessing the Readability of Web Search Results for Searchers with Dyslexia
Adam Fourney, Meredith Ringel Morris, Abdullah Ali, Laura Vonessen
The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2018
Calendar-Aware Proactive Email Recommendation
Qian Zhao, Paul Bennett, Adam Fourney, Anne Loomis Thompson, Shane Williams, Adam D. Troy, Susan Dumais
Proceedings of the 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2018) | July 2018
Exploring the Role of Conversational Cues in Guided Task Support with Virtual Assistants
Alexandra Vtyurina, Adam Fourney
2018 ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Understanding the Needs of Searchers with Dyslexia
Meredith Ringel Morris, Adam Fourney, Abdullah Ali, Laura Vonessen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Characterizing Search in Productivity Software
Horatiu Bota, Adam Fourney, Susan Dumais, Tomasz L. Religa, Robert Rounthwaite
Proceedings of CHIIR 2018 | March 2018
-
Geographic and Temporal Trends in Fake News Consumption During the 2016 US Presidential Election
Adam Fourney, Miklos Z. Racz, Gireeja Ranade, Markus Mobius, Eric Horvitz
Proceedings of the 2017 ACM on Conference on Information and Knowledge Management | November 2017
ISBN: 978-1-4503-4918-5
Managing Uncertainty in Time Expressions for Virtual Assistants
Xin Rong, Adam Fourney, Robin N. Brewer, Meredith Ringel Morris, Paul N. Bennett
Proceedings of the 35th Annual CHI Conference on Human Factors in Computing Systems (CHI '17) | May 2017
Best Paper Honorable Mention
Web Search as a Linguistic Tool
Adam Fourney, Meredith Ringel Morris, Ryen W. White
Proceedings of WWW 2017 | April 2017
-
Automatic Identification and Contextual Reformulation of Implicit System-Related Queries
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '16) | July 2016
-
Exploring Time-Dependent Concerns about Pregnancy and Childbirth from Search Logs
Adam Fourney, Ryen W. White, Eric Horvitz
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15) | April 2015
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15)
ISBN: 978-1-4503-3145-6
Best of CHI honorable mention
-
Enhancing Technical Q&A Forums with CiteHistory
Adam Fourney, Meredith Ringel Morris
Proceedings of ICWSM 2013 | July 2013
You can download the CiteHistory plugin at http://research.microsoft.com/en-us/um/redmond/projects/citehistory/
Publications by Research Area
-
When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
January 2024
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ArXiv Preprint | February 2023
Understanding questions that arise when working with business documents
FARNAZ JAHANBAKHSH, Elnaz Nouri, Robert Sim, Ryen W. White, Adam Fourney
Human-Computer Interaction | November 2022
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
Two Birds with One Phone: The Role of Mobile Use in the Daily Practices of Remote Information Work
Vedant Das Swain, Shane Williams, Adam Fourney, Shamsi Iqbal
CHIWORK 2022 | June 2022
Exploring Interactive Sound Design for Auditory Websites
Lotus Zhang, Jingyao Shao, Augustina Ao Liu, Lucy Jiang, Abigale Stangl, Adam Fourney, Meredith Ringel Morris, Leah Findlater
CHI 2022 | April 2022
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
DIY: Assessing the Correctness of Natural Language to SQL Systems
Arpit Narechania, Adam Fourney, Bongshin Lee, Gonzalo Ramos
IUI | April 2021
An Eye Tracking Study of Web Search by People with and without Dyslexia
Srishti Palani, Adam Fourney, Shane Williams, Kevin Larson, Irina Spiridonova, Meredith Ringel Morris
SIGIR 2020 | July 2020
On How People Navigate Through Their Personal Web of Things
Dhivya Eswaran, Shamsi Iqbal, Adam Fourney, Shane Williams, Paul Bennett
CHI 2020 Workshop on Speculative Designs for Emergent Personal Data Trails | April 2020
VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Alexandra Vtyurina, Adam Fourney, Meredith Ringel Morris, Leah Findlater, Ryen W. White
ASSETS 2019 | October 2019
Best Paper Nominee
Mercury: Empowering Programmers’ Mobile Work Practices with Microproductivity
Alex Williams, Harmanpreet Kaur, Shamsi Iqbal, Ryen W. White, Jaime Teevan, Adam Fourney
UIST 2019 | October 2019
Multi-device digital assistance
Ryen W. White, Adam Fourney, Allen Herring, Paul Bennett, Nirupama Chandrasekaran, Robert Sim, Elnaz Nouri, Mark Encarnación
Communications of the ACM | July 2019
Studying Preferences and Concerns about Information Disclosure in Email Notifications
Yongsung Kim, Adam Fourney, Ece Kamar
The Web Conference (WWW '19) | May 2019
The Impact of Web Browser Reader Views on Reading Speed and User Experience
Qisheng Li, Meredith Ringel Morris, Adam Fourney, Kevin Larson, Katherina Reinecke
CHI 2019 | May 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Supporting Complex Tasks Using Multiple Devices
Elnaz Nouri, Adam Fourney, Robert Sim, Ryen W. White
Task Intelligence Workshop @ WSDM 2019 Conference | January 2019
Assessing the Readability of Web Search Results for Searchers with Dyslexia
Adam Fourney, Meredith Ringel Morris, Abdullah Ali, Laura Vonessen
The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2018
Understanding the Needs of Searchers with Dyslexia
Meredith Ringel Morris, Adam Fourney, Abdullah Ali, Laura Vonessen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Exploring the Role of Conversational Cues in Guided Task Support with Virtual Assistants
Alexandra Vtyurina, Adam Fourney
2018 ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Characterizing Search in Productivity Software
Horatiu Bota, Adam Fourney, Susan Dumais, Tomasz L. Religa, Robert Rounthwaite
Proceedings of CHIIR 2018 | March 2018
Managing Uncertainty in Time Expressions for Virtual Assistants
Xin Rong, Adam Fourney, Robin N. Brewer, Meredith Ringel Morris, Paul N. Bennett
Proceedings of the 35th Annual CHI Conference on Human Factors in Computing Systems (CHI '17) | May 2017
Best Paper Honorable Mention
Web Search as a Linguistic Tool
Adam Fourney, Meredith Ringel Morris, Ryen W. White
Proceedings of WWW 2017 | April 2017
Enhancing Technical Q&A Forums with CiteHistory
Adam Fourney, Meredith Ringel Morris
Proceedings of ICWSM 2013 | July 2013
You can download the CiteHistory plugin at http://research.microsoft.com/en-us/um/redmond/projects/citehistory/
-
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
CHI 2024 | May 2024
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ArXiv Preprint | February 2023
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction
Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah
NAACL 2021 | June 2021
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
DIY: Assessing the Correctness of Natural Language to SQL Systems
Arpit Narechania, Adam Fourney, Bongshin Lee, Gonzalo Ramos
IUI | April 2021
Leveraging Structured Metadata for Improving Question Answering on the Web
Xinya Du, Adam Fourney, Robert Sim, Paul Bennett, Claire Cardie, Ahmed Awadallah
AACL 2020 | December 2020
Proactive Suggestion Generation: Data and Methods for Stepwise Task Assistance
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
Proceedings of the 43 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020) | July 2020
On How People Navigate Through Their Personal Web of Things
Dhivya Eswaran, Shamsi Iqbal, Adam Fourney, Shane Williams, Paul Bennett
CHI 2020 Workshop on Speculative Designs for Emergent Personal Data Trails | April 2020
Step-wise Recommendation for Complex Task Support
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Conversations with Documents: An Exploration of Document-Centered Assistance
Maartje ter Hoeve, Robert Sim, Elnaz Nouri, Adam Fourney, Maarten de Rijke, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Toward Activity Discovery in the Personal Web
Tara Safavi, Adam Fourney, Robert Sim, Marcin Juraszek, Shane Williams, Ned Friend, Danai Koutra, Paul Bennett
The 13th ACM International Conference on Web Search and Data Mining (WSDM) | February 2020
VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Alexandra Vtyurina, Adam Fourney, Meredith Ringel Morris, Leah Findlater, Ryen W. White
ASSETS 2019 | October 2019
Best Paper Nominee
Multi-device digital assistance
Ryen W. White, Adam Fourney, Allen Herring, Paul Bennett, Nirupama Chandrasekaran, Robert Sim, Elnaz Nouri, Mark Encarnación
Communications of the ACM | July 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Supporting Complex Tasks Using Multiple Devices
Elnaz Nouri, Adam Fourney, Robert Sim, Ryen W. White
Task Intelligence Workshop @ WSDM 2019 Conference | January 2019
Managing Uncertainty in Time Expressions for Virtual Assistants
Xin Rong, Adam Fourney, Robin N. Brewer, Meredith Ringel Morris, Paul N. Bennett
Proceedings of the 35th Annual CHI Conference on Human Factors in Computing Systems (CHI '17) | May 2017
Best Paper Honorable Mention
-
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
-
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
-
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
DIY: Assessing the Correctness of Natural Language to SQL Systems
Arpit Narechania, Adam Fourney, Bongshin Lee, Gonzalo Ramos
IUI | April 2021
-
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
An Eye Tracking Study of Web Search by People with and without Dyslexia
Srishti Palani, Adam Fourney, Shane Williams, Kevin Larson, Irina Spiridonova, Meredith Ringel Morris
SIGIR 2020 | July 2020
Proactive Suggestion Generation: Data and Methods for Stepwise Task Assistance
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
Proceedings of the 43 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020) | July 2020
On How People Navigate Through Their Personal Web of Things
Dhivya Eswaran, Shamsi Iqbal, Adam Fourney, Shane Williams, Paul Bennett
CHI 2020 Workshop on Speculative Designs for Emergent Personal Data Trails | April 2020
Characterizing Search-Engine Traffic to Internet Research Agency Web Properties
Alexander Spangher, Gireeja Ranade, Besmira Nushi, Adam Fourney, Eric Horvitz
The Web Conference (TheWebConf '20) | April 2020
Step-wise Recommendation for Complex Task Support
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Conversations with Documents: An Exploration of Document-Centered Assistance
Maartje ter Hoeve, Robert Sim, Elnaz Nouri, Adam Fourney, Maarten de Rijke, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Toward Activity Discovery in the Personal Web
Tara Safavi, Adam Fourney, Robert Sim, Marcin Juraszek, Shane Williams, Ned Friend, Danai Koutra, Paul Bennett
The 13th ACM International Conference on Web Search and Data Mining (WSDM) | February 2020
VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Alexandra Vtyurina, Adam Fourney, Meredith Ringel Morris, Leah Findlater, Ryen W. White
ASSETS 2019 | October 2019
Best Paper Nominee
Supporting Complex Tasks Using Multiple Devices
Elnaz Nouri, Adam Fourney, Robert Sim, Ryen W. White
Task Intelligence Workshop @ WSDM 2019 Conference | January 2019
Assessing the Readability of Web Search Results for Searchers with Dyslexia
Adam Fourney, Meredith Ringel Morris, Abdullah Ali, Laura Vonessen
The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2018
Calendar-Aware Proactive Email Recommendation
Qian Zhao, Paul Bennett, Adam Fourney, Anne Loomis Thompson, Shane Williams, Adam D. Troy, Susan Dumais
Proceedings of the 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2018) | July 2018
Understanding the Needs of Searchers with Dyslexia
Meredith Ringel Morris, Adam Fourney, Abdullah Ali, Laura Vonessen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Characterizing Search in Productivity Software
Horatiu Bota, Adam Fourney, Susan Dumais, Tomasz L. Religa, Robert Rounthwaite
Proceedings of CHIIR 2018 | March 2018
Web Search as a Linguistic Tool
Adam Fourney, Meredith Ringel Morris, Ryen W. White
Proceedings of WWW 2017 | April 2017
Automatic Identification and Contextual Reformulation of Implicit System-Related Queries
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '16) | July 2016
Exploring Time-Dependent Concerns about Pregnancy and Childbirth from Search Logs
Adam Fourney, Ryen W. White, Eric Horvitz
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15) | April 2015
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15)
ISBN: 978-1-4503-3145-6
Best of CHI honorable mention
Enhancing Technical Q&A Forums with CiteHistory
Adam Fourney, Meredith Ringel Morris
Proceedings of ICWSM 2013 | July 2013
You can download the CiteHistory plugin at http://research.microsoft.com/en-us/um/redmond/projects/citehistory/
-
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
Social Media through Voice: Synthesized Voice Qualities and Self-presentation
Lotus Zhang, Lucy Jiang, Nicole Washington, Augustina Ao Liu, Jingyao Shao, Adam Fourney, Meredith Ringel Morris, Leah Findlater
CSCW 2021 | October 2021
Geographic and Temporal Trends in Fake News Consumption During the 2016 US Presidential Election
Adam Fourney, Miklos Z. Racz, Gireeja Ranade, Markus Mobius, Eric Horvitz
Proceedings of the 2017 ACM on Conference on Information and Knowledge Management | November 2017
ISBN: 978-1-4503-4918-5
-
NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction
Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah
NAACL 2021 | June 2021
DIY: Assessing the Correctness of Natural Language to SQL Systems
Arpit Narechania, Adam Fourney, Bongshin Lee, Gonzalo Ramos
IUI | April 2021
Leveraging Structured Metadata for Improving Question Answering on the Web
Xinya Du, Adam Fourney, Robert Sim, Paul Bennett, Claire Cardie, Ahmed Awadallah
AACL 2020 | December 2020
Supporting Complex Tasks Using Multiple Devices
Elnaz Nouri, Adam Fourney, Robert Sim, Ryen W. White
Task Intelligence Workshop @ WSDM 2019 Conference | January 2019
Managing Uncertainty in Time Expressions for Virtual Assistants
Xin Rong, Adam Fourney, Robin N. Brewer, Meredith Ringel Morris, Paul N. Bennett
Proceedings of the 35th Annual CHI Conference on Human Factors in Computing Systems (CHI '17) | May 2017
Best Paper Honorable Mention
-
Exploring Time-Dependent Concerns about Pregnancy and Childbirth from Search Logs
Adam Fourney, Ryen W. White, Eric Horvitz
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15) | April 2015
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15)
ISBN: 978-1-4503-3145-6
Best of CHI honorable mention
Publications by Type
-
When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
January 2024
-
Microsoft New Future of Work Report 2023
Jenna Butler, Sonia Jaffe, Nancy Baym, Mary Czerwinski, Shamsi Iqbal, Kate Nowak, Sean Rintel, Abigail Sellen, Mihaela Vorvoreanu, Najeeb G. Abdulhamid, Judith Amores, Reid Andersen, Kagonya Awori, Maxamed Axmed, danah boyd, James Brand, Georg Buscher, Dean Carignan, Martin Chan, Adam Coleman, Scott Counts, Madeleine Daepp, Adam Fourney, Daniel G. Goldstein, Andy Gordon, Aaron L Halfaker, Javier Hernandez, Jake Hofman, Jenny Lay-Flurrie, Vera Liao, Siân Lindley, Sathish Manivannan, Charlton Mcilwain, Subigya Nepal, Jennifer Neville, Stephanie Nyairo, Jacki O'Neill, Victor Poznanski, Gonzalo Ramos, Nagu Rangan, Lacey Rosedale, David Rothschild, Tara Safavi, Advait Sarkar, Ava Scott, Chirag Shah, Neha Parikh Shah, Teny Shapiro, Ryland Shaw, Auste Simkute, Jina Suh, Siddharth Suri, Ioana Tanase, Lev Tankelevitch, Adam Troy, Mengting Wan, Ryen W. White, Longqi Yang, Brent Hecht, Jaime Teevan
MSR-TR-2023-34 | December 2023
Published by Microsoft
-
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
CHI 2024 | May 2024
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ArXiv Preprint | February 2023
Understanding questions that arise when working with business documents
FARNAZ JAHANBAKHSH, Elnaz Nouri, Robert Sim, Ryen W. White, Adam Fourney
Human-Computer Interaction | November 2022
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
Two Birds with One Phone: The Role of Mobile Use in the Daily Practices of Remote Information Work
Vedant Das Swain, Shane Williams, Adam Fourney, Shamsi Iqbal
CHIWORK 2022 | June 2022
Exploring Interactive Sound Design for Auditory Websites
Lotus Zhang, Jingyao Shao, Augustina Ao Liu, Lucy Jiang, Abigale Stangl, Adam Fourney, Meredith Ringel Morris, Leah Findlater
CHI 2022 | April 2022
Social Media through Voice: Synthesized Voice Qualities and Self-presentation
Lotus Zhang, Lucy Jiang, Nicole Washington, Augustina Ao Liu, Jingyao Shao, Adam Fourney, Meredith Ringel Morris, Leah Findlater
CSCW 2021 | October 2021
NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction
Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah
NAACL 2021 | June 2021
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
DIY: Assessing the Correctness of Natural Language to SQL Systems
Arpit Narechania, Adam Fourney, Bongshin Lee, Gonzalo Ramos
IUI | April 2021
Leveraging Structured Metadata for Improving Question Answering on the Web
Xinya Du, Adam Fourney, Robert Sim, Paul Bennett, Claire Cardie, Ahmed Awadallah
AACL 2020 | December 2020
An Eye Tracking Study of Web Search by People with and without Dyslexia
Srishti Palani, Adam Fourney, Shane Williams, Kevin Larson, Irina Spiridonova, Meredith Ringel Morris
SIGIR 2020 | July 2020
Proactive Suggestion Generation: Data and Methods for Stepwise Task Assistance
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
Proceedings of the 43 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020) | July 2020
On How People Navigate Through Their Personal Web of Things
Dhivya Eswaran, Shamsi Iqbal, Adam Fourney, Shane Williams, Paul Bennett
CHI 2020 Workshop on Speculative Designs for Emergent Personal Data Trails | April 2020
Characterizing Search-Engine Traffic to Internet Research Agency Web Properties
Alexander Spangher, Gireeja Ranade, Besmira Nushi, Adam Fourney, Eric Horvitz
The Web Conference (TheWebConf '20) | April 2020
Step-wise Recommendation for Complex Task Support
Elnaz Nouri, Robert Sim, Adam Fourney, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Conversations with Documents: An Exploration of Document-Centered Assistance
Maartje ter Hoeve, Robert Sim, Elnaz Nouri, Adam Fourney, Maarten de Rijke, Ryen W. White
2020 Conference on Human Information Interaction and Retrieval | March 2020
Toward Activity Discovery in the Personal Web
Tara Safavi, Adam Fourney, Robert Sim, Marcin Juraszek, Shane Williams, Ned Friend, Danai Koutra, Paul Bennett
The 13th ACM International Conference on Web Search and Data Mining (WSDM) | February 2020
VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Alexandra Vtyurina, Adam Fourney, Meredith Ringel Morris, Leah Findlater, Ryen W. White
ASSETS 2019 | October 2019
Best Paper Nominee
Mercury: Empowering Programmers’ Mobile Work Practices with Microproductivity
Alex Williams, Harmanpreet Kaur, Shamsi Iqbal, Ryen W. White, Jaime Teevan, Adam Fourney
UIST 2019 | October 2019
Studying Preferences and Concerns about Information Disclosure in Email Notifications
Yongsung Kim, Adam Fourney, Ece Kamar
The Web Conference (WWW '19) | May 2019
The Impact of Web Browser Reader Views on Reading Speed and User Experience
Qisheng Li, Meredith Ringel Morris, Adam Fourney, Kevin Larson, Katherina Reinecke
CHI 2019 | May 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Supporting Complex Tasks Using Multiple Devices
Elnaz Nouri, Adam Fourney, Robert Sim, Ryen W. White
Task Intelligence Workshop @ WSDM 2019 Conference | January 2019
Assessing the Readability of Web Search Results for Searchers with Dyslexia
Adam Fourney, Meredith Ringel Morris, Abdullah Ali, Laura Vonessen
The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2018
Calendar-Aware Proactive Email Recommendation
Qian Zhao, Paul Bennett, Adam Fourney, Anne Loomis Thompson, Shane Williams, Adam D. Troy, Susan Dumais
Proceedings of the 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2018) | July 2018
Understanding the Needs of Searchers with Dyslexia
Meredith Ringel Morris, Adam Fourney, Abdullah Ali, Laura Vonessen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Exploring the Role of Conversational Cues in Guided Task Support with Virtual Assistants
Alexandra Vtyurina, Adam Fourney
2018 ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Characterizing Search in Productivity Software
Horatiu Bota, Adam Fourney, Susan Dumais, Tomasz L. Religa, Robert Rounthwaite
Proceedings of CHIIR 2018 | March 2018
Geographic and Temporal Trends in Fake News Consumption During the 2016 US Presidential Election
Adam Fourney, Miklos Z. Racz, Gireeja Ranade, Markus Mobius, Eric Horvitz
Proceedings of the 2017 ACM on Conference on Information and Knowledge Management | November 2017
ISBN: 978-1-4503-4918-5
Managing Uncertainty in Time Expressions for Virtual Assistants
Xin Rong, Adam Fourney, Robin N. Brewer, Meredith Ringel Morris, Paul N. Bennett
Proceedings of the 35th Annual CHI Conference on Human Factors in Computing Systems (CHI '17) | May 2017
Best Paper Honorable Mention
Web Search as a Linguistic Tool
Adam Fourney, Meredith Ringel Morris, Ryen W. White
Proceedings of WWW 2017 | April 2017
Automatic Identification and Contextual Reformulation of Implicit System-Related Queries
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '16) | July 2016
Exploring Time-Dependent Concerns about Pregnancy and Childbirth from Search Logs
Adam Fourney, Ryen W. White, Eric Horvitz
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15) | April 2015
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15)
ISBN: 978-1-4503-3145-6
Best of CHI honorable mention
Enhancing Technical Q&A Forums with CiteHistory
Adam Fourney, Meredith Ringel Morris
Proceedings of ICWSM 2013 | July 2013
You can download the CiteHistory plugin at http://research.microsoft.com/en-us/um/redmond/projects/citehistory/
-
Multi-device digital assistance
Ryen W. White, Adam Fourney, Allen Herring, Paul Bennett, Nirupama Chandrasekaran, Robert Sim, Elnaz Nouri, Mark Encarnación
Communications of the ACM | July 2019