HINT: Integration Testing for AI-based Features with Humans in the Loop
Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi
International Conference on Intelligent User Interfaces | March 2022
The Human-AI eXperiences (HAX) Team
Empowering the creation of responsible human-AI experiences
Publications
Publications
Publications by Year
-
-
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld
AAAI 2021 | February 2021
-
The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation
Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims
Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020
-
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
People and AI See Things Different Implications of Mismatched Perception on HCI for AI Systems
Saleema Amershi, Ece Kamar, Emre Kiciman
Workshop on Human-Centered Machine Learning Perspectives at CHI 2019 | May 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence
Qian Yang, Justin Cranshaw, Saleema Amershi, Shamsi Iqbal, Jaime Teevan
CHI 2019 | May 2019
Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems
Rafal Kocielnik, Saleema Amershi, Paul Bennett
CHI 2019 | May 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019
Publications by Research Area
-
HINT: Integration Testing for AI-based Features with Humans in the Loop
Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi
International Conference on Intelligent User Interfaces | March 2022
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld
AAAI 2021 | February 2021
The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation
Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims
Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
People and AI See Things Different Implications of Mismatched Perception on HCI for AI Systems
Saleema Amershi, Ece Kamar, Emre Kiciman
Workshop on Human-Centered Machine Learning Perspectives at CHI 2019 | May 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems
Rafal Kocielnik, Saleema Amershi, Paul Bennett
CHI 2019 | May 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019
-
HINT: Integration Testing for AI-based Features with Humans in the Loop
Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi
International Conference on Intelligent User Interfaces | March 2022
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation
Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims
Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems
Rafal Kocielnik, Saleema Amershi, Paul Bennett
CHI 2019 | May 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019
-
The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation
Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims
Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020
Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems
Rafal Kocielnik, Saleema Amershi, Paul Bennett
CHI 2019 | May 2019
-
Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence
Qian Yang, Justin Cranshaw, Saleema Amershi, Shamsi Iqbal, Jaime Teevan
CHI 2019 | May 2019
-
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
Publications by Type
-
HINT: Integration Testing for AI-based Features with Humans in the Loop
Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi
International Conference on Intelligent User Interfaces | March 2022
Planning for Natural Language Failures with the AI Playbook
Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi
2021 CHI Conference on Human Factors in Computing Systems | May 2021
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld
AAAI 2021 | February 2021
The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation
Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims
Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
People and AI See Things Different Implications of Mismatched Perception on HCI for AI Systems
Saleema Amershi, Ece Kamar, Emre Kiciman
Workshop on Human-Centered Machine Learning Perspectives at CHI 2019 | May 2019
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz
CHI 2019 | May 2019
CHI 2019 Honorable Mention Award
Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems
Rafal Kocielnik, Saleema Amershi, Paul Bennett
CHI 2019 | May 2019
Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence
Qian Yang, Justin Cranshaw, Saleema Amershi, Shamsi Iqbal, Jaime Teevan
CHI 2019 | May 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019