Publication SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval Hossein A. Rahmani, Xi Wang, Emine Yilmaz, Nick Craswell, Bhaskar Mitra, Paul Thomas 2025 The Web Conference | January 2025
Publication Sociotechnical Implications of Generative Artificial Intelligence for Information Access Bhaskar Mitra, Henriette Cramer, Olya Gurevich Information Access in the Era of Generative AI, 7 | Published by Springer | 2025
Publication Gaps Between Research and Practice When Measuring Representational Harms Caused by LLM-Based Systems Emma Harvey, Emily Sheng, Su Lin Blodgett, Alex Chouldechova, Jean Garcia-Gathright, Alexandra Olteanu, Hanna Wallach November 2024
Publication Evaluating Generative AI Systems is a Social Science Measurement Challenge Hanna Wallach, Meera Desai, Nick Pangakis, A. Feder Cooper, Angelina Wang, Solon Barocas, Alex Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs November 2024
Publication Metrics for What, Metrics for Whom: Assessing Actionability of Bias Evaluation Metrics in NLP Pieter Delobelle, Giuseppe Attanasio, Debora Nozza, Su Lin Blodgett, Zeerak Talat 2024 Empirical Methods in Natural Language Processing | November 2024
Publication Energy-efficient Reinforcement Learning by Discovering Neural Pathways Alessandro Sordoni October 2024
Publication Proceedings of The First Workshop on Large Language Models for Evaluation in Information Retrieval (LLM4Eval 2024) Clemencia Siro, Mohammad Aliannejadi, Hossein A. Rahmani, Nick Craswell, Charles L. A. Clarke, Guglielmo Faggioli, Bhaskar Mitra, Paul Thomas, Emine Yilmaz September 2024
Publication A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning Prateek Yadav, Colin Raffel, Mohammed Muqeeth, Lucas Caccia, Haokun Liu, Tian-Xiang Chen, Mohit Bansal, Leshem Choshen, Alessandro Sordoni ArXiv | August 2024, Vol abs/2408.07057
Publication Understanding the Impacts of Language Technologies’ Performance Disparities on African American Language Speakers Jay Cunningham, Su Lin Blodgett, Hal Daumé III, Christina Harrington, Hanna Wallach, Michael Madaio Findings of the Association for Computational Linguistics: ACL 2024 | August 2024
Publication ECBD: Evidence-Centered Benchmark Design for NLP Yu Lu Liu, Su Lin Blodgett, Jackie Cheung, Q. Vera Liao, Alexandra Olteanu, Ziang Xiao 2024 Meeting of the Association for Computational Linguistics | August 2024
