Dan Vann

Principal Applied Scientist

出版物

表示方法:

- Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming
  
  Alex Chouldechova, A. Feder Cooper, Solon Barocas, Abhinav Palia, Dan Vann, Hanna Wallach
  
  NeurIPS 2025 | October 2025
  
  Publication
- Taxonomizing Representational Harms using Speech Act Theory
  
  Emily Corvi, Hannah Washington, Stefanie Reed, Chad Atalla, Alex Chouldechova, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Emily Sheng, Dan Vann, Matthew Vogel, Hanna Wallach
  
  March 2025
  
  Publication
- Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alex Chouldechova, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  ICML 2025 | January 2025
  
  Publication
- A Shared Standard for Valid Measurement of Generative AI Systems’ Capabilities, Risks, and Impacts
  
  Alex Chouldechova, Chad Atalla, Solon Barocas, A. Feder Cooper, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Matthew Vogel, Hannah Washington, Hanna Wallach
  
  December 2024
  
  Publication
- Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, Nick Pangakis, A. Feder Cooper, Angelina Wang, Solon Barocas, Alex Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  November 2024
  
  Publication
- A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications
  
  Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna Wallach, Sarah Bird, Mei Chen
  
  ArXiv | October 2023, 巻abs/2310.17750
  
  DOI Publication Publication
- A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications
  
  Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna Wallach, Sarah Bird, Mei Chen
  
  October 2023
  
  Publication
- FairPrism: Evaluating Fairness-Related Harms in Text Generation
  
  Eve Fleisig, Aubrie Amstutz, Chad Atalla, Su Lin Blodgett, Hal Daumé III, Alexandra Olteanu, Emily Sheng, Dan Vann, Hanna Wallach
  
  ACL 2023 | July 2023
  
  Publication

- Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming
  
  Alex Chouldechova, A. Feder Cooper, Solon Barocas, Abhinav Palia, Dan Vann, Hanna Wallach
  
  NeurIPS 2025 | October 2025
  
  Publication
- Taxonomizing Representational Harms using Speech Act Theory
  
  Emily Corvi, Hannah Washington, Stefanie Reed, Chad Atalla, Alex Chouldechova, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Emily Sheng, Dan Vann, Matthew Vogel, Hanna Wallach
  
  March 2025
  
  Publication
- Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alex Chouldechova, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  ICML 2025 | January 2025
  
  Publication
- A Shared Standard for Valid Measurement of Generative AI Systems’ Capabilities, Risks, and Impacts
  
  Alex Chouldechova, Chad Atalla, Solon Barocas, A. Feder Cooper, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Matthew Vogel, Hannah Washington, Hanna Wallach
  
  December 2024
  
  Publication
- Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, Nick Pangakis, A. Feder Cooper, Angelina Wang, Solon Barocas, Alex Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  November 2024
  
  Publication
- A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications
  
  Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna Wallach, Sarah Bird, Mei Chen
  
  ArXiv | October 2023, 巻abs/2310.17750
  
  DOI Publication Publication
- A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications
  
  Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna Wallach, Sarah Bird, Mei Chen
  
  October 2023
  
  Publication
- FairPrism: Evaluating Fairness-Related Harms in Text Generation
  
  Eve Fleisig, Aubrie Amstutz, Chad Atalla, Su Lin Blodgett, Hal Daumé III, Alexandra Olteanu, Emily Sheng, Dan Vann, Hanna Wallach
  
  ACL 2023 | July 2023
  
  Publication
- Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming
  
  Alex Chouldechova, A. Feder Cooper, Solon Barocas, Abhinav Palia, Dan Vann, Hanna Wallach
  
  NeurIPS 2025 | October 2025
  
  Publication
- Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming
  
  Alex Chouldechova, A. Feder Cooper, Solon Barocas, Abhinav Palia, Dan Vann, Hanna Wallach
  
  NeurIPS 2025 | October 2025
  
  Publication
- Taxonomizing Representational Harms using Speech Act Theory
  
  Emily Corvi, Hannah Washington, Stefanie Reed, Chad Atalla, Alex Chouldechova, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Emily Sheng, Dan Vann, Matthew Vogel, Hanna Wallach
  
  March 2025
  
  Publication
- Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alex Chouldechova, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  ICML 2025 | January 2025
  
  Publication
- A Shared Standard for Valid Measurement of Generative AI Systems’ Capabilities, Risks, and Impacts
  
  Alex Chouldechova, Chad Atalla, Solon Barocas, A. Feder Cooper, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Matthew Vogel, Hannah Washington, Hanna Wallach
  
  December 2024
  
  Publication
- Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, Nick Pangakis, A. Feder Cooper, Angelina Wang, Solon Barocas, Alex Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  November 2024
  
  Publication
- A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications
  
  Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna Wallach, Sarah Bird, Mei Chen
  
  ArXiv | October 2023, 巻abs/2310.17750
  
  DOI Publication Publication

- Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming
  
  Alex Chouldechova, A. Feder Cooper, Solon Barocas, Abhinav Palia, Dan Vann, Hanna Wallach
  
  NeurIPS 2025 | October 2025
  
  Publication
- Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alex Chouldechova, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  ICML 2025 | January 2025
  
  Publication
- FairPrism: Evaluating Fairness-Related Harms in Text Generation
  
  Eve Fleisig, Aubrie Amstutz, Chad Atalla, Su Lin Blodgett, Hal Daumé III, Alexandra Olteanu, Emily Sheng, Dan Vann, Hanna Wallach
  
  ACL 2023 | July 2023
  
  Publication
- Taxonomizing Representational Harms using Speech Act Theory
  
  Emily Corvi, Hannah Washington, Stefanie Reed, Chad Atalla, Alex Chouldechova, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Emily Sheng, Dan Vann, Matthew Vogel, Hanna Wallach
  
  March 2025
  
  Publication
- A Shared Standard for Valid Measurement of Generative AI Systems’ Capabilities, Risks, and Impacts
  
  Alex Chouldechova, Chad Atalla, Solon Barocas, A. Feder Cooper, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Matthew Vogel, Hannah Washington, Hanna Wallach
  
  December 2024
  
  Publication
- Evaluating Generative AI Systems is a Social Science Measurement Challenge
  
  Hanna Wallach, Meera Desai, Nick Pangakis, A. Feder Cooper, Angelina Wang, Solon Barocas, Alex Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
  
  November 2024
  
  Publication
- A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications
  
  Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna Wallach, Sarah Bird, Mei Chen
  
  ArXiv | October 2023, 巻abs/2310.17750
  
  DOI Publication Publication
- A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications
  
  Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna Wallach, Sarah Bird, Mei Chen
  
  October 2023
  
  Publication

Dan Vann

出版物

Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming

Taxonomizing Representational Harms using Speech Act Theory

Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge

A Shared Standard for Valid Measurement of Generative AI Systems’ Capabilities, Risks, and Impacts

Evaluating Generative AI Systems is a Social Science Measurement Challenge

A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications

A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications

FairPrism: Evaluating Fairness-Related Harms in Text Generation

Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming

Taxonomizing Representational Harms using Speech Act Theory

Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge

A Shared Standard for Valid Measurement of Generative AI Systems’ Capabilities, Risks, and Impacts

Evaluating Generative AI Systems is a Social Science Measurement Challenge

A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications

A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications

FairPrism: Evaluating Fairness-Related Harms in Text Generation

Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming

Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming

Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming

Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge

FairPrism: Evaluating Fairness-Related Harms in Text Generation

Taxonomizing Representational Harms using Speech Act Theory

A Shared Standard for Valid Measurement of Generative AI Systems’ Capabilities, Risks, and Impacts

Evaluating Generative AI Systems is a Social Science Measurement Challenge

A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications

A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications

お問い合わせ Dan Vann

Microsoft Research Lab – New York City