Sunayana Sitaram

Principal Researcher

出版物

表示方法:

- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- The role of synthetic data in Multilingual, Multi-cultural AI systems: Lessons from Indic Languages
  
  Pranjal Chitale, Varun Gumma, Sanchit Ahuja, Prashant Kodali, Manan Uppadhyay, Deepthi Sudharsan, Sunayana Sitaram
  
  September 2025
  
  Publication プロジェクト
- Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
  
  Millicent Ochieng, Varun Gumma, Sunayana Sitaram, Jindong Wang, Vishrav Chaudhary, Keshet Ronen, Kalika Bali, Jacki O'Neill
  
  Association for Computational Linguistics (ACL 2025) | May 2025
  
  Publication プロジェクト
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
  
  Somnath Kumar, Vaibhav Balloli, Mercy Ranjit, Kabir Ahuja, Tanuja Ganu, Sunayana Sitaram, Kalika Bali, Akshay Nambi
  
  May 2024
  
  Preprint
- PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
  
  Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
  
  May 2024
  
  Preprint 動画プロジェクト
- TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
  
  Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Swami Manohar
  
  February 2024
  
  DOI Publication Publication Github
- DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
  
  Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
  
  February 2024
  
  DOI Publication Publication Github
- CultureLLM: Incorporating Cultural Differences into Large Language Models
  
  Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie
  
  NeurIPS 2024 | February 2024
  
  DOI Publication Publication
- MEGA: Multilingual Evaluation of Generative AI
  
  Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
  
  EMNLP 2023 | October 2023
  
  Publication Github プロジェクトプロジェクトプロジェクト
- Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
  
  Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, M. Choudhury, Kalika Bali, Sunayana Sitaram
  
  2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) | September 2023, pp. 1051-1070
  
  DOI Publication Publication PDF
- A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models
  
  Krithika Ramesh, Arnav Chavan, Shrey Pandit, Sunayana Sitaram
  
  ACL 2023 | July 2023
  
  Publication プロジェクト
- ACL 2023 Multilingual Models Tutorial Slides
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja
  
  July 2023
  
  Publication プロジェクト
- On Evaluating and Mitigating Gender Biases in Multilingual Settings
  
  Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram
  
  ACL 2023 | July 2023
  
  Publication プロジェクト
- LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems
  
  Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury
  
  Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022
  
  System Demonstration
  
  Publication 動画 Github プロジェクト
- A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies
  
  A. Seza Doğruöz, Sunayana Sitaram, Barbara E. Bullock, Almeida Jacqueline Toribio
  
  2021 Meeting of the Association for Computational Linguistics | August 2021
  
  DOI PDF Publication Publication Publication Publication Publication プロジェクト
- Multilingual and code-switching ASR challenges for low resource Indian languages
  
  Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
  
  Interspeech 2021 | August 2021
  
  Publication
- A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist
  
  Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram
  
  Workshop on Human Evaluation of NLP Systems | April 2021
  
  Publication プロジェクト
- GCM: A Toolkit for Generating Synthetic Code-mixed Text
  
  Mohd Sanad Zaki Rizvi, Anirudh Srinivasan, Tanuja Ganu, Monojit Choudhury, Sunayana Sitaram
  
  2021 Conference of the European Chapter of the Association for Computational Linguistics | April 2021
  
  DOI Publication Publication プロジェクト
- GLUECoS: An Evaluation Benchmark for Code-Switched NLP
  
  Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
  
  ACL 2020 | July 2020
  
  Publication Github
- GLUECoS: An Evaluation Benchmark for Code-Switched NLP
  
  Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
  
  Association for Computational Linguistics (ACL) | June 2020
  
  DOI Publication プロジェクト
- Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition
  
  Gurunath Reddy Madhumani, Sanket Shah, Basil Abraham, Vikas Joshi, Sunayana Sitaram
  
  arXiv preprint arXiv:2006.05257 | June 2020
  
  PDF Publication プロジェクト
- A New Dataset for Natural Language Inference from Code-mixed Conversations
  
  Simran Khanuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
  
  Workshop on Computational Approaches to Code Switching | May 2020
  
  PDF Publication プロジェクト
- Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers
  
  Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyothi, Sunayana Sitaram, Vivek Seshadri
  
  Language Resources and Evaluation Conference (LREC) | May 2020
  
  PDF Publication プロジェクトプロジェクト
- Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
  
  Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
  
  International Conference on Natural Language Processing (ICON) | December 2019
  
  PDF Publication プロジェクト
- Deploying Language Technologies for Underserved Communities
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Sebastin Santy
  
  UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
  
  Publication プロジェクト
- ELLORA: Enabling Low Resource Languages with Technology
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
  
  UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
  
  PDF Publication 動画 Github プロジェクト
- CoSSAT: Code-Switched Speech Annotation Tool
  
  Sanket Shah, Pratik Joshi, Sunayana Sitaram (susitara), Sebastin Santy
  
  EMNLP AnnoNLP workshop | November 2019
  
  Publication プロジェクト
- Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech
  
  Sanket Shah, Sunayana Sitaram
  
  International Conference on Data Mining | November 2019
  
  DOI Publication プロジェクト
- End-to-End ASR for Code-switched Hindi-English Speech
  
  Brij Mohan Lal Srivastava, Basil Abraham, Sunayana Sitaram, Rupesh K. Mehta, Preethi Jyothi
  
  arXiv preprint arXiv:1906.09426 | June 2019
  
  Publication PDF プロジェクト
- A Survey of Code-switched Speech and Language Processing
  
  Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black
  
  March 2019
  
  Publication プロジェクト
- Word Embeddings for Code-Mixed Language Processing
  
  Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2018
  
  Publication プロジェクト
- Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages
  
  Savitha Murthy, Dinkar Sitaram, Sunayana Sitaram
  
  Interspeech 2018 | September 2018
  
  公開日
- Homophone Identification and Merging for Code-switched Speech Recognition
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram
  
  Interspeech 2018 | September 2018
  
  公開日プロジェクト
- Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
  
  Workshop Spoken Language Technologies for Under-resourced Languages | August 2018
  
  DOI Publication Publication プロジェクト
- Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
  
  SLTU | August 2018
  
  Publication プロジェクト
- Automatic Detection of Code-switching Style from Acoustics
  
  SaiKrishna Rallabandi, Sunayana Sitaram, Alan W Black
  
  Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
  
  公開日プロジェクト
- Phone Merging For Code-switched Speech Recognition
  
  Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury
  
  Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
  
  公開日プロジェクト
- Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data
  
  Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, Sunayana Sitaram, Sandipan Dandapat, Kalika Bali
  
  Proceedings of ACL 2018 | July 2018
  
  公開日プロジェクト
- Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
  
  Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
  
  LREC 2018 | May 2018
  
  公開日
- Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
  
  Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
  
  Language Resources and Evaluation (LREC) | April 2018
  
  PDF Publication Publication プロジェクト
- Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks
  
  Ashutosh Baheti, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
  
  ICON 2017 | December 2017
  
  公開日プロジェクト
- Speech Synthesis for Mixed-Language Navigation Instructions
  
  Khythiraghavi Chandu, Sai Krishna Rallabandi, Sunayana Sitaram, Alan W Black
  
  Interspeech 2017 | August 2017
  
  公開日プロジェクト
- Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text
  
  Sunayana Sitaram, Sai Krishna Rallabandi, Shruti Rijhwani, Alan W Black
  
  Speech Synthesis Workshop 8 | August 2016
  
  公開日プロジェクト

- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
  
  Millicent Ochieng, Varun Gumma, Sunayana Sitaram, Jindong Wang, Vishrav Chaudhary, Keshet Ronen, Kalika Bali, Jacki O'Neill
  
  Association for Computational Linguistics (ACL 2025) | May 2025
  
  Publication プロジェクト
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
  
  Somnath Kumar, Vaibhav Balloli, Mercy Ranjit, Kabir Ahuja, Tanuja Ganu, Sunayana Sitaram, Kalika Bali, Akshay Nambi
  
  May 2024
  
  Preprint
- PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
  
  Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
  
  May 2024
  
  Preprint 動画プロジェクト
- DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
  
  Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
  
  February 2024
  
  DOI Publication Publication Github
- CultureLLM: Incorporating Cultural Differences into Large Language Models
  
  Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie
  
  NeurIPS 2024 | February 2024
  
  DOI Publication Publication
- MEGA: Multilingual Evaluation of Generative AI
  
  Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
  
  EMNLP 2023 | October 2023
  
  Publication Github プロジェクトプロジェクトプロジェクト
- Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
  
  Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, M. Choudhury, Kalika Bali, Sunayana Sitaram
  
  2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) | September 2023, pp. 1051-1070
  
  DOI Publication Publication PDF
- LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems
  
  Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury
  
  Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022
  
  System Demonstration
  
  Publication 動画 Github プロジェクト
- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
  
  Millicent Ochieng, Varun Gumma, Sunayana Sitaram, Jindong Wang, Vishrav Chaudhary, Keshet Ronen, Kalika Bali, Jacki O'Neill
  
  Association for Computational Linguistics (ACL 2025) | May 2025
  
  Publication プロジェクト
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- The role of synthetic data in Multilingual, Multi-cultural AI systems: Lessons from Indic Languages
  
  Pranjal Chitale, Varun Gumma, Sanchit Ahuja, Prashant Kodali, Manan Uppadhyay, Deepthi Sudharsan, Sunayana Sitaram
  
  September 2025
  
  Publication プロジェクト
- Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
  
  Millicent Ochieng, Varun Gumma, Sunayana Sitaram, Jindong Wang, Vishrav Chaudhary, Keshet Ronen, Kalika Bali, Jacki O'Neill
  
  Association for Computational Linguistics (ACL 2025) | May 2025
  
  Publication プロジェクト
- PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
  
  Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
  
  May 2024
  
  Preprint 動画プロジェクト
- DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
  
  Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
  
  February 2024
  
  DOI Publication Publication Github
- MEGA: Multilingual Evaluation of Generative AI
  
  Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
  
  EMNLP 2023 | October 2023
  
  Publication Github プロジェクトプロジェクトプロジェクト
- ACL 2023 Multilingual Models Tutorial Slides
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja
  
  July 2023
  
  Publication プロジェクト
- On Evaluating and Mitigating Gender Biases in Multilingual Settings
  
  Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram
  
  ACL 2023 | July 2023
  
  Publication プロジェクト
- A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models
  
  Krithika Ramesh, Arnav Chavan, Shrey Pandit, Sunayana Sitaram
  
  ACL 2023 | July 2023
  
  Publication プロジェクト
- LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems
  
  Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury
  
  Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022
  
  System Demonstration
  
  Publication 動画 Github プロジェクト
- A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies
  
  A. Seza Doğruöz, Sunayana Sitaram, Barbara E. Bullock, Almeida Jacqueline Toribio
  
  2021 Meeting of the Association for Computational Linguistics | August 2021
  
  DOI PDF Publication Publication Publication Publication Publication プロジェクト
- Multilingual and code-switching ASR challenges for low resource Indian languages
  
  Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
  
  Interspeech 2021 | August 2021
  
  Publication
- GCM: A Toolkit for Generating Synthetic Code-mixed Text
  
  Mohd Sanad Zaki Rizvi, Anirudh Srinivasan, Tanuja Ganu, Monojit Choudhury, Sunayana Sitaram
  
  2021 Conference of the European Chapter of the Association for Computational Linguistics | April 2021
  
  DOI Publication Publication プロジェクト
- A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist
  
  Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram
  
  Workshop on Human Evaluation of NLP Systems | April 2021
  
  Publication プロジェクト
- GLUECoS: An Evaluation Benchmark for Code-Switched NLP
  
  Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
  
  ACL 2020 | July 2020
  
  Publication Github
- GLUECoS: An Evaluation Benchmark for Code-Switched NLP
  
  Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
  
  Association for Computational Linguistics (ACL) | June 2020
  
  DOI Publication プロジェクト
- Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition
  
  Gurunath Reddy Madhumani, Sanket Shah, Basil Abraham, Vikas Joshi, Sunayana Sitaram
  
  arXiv preprint arXiv:2006.05257 | June 2020
  
  PDF Publication プロジェクト
- A New Dataset for Natural Language Inference from Code-mixed Conversations
  
  Simran Khanuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
  
  Workshop on Computational Approaches to Code Switching | May 2020
  
  PDF Publication プロジェクト
- Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers
  
  Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyothi, Sunayana Sitaram, Vivek Seshadri
  
  Language Resources and Evaluation Conference (LREC) | May 2020
  
  PDF Publication プロジェクトプロジェクト
- Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
  
  Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
  
  International Conference on Natural Language Processing (ICON) | December 2019
  
  PDF Publication プロジェクト
- Deploying Language Technologies for Underserved Communities
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Sebastin Santy
  
  UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
  
  Publication プロジェクト
- ELLORA: Enabling Low Resource Languages with Technology
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
  
  UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
  
  PDF Publication 動画 Github プロジェクト
- Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech
  
  Sanket Shah, Sunayana Sitaram
  
  International Conference on Data Mining | November 2019
  
  DOI Publication プロジェクト
- CoSSAT: Code-Switched Speech Annotation Tool
  
  Sanket Shah, Pratik Joshi, Sunayana Sitaram (susitara), Sebastin Santy
  
  EMNLP AnnoNLP workshop | November 2019
  
  Publication プロジェクト
- End-to-End ASR for Code-switched Hindi-English Speech
  
  Brij Mohan Lal Srivastava, Basil Abraham, Sunayana Sitaram, Rupesh K. Mehta, Preethi Jyothi
  
  arXiv preprint arXiv:1906.09426 | June 2019
  
  Publication PDF プロジェクト
- A Survey of Code-switched Speech and Language Processing
  
  Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black
  
  March 2019
  
  Publication プロジェクト
- Word Embeddings for Code-Mixed Language Processing
  
  Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2018
  
  Publication プロジェクト
- Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages
  
  Savitha Murthy, Dinkar Sitaram, Sunayana Sitaram
  
  Interspeech 2018 | September 2018
  
  公開日
- Homophone Identification and Merging for Code-switched Speech Recognition
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram
  
  Interspeech 2018 | September 2018
  
  公開日プロジェクト
- Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
  
  Workshop Spoken Language Technologies for Under-resourced Languages | August 2018
  
  DOI Publication Publication プロジェクト
- Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
  
  SLTU | August 2018
  
  Publication プロジェクト
- Automatic Detection of Code-switching Style from Acoustics
  
  SaiKrishna Rallabandi, Sunayana Sitaram, Alan W Black
  
  Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
  
  公開日プロジェクト
- Phone Merging For Code-switched Speech Recognition
  
  Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury
  
  Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
  
  公開日プロジェクト
- Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data
  
  Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, Sunayana Sitaram, Sandipan Dandapat, Kalika Bali
  
  Proceedings of ACL 2018 | July 2018
  
  公開日プロジェクト
- Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
  
  Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
  
  LREC 2018 | May 2018
  
  公開日
- Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
  
  Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
  
  Language Resources and Evaluation (LREC) | April 2018
  
  PDF Publication Publication プロジェクト
- Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks
  
  Ashutosh Baheti, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
  
  ICON 2017 | December 2017
  
  公開日プロジェクト
- Speech Synthesis for Mixed-Language Navigation Instructions
  
  Khythiraghavi Chandu, Sai Krishna Rallabandi, Sunayana Sitaram, Alan W Black
  
  Interspeech 2017 | August 2017
  
  公開日プロジェクト
- Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text
  
  Sunayana Sitaram, Sai Krishna Rallabandi, Shruti Rijhwani, Alan W Black
  
  Speech Synthesis Workshop 8 | August 2016
  
  公開日プロジェクト
- TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
  
  Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Swami Manohar
  
  February 2024
  
  DOI Publication Publication Github
- Multilingual and code-switching ASR challenges for low resource Indian languages
  
  Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
  
  Interspeech 2021 | August 2021
  
  Publication
- Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
  
  Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
  
  International Conference on Natural Language Processing (ICON) | December 2019
  
  PDF Publication プロジェクト
- ELLORA: Enabling Low Resource Languages with Technology
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
  
  UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
  
  PDF Publication 動画 Github プロジェクト

- New Future of Work Report 2025
  
  Jenna Butler, Sonia Jaffe, Rebecca Janssen, Nancy Baym, Jake Hofman, Brent Hecht, Sean Rintel, Bahar Sarrafzadeh, Abigail Sellen, Mihaela Vorvoreanu, Jaime Teevan, Mohammed Alsobay, Liz Ankrah, Stephanie Beers, Megan Benzing, Mia Bruch, Zana Buçinca, Mar Carpanelli, Amelia Cole, Scott Counts, Madeleine Daepp, Justin Edwards, Alex Farach, Daniel G. Goldstein, Mary L. Gray, Javier Hernandez, Eric Horvitz, Nicole Immorlica, Kori Inkpen, Shamsi Iqbal, Manasa Jagadeesh, Siân Lindley, Brendan Lucier, Mercy Muchai, Ambrita Nand, Alexandra Olteanu, Jacki O'Neill, Max Peterschmidt, Christian Poelitz, Rabeeza, Nathalie Henry Riche, Advait Sarkar, Sunayana Sitaram, Amanda Snellinger, Jina Suh, John Tang, Lev Tankelevitch, Kiran Tomlinson, Anne Trapasso, Adam D. Troy, Gaurav Verma, Jack Williams, Ben Zorn, Jordana Young
  
  MSR-TR-2025-58 | December 2025
  
  Microsoft による投稿
  
  Publication
- Microsoft New Future of Work Report 2024
  
  Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
  
  MSR-TR-2024-56 | December 2024
  
  Microsoft による投稿
  
  Publication プロジェクトプロジェクト
- The role of synthetic data in Multilingual, Multi-cultural AI systems: Lessons from Indic Languages
  
  Pranjal Chitale, Varun Gumma, Sanchit Ahuja, Prashant Kodali, Manan Uppadhyay, Deepthi Sudharsan, Sunayana Sitaram
  
  September 2025
  
  Publication プロジェクト
- TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
  
  Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Swami Manohar
  
  February 2024
  
  DOI Publication Publication Github
- DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
  
  Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
  
  February 2024
  
  DOI Publication Publication Github
- ACL 2023 Multilingual Models Tutorial Slides
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja
  
  July 2023
  
  Publication プロジェクト
- Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
  
  Millicent Ochieng, Varun Gumma, Sunayana Sitaram, Jindong Wang, Vishrav Chaudhary, Keshet Ronen, Kalika Bali, Jacki O'Neill
  
  Association for Computational Linguistics (ACL 2025) | May 2025
  
  Publication プロジェクト
- CultureLLM: Incorporating Cultural Differences into Large Language Models
  
  Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie
  
  NeurIPS 2024 | February 2024
  
  DOI Publication Publication
- MEGA: Multilingual Evaluation of Generative AI
  
  Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
  
  EMNLP 2023 | October 2023
  
  Publication Github プロジェクトプロジェクトプロジェクト
- On Evaluating and Mitigating Gender Biases in Multilingual Settings
  
  Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram
  
  ACL 2023 | July 2023
  
  Publication プロジェクト
- A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models
  
  Krithika Ramesh, Arnav Chavan, Shrey Pandit, Sunayana Sitaram
  
  ACL 2023 | July 2023
  
  Publication プロジェクト
- LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems
  
  Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury
  
  Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022
  
  System Demonstration
  
  Publication 動画 Github プロジェクト
- A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies
  
  A. Seza Doğruöz, Sunayana Sitaram, Barbara E. Bullock, Almeida Jacqueline Toribio
  
  2021 Meeting of the Association for Computational Linguistics | August 2021
  
  DOI PDF Publication Publication Publication Publication Publication プロジェクト
- Multilingual and code-switching ASR challenges for low resource Indian languages
  
  Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
  
  Interspeech 2021 | August 2021
  
  Publication
- GCM: A Toolkit for Generating Synthetic Code-mixed Text
  
  Mohd Sanad Zaki Rizvi, Anirudh Srinivasan, Tanuja Ganu, Monojit Choudhury, Sunayana Sitaram
  
  2021 Conference of the European Chapter of the Association for Computational Linguistics | April 2021
  
  DOI Publication Publication プロジェクト
- A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist
  
  Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram
  
  Workshop on Human Evaluation of NLP Systems | April 2021
  
  Publication プロジェクト
- GLUECoS: An Evaluation Benchmark for Code-Switched NLP
  
  Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
  
  ACL 2020 | July 2020
  
  Publication Github
- GLUECoS: An Evaluation Benchmark for Code-Switched NLP
  
  Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
  
  Association for Computational Linguistics (ACL) | June 2020
  
  DOI Publication プロジェクト
- A New Dataset for Natural Language Inference from Code-mixed Conversations
  
  Simran Khanuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
  
  Workshop on Computational Approaches to Code Switching | May 2020
  
  PDF Publication プロジェクト
- Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers
  
  Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyothi, Sunayana Sitaram, Vivek Seshadri
  
  Language Resources and Evaluation Conference (LREC) | May 2020
  
  PDF Publication プロジェクトプロジェクト
- Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
  
  Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
  
  International Conference on Natural Language Processing (ICON) | December 2019
  
  PDF Publication プロジェクト
- Deploying Language Technologies for Underserved Communities
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Sebastin Santy
  
  UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
  
  Publication プロジェクト
- ELLORA: Enabling Low Resource Languages with Technology
  
  Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
  
  UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
  
  PDF Publication 動画 Github プロジェクト
- Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech
  
  Sanket Shah, Sunayana Sitaram
  
  International Conference on Data Mining | November 2019
  
  DOI Publication プロジェクト
- CoSSAT: Code-Switched Speech Annotation Tool
  
  Sanket Shah, Pratik Joshi, Sunayana Sitaram (susitara), Sebastin Santy
  
  EMNLP AnnoNLP workshop | November 2019
  
  Publication プロジェクト
- Word Embeddings for Code-Mixed Language Processing
  
  Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2018
  
  Publication プロジェクト
- Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages
  
  Savitha Murthy, Dinkar Sitaram, Sunayana Sitaram
  
  Interspeech 2018 | September 2018
  
  公開日
- Homophone Identification and Merging for Code-switched Speech Recognition
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram
  
  Interspeech 2018 | September 2018
  
  公開日プロジェクト
- Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
  
  Workshop Spoken Language Technologies for Under-resourced Languages | August 2018
  
  DOI Publication Publication プロジェクト
- Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages
  
  Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
  
  SLTU | August 2018
  
  Publication プロジェクト
- Automatic Detection of Code-switching Style from Acoustics
  
  SaiKrishna Rallabandi, Sunayana Sitaram, Alan W Black
  
  Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
  
  公開日プロジェクト
- Phone Merging For Code-switched Speech Recognition
  
  Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury
  
  Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
  
  公開日プロジェクト
- Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data
  
  Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, Sunayana Sitaram, Sandipan Dandapat, Kalika Bali
  
  Proceedings of ACL 2018 | July 2018
  
  公開日プロジェクト
- Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
  
  Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
  
  LREC 2018 | May 2018
  
  公開日
- Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
  
  Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
  
  Language Resources and Evaluation (LREC) | April 2018
  
  PDF Publication Publication プロジェクト
- Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks
  
  Ashutosh Baheti, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
  
  ICON 2017 | December 2017
  
  公開日プロジェクト
- Speech Synthesis for Mixed-Language Navigation Instructions
  
  Khythiraghavi Chandu, Sai Krishna Rallabandi, Sunayana Sitaram, Alan W Black
  
  Interspeech 2017 | August 2017
  
  公開日プロジェクト
- Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text
  
  Sunayana Sitaram, Sai Krishna Rallabandi, Shruti Rijhwani, Alan W Black
  
  Speech Synthesis Workshop 8 | August 2016
  
  公開日プロジェクト
- Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
  
  Somnath Kumar, Vaibhav Balloli, Mercy Ranjit, Kabir Ahuja, Tanuja Ganu, Sunayana Sitaram, Kalika Bali, Akshay Nambi
  
  May 2024
  
  Preprint
- PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
  
  Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
  
  May 2024
  
  Preprint 動画プロジェクト
- A Survey of Code-switched Speech and Language Processing
  
  Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black
  
  March 2019
  
  Publication プロジェクト
- Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
  
  Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, M. Choudhury, Kalika Bali, Sunayana Sitaram
  
  2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) | September 2023, pp. 1051-1070
  
  DOI Publication Publication PDF
- Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition
  
  Gurunath Reddy Madhumani, Sanket Shah, Basil Abraham, Vikas Joshi, Sunayana Sitaram
  
  arXiv preprint arXiv:2006.05257 | June 2020
  
  PDF Publication プロジェクト
- End-to-End ASR for Code-switched Hindi-English Speech
  
  Brij Mohan Lal Srivastava, Basil Abraham, Sunayana Sitaram, Rupesh K. Mehta, Preethi Jyothi
  
  arXiv preprint arXiv:1906.09426 | June 2019
  
  Publication PDF プロジェクト

Sunayana Sitaram

出版物

New Future of Work Report 2025

The role of synthetic data in Multilingual, Multi-cultural AI systems: Lessons from Indic Languages

Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios

Microsoft New Future of Work Report 2024

Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs

PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models

TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs

DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures

CultureLLM: Incorporating Cultural Differences into Large Language Models

MEGA: Multilingual Evaluation of Generative AI

Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?

A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models

ACL 2023 Multilingual Models Tutorial Slides

On Evaluating and Mitigating Gender Biases in Multilingual Settings

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems

A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies

Multilingual and code-switching ASR challenges for low resource Indian languages

A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist

GCM: A Toolkit for Generating Synthetic Code-mixed Text

GLUECoS: An Evaluation Benchmark for Code-Switched NLP

GLUECoS: An Evaluation Benchmark for Code-Switched NLP

Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition

A New Dataset for Natural Language Inference from Code-mixed Conversations

Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers

Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.

Deploying Language Technologies for Underserved Communities

ELLORA: Enabling Low Resource Languages with Technology

CoSSAT: Code-Switched Speech Annotation Tool

Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech

End-to-End ASR for Code-switched Hindi-English Speech

A Survey of Code-switched Speech and Language Processing

Word Embeddings for Code-Mixed Language Processing

Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages

Homophone Identification and Merging for Code-switched Speech Recognition

Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.

Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages

Automatic Detection of Code-switching Style from Acoustics

Phone Merging For Code-switched Speech Recognition

Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data

Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach

Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach

Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks

Speech Synthesis for Mixed-Language Navigation Instructions

Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text

New Future of Work Report 2025

Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios

Microsoft New Future of Work Report 2024

Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs

PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models

DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures

CultureLLM: Incorporating Cultural Differences into Large Language Models

MEGA: Multilingual Evaluation of Generative AI

Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems

New Future of Work Report 2025

Microsoft New Future of Work Report 2024

New Future of Work Report 2025

Microsoft New Future of Work Report 2024

New Future of Work Report 2025

Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios

Microsoft New Future of Work Report 2024

New Future of Work Report 2025

Microsoft New Future of Work Report 2024

New Future of Work Report 2025

Microsoft New Future of Work Report 2024

The role of synthetic data in Multilingual, Multi-cultural AI systems: Lessons from Indic Languages

Beyond Metrics: Evaluating LLMs’ Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios

PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models

DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures

MEGA: Multilingual Evaluation of Generative AI

ACL 2023 Multilingual Models Tutorial Slides

On Evaluating and Mitigating Gender Biases in Multilingual Settings

A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems

A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies

Multilingual and code-switching ASR challenges for low resource Indian languages

GCM: A Toolkit for Generating Synthetic Code-mixed Text

A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist