DevEx in Action: A study of its tangible impacts
Nicole Forsgren, Eirini Kalliamvakou, Abi Noda, Michaela Greiler, Brian Houck, Margaret-Anne Storey
ACM Queue | January 2024, Vol 21(6)
Publications
Publications
Publications by Year
-
-
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
The Best of Both Worlds: Unlocking the Potential of Hybrid Work for Software Engineers
Brian Houck, Henry Yelin, Jenna Butler, Nicole Forsgren, Alison McMartin
May 2023
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
-
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Sarah Fakhoury, Negar Ghorbani, Todd Mytkowicz, Christian Bird, Jinu Jang, Neel Sundaresan, Shuvendu Lahiri, Elizabeth Dinella
The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’22) | November 2022
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
SoftNER: Mining knowledge graphs from Cloud Incidents
Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao, Nachiappan Nagappan
Empirical Software Engineering | April 2022, Vol 27(4)
-
Technical report
Chandra Maddila, Apoorva Agrawal, Thomas Zimmermann, Nicole Forsgren, Kim Herzig, Arie van Deursen
MSR-TR-2021-28 | October 2021
Published by Microsoft
Appendix to How Developers and Managers Define and Trade Off Productivity and Quality
Margaret-Anne Storey, Brian Houck, Thomas Zimmermann
MSR-TR-2021-26 | October 2021
Published by Microsoft
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
Including Everyone, Everywhere: Understanding Opportunities and Challenges of Geographic Gender-Inclusion in OSS
Gede Artha Azriadi Prana, Denae Ford, Ayushi Rastogi, David Lo, Rahul Purandare, Nachiappan Nagappan
ICSE 2022 | September 2021
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
“Is My Mic On?” Preparing SE Students for Collaborative Remote Work and Hybrid Team Communication
Makayla Moster, Denae Ford, Paige Rodeghero
ICSE JSEET | May 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
DeepMerge: Learning to Merge Programs
Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri
May 2021
MIS Quarterly
Monica Chiarini Tremblay, Rajiv Kohli, Nicole Forsgren
MIS Quarterly | March 2021, Vol 45(1): pp. 455-459
The SPACE of Developer Productivity: There’s more to it than you think
Nicole Forsgren, Margaret-Anne Storey, Chandra Maddila, Tom Zimmermann, Brian Houck, Jenna Butler
ACM Queue | February 2021, Vol 19(1): pp. 20-48
‘How Was Your Weekend?’ Software Development Teams Working From Home During COVID-19
Courtney Miller, Paige Rodeghero, Margaret-Anne Storey, Denae Ford, Tom Zimmermann
ICSE 2021 | January 2021
Distinguished Paper Award at ICSE 2021
-
Analyzing Web Search Behavior for Software Engineering Tasks
Nikitha Rao, Chetan Bansal, Tom Zimmermann, Ahmed Awadallah, Nachi Nagappan
IEEE BigData | December 2020
Survey on Onboarding Software Engineers During a Pandemic
Paige Rodeghero, Thomas Zimmermann, Denae Ford
MSR-TR-2020-36 | October 2020
Published by Microsoft
Large-Scale Intent Analysis for Identifying Large-Review-Effort Code Changes
Song Wang, Chetan Bansal, Nachi Nagappan
Information and Software Technology | September 2020
A Tale of Two Cities: Software Developers Working from Home During the COVID-19 Pandemic.
Denae Ford, Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Sonia Jaffe, Chandra Maddila, Jenna Butler, Brian Houck, Nachi Nagappan
August 2020
Appendix to A Tale of Two Cities: Software Developers Working from Home During the COVID-19 Pandemic
Denae Ford, Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Sonia Jaffe, Chandra Maddila, Jenna Butler, Brian Houck, Nachi Nagappan
MSR-TR-2020-28 | August 2020
Published by Microsoft
A Taxonomy of Software Delivery Performance Profiles: Investigating the Effects of DevOps Practices
Marcus A. Rothenberger, Jez Humble, Jason Bennett Thatcher, Dustin Smith, Nicole Forsgren
2020 (AMCIS) Americas Conference on Information Systems | August 2020
An Empirical Study of Software Exceptions in the Field using Search Logs
Foyzul Hassan, Chetan Bansal, Nachi Nagappan, Tom Zimmermann, Ahmed Awadallah
ESEM 2020 | July 2020
The State of the ML-universe: 10 Years of Artificial Intelligence & Machine Learning Software Development on GitHub
Danielle Gonzalez, Thomas Zimmermann, Nachiappan Nagappan
Proceedings of the 17th International Conference on Mining Software Repositories (MSR) | May 2020
-
Towards a Theory of Software Developer Job Satisfaction and Perceived Productivity
Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Jacek Czerwonka, Brendan Murphy, Eirini Kalliamvakou
IEEE Transactions on Software Engineering | September 2019
Ten simple rules for helping newcomers become contributors to open projects
Dan Sholler, Igor Steinmacher, Denae Ford, Mara Averick, Mike Hoye, Greg Wilson
PLoS Computational Biology | September 2019, Vol 15
Beyond the Code Itself: How Programmers Really Look at Pull Requests
Denae Ford, Mahnaz Behroozi, Alexander Serebrenik, Chris Parnin
In proceedings of the ACM/IEEE Internationl Conference on Software Engineering – Software Engineering in Society (ICSE SEIS) | May 2019
How Remote Work Can Foster a More Inclusive Environment for Transgender Developers
Denae Ford, Reed Milewicz, Alexander Serebrenik
In proceedings of the ACM/IEEE ICSE 2nd International Workshop on Gender Equality in Software Engineering (GE) | May 2019
Today was a Good Day: The Daily Life of Software Developers
Andre N. Meyer, Earl T. Barr, Christian Bird, Thomas Zimmermann
IEEE Transactions on Software Engineering | April 2019
To appear.
Understanding Software Developer Activity via Windows 10 Telemetry
Spencer Buja, Thomas Zimmermann, Philippe Kirsanov, Ankit Tandon, Xue Liu, Jay Windsor, Henok Addis
MSR-TR-2019-42 | April 2019
Published by Microsoft
Presented at the 2019 Wharton People Analytics Conference. Finalist for the White Paper Competition
The Effect of Work Environments on Productivity and Satisfaction of Software Engineers
Brittany Johnson, Thomas Zimmermann, Christian Bird
IEEE Transactions on Software Engineering | February 2019
To appear.
-
How Should Compilers Explain Problems to Developers?
Titus Barik, Denae Ford, Emerson Murphy-Hill, Chris Parnin
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2018
Selfies as Social Movements: Influences on Participation and Perceived Impact on Stereotypes
Fannie Liu, Denae Ford, Laura Dabbish, Chris Parnin
In proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW) | November 2018
Dazed: Measuring the Cognitive Load of Solving Technical Interview Problems At the Whiteboard
Mahnaz Behroozi, Alison Lui, Ian Moore, Denae Ford , Chris Parnin
In proceedings of the IEEE International Conference on Software Engineering – New Ideas and Emerging Results Track (ICSE NIER) | May 2018
“We Don’t Do That Here”: How Collaborative Editing with Mentors Improves Engagement in Social Q&A Communities
Denae Ford , Kristina Lustig, Jeremy Banks, Chris Parnin
In proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
-
Characterizing Software Engineering Work with Personas Based on Knowledge Worker Actions
Denae Ford, Tom Zimmermann, Christian Bird, Nachi Nagappan
In proceedings of the IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) | November 2017
Someone Like Me: How Does Peer Parity Influence Participation of Women on Stack Overflow?
Denae Ford , Alisse Harkins, Chris Parnin
In proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | October 2017
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
The Tech-Talk Balance: What Technical Interviewers Expect from Technical Candidates
Denae Ford, Titus Barik, Leslie Rand-Pickett, Chris Parnin
Proceedings of the IEEE ICSE 10th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). | May 2017
-
Appendix to Everything You Wanted to Know About Data Scientists
Miryung Kim, Thomas Zimmermann, Robert DeLine, Andrew Begel
MSR-TR-2016-1127 | December 2016
A Cross-Tool Communication Study on Program Analysis Tool Notifications
Brittany Johnson, Rahul Pandita, Justin Smith, Denae Ford, Sarah Elder, Emerson Murphy-Hill, Sarah Heckman, Caitlin Sadowski
International Symposium on the Foundations of Software Engineering (FSE) | November 2016
Paradise Unplugged: Identifying Barriers for Female Participation on Stack Overflow
Denae Ford, Justin Smith, Philip J. Guo, Chris Parnin
International Symposium on the Foundations of Software Engineering (FSE) | November 2016
Appendix to Personas in Practice: Adapting Knowledge Worker Actions to Software Engineer
Denae Ford, Tom Zimmermann, Christian Bird, Nachi Nagappan
MSR-TR-2016-75 | October 2016
Published by Microsoft
“What Went Right and What Went Wrong”: An Analysis of 155 Postmortems from Game Development
Michael Washburn Jr., Pavithra Sathiyanarayanan, Meiyappan Nagappan, Tom Zimmermann, Christian Bird
Proceedings of the 38th International Conference on Software Engineering (ICSE 2016 SEIP Track) | May 2016
Belief & Evidence in Empirical Software Engineering
Prem Devanbu, Tom Zimmermann, Christian Bird
Proceedings of the 38th International Conference on Software Engineering (ICSE 2016) | May 2016
Beliefs, Practices, and Personalities of Software Engineers: A Survey in a Large Software Company
Edward K. Smith, Christian Bird, Tom Zimmermann
Proceedings of the 9th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE 2016) | May 2016
-
Studying Sustained Attention and Cognitive States in Remote Technical Interviews
Denae Ford, Titus Barik, Chris Parnin
In proceedings of the ACM ICER 3rd International Workshop on Eye Movements in Programming (EMIP) | November 2015
Appendix to Transitioning from Closed Source to Open Source: Analysis and Observations from Six Projects
Pavneet Singh Kochhar, Nachi Nagappan, Tom Zimmermann, Christian Bird
MSR-TR-2015-82 | October 2015
How Practitioners Perceive the Relevance of Software Engineering Research
David Lo, Nachi Nagappan, Tom Zimmermann
September 2015
Appendix to The Effect of Work Environments on Productivity
Thomas Zimmermann, Brittany Johnson, Christian Bird, Tom Zimmermann
MSR-TR-2015-66 | August 2015
Approximating Attack Surfaces with Stack Traces
Christopher Theisen, Kim Herzig, Patrick Morrison, Brendan Murphy, Laurie Williams
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Please note that this paper is not yet published, but accepted for inclusion.
Characteristics of Useful Code Reviews: An Empirical Study at Microsoft
Amiangshu Bosu, Michaela Greiler, Christian Bird
Proceedings of the International Conference on Mining Software Repositories | May 2015
Empirically Detecting False Test Alarms Using Association Rules
Kim Herzig, Nachi Nagappan
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Exploring Causes of Frustration for Software Developers
Denae Ford, Chris Parnin
In proceedings of the IEEE ICSE 9th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) | May 2015
Helping developers help themselves: Automatic decomposition of code review changesets
Mike Barnett, Christian Bird, Shuvendu Lahiri, Joao Brunet
Proceedings of the 37th International Conference on Software Engineering | May 2015
The Art of Testing Less without Sacrificing Quality
Kim Herzig, Michaela Greiler, Jacek Czerwonka, Brendan Murphy
Proceedings of the 2015 International Conference on Software Engineering | May 2015
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
Challenges with Applying Vulnerability Prediction Models
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security | April 2015
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security
Do Topics Make Sense to Managers and Developers?
Abram Hindle, Christian Bird, Tom Zimmermann, Nachi Nagappan
Empirical Software Engineering | April 2015, Vol 20: pp. 479-515
The impact of tangled code changes on defect prediction models
Empirical Software Engineering | April 2015, pp. 1-34
Lessons Learned From Deploying a Code Review Analytics Platform
Christian Bird, Trevor Carnahan, Michaela Greiler
MSR-TR-2015-22 | February 2015
The Design Space of Bug Fixes and How Developers Navigate It
Emerson Murphy-Hill, Tom Zimmermann, Christian Bird, Nachi Nagappan
IEEE Transactions on Software Engineering | January 2015, Vol 41(1): pp. 65-81
-
The Uniqueness of Changes: Characteristics and Applications
Baishakhi Ray, Meiyappan Nagappan, Christian Bird, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-149 | November 2014
Published by Microsoft
Learning Natural Coding Conventions
Miltiadis Allamanis, Earl T. Barr, Christian Bird, Charles Sutton
Proceedings of the ACM SigSoft Symposium on Foundations of Software Engineering | November 2014
Software Developers’ Perceptions of Productivity
André N. Meyer, Thomas Fritz, Gail C. Murphy, Tom Zimmermann
FSE ’14: Proceedings of the 22nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering | November 2014
Using Pre-Release Test Failures to Build Early Post-Release Defect Prediction Models
Proceedings of the 25th International Symposium on Software Reliability Engineering | November 2014
The First Hour Experience: How the Initial Play can Engage (or Lose) New Players
Gifford Cheung, Tom Zimmermann, Nachi Nagappan
CHI PLAY ’14: Proceedings of the First ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play | October 2014
Appendix to The Health of Software Engineering Research
David Lo, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-119 | September 2014
Appendix to Do It Yourself! Homegrown Tools in a Large Software Company
Christian Bird, Tom Zimmermann, Edward K. Smith
MSR-TR-2014-118 | September 2014
Mining Energy Traces to Aid in Software Development: An Empirical Case Study
Ashish Gupta, Thomas Zimmermann, Christian Bird, Nachiappan Nagappan, Thirumalesh Bhat, Syed Emran, Nachi Nagappan, Tom Zimmermann
ESEM ’14: Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurements | September 2014
ESEM '14: Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurements
The Impact of Test Ownership and Team Structure on the Reliability and Effectiveness of Quality Test Runs
Kim Herzig, Nachi Nagappan
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement | September 2014
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement
An Empirical Study of Refactoring Challenges and Benefits at Microsoft
Miryung Kim, Thomas Zimmermann, Nachiappan Nagappan, Nachi Nagappan, Tom Zimmermann
IEEE Transactions on Software Engineering | July 2014, Vol 40(7)
Analyze This! 145 Questions for Data Scientists in Software Engineering
Andrew Begel, Tom Zimmermann
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Cowboys, Ankle Sprains, and Keepers of Quality: How Is Video Game Development Different from Software Development?
Emerson Murphy-Hill, Tom Zimmermann, Nachi Nagappan
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014)
Extrinsic Influence Factors in Software Reliability: A Study of 200,000 Windows Machines
Christian Bird, Venkatesh-Prasad Ranganath, Tom Zimmermann, Nachi Nagappan, Andreas Zeller
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Transition from Centralized to Distributed VCS: A Microsoft Case Study on Reasons, Barriers, and Outcomes
Kivanc Muslu, Christian Bird, Nachiappan Nagappan, Jacek Czerwonka, Nachi Nagappan
Proceedings of the International Conference on Software Engineering | June 2014
Proceedings of the International Conference on Software Engineering
Understanding and Improving Software Build Teams
Shaun Phillips, Thomas Zimmermann, Christian Bird, Tom Zimmermann
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014)
Off With Their Assists: An Empirical Study of Driving Skill in Forza Motorsports 4
Thomas Debeauvais, Tom Zimmermann, Nachi Nagappan, Kevin Carter, Ryan Cooper, Dan Greenawalt, Tyson Solberg
Proceedings of the 9th International Conference on the Foundations of Digital Games (FDG 2014) | April 2014
Motion Sickness Susceptibility in Software Developers
Emerson Murphy-Hill, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-24 | March 2014
Branching Taxonomy
Brendan Murphy, Jacek Czerwonka, Laurie Williams
MSR-TR-2014-23 | February 2014
-
Predicting Defects Using Change Genealogies
Kim Herzig, Sascha Just, Andreas Rau, Andreas Zeller
Proceedings of the 2013 IEEE 24nd International Symposium on Software Reliability Engineering | November 2013
Analyze This! 145 Questions for Data Scientists in Software Engineering (Technical Report MSR-TR-2013-111)
Andrew Begel, Tom Zimmermann
MSR-TR-2013-111 | October 2013
Published by Microsoft
Have Agile Techniques been the Silver Bullet for Software Development at Microsoft?
Brendan Murphy, Christian Bird, Tom Zimmermann, Laurie Williams, Nachi Nagappan, Andrew Begel
ACM ESEM | October 2013
Appendix to Analyze This! 145 Questions for Data Scientists in Software Engineering
Andrew Begel, Tom Zimmermann
MSR-TR-2013-84 | September 2013
Published by Microsoft
Dwelling in Software: Aspects of the felt-life of engineers in large software projects
Richard Harper, Christian Bird, Tom Zimmermann, Brendan Murphy
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW ’13) | September 2013
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW '13)
Convergent Software Peer Review Practices
Peter C. Rigby, Christian Bird
Proceedings of the the joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering (ESEC/FSE) | August 2013
Preprint available upon request to cbird@microsoft.com or peter.rigby@concordia.ca
Diversity in Software Engineering Research
Meiyappan Nagappan, Tom Zimmermann, Christian Bird
Proceedings of the 9th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2013) | August 2013
Leveraging the Crowd: How 48,000 Users Helped Improve Lync Performance
Robert Musson, Jacqueline Richards, Danyel Fisher, Christian Bird, Brian Bussone, Sandipan Ganguly
IEEE Software | August 2013
Collecting a Heap of Shapes
Earl T. Barr, Christian Bird, Mark Marron
Proceedings of the International Symposium on Software Testing and Analysis, 2013 | July 2013
Distinguished Paper Award
Structural and Temporal Patterns-Based Features
Venkatesh-Prasad Ranganath, Jithin Thomas
Proceedings of International Workshop on Data Analysis Patterns in Software Engineering (DAPSE) 2013 | May 2013
Expectations, Outcomes, and Challenges of Modern Code Review
Christian Bird, Alberto Bacchelli
Proceedings of the International Conference on Software Engineering | May 2013
It’s not a Bug, It’s a Feature: How Misclassification Impacts Bug Prediction
Kim Herzig, Sascha Just, Andreas Zeller
Proceedings of the 2013 International Conference on Software Engineering | May 2013
Appendix to The Design of Bug Fixes
Emerson Murphy-Hill, Tom Zimmermann, Christian Bird, Nachi Nagappan
MSR-TR-2013-22 | April 2013
Mastering the Art of War: How Patterns of Gameplay Influence Skill in Halo
Jeff Huang, Tom Zimmermann, Nachi Nagappan, Charles Harrison, Bruce Phillips
Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2013) | April 2013
Predicting Method Crashes with Bytecode Operations
Sunghun Kim, Tom Zimmermann, Rahul Premraj, Nicolas Bettenburg, Shivkumar Shivaji
Proceedings of the 6th Annual India Software Engineering Conference (ISEC 2013) | February 2013
Proceedings of the 6th Annual India Software Engineering Conference (ISEC 2013)
The Impact of Tangled Code Changes
Proceedings of the 10th Working Conference on Mining Software Repositories | January 2013
http://dl.acm.org/citation.cfm?id=2487085.2487113
-
A Field Study of Refactoring Challenges and Benefits
Miryung Kim, Tom Zimmermann, Nachi Nagappan
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012) | November 2012
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012)
Assessing the Value of Branches with What-if Analysis
Christian Bird, Thomas Zimmermann, Tom Zimmermann
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012) | November 2012
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012)
Empirical analysis of user data in game software development
Kenneth Hullett, Nachi Nagappan, Eric Schuh, John Hopson
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement | November 2012
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Empirical Analysis of User Data in Game Software Development
Kenneth Hullett, Nachi Nagappan, Eric Schuh, John Hopson
Proceedings of Empirical Software Engineering and Measurement | September 2012
Relating Requirements to Implementation via Topic Analysis
Abram Hindle, Christian Bird, Tom Zimmermann, Nachi Nagappan
Proceedings of the 2012 International Conference on Software Maintenance (ICSM 2012) | September 2012
The Effect of Branching Strategies on Software Quality
Emad Shihab, Christian Bird, Tom Zimmermann
Proceedings of the ACM/IEEE International Symposium on Empirical Software Engineering and Measurement | September 2012
Predicting Method Crashes with Bytecode Operations
Sunghun Kim, Tom Zimmermann, Rahul Premraj, Nicolas Bettenburg, Shivkumar Shivaji
MSR-TR-2012-94 | September 2012
Representativeness in Software Engineering Research
Meiyappan Nagappan, Tom Zimmermann, Christian Bird
MSR-TR-2012-93 | September 2012
Compatibility Testing via Patterns-Based Trace Comparison
Venkatesh-Prasad Ranganath, Pradip Vallathol, Pankaj Gupta
MSR-TR-2012-87 | August 2012
Characterizing and Predicting Which Bugs Get Reopened
Tom Zimmermann, Nachi Nagappan, Philip J. Guo, Brendan Murphy
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Goldfish Bowl Panel: Software Development Analytics
Tim Menzies, Tom Zimmermann
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Information Needs for Software Development Analytics
Raymond P.L. Buse, Tom Zimmermann
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Data-Driven Games User Research
Tom Zimmermann, Bruce Phillips, Nachi Nagappan, Chuck Harrison
Proceedings of the CHI Workshop on Game User Research (CHI-GUR 2012) | May 2012
Appendix to A Field Study of Refactoring Rationale, Benefits, and Challenges at Microsoft
Miryung Kim, Thomas Zimmermann, Nachiappan Nagappan, Nachi Nagappan, Tom Zimmermann
MSR-TR-2012-4 | January 2012
-
Detecting Energy Patterns in Software Development
Ashish Gupta, Tom Zimmermann, Christian Bird, Nachi Nagappan, Thirumalesh Bhat, Syed Emran
MSR-TR-2011-106 | November 2011
Local vs Global Models for Effort Estimation and Defect Prediction
Tim Menzies, Andrew Butcher, Andrian Marcus, Tom Zimmermann, David Cok
Proceedings of the 26st IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) | November 2011
An Explanatory Analysis on Eclipse Beta-Release Bugs Through In-Process Metrics
Ayse Tosun Misirli, Brendan Murphy, Tom Zimmermann, Ayse Basar
Proceedings of the 8th International Workshop on Software Quality (WoSQ 2011) | September 2011
An Integration Resolution Algorithm for Mining Multiple Branches in Version Control Systems (Industry Track)
Alexander Tarvo, Tom Zimmermann, Jacek Czerwonka
Proceedings of the 27th IEEE International Conference on Software Maintenance (ICSM 2011) | September 2011
Don’t Touch My Code! Examining the Effects of Ownership on Software Quality
Christian Bird, Nachi Nagappan, Brendan Murphy, Harald Gall, Premkumar Devanbu
Proceedings of the the eighth joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering | September 2011
Proceedings of the the eighth joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering
Failure is a Four-Letter Word: A Parody in Empirical Research
Andreas Zeller, Tom Zimmermann, Christian Bird
Proceedings of the 7th International Conference on Predictive Models in Software Engineering | September 2011
Sociotechnical Coordination and Collaboration in Open Source Software
Proceedings of the 27th IEEE International Conference on Software Maintenance | September 2011
Understanding a Developer Social Network and its Evolution
Qiaona Hong, Sunghun Kim, S. C. Cheung, Christian Bird
Proceedings of the 27th IEEE International Conference on Software Maintenance | September 2011
Java Generics Adoption: How New Features are Introduced, Championed, or Ignored
Chris Parnin, Christian Bird, Emerson Murphy-Hill
Proceedings of the International Working Conference on Mining Software Repositories | May 2011
Empirical Software Engineering at Microsoft Research
Christian Bird, Brendan Murphy, Nachi Nagappan, Tom Zimmermann
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW) | March 2011
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW)
“Not My Bug!” and Other Reasons for Software Bug Report Reassignments
Philip J. Guo, Thomas Zimmermann, Nachiappan Nagappan, Brendan Murphy, Nachi Nagappan, Tom Zimmermann
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW) | March 2011
An Empirical Study of the Factors Relating Field Failures and Dependencies
Tom Zimmermann, Nachi Nagappan, Laurie Williams, Kim Herzig, Rahul Premraj
Proceedings of the 4th International Conference on Software Testing, Verification and Validation (ICST) | March 2011
CRANE: Failure Prediction, Change Analysis and Test Prioritization in Practice – Experiences from Windows
Jacek Czerwonka, Rajiv Das, Nachi Nagappan, Alex Tarvo, Alex Teterev
International Conference on Software Testing | March 2011
Information Needs for Software Development Analytics
Raymond P.L. Buse, Tom Zimmermann
MSR-TR-2011-8 | January 2011
-
Analytics for Software Development
Tom Zimmermann, Raymond P. L. Buse
Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER) | November 2010
Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER)
Change Bursts as Defect Predictors
Nachi Nagappan, Andreas Zeller, Tom Zimmermann, Kim Herzig, Brendan Murphy
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE) | November 2010
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE)
Security Trend Analysis with CVE Topic Models
Stephan Neuhaus, Tom Zimmermann
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE) | November 2010
Analytics for Software Development
MSR-TR-2010-111 | August 2010
Accepted at the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER). Please cite the workshop paper instead.
Characterizing and Predicting Which Bugs Get Fixed: An Empirical Study of Microsoft Windows
Philip J. Guo, Tom Zimmermann, Nachi Nagappan, Brendan Murphy
Proceedings of the 32th International Conference on Software Engineering (ICSE) | May 2010
Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista
Tom Zimmermann, Nachi Nagappan, Laurie Williams
Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST) | April 2010
Most Influential Paper Award at ICST 2020 MIP Practical
-
Coordination in Large-Scale Software Development: Helpful and Unhelpful Behaviors
Andrew Begel, Nachi Nagappan
MSR-TR-2009-135 | September 2009
Does Distributed Development Affect Software Quality? An Empirical Case Study of Windows Vista
Christian Bird, Nachi Nagappan, Premkumar Devanbu, Harald Gall, Brendan Murphy
Communications of the ACM | August 2009, Vol 52(8): pp. 85-93
Coordination in large-scale software teams
Andrew Begel, Nachi Nagappan, Christopher Poile, Lucas Layman
Proceedings of the 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering (CHASE) | May 2009
Proceedings of the 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering (CHASE)
ISBN: 978-1-4244-3712-2
On Equivalence Partitioning of Code Paths inside OS Kernel Components
Constantin Sârbu, Nachi Nagappan, Neeraj Suri
Proceedings of the 2009 Software Technologies for Future Dependable Distributed Systems (STFSSD) | March 2009
ISBN: 978-0-7695-3572-2
Guest Editors’ Introduction: Mining Software Archives
Nachi Nagappan, Tom Zimmermann, Andreas Zeller
IEEE Software | January 2009, Vol 26: pp. 24-25
The Beauty and the Beast: Vulnerabilities in Red Hat’s Packages
Stephan Neuhaus, Thomas Zimmermann
Proceedings of the 2009 USENIX Annual Technical Conference (USENIX ATC) | January 2009
-
Predicting Defects using Network Analysis on Dependency Graphs
Tom Zimmermann, Nachi Nagappan
Proceedings of the 30th International Conference on Software Engineering (ICSE) | May 2008
Proceedings of the 30th International Conference on Software Engineering (ICSE)
Publications by Research Area
-
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
SoftNER: Mining knowledge graphs from Cloud Incidents
Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao, Nachiappan Nagappan
Empirical Software Engineering | April 2022, Vol 27(4)
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
MIS Quarterly
Monica Chiarini Tremblay, Rajiv Kohli, Nicole Forsgren
MIS Quarterly | March 2021, Vol 45(1): pp. 455-459
The State of the ML-universe: 10 Years of Artificial Intelligence & Machine Learning Software Development on GitHub
Danielle Gonzalez, Thomas Zimmermann, Nachiappan Nagappan
Proceedings of the 17th International Conference on Mining Software Repositories (MSR) | May 2020
-
DevEx in Action: A study of its tangible impacts
Nicole Forsgren, Eirini Kalliamvakou, Abi Noda, Michaela Greiler, Brian Houck, Margaret-Anne Storey
ACM Queue | January 2024, Vol 21(6)
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
The Best of Both Worlds: Unlocking the Potential of Hybrid Work for Software Engineers
Brian Houck, Henry Yelin, Jenna Butler, Nicole Forsgren, Alison McMartin
May 2023
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Sarah Fakhoury, Negar Ghorbani, Todd Mytkowicz, Christian Bird, Jinu Jang, Neel Sundaresan, Shuvendu Lahiri, Elizabeth Dinella
The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’22) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
SoftNER: Mining knowledge graphs from Cloud Incidents
Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao, Nachiappan Nagappan
Empirical Software Engineering | April 2022, Vol 27(4)
Technical report
Chandra Maddila, Apoorva Agrawal, Thomas Zimmermann, Nicole Forsgren, Kim Herzig, Arie van Deursen
MSR-TR-2021-28 | October 2021
Published by Microsoft
Appendix to How Developers and Managers Define and Trade Off Productivity and Quality
Margaret-Anne Storey, Brian Houck, Thomas Zimmermann
MSR-TR-2021-26 | October 2021
Published by Microsoft
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
Including Everyone, Everywhere: Understanding Opportunities and Challenges of Geographic Gender-Inclusion in OSS
Gede Artha Azriadi Prana, Denae Ford, Ayushi Rastogi, David Lo, Rahul Purandare, Nachiappan Nagappan
ICSE 2022 | September 2021
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
“Is My Mic On?” Preparing SE Students for Collaborative Remote Work and Hybrid Team Communication
Makayla Moster, Denae Ford, Paige Rodeghero
ICSE JSEET | May 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
DeepMerge: Learning to Merge Programs
Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri
May 2021
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
MIS Quarterly
Monica Chiarini Tremblay, Rajiv Kohli, Nicole Forsgren
MIS Quarterly | March 2021, Vol 45(1): pp. 455-459
The SPACE of Developer Productivity: There’s more to it than you think
Nicole Forsgren, Margaret-Anne Storey, Chandra Maddila, Tom Zimmermann, Brian Houck, Jenna Butler
ACM Queue | February 2021, Vol 19(1): pp. 20-48
‘How Was Your Weekend?’ Software Development Teams Working From Home During COVID-19
Courtney Miller, Paige Rodeghero, Margaret-Anne Storey, Denae Ford, Tom Zimmermann
ICSE 2021 | January 2021
Distinguished Paper Award at ICSE 2021
Analyzing Web Search Behavior for Software Engineering Tasks
Nikitha Rao, Chetan Bansal, Tom Zimmermann, Ahmed Awadallah, Nachi Nagappan
IEEE BigData | December 2020
Survey on Onboarding Software Engineers During a Pandemic
Paige Rodeghero, Thomas Zimmermann, Denae Ford
MSR-TR-2020-36 | October 2020
Published by Microsoft
Large-Scale Intent Analysis for Identifying Large-Review-Effort Code Changes
Song Wang, Chetan Bansal, Nachi Nagappan
Information and Software Technology | September 2020
A Tale of Two Cities: Software Developers Working from Home During the COVID-19 Pandemic.
Denae Ford, Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Sonia Jaffe, Chandra Maddila, Jenna Butler, Brian Houck, Nachi Nagappan
August 2020
Appendix to A Tale of Two Cities: Software Developers Working from Home During the COVID-19 Pandemic
Denae Ford, Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Sonia Jaffe, Chandra Maddila, Jenna Butler, Brian Houck, Nachi Nagappan
MSR-TR-2020-28 | August 2020
Published by Microsoft
A Taxonomy of Software Delivery Performance Profiles: Investigating the Effects of DevOps Practices
Marcus A. Rothenberger, Jez Humble, Jason Bennett Thatcher, Dustin Smith, Nicole Forsgren
2020 (AMCIS) Americas Conference on Information Systems | August 2020
An Empirical Study of Software Exceptions in the Field using Search Logs
Foyzul Hassan, Chetan Bansal, Nachi Nagappan, Tom Zimmermann, Ahmed Awadallah
ESEM 2020 | July 2020
The State of the ML-universe: 10 Years of Artificial Intelligence & Machine Learning Software Development on GitHub
Danielle Gonzalez, Thomas Zimmermann, Nachiappan Nagappan
Proceedings of the 17th International Conference on Mining Software Repositories (MSR) | May 2020
Towards a Theory of Software Developer Job Satisfaction and Perceived Productivity
Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Jacek Czerwonka, Brendan Murphy, Eirini Kalliamvakou
IEEE Transactions on Software Engineering | September 2019
Ten simple rules for helping newcomers become contributors to open projects
Dan Sholler, Igor Steinmacher, Denae Ford, Mara Averick, Mike Hoye, Greg Wilson
PLoS Computational Biology | September 2019, Vol 15
How Remote Work Can Foster a More Inclusive Environment for Transgender Developers
Denae Ford, Reed Milewicz, Alexander Serebrenik
In proceedings of the ACM/IEEE ICSE 2nd International Workshop on Gender Equality in Software Engineering (GE) | May 2019
Beyond the Code Itself: How Programmers Really Look at Pull Requests
Denae Ford, Mahnaz Behroozi, Alexander Serebrenik, Chris Parnin
In proceedings of the ACM/IEEE Internationl Conference on Software Engineering – Software Engineering in Society (ICSE SEIS) | May 2019
Understanding Software Developer Activity via Windows 10 Telemetry
Spencer Buja, Thomas Zimmermann, Philippe Kirsanov, Ankit Tandon, Xue Liu, Jay Windsor, Henok Addis
MSR-TR-2019-42 | April 2019
Published by Microsoft
Presented at the 2019 Wharton People Analytics Conference. Finalist for the White Paper Competition
Today was a Good Day: The Daily Life of Software Developers
Andre N. Meyer, Earl T. Barr, Christian Bird, Thomas Zimmermann
IEEE Transactions on Software Engineering | April 2019
To appear.
The Effect of Work Environments on Productivity and Satisfaction of Software Engineers
Brittany Johnson, Thomas Zimmermann, Christian Bird
IEEE Transactions on Software Engineering | February 2019
To appear.
How Should Compilers Explain Problems to Developers?
Titus Barik, Denae Ford, Emerson Murphy-Hill, Chris Parnin
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2018
Dazed: Measuring the Cognitive Load of Solving Technical Interview Problems At the Whiteboard
Mahnaz Behroozi, Alison Lui, Ian Moore, Denae Ford , Chris Parnin
In proceedings of the IEEE International Conference on Software Engineering – New Ideas and Emerging Results Track (ICSE NIER) | May 2018
“We Don’t Do That Here”: How Collaborative Editing with Mentors Improves Engagement in Social Q&A Communities
Denae Ford , Kristina Lustig, Jeremy Banks, Chris Parnin
In proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Characterizing Software Engineering Work with Personas Based on Knowledge Worker Actions
Denae Ford, Tom Zimmermann, Christian Bird, Nachi Nagappan
In proceedings of the IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) | November 2017
Someone Like Me: How Does Peer Parity Influence Participation of Women on Stack Overflow?
Denae Ford , Alisse Harkins, Chris Parnin
In proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | October 2017
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
The Tech-Talk Balance: What Technical Interviewers Expect from Technical Candidates
Denae Ford, Titus Barik, Leslie Rand-Pickett, Chris Parnin
Proceedings of the IEEE ICSE 10th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). | May 2017
Appendix to Everything You Wanted to Know About Data Scientists
Miryung Kim, Thomas Zimmermann, Robert DeLine, Andrew Begel
MSR-TR-2016-1127 | December 2016
Paradise Unplugged: Identifying Barriers for Female Participation on Stack Overflow
Denae Ford, Justin Smith, Philip J. Guo, Chris Parnin
International Symposium on the Foundations of Software Engineering (FSE) | November 2016
A Cross-Tool Communication Study on Program Analysis Tool Notifications
Brittany Johnson, Rahul Pandita, Justin Smith, Denae Ford, Sarah Elder, Emerson Murphy-Hill, Sarah Heckman, Caitlin Sadowski
International Symposium on the Foundations of Software Engineering (FSE) | November 2016
Appendix to Personas in Practice: Adapting Knowledge Worker Actions to Software Engineer
Denae Ford, Tom Zimmermann, Christian Bird, Nachi Nagappan
MSR-TR-2016-75 | October 2016
Published by Microsoft
“What Went Right and What Went Wrong”: An Analysis of 155 Postmortems from Game Development
Michael Washburn Jr., Pavithra Sathiyanarayanan, Meiyappan Nagappan, Tom Zimmermann, Christian Bird
Proceedings of the 38th International Conference on Software Engineering (ICSE 2016 SEIP Track) | May 2016
Belief & Evidence in Empirical Software Engineering
Prem Devanbu, Tom Zimmermann, Christian Bird
Proceedings of the 38th International Conference on Software Engineering (ICSE 2016) | May 2016
Beliefs, Practices, and Personalities of Software Engineers: A Survey in a Large Software Company
Edward K. Smith, Christian Bird, Tom Zimmermann
Proceedings of the 9th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE 2016) | May 2016
Studying Sustained Attention and Cognitive States in Remote Technical Interviews
Denae Ford, Titus Barik, Chris Parnin
In proceedings of the ACM ICER 3rd International Workshop on Eye Movements in Programming (EMIP) | November 2015
Appendix to Transitioning from Closed Source to Open Source: Analysis and Observations from Six Projects
Pavneet Singh Kochhar, Nachi Nagappan, Tom Zimmermann, Christian Bird
MSR-TR-2015-82 | October 2015
How Practitioners Perceive the Relevance of Software Engineering Research
David Lo, Nachi Nagappan, Tom Zimmermann
September 2015
Appendix to The Effect of Work Environments on Productivity
Thomas Zimmermann, Brittany Johnson, Christian Bird, Tom Zimmermann
MSR-TR-2015-66 | August 2015
Exploring Causes of Frustration for Software Developers
Denae Ford, Chris Parnin
In proceedings of the IEEE ICSE 9th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) | May 2015
The Art of Testing Less without Sacrificing Quality
Kim Herzig, Michaela Greiler, Jacek Czerwonka, Brendan Murphy
Proceedings of the 2015 International Conference on Software Engineering | May 2015
Empirically Detecting False Test Alarms Using Association Rules
Kim Herzig, Nachi Nagappan
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Approximating Attack Surfaces with Stack Traces
Christopher Theisen, Kim Herzig, Patrick Morrison, Brendan Murphy, Laurie Williams
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Please note that this paper is not yet published, but accepted for inclusion.
Helping developers help themselves: Automatic decomposition of code review changesets
Mike Barnett, Christian Bird, Shuvendu Lahiri, Joao Brunet
Proceedings of the 37th International Conference on Software Engineering | May 2015
Characteristics of Useful Code Reviews: An Empirical Study at Microsoft
Amiangshu Bosu, Michaela Greiler, Christian Bird
Proceedings of the International Conference on Mining Software Repositories | May 2015
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
Challenges with Applying Vulnerability Prediction Models
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security | April 2015
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security
The impact of tangled code changes on defect prediction models
Empirical Software Engineering | April 2015, pp. 1-34
Do Topics Make Sense to Managers and Developers?
Abram Hindle, Christian Bird, Tom Zimmermann, Nachi Nagappan
Empirical Software Engineering | April 2015, Vol 20: pp. 479-515
Lessons Learned From Deploying a Code Review Analytics Platform
Christian Bird, Trevor Carnahan, Michaela Greiler
MSR-TR-2015-22 | February 2015
The Design Space of Bug Fixes and How Developers Navigate It
Emerson Murphy-Hill, Tom Zimmermann, Christian Bird, Nachi Nagappan
IEEE Transactions on Software Engineering | January 2015, Vol 41(1): pp. 65-81
The Uniqueness of Changes: Characteristics and Applications
Baishakhi Ray, Meiyappan Nagappan, Christian Bird, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-149 | November 2014
Published by Microsoft
Using Pre-Release Test Failures to Build Early Post-Release Defect Prediction Models
Proceedings of the 25th International Symposium on Software Reliability Engineering | November 2014
Learning Natural Coding Conventions
Miltiadis Allamanis, Earl T. Barr, Christian Bird, Charles Sutton
Proceedings of the ACM SigSoft Symposium on Foundations of Software Engineering | November 2014
Software Developers’ Perceptions of Productivity
André N. Meyer, Thomas Fritz, Gail C. Murphy, Tom Zimmermann
FSE ’14: Proceedings of the 22nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering | November 2014
The First Hour Experience: How the Initial Play can Engage (or Lose) New Players
Gifford Cheung, Tom Zimmermann, Nachi Nagappan
CHI PLAY ’14: Proceedings of the First ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play | October 2014
Appendix to The Health of Software Engineering Research
David Lo, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-119 | September 2014
The Impact of Test Ownership and Team Structure on the Reliability and Effectiveness of Quality Test Runs
Kim Herzig, Nachi Nagappan
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement | September 2014
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement
Appendix to Do It Yourself! Homegrown Tools in a Large Software Company
Christian Bird, Tom Zimmermann, Edward K. Smith
MSR-TR-2014-118 | September 2014
Mining Energy Traces to Aid in Software Development: An Empirical Case Study
Ashish Gupta, Thomas Zimmermann, Christian Bird, Nachiappan Nagappan, Thirumalesh Bhat, Syed Emran, Nachi Nagappan, Tom Zimmermann
ESEM ’14: Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurements | September 2014
ESEM '14: Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurements
An Empirical Study of Refactoring Challenges and Benefits at Microsoft
Miryung Kim, Thomas Zimmermann, Nachiappan Nagappan, Nachi Nagappan, Tom Zimmermann
IEEE Transactions on Software Engineering | July 2014, Vol 40(7)
Extrinsic Influence Factors in Software Reliability: A Study of 200,000 Windows Machines
Christian Bird, Venkatesh-Prasad Ranganath, Tom Zimmermann, Nachi Nagappan, Andreas Zeller
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Transition from Centralized to Distributed VCS: A Microsoft Case Study on Reasons, Barriers, and Outcomes
Kivanc Muslu, Christian Bird, Nachiappan Nagappan, Jacek Czerwonka, Nachi Nagappan
Proceedings of the International Conference on Software Engineering | June 2014
Proceedings of the International Conference on Software Engineering
Analyze This! 145 Questions for Data Scientists in Software Engineering
Andrew Begel, Tom Zimmermann
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Cowboys, Ankle Sprains, and Keepers of Quality: How Is Video Game Development Different from Software Development?
Emerson Murphy-Hill, Tom Zimmermann, Nachi Nagappan
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014)
Understanding and Improving Software Build Teams
Shaun Phillips, Thomas Zimmermann, Christian Bird, Tom Zimmermann
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014)
Off With Their Assists: An Empirical Study of Driving Skill in Forza Motorsports 4
Thomas Debeauvais, Tom Zimmermann, Nachi Nagappan, Kevin Carter, Ryan Cooper, Dan Greenawalt, Tyson Solberg
Proceedings of the 9th International Conference on the Foundations of Digital Games (FDG 2014) | April 2014
Motion Sickness Susceptibility in Software Developers
Emerson Murphy-Hill, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-24 | March 2014
Analyze This! 145 Questions for Data Scientists in Software Engineering (Technical Report MSR-TR-2013-111)
Andrew Begel, Tom Zimmermann
MSR-TR-2013-111 | October 2013
Published by Microsoft
Appendix to Analyze This! 145 Questions for Data Scientists in Software Engineering
Andrew Begel, Tom Zimmermann
MSR-TR-2013-84 | September 2013
Published by Microsoft
Dwelling in Software: Aspects of the felt-life of engineers in large software projects
Richard Harper, Christian Bird, Tom Zimmermann, Brendan Murphy
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW ’13) | September 2013
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW '13)
Convergent Software Peer Review Practices
Peter C. Rigby, Christian Bird
Proceedings of the the joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering (ESEC/FSE) | August 2013
Preprint available upon request to cbird@microsoft.com or peter.rigby@concordia.ca
Leveraging the Crowd: How 48,000 Users Helped Improve Lync Performance
Robert Musson, Jacqueline Richards, Danyel Fisher, Christian Bird, Brian Bussone, Sandipan Ganguly
IEEE Software | August 2013
Diversity in Software Engineering Research
Meiyappan Nagappan, Tom Zimmermann, Christian Bird
Proceedings of the 9th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2013) | August 2013
Collecting a Heap of Shapes
Earl T. Barr, Christian Bird, Mark Marron
Proceedings of the International Symposium on Software Testing and Analysis, 2013 | July 2013
Distinguished Paper Award
Structural and Temporal Patterns-Based Features
Venkatesh-Prasad Ranganath, Jithin Thomas
Proceedings of International Workshop on Data Analysis Patterns in Software Engineering (DAPSE) 2013 | May 2013
It’s not a Bug, It’s a Feature: How Misclassification Impacts Bug Prediction
Kim Herzig, Sascha Just, Andreas Zeller
Proceedings of the 2013 International Conference on Software Engineering | May 2013
Expectations, Outcomes, and Challenges of Modern Code Review
Christian Bird, Alberto Bacchelli
Proceedings of the International Conference on Software Engineering | May 2013
Appendix to The Design of Bug Fixes
Emerson Murphy-Hill, Tom Zimmermann, Christian Bird, Nachi Nagappan
MSR-TR-2013-22 | April 2013
Mastering the Art of War: How Patterns of Gameplay Influence Skill in Halo
Jeff Huang, Tom Zimmermann, Nachi Nagappan, Charles Harrison, Bruce Phillips
Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2013) | April 2013
Predicting Method Crashes with Bytecode Operations
Sunghun Kim, Tom Zimmermann, Rahul Premraj, Nicolas Bettenburg, Shivkumar Shivaji
Proceedings of the 6th Annual India Software Engineering Conference (ISEC 2013) | February 2013
Proceedings of the 6th Annual India Software Engineering Conference (ISEC 2013)
Assessing the Value of Branches with What-if Analysis
Christian Bird, Thomas Zimmermann, Tom Zimmermann
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012) | November 2012
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012)
A Field Study of Refactoring Challenges and Benefits
Miryung Kim, Tom Zimmermann, Nachi Nagappan
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012) | November 2012
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012)
Empirical analysis of user data in game software development
Kenneth Hullett, Nachi Nagappan, Eric Schuh, John Hopson
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement | November 2012
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Relating Requirements to Implementation via Topic Analysis
Abram Hindle, Christian Bird, Tom Zimmermann, Nachi Nagappan
Proceedings of the 2012 International Conference on Software Maintenance (ICSM 2012) | September 2012
Empirical Analysis of User Data in Game Software Development
Kenneth Hullett, Nachi Nagappan, Eric Schuh, John Hopson
Proceedings of Empirical Software Engineering and Measurement | September 2012
The Effect of Branching Strategies on Software Quality
Emad Shihab, Christian Bird, Tom Zimmermann
Proceedings of the ACM/IEEE International Symposium on Empirical Software Engineering and Measurement | September 2012
Predicting Method Crashes with Bytecode Operations
Sunghun Kim, Tom Zimmermann, Rahul Premraj, Nicolas Bettenburg, Shivkumar Shivaji
MSR-TR-2012-94 | September 2012
Representativeness in Software Engineering Research
Meiyappan Nagappan, Tom Zimmermann, Christian Bird
MSR-TR-2012-93 | September 2012
Compatibility Testing via Patterns-Based Trace Comparison
Venkatesh-Prasad Ranganath, Pradip Vallathol, Pankaj Gupta
MSR-TR-2012-87 | August 2012
Characterizing and Predicting Which Bugs Get Reopened
Tom Zimmermann, Nachi Nagappan, Philip J. Guo, Brendan Murphy
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Information Needs for Software Development Analytics
Raymond P.L. Buse, Tom Zimmermann
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Goldfish Bowl Panel: Software Development Analytics
Tim Menzies, Tom Zimmermann
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Data-Driven Games User Research
Tom Zimmermann, Bruce Phillips, Nachi Nagappan, Chuck Harrison
Proceedings of the CHI Workshop on Game User Research (CHI-GUR 2012) | May 2012
Appendix to A Field Study of Refactoring Rationale, Benefits, and Challenges at Microsoft
Miryung Kim, Thomas Zimmermann, Nachiappan Nagappan, Nachi Nagappan, Tom Zimmermann
MSR-TR-2012-4 | January 2012
Detecting Energy Patterns in Software Development
Ashish Gupta, Tom Zimmermann, Christian Bird, Nachi Nagappan, Thirumalesh Bhat, Syed Emran
MSR-TR-2011-106 | November 2011
Local vs Global Models for Effort Estimation and Defect Prediction
Tim Menzies, Andrew Butcher, Andrian Marcus, Tom Zimmermann, David Cok
Proceedings of the 26st IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) | November 2011
Don’t Touch My Code! Examining the Effects of Ownership on Software Quality
Christian Bird, Nachi Nagappan, Brendan Murphy, Harald Gall, Premkumar Devanbu
Proceedings of the the eighth joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering | September 2011
Proceedings of the the eighth joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering
Failure is a Four-Letter Word: A Parody in Empirical Research
Andreas Zeller, Tom Zimmermann, Christian Bird
Proceedings of the 7th International Conference on Predictive Models in Software Engineering | September 2011
Sociotechnical Coordination and Collaboration in Open Source Software
Proceedings of the 27th IEEE International Conference on Software Maintenance | September 2011
An Integration Resolution Algorithm for Mining Multiple Branches in Version Control Systems (Industry Track)
Alexander Tarvo, Tom Zimmermann, Jacek Czerwonka
Proceedings of the 27th IEEE International Conference on Software Maintenance (ICSM 2011) | September 2011
An Explanatory Analysis on Eclipse Beta-Release Bugs Through In-Process Metrics
Ayse Tosun Misirli, Brendan Murphy, Tom Zimmermann, Ayse Basar
Proceedings of the 8th International Workshop on Software Quality (WoSQ 2011) | September 2011
Java Generics Adoption: How New Features are Introduced, Championed, or Ignored
Chris Parnin, Christian Bird, Emerson Murphy-Hill
Proceedings of the International Working Conference on Mining Software Repositories | May 2011
Empirical Software Engineering at Microsoft Research
Christian Bird, Brendan Murphy, Nachi Nagappan, Tom Zimmermann
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW) | March 2011
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW)
“Not My Bug!” and Other Reasons for Software Bug Report Reassignments
Philip J. Guo, Thomas Zimmermann, Nachiappan Nagappan, Brendan Murphy, Nachi Nagappan, Tom Zimmermann
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW) | March 2011
An Empirical Study of the Factors Relating Field Failures and Dependencies
Tom Zimmermann, Nachi Nagappan, Laurie Williams, Kim Herzig, Rahul Premraj
Proceedings of the 4th International Conference on Software Testing, Verification and Validation (ICST) | March 2011
CRANE: Failure Prediction, Change Analysis and Test Prioritization in Practice – Experiences from Windows
Jacek Czerwonka, Rajiv Das, Nachi Nagappan, Alex Tarvo, Alex Teterev
International Conference on Software Testing | March 2011
Information Needs for Software Development Analytics
Raymond P.L. Buse, Tom Zimmermann
MSR-TR-2011-8 | January 2011
Change Bursts as Defect Predictors
Nachi Nagappan, Andreas Zeller, Tom Zimmermann, Kim Herzig, Brendan Murphy
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE) | November 2010
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE)
Analytics for Software Development
Tom Zimmermann, Raymond P. L. Buse
Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER) | November 2010
Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER)
Security Trend Analysis with CVE Topic Models
Stephan Neuhaus, Tom Zimmermann
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE) | November 2010
Analytics for Software Development
MSR-TR-2010-111 | August 2010
Accepted at the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER). Please cite the workshop paper instead.
Characterizing and Predicting Which Bugs Get Fixed: An Empirical Study of Microsoft Windows
Philip J. Guo, Tom Zimmermann, Nachi Nagappan, Brendan Murphy
Proceedings of the 32th International Conference on Software Engineering (ICSE) | May 2010
Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista
Tom Zimmermann, Nachi Nagappan, Laurie Williams
Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST) | April 2010
Most Influential Paper Award at ICST 2020 MIP Practical
Coordination in Large-Scale Software Development: Helpful and Unhelpful Behaviors
Andrew Begel, Nachi Nagappan
MSR-TR-2009-135 | September 2009
Does Distributed Development Affect Software Quality? An Empirical Case Study of Windows Vista
Christian Bird, Nachi Nagappan, Premkumar Devanbu, Harald Gall, Brendan Murphy
Communications of the ACM | August 2009, Vol 52(8): pp. 85-93
Coordination in large-scale software teams
Andrew Begel, Nachi Nagappan, Christopher Poile, Lucas Layman
Proceedings of the 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering (CHASE) | May 2009
Proceedings of the 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering (CHASE)
ISBN: 978-1-4244-3712-2
On Equivalence Partitioning of Code Paths inside OS Kernel Components
Constantin Sârbu, Nachi Nagappan, Neeraj Suri
Proceedings of the 2009 Software Technologies for Future Dependable Distributed Systems (STFSSD) | March 2009
ISBN: 978-0-7695-3572-2
The Beauty and the Beast: Vulnerabilities in Red Hat’s Packages
Stephan Neuhaus, Thomas Zimmermann
Proceedings of the 2009 USENIX Annual Technical Conference (USENIX ATC) | January 2009
Guest Editors’ Introduction: Mining Software Archives
Nachi Nagappan, Tom Zimmermann, Andreas Zeller
IEEE Software | January 2009, Vol 26: pp. 24-25
Predicting Defects using Network Analysis on Dependency Graphs
Tom Zimmermann, Nachi Nagappan
Proceedings of the 30th International Conference on Software Engineering (ICSE) | May 2008
Proceedings of the 30th International Conference on Software Engineering (ICSE)
-
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
Including Everyone, Everywhere: Understanding Opportunities and Challenges of Geographic Gender-Inclusion in OSS
Gede Artha Azriadi Prana, Denae Ford, Ayushi Rastogi, David Lo, Rahul Purandare, Nachiappan Nagappan
ICSE 2022 | September 2021
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
“Is My Mic On?” Preparing SE Students for Collaborative Remote Work and Hybrid Team Communication
Makayla Moster, Denae Ford, Paige Rodeghero
ICSE JSEET | May 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
A Tale of Two Cities: Software Developers Working from Home During the COVID-19 Pandemic.
Denae Ford, Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Sonia Jaffe, Chandra Maddila, Jenna Butler, Brian Houck, Nachi Nagappan
August 2020
Ten simple rules for helping newcomers become contributors to open projects
Dan Sholler, Igor Steinmacher, Denae Ford, Mara Averick, Mike Hoye, Greg Wilson
PLoS Computational Biology | September 2019, Vol 15
How Remote Work Can Foster a More Inclusive Environment for Transgender Developers
Denae Ford, Reed Milewicz, Alexander Serebrenik
In proceedings of the ACM/IEEE ICSE 2nd International Workshop on Gender Equality in Software Engineering (GE) | May 2019
Beyond the Code Itself: How Programmers Really Look at Pull Requests
Denae Ford, Mahnaz Behroozi, Alexander Serebrenik, Chris Parnin
In proceedings of the ACM/IEEE Internationl Conference on Software Engineering – Software Engineering in Society (ICSE SEIS) | May 2019
How Should Compilers Explain Problems to Developers?
Titus Barik, Denae Ford, Emerson Murphy-Hill, Chris Parnin
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2018
Selfies as Social Movements: Influences on Participation and Perceived Impact on Stereotypes
Fannie Liu, Denae Ford, Laura Dabbish, Chris Parnin
In proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW) | November 2018
Dazed: Measuring the Cognitive Load of Solving Technical Interview Problems At the Whiteboard
Mahnaz Behroozi, Alison Lui, Ian Moore, Denae Ford , Chris Parnin
In proceedings of the IEEE International Conference on Software Engineering – New Ideas and Emerging Results Track (ICSE NIER) | May 2018
“We Don’t Do That Here”: How Collaborative Editing with Mentors Improves Engagement in Social Q&A Communities
Denae Ford , Kristina Lustig, Jeremy Banks, Chris Parnin
In proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Characterizing Software Engineering Work with Personas Based on Knowledge Worker Actions
Denae Ford, Tom Zimmermann, Christian Bird, Nachi Nagappan
In proceedings of the IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) | November 2017
Someone Like Me: How Does Peer Parity Influence Participation of Women on Stack Overflow?
Denae Ford , Alisse Harkins, Chris Parnin
In proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | October 2017
The Tech-Talk Balance: What Technical Interviewers Expect from Technical Candidates
Denae Ford, Titus Barik, Leslie Rand-Pickett, Chris Parnin
Proceedings of the IEEE ICSE 10th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). | May 2017
Paradise Unplugged: Identifying Barriers for Female Participation on Stack Overflow
Denae Ford, Justin Smith, Philip J. Guo, Chris Parnin
International Symposium on the Foundations of Software Engineering (FSE) | November 2016
Studying Sustained Attention and Cognitive States in Remote Technical Interviews
Denae Ford, Titus Barik, Chris Parnin
In proceedings of the ACM ICER 3rd International Workshop on Eye Movements in Programming (EMIP) | November 2015
Exploring Causes of Frustration for Software Developers
Denae Ford, Chris Parnin
In proceedings of the IEEE ICSE 9th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) | May 2015
Dwelling in Software: Aspects of the felt-life of engineers in large software projects
Richard Harper, Christian Bird, Tom Zimmermann, Brendan Murphy
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW ’13) | September 2013
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW '13)
Mastering the Art of War: How Patterns of Gameplay Influence Skill in Halo
Jeff Huang, Tom Zimmermann, Nachi Nagappan, Charles Harrison, Bruce Phillips
Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2013) | April 2013
-
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
Branching Taxonomy
Brendan Murphy, Jacek Czerwonka, Laurie Williams
MSR-TR-2014-23 | February 2014
Predicting Defects Using Change Genealogies
Kim Herzig, Sascha Just, Andreas Rau, Andreas Zeller
Proceedings of the 2013 IEEE 24nd International Symposium on Software Reliability Engineering | November 2013
Have Agile Techniques been the Silver Bullet for Software Development at Microsoft?
Brendan Murphy, Christian Bird, Tom Zimmermann, Laurie Williams, Nachi Nagappan, Andrew Begel
ACM ESEM | October 2013
The Impact of Tangled Code Changes
Proceedings of the 10th Working Conference on Mining Software Repositories | January 2013
http://dl.acm.org/citation.cfm?id=2487085.2487113
-
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
Approximating Attack Surfaces with Stack Traces
Christopher Theisen, Kim Herzig, Patrick Morrison, Brendan Murphy, Laurie Williams
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Please note that this paper is not yet published, but accepted for inclusion.
Challenges with Applying Vulnerability Prediction Models
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security | April 2015
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security
Security Trend Analysis with CVE Topic Models
Stephan Neuhaus, Tom Zimmermann
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE) | November 2010
Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista
Tom Zimmermann, Nachi Nagappan, Laurie Williams
Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST) | April 2010
Most Influential Paper Award at ICST 2020 MIP Practical
-
Analyzing Web Search Behavior for Software Engineering Tasks
Nikitha Rao, Chetan Bansal, Tom Zimmermann, Ahmed Awadallah, Nachi Nagappan
IEEE BigData | December 2020
An Empirical Study of Software Exceptions in the Field using Search Logs
Foyzul Hassan, Chetan Bansal, Nachi Nagappan, Tom Zimmermann, Ahmed Awadallah
ESEM 2020 | July 2020
The impact of tangled code changes on defect prediction models
Empirical Software Engineering | April 2015, pp. 1-34
-
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
The Art of Testing Less without Sacrificing Quality
Kim Herzig, Michaela Greiler, Jacek Czerwonka, Brendan Murphy
Proceedings of the 2015 International Conference on Software Engineering | May 2015
Empirically Detecting False Test Alarms Using Association Rules
Kim Herzig, Nachi Nagappan
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Approximating Attack Surfaces with Stack Traces
Christopher Theisen, Kim Herzig, Patrick Morrison, Brendan Murphy, Laurie Williams
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Please note that this paper is not yet published, but accepted for inclusion.
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
Challenges with Applying Vulnerability Prediction Models
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security | April 2015
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security
The impact of tangled code changes on defect prediction models
Empirical Software Engineering | April 2015, pp. 1-34
Using Pre-Release Test Failures to Build Early Post-Release Defect Prediction Models
Proceedings of the 25th International Symposium on Software Reliability Engineering | November 2014
The Impact of Test Ownership and Team Structure on the Reliability and Effectiveness of Quality Test Runs
Kim Herzig, Nachi Nagappan
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement | September 2014
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement
-
Understanding a Developer Social Network and its Evolution
Qiaona Hong, Sunghun Kim, S. C. Cheung, Christian Bird
Proceedings of the 27th IEEE International Conference on Software Maintenance | September 2011
-
Coordination in Large-Scale Software Development: Helpful and Unhelpful Behaviors
Andrew Begel, Nachi Nagappan
MSR-TR-2009-135 | September 2009
Publications by Type
-
DevEx in Action: A study of its tangible impacts
Nicole Forsgren, Eirini Kalliamvakou, Abi Noda, Michaela Greiler, Brian Houck, Margaret-Anne Storey
ACM Queue | January 2024, Vol 21(6)
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
SoftNER: Mining knowledge graphs from Cloud Incidents
Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao, Nachiappan Nagappan
Empirical Software Engineering | April 2022, Vol 27(4)
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
MIS Quarterly
Monica Chiarini Tremblay, Rajiv Kohli, Nicole Forsgren
MIS Quarterly | March 2021, Vol 45(1): pp. 455-459
The SPACE of Developer Productivity: There’s more to it than you think
Nicole Forsgren, Margaret-Anne Storey, Chandra Maddila, Tom Zimmermann, Brian Houck, Jenna Butler
ACM Queue | February 2021, Vol 19(1): pp. 20-48
Large-Scale Intent Analysis for Identifying Large-Review-Effort Code Changes
Song Wang, Chetan Bansal, Nachi Nagappan
Information and Software Technology | September 2020
Towards a Theory of Software Developer Job Satisfaction and Perceived Productivity
Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Jacek Czerwonka, Brendan Murphy, Eirini Kalliamvakou
IEEE Transactions on Software Engineering | September 2019
Ten simple rules for helping newcomers become contributors to open projects
Dan Sholler, Igor Steinmacher, Denae Ford, Mara Averick, Mike Hoye, Greg Wilson
PLoS Computational Biology | September 2019, Vol 15
Today was a Good Day: The Daily Life of Software Developers
Andre N. Meyer, Earl T. Barr, Christian Bird, Thomas Zimmermann
IEEE Transactions on Software Engineering | April 2019
To appear.
The Effect of Work Environments on Productivity and Satisfaction of Software Engineers
Brittany Johnson, Thomas Zimmermann, Christian Bird
IEEE Transactions on Software Engineering | February 2019
To appear.
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
The impact of tangled code changes on defect prediction models
Empirical Software Engineering | April 2015, pp. 1-34
Do Topics Make Sense to Managers and Developers?
Abram Hindle, Christian Bird, Tom Zimmermann, Nachi Nagappan
Empirical Software Engineering | April 2015, Vol 20: pp. 479-515
The Design Space of Bug Fixes and How Developers Navigate It
Emerson Murphy-Hill, Tom Zimmermann, Christian Bird, Nachi Nagappan
IEEE Transactions on Software Engineering | January 2015, Vol 41(1): pp. 65-81
An Empirical Study of Refactoring Challenges and Benefits at Microsoft
Miryung Kim, Thomas Zimmermann, Nachiappan Nagappan, Nachi Nagappan, Tom Zimmermann
IEEE Transactions on Software Engineering | July 2014, Vol 40(7)
Leveraging the Crowd: How 48,000 Users Helped Improve Lync Performance
Robert Musson, Jacqueline Richards, Danyel Fisher, Christian Bird, Brian Bussone, Sandipan Ganguly
IEEE Software | August 2013
Does Distributed Development Affect Software Quality? An Empirical Case Study of Windows Vista
Christian Bird, Nachi Nagappan, Premkumar Devanbu, Harald Gall, Brendan Murphy
Communications of the ACM | August 2009, Vol 52(8): pp. 85-93
Guest Editors’ Introduction: Mining Software Archives
Nachi Nagappan, Tom Zimmermann, Andreas Zeller
IEEE Software | January 2009, Vol 26: pp. 24-25
-
The Best of Both Worlds: Unlocking the Potential of Hybrid Work for Software Engineers
Brian Houck, Henry Yelin, Jenna Butler, Nicole Forsgren, Alison McMartin
May 2023
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
DeepMerge: Learning to Merge Programs
Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri
May 2021
-
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
A Tale of Two Cities: Software Developers Working from Home During the COVID-19 Pandemic.
Denae Ford, Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Sonia Jaffe, Chandra Maddila, Jenna Butler, Brian Houck, Nachi Nagappan
August 2020
-
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Sarah Fakhoury, Negar Ghorbani, Todd Mytkowicz, Christian Bird, Jinu Jang, Neel Sundaresan, Shuvendu Lahiri, Elizabeth Dinella
The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’22) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
Including Everyone, Everywhere: Understanding Opportunities and Challenges of Geographic Gender-Inclusion in OSS
Gede Artha Azriadi Prana, Denae Ford, Ayushi Rastogi, David Lo, Rahul Purandare, Nachiappan Nagappan
ICSE 2022 | September 2021
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
“Is My Mic On?” Preparing SE Students for Collaborative Remote Work and Hybrid Team Communication
Makayla Moster, Denae Ford, Paige Rodeghero
ICSE JSEET | May 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
‘How Was Your Weekend?’ Software Development Teams Working From Home During COVID-19
Courtney Miller, Paige Rodeghero, Margaret-Anne Storey, Denae Ford, Tom Zimmermann
ICSE 2021 | January 2021
Distinguished Paper Award at ICSE 2021
Analyzing Web Search Behavior for Software Engineering Tasks
Nikitha Rao, Chetan Bansal, Tom Zimmermann, Ahmed Awadallah, Nachi Nagappan
IEEE BigData | December 2020
A Taxonomy of Software Delivery Performance Profiles: Investigating the Effects of DevOps Practices
Marcus A. Rothenberger, Jez Humble, Jason Bennett Thatcher, Dustin Smith, Nicole Forsgren
2020 (AMCIS) Americas Conference on Information Systems | August 2020
An Empirical Study of Software Exceptions in the Field using Search Logs
Foyzul Hassan, Chetan Bansal, Nachi Nagappan, Tom Zimmermann, Ahmed Awadallah
ESEM 2020 | July 2020
The State of the ML-universe: 10 Years of Artificial Intelligence & Machine Learning Software Development on GitHub
Danielle Gonzalez, Thomas Zimmermann, Nachiappan Nagappan
Proceedings of the 17th International Conference on Mining Software Repositories (MSR) | May 2020
How Remote Work Can Foster a More Inclusive Environment for Transgender Developers
Denae Ford, Reed Milewicz, Alexander Serebrenik
In proceedings of the ACM/IEEE ICSE 2nd International Workshop on Gender Equality in Software Engineering (GE) | May 2019
Beyond the Code Itself: How Programmers Really Look at Pull Requests
Denae Ford, Mahnaz Behroozi, Alexander Serebrenik, Chris Parnin
In proceedings of the ACM/IEEE Internationl Conference on Software Engineering – Software Engineering in Society (ICSE SEIS) | May 2019
How Should Compilers Explain Problems to Developers?
Titus Barik, Denae Ford, Emerson Murphy-Hill, Chris Parnin
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2018
Selfies as Social Movements: Influences on Participation and Perceived Impact on Stereotypes
Fannie Liu, Denae Ford, Laura Dabbish, Chris Parnin
In proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW) | November 2018
Dazed: Measuring the Cognitive Load of Solving Technical Interview Problems At the Whiteboard
Mahnaz Behroozi, Alison Lui, Ian Moore, Denae Ford , Chris Parnin
In proceedings of the IEEE International Conference on Software Engineering – New Ideas and Emerging Results Track (ICSE NIER) | May 2018
“We Don’t Do That Here”: How Collaborative Editing with Mentors Improves Engagement in Social Q&A Communities
Denae Ford , Kristina Lustig, Jeremy Banks, Chris Parnin
In proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) | April 2018
Characterizing Software Engineering Work with Personas Based on Knowledge Worker Actions
Denae Ford, Tom Zimmermann, Christian Bird, Nachi Nagappan
In proceedings of the IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) | November 2017
Someone Like Me: How Does Peer Parity Influence Participation of Women on Stack Overflow?
Denae Ford , Alisse Harkins, Chris Parnin
In proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | October 2017
The Tech-Talk Balance: What Technical Interviewers Expect from Technical Candidates
Denae Ford, Titus Barik, Leslie Rand-Pickett, Chris Parnin
Proceedings of the IEEE ICSE 10th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). | May 2017
Paradise Unplugged: Identifying Barriers for Female Participation on Stack Overflow
Denae Ford, Justin Smith, Philip J. Guo, Chris Parnin
International Symposium on the Foundations of Software Engineering (FSE) | November 2016
A Cross-Tool Communication Study on Program Analysis Tool Notifications
Brittany Johnson, Rahul Pandita, Justin Smith, Denae Ford, Sarah Elder, Emerson Murphy-Hill, Sarah Heckman, Caitlin Sadowski
International Symposium on the Foundations of Software Engineering (FSE) | November 2016
“What Went Right and What Went Wrong”: An Analysis of 155 Postmortems from Game Development
Michael Washburn Jr., Pavithra Sathiyanarayanan, Meiyappan Nagappan, Tom Zimmermann, Christian Bird
Proceedings of the 38th International Conference on Software Engineering (ICSE 2016 SEIP Track) | May 2016
Belief & Evidence in Empirical Software Engineering
Prem Devanbu, Tom Zimmermann, Christian Bird
Proceedings of the 38th International Conference on Software Engineering (ICSE 2016) | May 2016
Beliefs, Practices, and Personalities of Software Engineers: A Survey in a Large Software Company
Edward K. Smith, Christian Bird, Tom Zimmermann
Proceedings of the 9th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE 2016) | May 2016
Studying Sustained Attention and Cognitive States in Remote Technical Interviews
Denae Ford, Titus Barik, Chris Parnin
In proceedings of the ACM ICER 3rd International Workshop on Eye Movements in Programming (EMIP) | November 2015
How Practitioners Perceive the Relevance of Software Engineering Research
David Lo, Nachi Nagappan, Tom Zimmermann
September 2015
Exploring Causes of Frustration for Software Developers
Denae Ford, Chris Parnin
In proceedings of the IEEE ICSE 9th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) | May 2015
The Art of Testing Less without Sacrificing Quality
Kim Herzig, Michaela Greiler, Jacek Czerwonka, Brendan Murphy
Proceedings of the 2015 International Conference on Software Engineering | May 2015
Empirically Detecting False Test Alarms Using Association Rules
Kim Herzig, Nachi Nagappan
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Approximating Attack Surfaces with Stack Traces
Christopher Theisen, Kim Herzig, Patrick Morrison, Brendan Murphy, Laurie Williams
Companion Proceedings of the 37th International Conference on Software Engineering | May 2015
Please note that this paper is not yet published, but accepted for inclusion.
Helping developers help themselves: Automatic decomposition of code review changesets
Mike Barnett, Christian Bird, Shuvendu Lahiri, Joao Brunet
Proceedings of the 37th International Conference on Software Engineering | May 2015
Characteristics of Useful Code Reviews: An Empirical Study at Microsoft
Amiangshu Bosu, Michaela Greiler, Christian Bird
Proceedings of the International Conference on Mining Software Repositories | May 2015
Challenges with Applying Vulnerability Prediction Models
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security | April 2015
Proceedings of the 2015 Symposium and Bootcamp on the Science of Security
Using Pre-Release Test Failures to Build Early Post-Release Defect Prediction Models
Proceedings of the 25th International Symposium on Software Reliability Engineering | November 2014
Learning Natural Coding Conventions
Miltiadis Allamanis, Earl T. Barr, Christian Bird, Charles Sutton
Proceedings of the ACM SigSoft Symposium on Foundations of Software Engineering | November 2014
Software Developers’ Perceptions of Productivity
André N. Meyer, Thomas Fritz, Gail C. Murphy, Tom Zimmermann
FSE ’14: Proceedings of the 22nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering | November 2014
The First Hour Experience: How the Initial Play can Engage (or Lose) New Players
Gifford Cheung, Tom Zimmermann, Nachi Nagappan
CHI PLAY ’14: Proceedings of the First ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play | October 2014
The Impact of Test Ownership and Team Structure on the Reliability and Effectiveness of Quality Test Runs
Kim Herzig, Nachi Nagappan
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement | September 2014
Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement
Mining Energy Traces to Aid in Software Development: An Empirical Case Study
Ashish Gupta, Thomas Zimmermann, Christian Bird, Nachiappan Nagappan, Thirumalesh Bhat, Syed Emran, Nachi Nagappan, Tom Zimmermann
ESEM ’14: Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurements | September 2014
ESEM '14: Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurements
Extrinsic Influence Factors in Software Reliability: A Study of 200,000 Windows Machines
Christian Bird, Venkatesh-Prasad Ranganath, Tom Zimmermann, Nachi Nagappan, Andreas Zeller
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Transition from Centralized to Distributed VCS: A Microsoft Case Study on Reasons, Barriers, and Outcomes
Kivanc Muslu, Christian Bird, Nachiappan Nagappan, Jacek Czerwonka, Nachi Nagappan
Proceedings of the International Conference on Software Engineering | June 2014
Proceedings of the International Conference on Software Engineering
Analyze This! 145 Questions for Data Scientists in Software Engineering
Andrew Begel, Tom Zimmermann
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Cowboys, Ankle Sprains, and Keepers of Quality: How Is Video Game Development Different from Software Development?
Emerson Murphy-Hill, Tom Zimmermann, Nachi Nagappan
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014)
Understanding and Improving Software Build Teams
Shaun Phillips, Thomas Zimmermann, Christian Bird, Tom Zimmermann
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014) | June 2014
Proceedings of the 36th International Conference on Software Engineering (ICSE 2014)
Off With Their Assists: An Empirical Study of Driving Skill in Forza Motorsports 4
Thomas Debeauvais, Tom Zimmermann, Nachi Nagappan, Kevin Carter, Ryan Cooper, Dan Greenawalt, Tyson Solberg
Proceedings of the 9th International Conference on the Foundations of Digital Games (FDG 2014) | April 2014
Predicting Defects Using Change Genealogies
Kim Herzig, Sascha Just, Andreas Rau, Andreas Zeller
Proceedings of the 2013 IEEE 24nd International Symposium on Software Reliability Engineering | November 2013
Have Agile Techniques been the Silver Bullet for Software Development at Microsoft?
Brendan Murphy, Christian Bird, Tom Zimmermann, Laurie Williams, Nachi Nagappan, Andrew Begel
ACM ESEM | October 2013
Dwelling in Software: Aspects of the felt-life of engineers in large software projects
Richard Harper, Christian Bird, Tom Zimmermann, Brendan Murphy
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW ’13) | September 2013
Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW '13)
Convergent Software Peer Review Practices
Peter C. Rigby, Christian Bird
Proceedings of the the joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering (ESEC/FSE) | August 2013
Preprint available upon request to cbird@microsoft.com or peter.rigby@concordia.ca
Diversity in Software Engineering Research
Meiyappan Nagappan, Tom Zimmermann, Christian Bird
Proceedings of the 9th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2013) | August 2013
Collecting a Heap of Shapes
Earl T. Barr, Christian Bird, Mark Marron
Proceedings of the International Symposium on Software Testing and Analysis, 2013 | July 2013
Distinguished Paper Award
Structural and Temporal Patterns-Based Features
Venkatesh-Prasad Ranganath, Jithin Thomas
Proceedings of International Workshop on Data Analysis Patterns in Software Engineering (DAPSE) 2013 | May 2013
It’s not a Bug, It’s a Feature: How Misclassification Impacts Bug Prediction
Kim Herzig, Sascha Just, Andreas Zeller
Proceedings of the 2013 International Conference on Software Engineering | May 2013
Expectations, Outcomes, and Challenges of Modern Code Review
Christian Bird, Alberto Bacchelli
Proceedings of the International Conference on Software Engineering | May 2013
Mastering the Art of War: How Patterns of Gameplay Influence Skill in Halo
Jeff Huang, Tom Zimmermann, Nachi Nagappan, Charles Harrison, Bruce Phillips
Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2013) | April 2013
Predicting Method Crashes with Bytecode Operations
Sunghun Kim, Tom Zimmermann, Rahul Premraj, Nicolas Bettenburg, Shivkumar Shivaji
Proceedings of the 6th Annual India Software Engineering Conference (ISEC 2013) | February 2013
Proceedings of the 6th Annual India Software Engineering Conference (ISEC 2013)
The Impact of Tangled Code Changes
Proceedings of the 10th Working Conference on Mining Software Repositories | January 2013
http://dl.acm.org/citation.cfm?id=2487085.2487113
Assessing the Value of Branches with What-if Analysis
Christian Bird, Thomas Zimmermann, Tom Zimmermann
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012) | November 2012
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012)
A Field Study of Refactoring Challenges and Benefits
Miryung Kim, Tom Zimmermann, Nachi Nagappan
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012) | November 2012
Proceedings of the 20th International Symposium on Foundations of Software Engineering (FSE 2012)
Empirical analysis of user data in game software development
Kenneth Hullett, Nachi Nagappan, Eric Schuh, John Hopson
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement | November 2012
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Relating Requirements to Implementation via Topic Analysis
Abram Hindle, Christian Bird, Tom Zimmermann, Nachi Nagappan
Proceedings of the 2012 International Conference on Software Maintenance (ICSM 2012) | September 2012
Empirical Analysis of User Data in Game Software Development
Kenneth Hullett, Nachi Nagappan, Eric Schuh, John Hopson
Proceedings of Empirical Software Engineering and Measurement | September 2012
The Effect of Branching Strategies on Software Quality
Emad Shihab, Christian Bird, Tom Zimmermann
Proceedings of the ACM/IEEE International Symposium on Empirical Software Engineering and Measurement | September 2012
Characterizing and Predicting Which Bugs Get Reopened
Tom Zimmermann, Nachi Nagappan, Philip J. Guo, Brendan Murphy
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Information Needs for Software Development Analytics
Raymond P.L. Buse, Tom Zimmermann
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Goldfish Bowl Panel: Software Development Analytics
Tim Menzies, Tom Zimmermann
Proceedings of the 34th International Conference on Software Engineering (ICSE 2012 SEIP Track) | June 2012
Data-Driven Games User Research
Tom Zimmermann, Bruce Phillips, Nachi Nagappan, Chuck Harrison
Proceedings of the CHI Workshop on Game User Research (CHI-GUR 2012) | May 2012
Local vs Global Models for Effort Estimation and Defect Prediction
Tim Menzies, Andrew Butcher, Andrian Marcus, Tom Zimmermann, David Cok
Proceedings of the 26st IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) | November 2011
Don’t Touch My Code! Examining the Effects of Ownership on Software Quality
Christian Bird, Nachi Nagappan, Brendan Murphy, Harald Gall, Premkumar Devanbu
Proceedings of the the eighth joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering | September 2011
Proceedings of the the eighth joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering
Understanding a Developer Social Network and its Evolution
Qiaona Hong, Sunghun Kim, S. C. Cheung, Christian Bird
Proceedings of the 27th IEEE International Conference on Software Maintenance | September 2011
Failure is a Four-Letter Word: A Parody in Empirical Research
Andreas Zeller, Tom Zimmermann, Christian Bird
Proceedings of the 7th International Conference on Predictive Models in Software Engineering | September 2011
Sociotechnical Coordination and Collaboration in Open Source Software
Proceedings of the 27th IEEE International Conference on Software Maintenance | September 2011
An Integration Resolution Algorithm for Mining Multiple Branches in Version Control Systems (Industry Track)
Alexander Tarvo, Tom Zimmermann, Jacek Czerwonka
Proceedings of the 27th IEEE International Conference on Software Maintenance (ICSM 2011) | September 2011
An Explanatory Analysis on Eclipse Beta-Release Bugs Through In-Process Metrics
Ayse Tosun Misirli, Brendan Murphy, Tom Zimmermann, Ayse Basar
Proceedings of the 8th International Workshop on Software Quality (WoSQ 2011) | September 2011
Java Generics Adoption: How New Features are Introduced, Championed, or Ignored
Chris Parnin, Christian Bird, Emerson Murphy-Hill
Proceedings of the International Working Conference on Mining Software Repositories | May 2011
Empirical Software Engineering at Microsoft Research
Christian Bird, Brendan Murphy, Nachi Nagappan, Tom Zimmermann
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW) | March 2011
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW)
“Not My Bug!” and Other Reasons for Software Bug Report Reassignments
Philip J. Guo, Thomas Zimmermann, Nachiappan Nagappan, Brendan Murphy, Nachi Nagappan, Tom Zimmermann
Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW) | March 2011
An Empirical Study of the Factors Relating Field Failures and Dependencies
Tom Zimmermann, Nachi Nagappan, Laurie Williams, Kim Herzig, Rahul Premraj
Proceedings of the 4th International Conference on Software Testing, Verification and Validation (ICST) | March 2011
CRANE: Failure Prediction, Change Analysis and Test Prioritization in Practice – Experiences from Windows
Jacek Czerwonka, Rajiv Das, Nachi Nagappan, Alex Tarvo, Alex Teterev
International Conference on Software Testing | March 2011
Change Bursts as Defect Predictors
Nachi Nagappan, Andreas Zeller, Tom Zimmermann, Kim Herzig, Brendan Murphy
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE) | November 2010
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE)
Analytics for Software Development
Tom Zimmermann, Raymond P. L. Buse
Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER) | November 2010
Proceedings of the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER)
Security Trend Analysis with CVE Topic Models
Stephan Neuhaus, Tom Zimmermann
Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE) | November 2010
Characterizing and Predicting Which Bugs Get Fixed: An Empirical Study of Microsoft Windows
Philip J. Guo, Tom Zimmermann, Nachi Nagappan, Brendan Murphy
Proceedings of the 32th International Conference on Software Engineering (ICSE) | May 2010
Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista
Tom Zimmermann, Nachi Nagappan, Laurie Williams
Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST) | April 2010
Most Influential Paper Award at ICST 2020 MIP Practical
Coordination in large-scale software teams
Andrew Begel, Nachi Nagappan, Christopher Poile, Lucas Layman
Proceedings of the 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering (CHASE) | May 2009
Proceedings of the 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering (CHASE)
ISBN: 978-1-4244-3712-2
On Equivalence Partitioning of Code Paths inside OS Kernel Components
Constantin Sârbu, Nachi Nagappan, Neeraj Suri
Proceedings of the 2009 Software Technologies for Future Dependable Distributed Systems (STFSSD) | March 2009
ISBN: 978-0-7695-3572-2
The Beauty and the Beast: Vulnerabilities in Red Hat’s Packages
Stephan Neuhaus, Thomas Zimmermann
Proceedings of the 2009 USENIX Annual Technical Conference (USENIX ATC) | January 2009
Predicting Defects using Network Analysis on Dependency Graphs
Tom Zimmermann, Nachi Nagappan
Proceedings of the 30th International Conference on Software Engineering (ICSE) | May 2008
Proceedings of the 30th International Conference on Software Engineering (ICSE)
-
Technical report
Chandra Maddila, Apoorva Agrawal, Thomas Zimmermann, Nicole Forsgren, Kim Herzig, Arie van Deursen
MSR-TR-2021-28 | October 2021
Published by Microsoft
Appendix to How Developers and Managers Define and Trade Off Productivity and Quality
Margaret-Anne Storey, Brian Houck, Thomas Zimmermann
MSR-TR-2021-26 | October 2021
Published by Microsoft
Survey on Onboarding Software Engineers During a Pandemic
Paige Rodeghero, Thomas Zimmermann, Denae Ford
MSR-TR-2020-36 | October 2020
Published by Microsoft
Appendix to A Tale of Two Cities: Software Developers Working from Home During the COVID-19 Pandemic
Denae Ford, Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Sonia Jaffe, Chandra Maddila, Jenna Butler, Brian Houck, Nachi Nagappan
MSR-TR-2020-28 | August 2020
Published by Microsoft
Understanding Software Developer Activity via Windows 10 Telemetry
Spencer Buja, Thomas Zimmermann, Philippe Kirsanov, Ankit Tandon, Xue Liu, Jay Windsor, Henok Addis
MSR-TR-2019-42 | April 2019
Published by Microsoft
Presented at the 2019 Wharton People Analytics Conference. Finalist for the White Paper Competition
Appendix to Everything You Wanted to Know About Data Scientists
Miryung Kim, Thomas Zimmermann, Robert DeLine, Andrew Begel
MSR-TR-2016-1127 | December 2016
Appendix to Personas in Practice: Adapting Knowledge Worker Actions to Software Engineer
Denae Ford, Tom Zimmermann, Christian Bird, Nachi Nagappan
MSR-TR-2016-75 | October 2016
Published by Microsoft
Appendix to Transitioning from Closed Source to Open Source: Analysis and Observations from Six Projects
Pavneet Singh Kochhar, Nachi Nagappan, Tom Zimmermann, Christian Bird
MSR-TR-2015-82 | October 2015
Appendix to The Effect of Work Environments on Productivity
Thomas Zimmermann, Brittany Johnson, Christian Bird, Tom Zimmermann
MSR-TR-2015-66 | August 2015
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
Lessons Learned From Deploying a Code Review Analytics Platform
Christian Bird, Trevor Carnahan, Michaela Greiler
MSR-TR-2015-22 | February 2015
The Uniqueness of Changes: Characteristics and Applications
Baishakhi Ray, Meiyappan Nagappan, Christian Bird, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-149 | November 2014
Published by Microsoft
Appendix to The Health of Software Engineering Research
David Lo, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-119 | September 2014
Appendix to Do It Yourself! Homegrown Tools in a Large Software Company
Christian Bird, Tom Zimmermann, Edward K. Smith
MSR-TR-2014-118 | September 2014
Motion Sickness Susceptibility in Software Developers
Emerson Murphy-Hill, Tom Zimmermann, Nachi Nagappan
MSR-TR-2014-24 | March 2014
Branching Taxonomy
Brendan Murphy, Jacek Czerwonka, Laurie Williams
MSR-TR-2014-23 | February 2014
Analyze This! 145 Questions for Data Scientists in Software Engineering (Technical Report MSR-TR-2013-111)
Andrew Begel, Tom Zimmermann
MSR-TR-2013-111 | October 2013
Published by Microsoft
Appendix to Analyze This! 145 Questions for Data Scientists in Software Engineering
Andrew Begel, Tom Zimmermann
MSR-TR-2013-84 | September 2013
Published by Microsoft
Appendix to The Design of Bug Fixes
Emerson Murphy-Hill, Tom Zimmermann, Christian Bird, Nachi Nagappan
MSR-TR-2013-22 | April 2013
Predicting Method Crashes with Bytecode Operations
Sunghun Kim, Tom Zimmermann, Rahul Premraj, Nicolas Bettenburg, Shivkumar Shivaji
MSR-TR-2012-94 | September 2012
Representativeness in Software Engineering Research
Meiyappan Nagappan, Tom Zimmermann, Christian Bird
MSR-TR-2012-93 | September 2012
Compatibility Testing via Patterns-Based Trace Comparison
Venkatesh-Prasad Ranganath, Pradip Vallathol, Pankaj Gupta
MSR-TR-2012-87 | August 2012
Appendix to A Field Study of Refactoring Rationale, Benefits, and Challenges at Microsoft
Miryung Kim, Thomas Zimmermann, Nachiappan Nagappan, Nachi Nagappan, Tom Zimmermann
MSR-TR-2012-4 | January 2012
Detecting Energy Patterns in Software Development
Ashish Gupta, Tom Zimmermann, Christian Bird, Nachi Nagappan, Thirumalesh Bhat, Syed Emran
MSR-TR-2011-106 | November 2011
Information Needs for Software Development Analytics
Raymond P.L. Buse, Tom Zimmermann
MSR-TR-2011-8 | January 2011
Analytics for Software Development
MSR-TR-2010-111 | August 2010
Accepted at the FSE/SDP Workshop on the Future of Software Engineering Research (FoSER). Please cite the workshop paper instead.
Coordination in Large-Scale Software Development: Helpful and Unhelpful Behaviors
Andrew Begel, Nachi Nagappan
MSR-TR-2009-135 | September 2009