On the Distribution of "Simple Stupid Bugs" in Unit Test Files: An Exploratory Study (MSR 2021 - Mining Challenge)

Who

Anthony Peruma, Christian D. Newman

Track

MSR 2021 Mining Challenge

Time Zone

The program is currently displayed in (GMT+02:00) Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna.

Use conference time zone: (GMT+02:00) Amsterdam, Berlin, Bern, Rome, Stockholm, ViennaSelect other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

By setting a time band, the program will dim events that are outside this time window. This is useful for (virtual) conferences with a continuous program (with repeated sessions).
The time band will also limit the events that are included in the personal iCalendar subscription service.

Display full programSpecify a time band

Save

When

Mon 17 May 2021 17:18 - 17:21 at MSR Room 1 - Mining Challenge Session Chair(s): Miltiadis Allamanis, Rafael-Michael Karampatsis, Charles Sutton

Abstract

A key aspect of ensuring the quality of a software system is the practice of unit testing. Through unit tests, developers verify the correctness of production source code, thereby verifying the system’s intended behavior under test. However, unit test code is subject to issues, ranging from bugs in the code to poor test case design (i.e., test smells). In this study, we compare and contrast the occurrences of a type of single-statement-bug-fix known as “simple stupid bugs” (SStuBs) in test and non-test (i.e., production) files in popular open-source Java Maven projects. Our results show that SStuBs occur more frequently in non-test files than in test files, with most fix-related code associated with assertion statements in test files. Further, most test files exhibiting SStuBs also exhibit test smells. We envision our findings enabling tool vendors to better support developers in improving the maintenance of test suites.

Link to Preprint

https://arxiv.org/abs/2103.09388

Anthony Peruma

Rochester Institute of Technology

United States

Christian D. Newman

Rochester Institute of Technology

United States

Dataset (zenodo)

Presentation Recording

Time Zone

The program is currently displayed in (GMT+02:00) Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna.

Use conference time zone: (GMT+02:00) Amsterdam, Berlin, Bern, Rome, Stockholm, ViennaSelect other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

Display full programSpecify a time band

Save

Session Program

Mon 17 May
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

17:00 - 17:50	Mining Challenge SessionMining Challenge / Technical Papers at MSR Room 1 Chair(s): Miltiadis Allamanis Microsoft Research, UK, Rafael-Michael Karampatsis The University of Edinburgh, Charles Sutton Google Research

17:01 2m		Welcome by the Mining Challenge Co-chairs Mining Challenge Miltiadis Allamanis Microsoft Research, UK, Rafael-Michael Karampatsis The University of Edinburgh, Charles Sutton Google Research
17:03 3m Talk		A large-scale study on human-cloned changes for automated program repair Mining Challenge Fernanda Madeiral KTH Royal Institute of Technology, Thomas Durieux KTH Royal Institute of Technology, Sweden Link to publication Pre-print
17:06 3m Talk		Applying CodeBERT for Automated Program Repair of Java Simple Bugs Mining Challenge Ehsan Mashhadi University of Calgary, Hadi Hemmati University of Calgary Pre-print Media Attached
17:09 3m Talk		PySStuBs: Characterizing Single-Statement Bugs in Popular Open-Source Python Projects Mining Challenge Arthur Veloso Kamienski University of Alberta, Luisa Palechor University of Alberta, Abram Hindle University of Alberta, Cor-Paul Bezemer University of Alberta Pre-print
17:12 3m Talk		How Effective is Continuous Integration in Indicating Single-Statement Bugs? Mining Challenge Jasmine Latendresse Concordia University, Rabe Abdalkareem Queens University, Kingston, Canada, Diego Costa Concordia University, Canada, Emad Shihab Concordia University Pre-print
17:15 3m Talk		Mea culpa: How developers fix their own simple bugs differently from other developers Mining Challenge Wenhan Zhu University of Waterloo, Michael W. Godfrey University of Waterloo, Canada Pre-print
17:18 3m Talk		On the Distribution of "Simple Stupid Bugs" in Unit Test Files: An Exploratory Study Mining Challenge Anthony Peruma Rochester Institute of Technology, Christian D. Newman Rochester Institute of Technology Pre-print Media Attached
17:21 3m Talk		On the Rise and Fall of Simple Stupid Bugs: a Life-Cycle Analysis of SStuBs Mining Challenge Balázs Mosolygó University of Szeged, Norbert Vándor University of Szeged, Gabor Antal University of Szeged, Peter Hegedus University of Szeged Pre-print
17:24 3m Talk		On the Effectiveness of Deep Vulnerability Detectors to Simple Stupid Bug Detection Mining Challenge Jiayi Hua Beijing University of Posts and Telecommunications, Haoyu Wang Beijing University of Posts and Telecommunications Pre-print
17:27 23m Live Q&A		Discussions and Q&A Technical Papers

Information for Participants

Mon 17 May 2021 17:00 - 17:50 at MSR Room 1 - Mining Challenge Session Chair(s): Miltiadis Allamanis, Rafael-Michael Karampatsis, Charles Sutton

Info for room MSR Room 1:

Go directly to this room on Clowdr