A Study of Regression Test Selection in Continuous Integration Environments

Tingting Yu, Ting Wang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

9 Scopus citations

Abstract

Continuous integration (CI) systems perform the automated build, test execution, and delivery of the software. CI can provide fast feedback on software changes, minimizing the time and effort required in each iteration. In the meantime, it is important to ensure that enough testing is performed prior to code submission to avoid breaking builds. Recent approaches have been proposed to improve the cost-effectiveness of regression testing through techniques such as regression test selection (RTS). These approaches target at CI environments because traditional RTS techniques often use code instrumentation or very fine-grained dependency analysis, which may not be able to handle rapid changes. In this paper, we study in-depth the usage of RTS in CI environments for different open-source projects. We analyze 918 open-source projects using CI in GitHub to understand 1) under what conditions RTS is needed, and 2) how to balance the trade-offs between granularity levels to perform cost-effective RTS. The findings of this study can aid practitioners and researchers to develop more advanced RTS techniques for being adapted to CI environments.

Original languageEnglish
Title of host publicationProceedings - 29th IEEE International Symposium on Software Reliability Engineering, ISSRE 2018
EditorsSudipto Ghosh, Bojan Cukic, Robin Poston, Roberto Natella, Nuno Laranjeiro
Pages135-143
Number of pages9
ISBN (Electronic)9781538683217
DOIs
StatePublished - Nov 16 2018
Event29th IEEE International Symposium on Software Reliability Engineering, ISSRE 2018 - Memphis, United States
Duration: Oct 15 2018Oct 18 2018

Publication series

NameProceedings - International Symposium on Software Reliability Engineering, ISSRE
Volume2018-October
ISSN (Print)1071-9458

Conference

Conference29th IEEE International Symposium on Software Reliability Engineering, ISSRE 2018
Country/TerritoryUnited States
CityMemphis
Period10/15/1810/18/18

Bibliographical note

Funding Information:
ACKNOWLEDGMENTS This research is supported in part by the NSF grant CCF-1652149.

Publisher Copyright:
© 2018 IEEE.

Keywords

  • Continuous integration
  • Regression testing

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'A Study of Regression Test Selection in Continuous Integration Environments'. Together they form a unique fingerprint.

Cite this