An Empirical Study on Performance Bugs for Highly Configurable Software Systems

Xue Han, Tingting Yu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

32 Scopus citations

Abstract

Modern computer systems are highly-configurable, complicating the testing and debugging process. The sheer size of the configuration space makes the quality of software even harder to achieve. Performance is one of the key aspects of non-functional qualities, where performance bugs can cause significant performance degradation and lead to poor user experience. However, performance bugs are difficult to expose, primarily because detecting them requires specific inputs, as well as a specific execution environment (e.g., configurations). While researchers have developed techniques to analyze, quantify, detect, and fix performance bugs, we conjecture that many of these techniques may not be effective in highly-configurable systems. In this paper, we study the challenges that configurability creates for handling performance bugs. We study 113 real-world performance bugs, randomly sampled from three highly-configurable open-source projects: Apache, MySQL and Firefox. The findings of this study provide a set of lessons learned and guidance to aid practitioners and researchers to better handle performance bugs in highly-configurable software systems.

Original languageEnglish
Title of host publication10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2016
ISBN (Electronic)9781450344272
DOIs
StatePublished - Sep 8 2016
Event10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2016 - Ciudad Real, Spain
Duration: Sep 8 2016Sep 9 2016

Publication series

NameInternational Symposium on Empirical Software Engineering and Measurement
Volume08-09-September-2016
ISSN (Print)1949-3770
ISSN (Electronic)1949-3789

Conference

Conference10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2016
Country/TerritorySpain
CityCiudad Real
Period9/8/169/9/16

Bibliographical note

Publisher Copyright:
© 2016 ACM.

Keywords

  • Configuration
  • Empirical Study
  • Performance

ASJC Scopus subject areas

  • Computer Science Applications
  • Software

Fingerprint

Dive into the research topics of 'An Empirical Study on Performance Bugs for Highly Configurable Software Systems'. Together they form a unique fingerprint.

Cite this