The influence of size and coverage on test suite effectiveness

Akbar Siami Namin, James H. Andrews

Research output: Chapter in Book/Report/Conference proceedingConference contribution

97 Scopus citations

Abstract

We study the relationship between three properties of test suites: size, structural coverage, and fault-finding effectiveness. In particular, we study the question of whether achieving high coverage leads directly to greater effectiveness, or only indirectly through forcing a test suite to be larger. Our experiments indicate that coverage is sometimes correlated with effectiveness when size is controlled for, and that using both size and coverage yields a more accurate prediction of effectiveness than size alone. This in turn suggests that both size and coverage are important to test suite effectiveness. Our experiments also indicate that no linear relationship exists among the three variables of size, coverage and effectiveness, but that a nonlinear relationship does exist.

Original languageEnglish
Title of host publicationProceedings of the 18th International Symposium on Software Testing and Analysis, ISSTA 2009
PublisherAssociation for Computing Machinery, Inc
Pages57-67
Number of pages11
ISBN (Electronic)9781605583389
DOIs
StatePublished - Jul 19 2009
Event18th International Symposium on Software Testing and Analysis, ISSTA 2009 - Chicago, United States
Duration: Jul 19 2009Jul 23 2009

Publication series

NameProceedings of the 18th International Symposium on Software Testing and Analysis, ISSTA 2009

Conference

Conference18th International Symposium on Software Testing and Analysis, ISSTA 2009
CountryUnited States
CityChicago
Period07/19/0907/23/09

Keywords

  • Coverage criteria
  • Statistical analysis

Fingerprint Dive into the research topics of 'The influence of size and coverage on test suite effectiveness'. Together they form a unique fingerprint.

  • Cite this

    Namin, A. S., & Andrews, J. H. (2009). The influence of size and coverage on test suite effectiveness. In Proceedings of the 18th International Symposium on Software Testing and Analysis, ISSTA 2009 (pp. 57-67). (Proceedings of the 18th International Symposium on Software Testing and Analysis, ISSTA 2009). Association for Computing Machinery, Inc. https://doi.org/10.1145/1572272.1572280