Coverage is not strongly correlated with test suite effectiveness

@inproceedings{Inozemtseva2014CoverageIN,
  title={Coverage is not strongly correlated with test suite effectiveness},
  author={Laura Inozemtseva and Reid Holmes},
  booktitle={ICSE},
  year={2014}
}
The coverage of a test suite is often used as a proxy for its ability to detect faults. However, previous studies that investigated the correlation between code coverage and test suite effectiveness have failed to reach a consensus about the nature and strength of the relationship between these test suite characteristics. Moreover, many of the studies were done with small or synthetic programs, making it unclear whether their results generalize to larger programs, and some of the studies did… CONTINUE READING

Similar Papers

Citations

Publications citing this paper.
SHOWING 1-10 OF 187 CITATIONS

Do Pseudo Test Suites Lead to Inflated Correlation in Measuring Test Effectiveness?

  • 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST)
  • 2019
VIEW 7 EXCERPTS
CITES BACKGROUND, METHODS & RESULTS
HIGHLY INFLUENCED

Program State Coverage: A Test Coverage Metric Based on Executed Program States

  • 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER)
  • 2019
VIEW 6 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Assessing Test Suite E ↵ ectiveness Using Static Metrics

Paco van Beckhoven, Ana Oprescu, Magiel Bruntink
  • 2018
VIEW 11 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS
HIGHLY INFLUENCED

GreenScaler: training software energy models with automatic test generation

VIEW 7 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Code Coverage and Postrelease Defects: A Large-Scale Study on Open Source Projects

  • IEEE Transactions on Reliability
  • 2017
VIEW 5 EXCERPTS
CITES RESULTS & BACKGROUND
HIGHLY INFLUENCED

Directed test generation and analysis for web applications

VIEW 4 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

The Fitness Function for the Job: Search-Based Generation of Test Suites That Detect Real Faults

  • 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)
  • 2017
VIEW 5 EXCERPTS
CITES RESULTS & BACKGROUND
HIGHLY INFLUENCED

Can testedness be effectively measured?

VIEW 4 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS
HIGHLY INFLUENCED

Empirical Evaluation of Test Coverage for Functional Programs

  • 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST)
  • 2016
VIEW 10 EXCERPTS
CITES BACKGROUND, RESULTS & METHODS
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2013
2019

CITATION STATISTICS

  • 18 Highly Influenced Citations

  • Averaged 33 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-2 OF 2 REFERENCES