Test Set Size Minimization and Fault Detection Effectiveness: A Case Study in a Space Application

Abstract

An important question in software testing is whether it is reasonable to apply coverage based criteria as a lter to reduce the size of a test set. An empirical study was conducted using a test set minimization technique to explore the eeect of reducing the size of a test set, while keeping block coverage constant, on the fault detection strength of the resulting minimized test set. Two types of test sets were examined. For those with respect to a xed size, no test case screening was conducted during the generation, whereas for those with respect to a xed coverage, each subsequent test case had to improve the overall coverage in order to be included. The study reveals that no matter how a test set is generated (with or without any test case screening) block minimized test sets have a size/eeectiveness advantage, in terms of a signiicant reduction in test set size but with almost the same fault detection eeectiveness, over the original non-minimized test sets.

DOI: 10.1109/CMPSAC.1997.625062

Extracted Key Phrases

Showing 1-10 of 15 references

\IEEE 1044 -standard classiication for software errors, faults and failures

  • 1994

\A methodology for controlling the size of a test suite

  • M J Harrold, R Gupta, M L Sooa
  • 1993

\Experiments on the eeectiveness of dataaow-and controllow-based test adequacy criteria

  • M Hutchins, H Foster, T Goradia, T Ostrand
  • 1993

\ATAC: A data ow coverage testing tool for C

  • R Horgan, S A London
  • 1992
Showing 1-10 of 89 extracted citations

Statistics

01020'98'00'02'04'06'08'10'12'14'16
Citations per Year

144 Citations

Semantic Scholar estimates that this publication has received between 103 and 204 citations based on the available data.

See our FAQ for additional information.