Kernel-based Detection of Coincidentally Correct Test Cases to Improve Fault Localization Effectiveness

  title={Kernel-based Detection of Coincidentally Correct Test Cases to Improve Fault Localization Effectiveness},
  author={Farid Feyzi and Saeed Parsa},
  journal={Int. J. Appl. Pattern Recognit.},
Although empirical studies have confirmed the effectiveness of spectrum-based fault localization (SBFL) techniques, their performance may be degraded due to presence of some undesired circumstances such as the existence of coincidental correctness (CC) where one or more passing test cases exercise a faulty statement and thus causing some confusion to decide whether the underlying exercised statement is faulty or not. This article aims at improving SBFL effectiveness by mitigating the effect of… 
4 Citations

Figures and Tables from this paper

How detrimental is coincidental correctness to coverage‐based fault detection and localization? An empirical study

The impact of weak and strong CC on three well‐researched coverage‐based fault detection and localization techniques, namely, test suite reduction (TSR), test case prioritization (TCP) and SBFL, are studied.

CGT-FL: using cooperative game theory to effective fault localization in presence of coincidental correctness

  • Farid Feyzi
  • Computer Science
    Empirical Software Engineering
  • 2020
A new framework is developed for evaluation and ranking program statements in a manner that statements which have strong discriminatory power as a group but are weak as individuals could be identified and proves the outperformance of CGT-FL compared to state-of-the-art techniques.

A Passed Test Case Cluster Method to Improve Fault Localization

Coverage-Based Fault Localization (CBFL) techniques are based on the conjecture that the program elements executed by more failed test cases and less passed test cases have more chance to be faulty...



Trimming Test Suites with Coincidentally Correct Test Cases for Enhancing Fault Localizations

A technique to effectively identify coincidentally correct test cases is introduced that combines support vector machines and ensemble learning to detect mislabeled test cases and can be used to trim a test suite or flip the test status of the coincidental correctness test cases, improving the effectiveness of fault localizations.

A program slicing-based method for effective detection of coincidentally correct test cases

The empirical results demonstrate that the proposed heuristics can alleviate the coincidental correctness problem and improve the accuracy of SBFL techniques.

Identifying Coincidental Correctness for Fault Localization by Clustering Test Cases

Experimental results show that, by cleaning or relabeling these possibly coincidentally correct test cases, the effectiveness of coverage-based fault localization techniques can be effectively improved.

Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization

  • Wes MasriR. A. Assi
  • Computer Science
    2010 Third International Conference on Software Testing, Verification and Validation
  • 2010
This work aims at cleansing test suites from coincidental correctness to enhance fault localization by presenting three variations of a technique that identify the subset of passing tests that are likely to be coincidentally correct.

An empirical study of the factors that reduce the effectiveness of coverage-based fault localization

An empirical study conducted using 148 seeded versions of ten Java programs which included three releases of NanoXML, and seven programs from the Siemens test suite that were converted to Java showed that most of the above scenarios occur frequently.

FPA-Debug: Effective Statistical Fault Localization Considering Fault-proneness Analysis

A new fault-proneness-aware approach based on elastic net regression, namely FPA-Debug has been proposed in this paper, which employs a clustering-based strategy to alleviate coincidental correctness in fault localization and finds the smallest effective subset of program predicates known as bug predictors.

Software online bug detection: applying a new kernel method

The proposed approach has revealed 83 out of 132 bugs in Siemens while only 10% of code is required to be manually examined to locate the origins of failure, which is the most promising result compared with the latest approaches to early bug detection.

FPA-FL: Incorporating Static Fault-proneness Analysis into Statistical Fault Localization

A model for spectra-based software diagnosis

This article presents an improved approach to assist diagnosis of failures in software by ranking program statements or blocks in accordance with to how likely they are to be buggy, which out-performs previously proposed methods for the model program, the Siemens test suite and Space.