The Oracle Problem in Software Testing: A Survey

  title={The Oracle Problem in Software Testing: A Survey},
  author={E. Barr and M. Harman and P. McMinn and M. Shahbaz and Shin Yoo},
  journal={IEEE Transactions on Software Engineering},
  • E. Barr, M. Harman, +2 authors Shin Yoo
  • Published 2015
  • Computer Science
  • IEEE Transactions on Software Engineering
  • Testing involves examining the behaviour of a system in order to discover potential faults. Given an input for a system, the challenge of distinguishing the corresponding desired, correct behaviour from potentially incorrect behavior is called the “test oracle problem”. Test oracle automation is important to remove a current bottleneck that inhibits greater overall test automation. Without test oracle automation, the human has to determine whether observed behaviour is correct. The literature… CONTINUE READING
    451 Citations

    Figures and Topics from this paper

    Oracle problem in software testing
    • 7
    Automated Oracle Data Selection Support
    • 15
    • PDF
    Automating test oracles generation
    • 1
    • Highly Influenced
    • PDF
    Automated Steering of Model-Based Test Oracles to Admit Real Program Behaviors
    • 7
    • Highly Influenced
    • PDF
    A mapping study on testing non-testable systems
    • 11
    • PDF
    Test Oracle Strategies for Model-Based Testing
    • 33
    • Highly Influenced
    • PDF
    Supporting oracle construction via static analysis
    • J. Chen, Y. Bai, +4 authors H. Mei
    • Computer Science
    • 2016 31st IEEE/ACM International Conference on Automated Software Engineering (ASE)
    • 2016
    • 12
    • PDF
    Using Imprecise Test Oracles Modelled by FSM
    • 1


    Automated Test Oracles: A Survey
    • 32
    Automated oracle creation support, or: How I learned to stop worrying about fault propagation and love mutation testing
    • 68
    • PDF
    An Empirical Evaluation of Assertions as Oracles
    • 20
    On the Use of Specification-Based Assertions as Test Oracles
    • 34
    Test Oracles
    • 104
    • PDF
    An automated framework for software test oracle
    • 45
    • PDF
    A Comparative Study on Automated Software Test Oracle Methods
    • 54
    Dodona: automated oracle data set selection
    • 21
    • PDF