The Oracle Problem in Software Testing: A Survey

@article{Barr2015TheOP,
  title={The Oracle Problem in Software Testing: A Survey},
  author={Earl T. Barr and M. Harman and P. McMinn and Muzammil Shahbaz and Shin Yoo},
  journal={IEEE Transactions on Software Engineering},
  year={2015},
  volume={41},
  pages={507-525}
}
Testing involves examining the behaviour of a system in order to discover potential faults. Given an input for a system, the challenge of distinguishing the corresponding desired, correct behaviour from potentially incorrect behavior is called the “test oracle problem”. Test oracle automation is important to remove a current bottleneck that inhibits greater overall test automation. Without test oracle automation, the human has to determine whether observed behaviour is correct. The literature… Expand
460 Citations
Oracle problem in software testing
  • 7
Automated Oracle Data Selection Support
  • 15
  • PDF
Automating test oracles generation
  • 1
  • Highly Influenced
  • PDF
Automated Steering of Model-Based Test Oracles to Admit Real Program Behaviors
  • 7
  • Highly Influenced
  • PDF
A mapping study on testing non-testable systems
  • 11
  • PDF
Test Oracle Strategies for Model-Based Testing
  • N. Li, A. Offutt
  • Computer Science
  • IEEE Transactions on Software Engineering
  • 2017
  • 33
  • Highly Influenced
  • PDF
Supporting oracle construction via static analysis
  • J. Chen, Y. Bai, +4 authors Hong Mei
  • Computer Science
  • 2016 31st IEEE/ACM International Conference on Automated Software Engineering (ASE)
  • 2016
  • 12
  • PDF
Using Imprecise Test Oracles Modelled by FSM
  • 1
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 230 REFERENCES
Automated Test Oracles: A Survey
  • 32
Automated oracle creation support, or: How I learned to stop worrying about fault propagation and love mutation testing
  • 68
  • PDF
An Empirical Evaluation of Assertions as Oracles
  • Kavir Shrestha, M. Rutherford
  • Computer Science
  • 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation
  • 2011
  • 20
On the Use of Specification-Based Assertions as Test Oracles
  • 34
Test Oracles
  • 104
  • PDF
An automated framework for software test oracle
  • 45
  • PDF
A Comparative Study on Automated Software Test Oracle Methods
  • 55
Dodona: automated oracle data set selection
  • 21
  • PDF
...
1
2
3
4
5
...