BEARS: An Extensible Java Bug Benchmark for Automatic Program Repair Studies
@article{Delfim2019BEARSAE, title={BEARS: An Extensible Java Bug Benchmark for Automatic Program Repair Studies}, author={Fernanda Madeiral Delfim and Simon Urli and M. Maia and Monperrus Martin}, journal={2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER)}, year={2019}, pages={468-478} }
Benchmarks of bugs are essential to empirically evaluate automatic program repair tools. In this paper, we present BEARS, a project for collecting and storing bugs into an extensible bug benchmark for automatic repair studies in Java. The collection of bugs relies on commit building state from Continuous Integration (CI) to find potential pairs of buggy and patched program versions from open-source projects hosted on GitHub. Each pair of program versions passes through a pipeline where an… CONTINUE READING
Figures, Tables, and Topics from this paper
26 Citations
A Comprehensive Study of Automatic Program Repair on the QuixBugs Benchmark
- Computer Science
- 2019 IEEE 1st International Workshop on Intelligent Bug Fixing (IBF)
- 2019
- 23
Empirical review of Java program repair tools: a large-scale experiment on 2,141 bugs and 23,551 repair attempts
- Computer Science
- ESEC/SIGSOFT FSE
- 2019
- 22
- PDF
On the Efficiency of Test Suite based Program Repair A Systematic Assessment of 16 Automated Repair Systems for Java Programs
- Computer Science
- 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE)
- 2020
- 11
- PDF
A Comprehensive Study of Code-removal Patches in Automated Program Repair
- Computer Science
- ArXiv
- 2020
- PDF
A comprehensive study of automatic program repair on the QuixBugs benchmark
- Computer Science
- J. Syst. Softw.
- 2021
- 1
- PDF
Longitudinal Analysis of the Applicability of Program Repair on Past Commits
- Computer Science
- ArXiv
- 2020
- PDF
Critical Review of BugSwarm for Fault Localization and Program Repair
- Computer Science
- ArXiv
- 2019
- 2
- Highly Influenced
- PDF
A critical review on the evaluation of automated program repair systems
- Computer Science
- J. Syst. Softw.
- 2021
- PDF
A Survey on Automatic Bug Fixing
- Computer Science
- 2020 6th International Symposium on System and Software Reliability (ISSSR)
- 2020
References
SHOWING 1-10 OF 24 REFERENCES
Defects4J: a database of existing faults to enable controlled testing studies for Java programs
- Computer Science
- ISSTA 2014
- 2014
- 536
- Highly Influential
- PDF
Nopol: Automatic Repair of Conditional Statement Bugs in Java Programs
- Computer Science
- IEEE Transactions on Software Engineering
- 2017
- 206
- PDF
Codeflaws: A Programming Competition Benchmark for Evaluating Automated Program Repair Tools
- Engineering, Computer Science
- 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C)
- 2017
- 59
- PDF
The ManyBugs and IntroClass Benchmarks for Automated Repair of C Programs
- Computer Science
- IEEE Transactions on Software Engineering
- 2015
- 171
- Highly Influential
- PDF
Dissection of a bug dataset: Anatomy of 395 patches from Defects4J
- Computer Science
- 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER)
- 2018
- 55
- PDF
How to Design a Program Repair Bot? Insights from the Repairnator Project
- Computer Science
- 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP)
- 2017
- 58
- PDF