On Using a Benchmark to Evaluate C++ Extractors

  title={On Using a Benchmark to Evaluate C++ Extractors},
  author={Susan Elliott Sim and Richard C. Holt and Steve M. Easterbrook},
In this paper, we take the concept of benchmarking as used extensively in computing and apply it to evaluating C++ fact extractors. We demonstrated the efficacy of this approach by developing a prototype benchmark, CppETS 1.0 (C++ Extractor Test Suite, pronounced see-pets) and collecting feedback in a workshop setting. The CppETS benchmark characterises C++ extractors along two dimensions: Accuracy and Robustness. It consists of a series of test buckets that contain small C++ programs and… CONTINUE READING
Highly Cited
This paper has 50 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 33 extracted citations

Improving code completion with program history

Automated Software Engineering • 2010
View 1 Excerpt

The anatomy and physiology of the grid revisited

2009 Joint Working IEEE/IFIP Conference on Software Architecture & European Conference on Software Architecture • 2009

Toward automatic artifact matching for tool evaluation

ACM Southeast Regional Conference • 2009

fewer than 50 Citations

Citations per Year
Semantic Scholar estimates that this publication has 50 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 19 references

C++ Parser-Analysers for Reverse Engineering: Trade-offs and Benchmarks

Susan Elli ott Sim
http://www.cs.utoronto.ca/~simsuz/cascon2001, last accessed 7 January 2002. • 2001
View 5 Excerpts
Highly Influenced

Evaluating Architectural Extraction Tools

View 7 Excerpts
Highly Influenced

C and C++ Validation Test Suites

Plum Hall Inc
http://www.plumhall .com/suites.html, last accessed 8 January 2002. • 2002
View 2 Excerpts

C++ Validation Suite

Perennial Inc
http://www.peren.com/pages/cppvs.htm, last accessed 8 January 2002. • 2002
View 2 Excerpts

GCC Home Page- GNU Project- Free Software Foundation

The GCC Team
http://gcc.gnu.org/, last accessed 8 January 2002. • 2002
View 1 Excerpt

Tichy , “ Should Computer Scientists Experiment More ?

Margaret-Anne D. Storey, Susan Elliott Sim, Ken Wong

Exchange format bibliography

ACM SIGSOFT Software Engineering Notes • 2001
View 1 Excerpt

Similar Papers

Loading similar papers…