The DaCapo benchmarks: java benchmarking development and analysis

  title={The DaCapo benchmarks: java benchmarking development and analysis},
  author={S. Blackburn and Robin Garner and C. Hoffmann and A. Khan and K. McKinley and Rotem Bentzur and Amer Diwan and Daniel Feinberg and Daniel Frampton and Samuel Z. Guyer and Martin Hirzel and A. Hosking and M. Jump and H. Lee and J. B. Moss and Aashish Phansalkar and D. Stefanovic and Thomas VanDrunen and D. V. Dincklage and B. Wiedermann},
  booktitle={OOPSLA '06},
  • S. Blackburn, Robin Garner, +17 authors B. Wiedermann
  • Published in OOPSLA '06 2006
  • Computer Science
  • Since benchmarks drive computer science research and industry product development, which ones we use and how we evaluate them are key questions for the community. Despite complex runtime tradeoffs due to dynamic compilation and garbage collection required for Java programs, many evaluations still use methodologies developed for C, C++, and Fortran. SPEC, the dominant purveyor of benchmarks, compounded this problem by institutionalizing these methodologies for their Java benchmark suite. This… CONTINUE READING
    1,412 Citations
    Characterizing a Complex J2EE Workload: A Comprehensive Analysis and Opportunities for Optimizations
    • Yefim Shuf, I. Steiner
    • Computer Science
    • 2007 IEEE International Symposium on Performance Analysis of Systems & Software
    • 2007
    • 7
    Profiling and Tracing Support for Java Applications
    • 1
    • Highly Influenced
    • PDF
    A Sampling Microarchitecture Simulator for Java Workloads
    • 3
    A Rigorous Benchmarking and Performance Analysis Methodology for Python Workloads
    Automated construction of JavaScript benchmarks
    • 74
    • PDF


    Dynamic metrics for java
    • 97
    • Highly Influential
    How java programs interact with virtual machines at the microarchitectural level
    • 52
    • Highly Influential
    Memory system behavior of Java programs: methodology and analysis
    • 96
    • Highly Influential
    • PDF
    A Study of the Allocation Behavior of the SPECjvm98 Java Benchmark
    • 198
    • Highly Influential
    • PDF
    Supporting dynamic data structures on distributed-memory machines
    • 282
    • Highly Influential
    • PDF
    Principal Components Analysis
    • 1,949
    • Highly Influential
    Dynamic metrics for Java. InACM Conference on Object–Oriented Programming Systems, Languages, and Applications
    • 2003
    The allocation behavior of the SPECjvm98 Java benchmarks
    • 17
    • Highly Influential
    Dunteman.Principal Components Analysis
    • Sage Publications,
    • 1989