The case for application-specific benchmarking

@article{Seltzer1999TheCF,
  title={The case for application-specific benchmarking},
  author={Margo I. Seltzer and David Krinsky and Keith A. Smith and Xiaolan Zhang},
  journal={Proceedings of the Seventh Workshop on Hot Topics in Operating Systems},
  year={1999},
  pages={102-107}
}
Most performance analysis today uses either microbenchmarks or standard macrobenchmarks (e.g. SPEC, LADDIS, the Andrew benchmark). However, the results of such benchmarks provide little information to indicate how well a particular system will handle a particular application. Such results are, at best, useless and, at worst, misleading. In this paper we argue for an application-directed approach to benchmarking, using performance metrics that reflect the expected behavior of a particular… CONTINUE READING

Tables and Topics from this paper.

Explore Further: Topics Discussed in This Paper

Citations

Publications citing this paper.
SHOWING 1-10 OF 88 CITATIONS

An Enhanced MapReduce Workload Allocation Tool for Spot Market Resources

VIEW 6 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Characterizing Mote Performance: A Vector-Based Methodology

VIEW 3 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

SoK: Benchmarking Flaws in Systems Security

Erik van der Kouwe, Gernot Heiser, Dennis Andriesse, Herbert Bos, Cristiano Giuffrida
  • 2019 IEEE European Symposium on Security and Privacy (EuroS&P)
  • 2019
VIEW 1 EXCERPT

FILTER CITATIONS BY YEAR

1999
2019

CITATION STATISTICS

  • 3 Highly Influenced Citations