Pilot: A Framework that Understands How to Do Performance Benchmarks the Right Way

Abstract

Carrying out even the simplest performance benchmark requires considerable knowledge of statistics and computer systems, and painstakingly following many error-prone steps, which are distinct skill sets yet essential for getting statistically valid results. As a result, many performance measurements in peer-reviewed publications are flawed. Among many… (More)
DOI: 10.1109/MASCOTS.2016.31

Topics

6 Figures and Tables

Cite this paper

@article{Li2016PilotAF, title={Pilot: A Framework that Understands How to Do Performance Benchmarks the Right Way}, author={Yan Li and Yash Gupta and Ethan S. Miller and Darrell D. E. Long}, journal={2016 IEEE 24th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS)}, year={2016}, pages={169-178} }