Duet Benchmarking: Improving Measurement Accuracy in the Cloud

@article{Bulej2020DuetBI,
  title={Duet Benchmarking: Improving Measurement Accuracy in the Cloud},
  author={L. Bulej and Vojtech Hork{\'y} and P. Tuma and François Farquet and Aleksandar Prokopec},
  journal={Proceedings of the ACM/SPEC International Conference on Performance Engineering},
  year={2020}
}
We investigate the duet measurement procedure, which helps improve the accuracy of performance comparison experiments conducted on shared machines by executing the measured artifacts in parallel and evaluating their relative performance together, rather than individually. Specifically, we analyze the behavior of the procedure in multiple cloud environments and use experimental evidence to answer multiple research questions concerning the assumption underlying the procedure. We demonstrate… Expand

Figures, Tables, and Topics from this paper

References

SHOWING 1-3 OF 3 REFERENCES
The DaCapo benchmarks: java benchmarking development and analysis
https://travis-ci.com. SESSION 3: Performance as Throughput and Concerns ICPE '20
  • April 20–24,
  • 2020