Renaissance: benchmarking suite for parallel applications on the JVM
- Aleksandar Prokopec, Andrea Rosà, Walter Binder
- Computer ScienceACM-SIGPLAN Symposium on Programming Language…
- 8 June 2019
Renaissance, a new benchmark suite composed of modern, real-world, concurrent, and object-oriented workloads that exercise various concurrency primitives of the JVM, is presented and it is shown that the use of concurrencyPrimitives in these workloads reveals optimization opportunities that were not visible with the existing workloads.
Unit Testing Performance in Java Projects: Are We There Yet?
- Petr Stefan, Vojtech Horký, L. Bulej, P. Tůma
- Computer ScienceInternational Conference on Performance…
- 17 April 2017
A study of GitHub projects written in Java, looking for occurrences of performance evaluation code in common performance testing frameworks, quantifies the use of such frameworks, identifies the most relevant performance testing approaches, and describes how the design of the SPL performance testing framework is adjusted.
Analyzing the Impact of CPU Pinning and Partial CPU Loads on Performance and Energy Efficiency
- Andrej Podzimek, L. Bulej, L. Chen, Walter Binder, P. Tůma
- Computer Science15th IEEE/ACM International Symposium on Cluster…
- 4 May 2015
It is found that less common CPU pinning configurations improve energy efficiency at partial background loads, indicating that systems hosting collocated workloads could benefit from dynamicCPU pinning based on CPU load and workload type.
Benchmark Precision and Random Initial State
A method for quantitatively assessing the influence of nondeterminism on a benchmark, as well as an approach that provides a plausible estimate of result precision in face of the nond determinism are suggested.
CORBA benchmarking: a course with hidden obstacles
This work points out common causes of imprecision related to the gathering of timing information and the effects of warm-up, randomization, cross talk and delayed or hidden functionality in the performance of CORBA middleware.
Estimating the Impact of Code Additions on Garbage Collection Overhead
- P. Libic, L. Bulej, Vojtech Horký, P. Tůma
- Computer ScienceEuropean Performance Engineering Workshop
- 31 August 2015
A method to estimate the impact of code changes with additional allocations on garbage collection time is described, which can be applied, e.g., when assessing the overall performance impact of alternative changes.
Automated detection of performance regressions: the mono experience
- T. Kalibera, L. Bulej, P. Tůma
- Computer Science13th IEEE International Symposium on Modeling…
- 27 September 2005
On the example of a fully automated regression benchmarking environment for the mono open-source project, it is shown how the problems associated with nondeterminism can be tackled using statistical methods.
Do We Teach Useful Statistics for Performance Evaluation?
Here, a look at some of the issues on methods and experiments that would be considered basic in performance evaluation education.
Managing Latency in Edge-Cloud Environment