• Publications
  • Influence
Renaissance: benchmarking suite for parallel applications on the JVM
TLDR
Renaissance, a new benchmark suite composed of modern, real-world, concurrent, and object-oriented workloads that exercise various concurrency primitives of the JVM, is presented and it is shown that the use of concurrencyPrimitives in these workloads reveals optimization opportunities that were not visible with the existing workloads.
Unit Testing Performance in Java Projects: Are We There Yet?
TLDR
A study of GitHub projects written in Java, looking for occurrences of performance evaluation code in common performance testing frameworks, quantifies the use of such frameworks, identifies the most relevant performance testing approaches, and describes how the design of the SPL performance testing framework is adjusted.
Benchmark Precision and Random Initial State
TLDR
A method for quantitatively assessing the influence of nondeterminism on a benchmark, as well as an approach that provides a plausible estimate of result precision in face of the nond determinism are suggested.
Analyzing the Impact of CPU Pinning and Partial CPU Loads on Performance and Energy Efficiency
TLDR
It is found that less common CPU pinning configurations improve energy efficiency at partial background loads, indicating that systems hosting collocated workloads could benefit from dynamicCPU pinning based on CPU load and workload type.
CORBA benchmarking: a course with hidden obstacles
TLDR
This work points out common causes of imprecision related to the gathering of timing information and the effects of warm-up, randomization, cross talk and delayed or hidden functionality in the performance of CORBA middleware.
Automated detection of performance regressions: the mono experience
TLDR
On the example of a fully automated regression benchmarking environment for the mono open-source project, it is shown how the problems associated with nondeterminism can be tackled using statistical methods.
Do We Teach Useful Statistics for Performance Evaluation?
TLDR
Here, a look at some of the issues on methods and experiments that would be considered basic in performance evaluation education.
Repeated results analysis for middleware regression benchmarking
TLDR
The paper outlines the concept of regression benchmarking as a variant of regression testing focused at detecting performance regressions and proposes novel techniques for the repeated analysis of results for the purpose of detecting performance regressionions.
Unit testing performance with Stochastic Performance Logic
TLDR
Stochastic Performance Logic, a formalism for expressing performance requirements, together with interpretations that facilitate performance evaluation in the unit test context are implemented in a performance testing framework and evaluated in multiple experiments, demonstrating the ability to identify performance differences in realistic unit test scenarios.
On the limits of modeling generational garbage collector performance
TLDR
This work investigates the difference between the behavior of a real garbage collector implementation and a simplified model on a selection of workloads, focusing on the accuracy achievable with particular input information.
...
1
2
3
4
5
...