Improving Software Engineering Research Through Experimentation Workbenches

  title={Improving Software Engineering Research Through Experimentation Workbenches},
  author={Klaus Schmid and Sascha El-Sharkawy and Christian Kr{\"o}her},
Experimentation with software prototypes plays a fundamental role in software engineering research. In contrast to many other scientific disciplines, however, explicit support for this key activity in software engineering is relatively small. While some approaches to improve this situation have been proposed by the software engineering community, experiments are still very difficult and sometimes impossible to replicate. 

Figures and Topics from this paper


Using benchmarking to advance research: a challenge to software engineering
A theory of benchmarking within scientific disciplines is formulated and software engineering research is challenged to become more scientific and cohesive by working as a community to define benchmarks.
KernelHaven – An Experimentation Workbench for Analyzing Software Product Lines
This paper presents KernelHaven as an experimentation workbench supporting a significant number of experiments in the domain of static product line analysis and verification by means of an open plug-in infrastructure.
Software product lines in action - the best industrial practice in product line engineering
The authors combine academic research results with real-world industrial experiences, thus presenting a broad view on product line engineering so that both managers and technical specialists will benefit from exposure to this work.
Variability Modeling for Distributed Development - A Comparison with Established Practice
This paper addresses the question how existing, real-world, large-scale projects deal with variability modeling as a source of inspiration on how to deal with this in variability management and describes the configuration of other artifacts.
Variability issues in the evolution of information system ecosystems
This problem statement discusses some of the issues that arise in merging local variabilities with evolved versions of the reuse infrastructure of the development organization, focused on information systems.
From software product lines to software ecosystems
This paper discusses the emerging trend of software ecosystems and provides an overview of the key concepts and implications of adopting a software ecosystem approach, and defines the notion ofSoftware ecosystems and introduces a taxonomy.
KernelHaven: an open infrastructure for product line analysis
This work describes KernelHaven as a product line analysis research tool and highlights its basic approach as well as its fundamental capabilities, and describes available information extraction and processing plug-ins and how to combine them.
Formalizing distributed evolution of variability in information system ecosystems
An approach to evolution support is described, which is based on the formalization of modifications to configuration values and constraints on both the model and the data in the context of the evolution of multi-level configurations, which supports the identification of inconsistencies in evolution.
Reverse engineering variability in an industrial product line: observations and lessons learned
This paper presents an approach to reverse engineer variability constraints from the implementation of the Bosch PS-EC large-scale product line to improve the correctness and completeness of variability models.
An introduction to Docker for reproducible research
How the popular emerging technology Docker combines several areas from systems research - such as operating system virtualization, cross-platform portability, modular re-usable elements, versioning, and a 'DevOps' philosophy, to address these challenges is examined.