A Holistic Overview of Software Engineering Research Strategies

  title={A Holistic Overview of Software Engineering Research Strategies},
  author={Klaas-Jan Stol and Brian Fitzgerald},
  journal={2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry},
  • Klaas-Jan StolBrian Fitzgerald
  • Published 16 May 2015
  • Computer Science
  • 2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry
Empirical research studies are the principal mechanism through which the software engineering research community studies and learns from software engineering practice. The focus on empirical studies has increased significantly in the past decade, more or less coinciding with the emergence of evidence-based software engineering, an idea that was proposed in 2004. As a consequence, the software engineering community is familiar with a range of empirical methods. However, while several overviews… 

Figures and Tables from this paper

The ABC of Software Engineering Research

A taxonomy from the social sciences is adopted, termed here the ABC framework for SE research, which offers a holistic view of eight archetypal research strategies, and six ways in which the framework can advance SE research.

Empirical Strategies in Software Engineering Research: A Literature Survey

Context: The Software Engineering (SE) research continues to gain strength and interest for researchers considering the need to apply rigor and scientific validity to research results. Objective:

Methodology Matters: How We Study Socio-Technical Aspects in Software Engineering

It is proposed that the software engineering community should diversify the use of research strategies so that it may have a deeper understanding of human and social aspects of software development practice, while balancing the design and evaluation of innovations on the technical side.

The who, what, how of software engineering research: a socio-technical framework

A socio-technical research framework is developed to capture the main beneficiary of a research study, the main type of research contribution produced, and the research strategies used in the study ( how the authors methodologically approach delivering relevant results given the who and what of their studies).

A Study on the Prevalence of Human Values in Software Engineering Publications, 2015 - 2018

To what extent top Software Engineering conferences and journals have included research on human values in SE has been investigated, and the prevalence of directly relevant publications was higher in SE conferences compared to SE journals.

Continuous Systematic Literature Review: An Approach for Open Science

This paper proposes the concept, process and tooling support of Continuous Systematic Literature Review (CSLR) in SE aiming to keep SLRs constantly updated with the promotion of open science practices.

What Paper Types Are Accepted at the International Conference on Software Engineering?

Some outcomes relative to what topics and problems are addressed, what types of contribution are presented and how they are validated are summarized.

1st international workshop on conducting empirical studies in industry (CESI 2013): post-workshop report

The quality of empirical studies is critical for the success of the Software Engineering (SE) discipline. More and more SE researchers are conducting empirical studies involving the software

Evaluating the Characteristics of Code Reviewers and the Code Reviewed by Them in Open Source Projects

There is no correlation between contributor’s experience and contribution efficiency, and a developer with less experience can also provide efficient contributions.



Theory-oriented software engineering

Qualitative Methods in Empirical Studies of Software Engineering

  • C. Seaman
  • Computer Science
    IEEE Trans. Software Eng.
  • 1999
Several qualitative methods for data collection and analysis are presented in terms of how they may be incorporated into empirical studies of software engineering, in particular how they might be combined with quantitative methods.

Conducting realistic experiments in software engineering

It is argued that software engineering researchers should apply for resources enabling expensive and realistic software engineering experiments similar to how other researchers apply for Resources for expensive software and hardware that are necessary for their research.

A survey of controlled experiments in software engineering

This paper reports upon the present state of how controlled experiments in software engineering are conducted and the extent to which relevant information is reported, and quantitatively characterizes the topics and their subjects, tasks, environments, and environments.

Guidelines for conducting and reporting case study research in software engineering

This paper aims at providing an introduction to case study methodology and guidelines for researchers conducting case studies and readers studying reports of such studies, and presents recommended practices and evaluated checklists for researchers and readers of case study research.

Studying Software Engineers: Data Collection Techniques for Software Field Studies

A taxonomy of techniques is provided, focusing on those for data collection, organized according to the degree of human intervention each requires, and a discussion of how to use it effectively is provided.

Evidence-based software engineering

How software engineering might benefit from an evidence-based approach and to identify the potential difficulties associated with the approach are described and the impact that factors peculiar to software engineering would have on the ability to practice evidence- based software engineering (EBSE).

Modelling software engineering research with RSML

RSML can be used to model sophisticated, multifaceted research spanning a wide range of software engineering topics, yielding insights that are not easily captured by current coding schemes.

Towards a decision-making structure for selecting a research design in empirical software engineering

A decision-making structure containing a number of decision points, each one of them representing a specific aspect on empirical software engineering research, is provided to ensure that researchers make well-founded and informed decisions about their research designs.