Beyond Continuous Delivery: An Empirical Investigation of Continuous Deployment Challenges

  title={Beyond Continuous Delivery: An Empirical Investigation of Continuous Deployment Challenges},
  author={Mojtaba Shahin and Muhammad Ali Babar and Mansooreh Zahedi and Liming Zhu},
  journal={2017 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)},
  • Mojtaba ShahinM. Babar Liming Zhu
  • Published 9 November 2017
  • Computer Science, Business
  • 2017 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)
Context: A growing number of software organizations have been adopting Continuous DElivery (CDE) and Continuous Deployment (CD) practices. Researchers have started investing significant efforts in studying different aspects of CDE and CD. Many studies refer to CDE (i.e., where an application is potentially capable of being deployed) and CD (i.e., where an application is automatically deployed to production on every update) as synonyms and do not distinguish them from each other. Despite CDE… 

Figures and Tables from this paper

An empirical study of architecting for continuous delivery and deployment

A conceptual framework to support the process of (re-) architecting for CD is presented and evidence-based insights about practicing CD within monolithic systems are provided and the principle of “small and independent deployment units” is characterized as an alternative to the monoliths.

Towards cost-benefit evaluation for continuous software engineering activities

The benefits of CI/CD are overstated in literature without considering the contextual and domain complexities rendering some benefits infeasible.

Critical Success Factors of Continuous Practices in a DevOps Context

An initial framework of critical success factors for continuous practices and performance improvements is developed by increasing the understanding of these practices in a DevOps context by conducting a first step to validate the framework.

DevOps in Finland : study of practitioners’ perception

Faster release cycle time and system quality were the most agreed benefits and lack of common understanding for DevOps was considered the most challenging; further research and qualitative data is required to find out the actual reasons behind these results.

Mining Questions Asked about Continuous Software Engineering: A Case Study of Stack Overflow

An empirical study aimed at exploring CSE from the practitioners' perspective by mining discussions from Q&A websites, which identified 32 topics of discussions, among which "Error messages in Continuous Integration/Deployment" and "Continuous Integration concepts" are the most dominant.

Understanding DevOps critical success factors and organizational practices

  • Nasreen Azad
  • Business
    2022 IEEE/ACM International Workshop on Software-Intensive Business (IWSiB)
  • 2022
DevOps is a combination of practices and a company culture which aims minimize the barriers between the operation and development teams in the organization. As its adoption and use in the industry

A Survey of DevOps in the South African Software Context

This study investigated DevOps practices and experiences in the South African software development context, along with associated perceptions of benefits and challenges. Survey data collected from a

Challenges and solutions when adopting DevSecOps: A systematic review

Multicriteria decision‐making taxonomy for DevOps challenging factors using analytical hierarchy process

This work investigates, prioritizing, and developing the taxonomy of the key factors that could impact the adaptation and implementation of DevOps practices, and provides a roadmap to tackle the key challenges to implementing DevOps and offers suggestions for streamlining Dev Ops practices.

A Review on DevOps Adoption in Continuous Delivery Process

  • M. TohS. SahibuddinR. A. Bakar
  • Computer Science, Business
    2021 International Conference on Software Engineering & Computer Systems and 4th International Conference on Computational Science and Information Management (ICSECS-ICOCSIM)
  • 2021
There are four significant adoption factors that need to be considered in determining the success of the DevOps adoption in Continuous Delivery process.



On the journey to continuous deployment: Technical and social challenges along the way

Customer Involvement in Continuous Deployment: A Systematic Literature Review

A systematic literature review covering 25 primary studies reveals that although customer involvement in continuous deployment is highly relevant in the software industry today, it has been relatively unexplored in academic research.

Continuous Integration, Delivery and Deployment: A Systematic Review on Approaches, Tools, Challenges and Practices

The state of the art of continuous practices is reviewed to classify approaches and tools, identify challenges and practices in this regard, and identify the gaps for future research, revealing that continuous practices have been successfully applied to both greenfield and maintenance projects.

Continuous Deployment at Facebook and OANDA

It is shown that continuous deployment does not inhibit productivity or quality even in the face of substantial engineering team and code size growth, the first study to show it is possible to scale the size of an engineering team by 20X and thesize of the code base by 50X without negatively impacting developer productivity or software quality.

Towards DevOps in the Embedded Systems Domain: Why is It So Hard?

The contribution of this paper is to introduce the concept of DevOps adoption in the embedded systems domain and then to identify key challenges for the Dev Ops adoption.

Climbing the "Stairway to Heaven" -- A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software

A multiple-case study in which barriers associated with the transition towards continuous deployment are explored and key barriers in this transition as well as actions that need to be taken to address these are presented.

Bottom-up Adoption of Continuous Delivery in a Stage-Gate Managed Software Organization

The perceived problems of bottom-up CD adoption in a large global software development unit at Nokia Networks is investigated to understand how the stage-gate development process used by the unit affects the adoption.

Continuous software engineering: A roadmap and agenda