Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?

  title={Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?},
  author={Sasu M{\"a}kinen and Henrik Skogstr{\"o}m and Eero Laaksonen and Tommi Mikkonen},
  journal={2021 IEEE/ACM 1st Workshop on AI Engineering - Software Engineering for AI (WAIN)},
Following continuous software engineering practices, there has been an increasing interest in rapid deployment of machine learning (ML) features, called MLOps. In this paper, we study the importance of MLOps in the context of data scientists’ daily activities, based on a survey where we collected responses from 331 professionals from 63 different countries in ML domain, indicating on what they were working on in the last three months. Based on the results, up to 40% respondents say that they… 

Figures from this paper

Machine Learning Operations (MLOps): Overview, Definition, and Architecture

This work conducts mixed-method research and furnishes an aggregated overview of the necessary principles, components, and roles, as well as the associated architecture and workflows of Machine Learning Operations, and furnish a definition of MLOps.

A Systematic Review of Machine Learning DevOps

A systematic review of peer-reviewed conference papers and journal articles on ML-DevOps from 2015 to 2022 to ascertain the state-of-the-art and identify any gaps in the current literature finds evidence that there is a common understanding amongst scholars and experts on how MLOps should be implemented and institutionalized across industry to create a common vision.

Demystifying MLOps and Presenting a Recipe for the Selection of Open-Source Tools

By identifying aspects of machine learning, which can be reused from project to project, open-source tools which help in specific parts of the pipeline, and possible combinations, an overview of support in MLOps is given.

More Engineering, No Silos: Rethinking Processes and Interfaces in Collaboration between Interdisciplinary Teams for Machine Learning Projects

Key collaboration challenges that teams face when building and deploying ML systems into production are identified and most of these challenges center around communication, documentation, engineering, and process and recommendations to address these challenges are collected.

Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Process

This work identifies key collaboration challenges that teams face when building and deploying ML systems into production and finds that most of these challenges center around communication, documentation, engineering, and process, and collects recommendations to address these challenges.

Towards an AI‐driven business development framework: A multi‐case study

A conceptual framework is derived in which three high-level activities that companies perform in parallel with the development, deployment and evolution of models are identified, providing a blueprint for the lifecycle management of ML/DL model development that mirrors the continuous practices of DevOps, DataOps and MLOps.

MLOps - Definitions, Tools and Challenges

An concentrated overview of the Machine Learning Operations (MLOps) area, identifying them not only as the answer for the incorporation of ML models in production but also as a possible tool for efficient, robust and accurate machine learning models.

LAOps: Learning Analytics with Privacy-aware MLOps

: The intake of computer science faculty has rapidly increased with simultaneous reductions to course personnel. Presently, the economy is recovering slightly, and students are entering the working

Model Provenance Management in MLOps Pipeline

A method to manage the model evolution process in the MLOps system and implements the related system is designed and the definition of Model Provenance and its evolutionary correlation elements are given.

Accelerating the Machine Learning Model Deployment using MLOps

The main contribution of proposed work is that it can build and deploy the machine learning models automatically, without any manual intervention, and the models can also be retrained for better performance of the predictions.



Continuous software engineering: A roadmap and agenda

DevOps - A Software Architect's Perspective

The First Complete Guide to DevOps for Software Architects provides the organizational, technical, and operational context needed to deploy DevOps more efficiently, and review DevOps impact on each development phase.

Continuous software engineering and beyond: trends and challenges

Drawing on the lean concept of flow, a number of continuous activities which are important for software development in today’s context are identified, all underpinned by continuous innovation.

Effective DevOps: Building a Culture of Collaboration, Affinity, and Tooling at Scale

Some companies think that adopting devops means bringing in specialists or a host of new tools. With this practical guide, youll learn why devops is a professional and cultural movement that calls

Dimensions of DevOps

This study investigates the elements that characterize the Dev Ops phenomenon using a literature survey and interviews with practitioners actively involved in the DevOps movement to develop an initial conceptual framework.

Hidden Technical Debt in Machine Learning Systems

It is found it is common to incur massive ongoing maintenance costs in real-world ML systems, and several ML-specific risk factors to account for in system design are explored.

Continuous delivery for machine learning, Sept 2019

  • https://martinfowler.com/articles/cd4ml.html accessed Dec
  • 2020

Devops: A software revolution in the making

  • Cutter IT Journal,
  • 2011