Corpus ID: 15938737

Your data is your dogfood: DevOps in the astronomical observatory

  title={Your data is your dogfood: DevOps in the astronomical observatory},
  author={Frossie Economou and Joshua C. Hoblitt and Patrick Norris},
DevOps is the contemporary term for a software development culture that purposefully blurs distinction between software development and IT operations by treating "infrastructure as code." DevOps teams typically implement practices summarised by the colloquial directive to "eat your own dogfood;" meaning that software tools developed by a team should be used internally rather thrown over the fence to operations or users. We present a brief overview of how DevOps techniques bring proven software… Expand
LSST data management software development practices and tools
This paper discusses the agile software development methodology and the API and developer decision making process for the LSST data management system, and the software tools that are used for continuous integration and deployment. Expand
Characterizing DevOps by Hearing Multiple Voices
A Multivocal Literature Review aiming at characterizing DevOps in multiple perspectives, including data sources from technical and gray literature, and identifying its recurrent principles, practices, required skills, potential benefits, challenges and what motivates the organizations to adopt it is performed. Expand
Using the Agile software development lifecycle to develop a standalone application for generating colour magnitude diagrams
This paper describes how CMD Plot Tool was developed using Object Orientated Programming and a formal software design lifecycle (SDLC) and highlights the need for the astronomical software development culture to identify appropriate programming paradigms and SDLCs. Expand
Using the Agile Software Development Lifecycle to develop a standalone application for generating Colour Magnitude Diagrams
Virtual observatories allow the means by which an astronomer is able to discover, access, and process data seamlessly, regardless of its physical location. However, steep learning curves are oftenExpand
Observatory/data centre partnerships and the VO-centric archive: The JCMT Science Archive experience
The JSA is a successful example of a service designed to use Virtual Observatory technologies from the start, and the motivation, process and lessons learned from this approach are described. Expand
Towards the adoption of DevOps in software product organizations: A maturity model approach
This technical report describes a study conducted at Centric and concerns the adoption of DevOps in software product organization (SPOs), which are organizations that produce software for multipleExpand
DevOps: A Definition and Perceived Adoption Impediments
This study interview 13 subjects in a software company adopting DevOps and presents 11 impediments for the company’s DevOps adoption that were identified based on the interviews. Expand
Astro2020 APC White Paper: Astronomy should be in the clouds
Making changes in a cross-mission, coordinated way can provide unprecedented economies of scale in personnel, data collection and management, archiving, algorithm and software development and, most importantly, science. Expand
Agile Processes in Software Engineering and Extreme Programming
This book contains the refereed proceedings of the 16th International Conference on Agile Software Development, XP 2015, held in Helsinki, Finland, in May 2015, and reflects the modern trend towards organizations that are simultaneously very efficient and flexible in software development and delivery. Expand
ORAC-DR: A generic data reduction pipeline infrastructure
The architecture of the pipeline system and the implementation of the core infrastructure are described, which includes sub-millimeter heterodyne arrays and continuum cameras, and the lessons learned since the initial deployment in the late 1990s. Expand


Sharing code and support between heterogeneous telescopes: the UKIRT and JCMT joint software projects
The processes by which UKIRT and JCMT have arrived at a large body of shared code and the experience with developing telescope-portable software and code re-use are discussed. Expand
Bring out your codes! Bring out your codes! (Increasing Software Visibility and Re-use)
Representatives of the community were assembled to present issues inhibiting code release and sought suggestions for tackling these factors, with apparent support for the propositions that algorithms should be readily available, code used to produce published scientific results should be made available, and there should be discovery mechanisms to allow these to be found easily. Expand
Data management cyberinfrastructure for the Large Synoptic Survey Telescope
The Large Synoptic Survey Telescope (LSST) project is a proposed large-aperture, wide-field, ground-based telescope that will survey half the sky every few nights in six optical bands. LSST willExpand
An open source application framework for astronomical imaging pipelines
The structure of the LSST application framework is outlined and its usefulness for constructing pipelines outside of theLSST context is explored, including two examples of which are discussed. Expand
Learning from 25 years of the extensible N-Dimensional Data Format
An overview of the historical drivers for the development of NDF and the lessons learned from using a defined hierarchical data model for many years in data reduction software, data pipelines and in data acquisition systems is provided. Expand
An overview of the HDF5 technology suite and its applications
An overview of the HDF5 technology suite and some of its applications is given and the data model, the software architecture and its performance enhancing capabilities are discussed. Expand
Chandra Publication Statistics
In this study we develop and propose publication metrics, based on an analysis of data from the Chandra bibliographic database, that are more meaningful and less sensitive to observatory-specificExpand
The Astrophysics Source Code Library: Where do we go from here?
The future of the ASCL is examined, the challenges facing it, the rationale behind its practices, and the need to balance what the authors might do with what they have the resources to accomplish are examined. Expand
An overview of the planned CCAT software system
The paper describes the architecture of the CCAT software and the development strategy and the anticipated first generation instruments include large format kinetic inductance detector (KID) cameras, a large format heterodyne array and a direct detection multi-object spectrometer. Expand
Design of the Pan‐STARRS telescopes
Pan-STARRS, the Panoramic Survey Telescope and Rapid Response System, is a project by the Institute for Astronomy, University of Hawaii, to first develop a single wide field synoptic survey telescopeExpand