Use of Docker for deployment and testing of astronomy software

@article{Morris2017UseOD,
  title={Use of Docker for deployment and testing of astronomy software},
  author={Dave Morris and S. Voutsinas and Nigel C. Hambly and Robert G. Mann},
  journal={Astron. Comput.},
  year={2017},
  volume={20},
  pages={105-119}
}
We describe preliminary investigations of using Docker for the deployment and testing of astronomy software. Docker is a relatively new containerisation technology that is developing rapidly and being adopted across a range of domains. It is based upon virtualization at operating system level, which presents many advantages in comparison to the more traditional hardware virtualization that underpins most cloud computing infrastructure today. A particular strength of Docker is its simple format… 
Research on Large Screen Visualization Based on Docker
TLDR
This work proposes a solution to use Docker and GPU to deploy large-screen visualization applications to display images, videos, WebGL applications, etc.
Scylla: A Mesos Framework for Container Based MPI Jobs
TLDR
Scylla is presented, which integrates Mesos with Docker Swarm to enable orchestration of MPI jobs on a cluster of VMs acquired from the Chameleon cloud and uses Docker Swarm for communication between containerized tasks and Apache Mesos for resource pooling and allocation.
Containers in Software Development: A Systematic Mapping Study
TLDR
Containers are most often discussed in the context of cloud computing, performance and DevOps, and it is found that what is currently missing is more deeply focused research.
PY-METEO-NUM: Dockerized Python Notebook Environment for Portable Data Analysis Workflows in Indonesian Atmospheric Science Communities
Reproducibility and replicability in analyzing data is one of the main requirements for the advance-ment of scientific fields that rely heavily on computational data analysis, such as atmospheric
Security Analysis and Threats Detection Techniques on Docker Container
TLDR
This paper gives a detailed analysis on Docker’s existing security mechanisms and the main threats Docker users must face, and the corresponding threats detection techniques for Docker images and Docker container instances are presented.
MOSFiT: Modular Open-Source Fitter for Transients
TLDR
This work introduces MOSFiT, a Python-based package that downloads transient datasets from open online catalogs, generates Monte Carlo ensembles of semi-analytical light curve fits to those datasets and their associated Bayesian parameter posteriors, and optionally delivers the fitting results back to those same catalogs to make them available to the rest of the community.
Determinants of Effective Change Management for Software Deployment Projects
Software application deployment change management is one of the emerging research themes that is gaining increased focus day by day. Our study examined the factors that affect software application
A Framework To Evaluate Pipeline Reproducibility Across Operating Systems
TLDR
A framework to evaluate the reproducibility of neuroimaging pipelines across operating systems is developed and it is hypothesized that the observed inter-OS differences come from numerical instabilities in the pipelines, triggered by rounding and truncation differences that originate in the update of mathematical libraries in different systems.
A Real Approach on Web Systems Packaging and Delivery
  • Claudio Navarro, C. Cares
  • Computer Science
    2018 IEEE International Conference on Automation/XXIII Congress of the Chilean Association of Automatic Control (ICA-ACCA)
  • 2018
TLDR
A systematic mapping review is conducted in order to elicit current contributions on packaging and delivery for sub-processes and an elicitation process from a real setting of the current packaging and Delivery sub- process is conducted, getting a refined map of activities as a contribution to this topic.
The 3HSP catalogue of extreme and high-synchrotron peaked blazars
Aims. High-synchrotron peaked blazars (HSPs or HBLs) play a central role in very high-energy (VHE) γ-ray astronomy, and likely in neutrino astronomy. Currently, the largest compilation of HSP
...
1
2
...

References

SHOWING 1-10 OF 28 REFERENCES
Sustainability and Reproducibility via Containerized Computing
TLDR
This work presents its experiences, technology, and future plans for open source containerization of software used to model particle and radiation beams, using Vagrant for cloud deployment and VirtualBox virtual machines for deployment to Mac OS and Windows computers.
Building a Virtual HPC Cluster with Auto Scaling by the Docker
TLDR
By integrating the auto-scaling feature of service discovery with the light-weight virtualization tool, the Docker, the construction of a virtual cluster on top of physical cluster hardware is attempted.
The International Virtual Observatory Alliance: recent technical developments and the road ahead
TLDR
The current status of IVOA projects, the priority areas for technical development, the science prototypes and planned developments are reviewed.
CANFAR: the Canadian Advanced Network for Astronomical Research
TLDR
The high-level architecture and the current state of the CANFAR project is described, which makes use of high-speed networking, cloud computing, cloud storage, meta-scheduling, provisioning and virtualisation.
The VISTA Science Archive
We describe the VISTA Science Archive (VSA) and itsfirst public release of data from five of the six VISTA public surveys. The VSA exists to support the VISTA surveys through their lifecycle: the
The LSST Data Management System
TLDR
The LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys that form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.
Service Infrastructure for Cross-Matching Distributed Datasets Using OGSA-DAI and TAP
TLDR
The Wide Field Astronomy Unit has worked with the Edinburgh Parallel Computing Centre (EPCC) in leveraging the OGSA-DAI1 grid middleware to enable cross catalogue queries on distributed Table Access Protocol2 (TAP) services.
AN INTERACTIVE WEB-BASED ANALYSIS FRAMEWORK FOR REMOTE SENSING CLOUD COMPUTING
TLDR
A spatiotemporal analysis platform to provide the end-user with a safe and convenient way to access massive remote sensing data stored in the cloud, and the cloud computing environment built by Docker makes the greatest use of the host system resources, and can handle more concurrent spatial-temporal computing tasks.
The WFCAM Science Archive
We describe the WFCAM Science Archive, which is the primary point of access for users of data from the wide-field infrared camera WFCAM on the United Kingdom Infrared Telescope (UKIRT), especially
The eleventh and twelfth data releases of the Sloan Digital Sky Survey: final data from SDSS-III
The third generation of the Sloan Digital Sky Survey (SDSS-III) took data from 2008 to 2014 using the original SDSS wide-field imager, the original and an upgraded multi-object fiber-fed optical
...
1
2
3
...