Ten years of software sustainability at the Infrared Processing and Analysis Center

@article{Berriman2011TenYO,
  title={Ten years of software sustainability at the Infrared Processing and Analysis Center},
  author={G. Bruce Berriman and John Good and Ewa Deelman and Anastasia Alexov},
  journal={Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences},
  year={2011},
  volume={369},
  pages={3384 - 3397}
}
  • G. Berriman, J. Good, A. Alexov
  • Published 28 August 2011
  • Computer Science
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
This paper presents a case study of an approach to sustainable software architecture that has been successfully applied over a period of 10 years to astronomy software services at the NASA Infrared Processing and Analysis Center (IPAC), Caltech (http://www.ipac.caltech.edu). The approach was developed in response to the need to build and maintain the NASA Infrared Science Archive (http://irsa.ipac.caltech.edu), NASA's archive node for infrared astronomy datasets. When the archive opened for… 

Figures from this paper

Sustainability in the Tapis Framework
TLDR
This paper describes the multi-faceted approach to sustaining an increasingly complex ecosystem of software, documentation and other digital assets, including both technical and organizational strategies for minimizing the cost of sustainment while maximizing available resources for sustainment activities.
Sustainability in software engineering: A systematic literature review
TLDR
This work aims to provide an overview of different aspects of sustainability in software engineering research with regard to research activity, investigated topics, identified limitations, proposed approaches, used methods, available studies, and considered domains.
The design and operation of the Keck Observatory archive
TLDR
At the end of 2013, KOA completed the ingestion of data from all eight active observatory instruments, and KOA will continue to ingest all newly obtained observations, at an anticipated volume of 4 TB per year.
How Will Astronomy Archives Survive the Data Tsunami?
TLDR
The STScI now reports that more papers are published with archived data sets than with newly acquired data, and projections indicate that by 2020, more than 60 PB of archived data will be accessible to astronomers.
Selected papers from the 2010 e-Science All Hands Meeting
TLDR
This Theme Issue, entitled ‘ e-Science: novel research, ‘ provides a forum for the e- science community to present and demonstrate their research, exchange ideas and socialize.
How will astronomy archives survive the data tsunami?
Astronomers are collecting more data than ever. What practices can keep them ahead of the flood?

References

SHOWING 1-10 OF 30 REFERENCES
A Case Study in Modernizing Software: The IRAS Scan Processing and Integration Tool (“Scanpi”)
The all-sky far-infrared sky survey performed by the Infrared Astronomical Satellite (IRAS), launched in 1983, remains of exceptional value in astronomy. A tool developed during the IRAS mission, the
The Application of Cloud Computing to Astronomy: A Study of Cost and Performance
TLDR
It is shown that the Amazon EC2 cloud offers better performance and value for processor- and memory-limited applications than for I/O-bound applications.
The Montage Image Mosaic Service: Custom Image Mosaics On-Demand
TLDR
The Infrared Science Archive (IRSA), part of the Infrared Processing and Analysis Center (IPAC) at Caltech, has now wrapped the Montage software as a CGI service and provided a compute and request management infrastructure capable of producing approximately 2 TBytes / day of image mosaic output.
Collaborative Astronomical Image Mosaics
TLDR
This chapter describes how astronomical imaging survey data have become a vital part of modern astronomy, how these data are archived and then served to the astronomical community through on-line data access portals, and introduces Montage as a tool for this task.
Data placement for scientific applications in distributed environments
TLDR
The interactions between two services used in large-scale science today are explored and the benefits of prestaging data using the Data Replication Service versus using the native data stage-in mechanisms of the Pegasus workflow management system are evaluated.
The Arecibo Legacy Fast ALFA survey. I. Science goals, survey design, and strategy
The recently initiated Arecibo Legacy Fast ALFA (ALFALFA) survey aims to map ~7000 deg2 of the high Galactic latitude sky visible from Arecibo, providing a H I line spectral database covering the
Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking
TLDR
The architecture, algorithms, performance, and usage of Montage as both a software toolkit and a grid portal are described.
A Distributed Algorithm for Determining the Provenance of Data
  • Paul T. Groth
  • Computer Science
    2008 IEEE Fourth International Conference on eScience
  • 2008
TLDR
An algorithm, D-PQuery, for determining the provenance of data from distributed sources of provenance information in a parallel fashion is described and an implementation of the algorithm as a Condor DAGMan workflow that works across Kickstart records is presented.
A Fresh Perspective on Developing and Executing DAG-Based Distributed Applications: A Case-Study of SAGA-Based Montage
TLDR
This paper uses the Montage astronomical image mosaicking application as prototypical DAG-based workflow application and introduces SAGA as a technology that permits the construction of abstractions that aid the development and execution of the applications, and thus addresses some of common shortcomings of traditional distributed applications development.
Astronomical Data Analysis Software and Systems XV
TLDR
The execution of a lunar shadow intercept and the conduction of an observing program from a Boeing 747-400 ER aircraft over the Antarctic interior permitted the previously unobtainable to be accomplished.
...
...