Publishing computational research - A review of infrastructures for reproducible and transparent scholarly communication

  title={Publishing computational research - A review of infrastructures for reproducible and transparent scholarly communication},
  author={Markus Konkol and Daniel N{\"u}st and Laura Goulier},
<p>Many research papers include results based on data that is analyzed using a computational analysis implemented, e.g., in R. Publishing these materials is perceived as being good scientific practice and essential for the scientific progress. For these reasons, organizations that provide funding increasingly demand applicants to outline data and software management plans as part of their research proposals. Furthermore, the author guidelines for paper submissions more often include a section… 
Trust but Verify: How to Leverage Policies, Workflows, and Infrastructure to Ensure Computational Reproducibility in Publication
This article distills findings from a qualitative study of seven reproducibility initiatives to enumerate nine key decision points for journals seeking to address concerns about the quality and rigor
Perspectives on Data Reproducibility and Replicability in Paleoclimate and Climate Science
Recommendations for addressing challenges include: development of searchable, auto-updated, interlinked, multi-archive public paleoclimate repositories for raw and processed digital datasets; cross-center standardized code base cases, improved data storage techniques, and a focus on replicability for climate simulation storage and access.
A Badging System for Reproducibility and Replicability in Remote Sensing Research
A badging system suited to the specifics of the Remote Sensing community is proposed, which aims at both recognizing the level of the reproducibility of the research, and to help increase its visibility.
Documentation Matters: Human-Centered AI System to Assist Data Science Code Documentation in Computational Notebooks
It is found that automated documentation generation techniques reduced the time for writing documentation, reminded participants to document code they would have ignored, and improved participants’ satisfaction with their computational notebook.
Themisto: Towards Automated Documentation Generation in Computational Notebooks
It is found that automated documentation generation techniques reduced the time for writing documentation, reminded participants to document code they would have ignored, and improved participants’ satisfaction with their computational notebook.
A Guide to Reproducible Research in Signal Processing and Machine Learning
This work aims to present signal processing researchers with a set of practical tools and strategies that can help mitigate many of the obstacles to producing reproducible computational experiments.
Reproducibilidad en AGILE: experiencias, logros y recomendaciones Reproducibility in AGILE: experiences, achievements, and recommendations
This article describes the experiences, activities carried out, resources generated and recommendations for the promotion of practices in reproducible research in the field of geographic information
Principles for data analysis workflows
Suggestions for practices and tools to advance reproducible, sound data-intensive analysis may furnish support for both students new to research and current researchers who are new to data- intensive work.
Toward Long-Term and Archivable Reproducibility
“Maneage” (managing data lineage), enabling cheap archiving, provenance extraction, and peer verification that has been tested in several research publications is introduced, and it is shown that longevity is a realistic requirement that does not sacrifice immediate or short-term reproducibility.
Experiences with Reproducibility: Case Studies from Scientific Workflows
Reproducible research is becoming essential for science to ensure transparency and for building trust. Additionally, reproducibility provides the cornerstone for sharing of methodology that can


CODECHECK: An open-science initiative to facilitate sharing of computer programs and results presented in scientific publications
Analysis of data and computational modelling is central to most scientific disciplines. The underlying computer programs are complex and costly to design. However, these computational techniques are
Enhancing reproducibility for computational methods
A novel set of Reproducibility Enhancement Principles (REP) targeting disclosure challenges involving computation is presented, which build upon more general proposals from the Transparency and Openness Promotion guidelines and emerged from workshop discussions among funding agencies, publishers and journal editors, industry participants, and researchers representing a broad range of domains.
Opening the Publication Process with Executable Research Compendia
It is concluded that ERCs provide a novel potential to find, explore, reuse, and archive computer-based research.
Editorial On Writing Reproducible and Interactive Papers
  • M. Chitre
  • Engineering
    IEEE Journal of Oceanic Engineering
  • 2018
While most publishers of scientific journals provide online archives of papers, in addition to or as a replacement for printed issues, the versions available online remain static documents. They fail
Creating Interactive Scientific Publications using Bindings
A toolkit for authors to easily create interactive figures by connecting specific UI widgets to parameters is proposed, and initial evidence that the concept is feasible and applicable to many papers with moderate effort is provided.
Practical Computational Reproducibility in the Life Sciences.
This suite combines three well-tested components-a system for building highly portable packages of bioinformatics software, containerization and virtualization technologies for isolating reusable execution environments for these packages, and workflow systems that automatically orchestrate the composition of these packages for entire pipelines-to achieve an unprecedented level of computational reproducibility.
Ten Simple Rules for Reproducible Computational Research
It is emphasized that reproducibility is not only a moral responsibility with respect to the scientific field, but that a lack of reproducible can also be a burden for you as an individual researcher.
The Legal Framework for Reproducible Scientific Research: Licensing and Copyright
  • V. Stodden
  • Computer Science
    Computing in Science & Engineering
  • 2009
The author proposes the reproducible research standard for scientific researchers to use for all components of their scholarship that should encourage reproducible scientific investigation through attribution, facilitate greater collaboration, and promote engagement of the larger community in scientific learning and discovery.
Publishers' Responsibilities in Promoting Data Quality and Reproducibility.
Practical approaches being taken by publishers, in six key areas, are described, their progress and effectiveness and the implications for researchers publishing their work are described.
Computing Environments for Reproducibility: Capturing the "Whole Tale"
The Whole Tale project aims to address technical and institutional barriers by connecting computational, data-intensive research efforts with the larger research process--transforming the knowledge discovery and dissemination process into one where data products are united with research articles to create "living publications" or "tales".