Reproducible research and GIScience: an evaluation using AGILE conference papers
@article{Nst2018ReproducibleRA, title={Reproducible research and GIScience: an evaluation using AGILE conference papers}, author={Daniel N{\"u}st and Carlos Granell and Barbara Hofer and Markus Konkol and Frank O. Ostermann and Rusne Sileryte and Valentina Cerutti}, journal={PeerJ}, year={2018}, volume={6} }
The demand for reproducible research is on the rise in disciplines concerned with data analysis and computational methods. Therefore, we reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Using this criteria, we assessed a sample of GIScience studies from the Association of Geographic Information Laboratories in Europe (AGILE) conference series, and…
Figures and Tables from this paper
57 Citations
Reproducible Research and GIScience: An Evaluation Using GIScience Conference Papers
- Computer ScienceGIScience
- 2021
A rubric for assessing the reproducibility of 75 conference papers published at the GIScience conference series in the years 2012-2018 is applied and previous recommendations for improving this situation are summarised and adapted.
Reproducibilidad en AGILE: experiencias, logros y recomendaciones Reproducibility in AGILE: experiences, achievements, and recommendations
- Computer Science
- 2020
A call to the Latin American GIScience community to consider the resources detailed here in order to encourage reproducible research in their scientific communities.
Reproducible Publications at AGILE conferences : Proposed guidelines for authors
- Medicine
- 2019
The development of publication guidelines needs to address a series of questions like how reviewers can be rewarded for their efforts to assess the reproducibility or what a reasonable balance is between being specific in the guidelines.
Leveraging Container Technologies in a GIScience Project: A Perspective from Open Reproducible Research
- Computer ScienceISPRS Int. J. Geo Inf.
- 2020
Enterprise containerisation technologies proved to enhance the reproducibility of a GIScience project and UML diagrams were used to describe representative work-flows deployed in the project.
A Web service for executable research compendia enables reproducible publications and transparent reviews in geospatial sciences
- Computer Science
- 2021
The ERC and ERS are found to be a powerful tool to improve reproducibility and thereby enable better investigating and understanding of computational workflows during peer review and derive lessons learned and challenges for future scholarly publishing of computer-based geospatial research.
REPRODUCIBILITY AND REPLICABILITY FORUM Practical Reproducibility in Geography and Geosciences Reproducible workflows in geography and geosciences
- Computer Science
- 2020
It is argued that all researchers working with computers should understand these technologies to control their computing environment, and it is concluded that researchers today can overcome many barriers and achieve a very high degree of reproducibility.
Cross‐disciplinary data practices in earth system science: Aligning services with reuse and reproducibility priorities
- Computer ScienceProceedings of the Association for Information Science and Technology
- 2020
Improvements in data service models for ESS and other interdisciplinary fields need to account for the diverse and distributed system of repositories and build a workforce with deeper knowledge of the complex data and methods that drive integrative systems science.
Practical Reproducibility in Geography and Geosciences
- Computer Science
- 2020
It is argued that all researchers working with computers should understand these technologies to control their computing environment, and the benefits of reproducible workflows in practice are presented.
Opening practice: supporting reproducibility and critical spatial data science
- Computer ScienceJournal of Geographical Systems
- 2020
This paper considers the role that reproducible and open spatial science may play in a more open and reproducible approach to geographic and spatial data science, and identifies the need for a critical approach.
Understanding experiments and research practices for reproducibility: an exploratory study
- Computer SciencePeerJ
- 2021
An exploratory study by conducting a survey addressed to researchers representing a range of disciplines to understand scientific experiments and research practices for reproducibility and offers general recommendations that could help the scientific community to understand, reproduce, and reuse experimental data and results in the research data lifecycle.
References
SHOWING 1-10 OF 65 REFERENCES
Data Sharing by Scientists: Practices and Perceptions
- MedicinePloS one
- 2011
Large scale programs, such as the NSF-sponsored DataNET will both bring attention and resources to the issue and make it easier for scientists to apply sound data management principles.
Toward the Geoscience Paper of the Future: Best practices for documenting and sharing research from data to software to provenance
- Computer Science
- 2016
This article proposes best practices for GPF authors to make data, software, and methods openly accessible, citable, and well documented to accelerate the pace of scientific discovery.
Opening the Publication Process with Executable Research Compendia
- Computer ScienceD Lib Mag.
- 2017
It is concluded that ERCs provide a novel potential to find, explore, reuse, and archive computer-based research.
Quantitative methods I
- Sociology
- 2016
Reproducible quantitative research is research that has been documented sufficiently rigorously that a third party can replicate any quantitative results that arise. It is argued here that such a…
Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research
- Computer Science
- 2013
A formalized set of best practice recommendations for computational scientists wishing to disseminate reproducible research, facilitate innovation by enabling data and code re-use, and enable broader communication of the output of digital scientific research are presented.
The Blind Men and the Elephant: Towards an Empirical Evaluation Framework for Software Sustainability
- Computer Science
- 2014
A definition of software sustainability is proposed and how it can be measured empirically in the design and engineering process of software systems is considered.
Advancing Science with VGI: Reproducibility and Replicability of Recent Studies using VGI
- BusinessTrans. GIS
- 2017
In scientific research, reproducibility and replicability are requirements to ensure the advancement of our body of knowledge. This holds true also for VGI‐related research and studies. However, the…
The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?
- BiologyBiological reviews of the Cambridge Philosophical Society
- 2016
It is claimed that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned.
20 Years of AGILE
- EducationAGILE Conf.
- 2017
The structure of AGILE as an organization is presented, and how the mission was translated into a range of activities is described in a number of paragraphs, where the AGILE working groups, initiatives, the participation in EU projects and conference themes are discussed.
Good enough practices in scientific computing
- Computer SciencePLoS Comput. Biol.
- 2017
A set of good computing practices that every researcher can adopt, regardless of their current level of computational skill are presented, which encompass data management, programming, collaborating with colleagues, organizing projects, tracking work, and writing manuscripts.