Reproducible research and GIScience: an evaluation using AGILE conference papers

@article{Nst2018ReproducibleRA,
  title={Reproducible research and GIScience: an evaluation using AGILE conference papers},
  author={Daniel N{\"u}st and Carlos Granell and Barbara Hofer and Markus Konkol and Frank O. Ostermann and Rusne Sileryte and Valentina Cerutti},
  journal={PeerJ},
  year={2018},
  volume={6}
}
The demand for reproducible research is on the rise in disciplines concerned with data analysis and computational methods. Therefore, we reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Using this criteria, we assessed a sample of GIScience studies from the Association of Geographic Information Laboratories in Europe (AGILE) conference series, and… 
View PDF
57 Citations
Highly Influential Citations
4
Background Citations
21
Methods Citations
13
Results Citations
1

Figures and Tables from this paper

57 Citations

Reproducible Research and GIScience: An Evaluation Using GIScience Conference Papers

A rubric for assessing the reproducibility of 75 conference papers published at the GIScience conference series in the years 2012-2018 is applied and previous recommendations for improving this situation are summarised and adapted.

Reproducibilidad en AGILE: experiencias, logros y recomendaciones Reproducibility in AGILE: experiences, achievements, and recommendations

A call to the Latin American GIScience community to consider the resources detailed here in order to encourage reproducible research in their scientific communities.

Reproducible Publications at AGILE conferences : Proposed guidelines for authors

The development of publication guidelines needs to address a series of questions like how reviewers can be rewarded for their efforts to assess the reproducibility or what a reasonable balance is between being specific in the guidelines.

Leveraging Container Technologies in a GIScience Project: A Perspective from Open Reproducible Research

Enterprise containerisation technologies proved to enhance the reproducibility of a GIScience project and UML diagrams were used to describe representative work-flows deployed in the project.

A Web service for executable research compendia enables reproducible publications and transparent reviews in geospatial sciences

The ERC and ERS are found to be a powerful tool to improve reproducibility and thereby enable better investigating and understanding of computational workflows during peer review and derive lessons learned and challenges for future scholarly publishing of computer-based geospatial research.

REPRODUCIBILITY AND REPLICABILITY FORUM Practical Reproducibility in Geography and Geosciences Reproducible workflows in geography and geosciences

It is argued that all researchers working with computers should understand these technologies to control their computing environment, and it is concluded that researchers today can overcome many barriers and achieve a very high degree of reproducibility.

Cross‐disciplinary data practices in earth system science: Aligning services with reuse and reproducibility priorities

Improvements in data service models for ESS and other interdisciplinary fields need to account for the diverse and distributed system of repositories and build a workforce with deeper knowledge of the complex data and methods that drive integrative systems science.

Practical Reproducibility in Geography and Geosciences

It is argued that all researchers working with computers should understand these technologies to control their computing environment, and the benefits of reproducible workflows in practice are presented.

Opening practice: supporting reproducibility and critical spatial data science

This paper considers the role that reproducible and open spatial science may play in a more open and reproducible approach to geographic and spatial data science, and identifies the need for a critical approach.

Understanding experiments and research practices for reproducibility: an exploratory study

An exploratory study by conducting a survey addressed to researchers representing a range of disciplines to understand scientific experiments and research practices for reproducibility and offers general recommendations that could help the scientific community to understand, reproduce, and reuse experimental data and results in the research data lifecycle.
...

References

SHOWING 1-10 OF 65 REFERENCES

Data Sharing by Scientists: Practices and Perceptions

Large scale programs, such as the NSF-sponsored DataNET will both bring attention and resources to the issue and make it easier for scientists to apply sound data management principles.

Toward the Geoscience Paper of the Future: Best practices for documenting and sharing research from data to software to provenance

This article proposes best practices for GPF authors to make data, software, and methods openly accessible, citable, and well documented to accelerate the pace of scientific discovery.

Opening the Publication Process with Executable Research Compendia

It is concluded that ERCs provide a novel potential to find, explore, reuse, and archive computer-based research.

Quantitative methods I

Reproducible quantitative research is research that has been documented sufficiently rigorously that a third party can replicate any quantitative results that arise. It is argued here that such a…

Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research

A formalized set of best practice recommendations for computational scientists wishing to disseminate reproducible research, facilitate innovation by enabling data and code re-use, and enable broader communication of the output of digital scientific research are presented.

The Blind Men and the Elephant: Towards an Empirical Evaluation Framework for Software Sustainability

A definition of software sustainability is proposed and how it can be measured empirically in the design and engineering process of software systems is considered.

Advancing Science with VGI: Reproducibility and Replicability of Recent Studies using VGI

In scientific research, reproducibility and replicability are requirements to ensure the advancement of our body of knowledge. This holds true also for VGI‐related research and studies. However, the…

The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?

It is claimed that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned.

20 Years of AGILE

The structure of AGILE as an organization is presented, and how the mission was translated into a range of activities is described in a number of paragraphs, where the AGILE working groups, initiatives, the participation in EU projects and conference themes are discussed.

Good enough practices in scientific computing

A set of good computing practices that every researcher can adopt, regardless of their current level of computational skill are presented, which encompass data management, programming, collaborating with colleagues, organizing projects, tracking work, and writing manuscripts.
...