A manifesto for reproducible science

@article{Munafo2017AMF,
  title={A manifesto for reproducible science},
  author={Marcus Robert Munafo and Brian A. Nosek and Dorothy V. M. Bishop and Katherine S. Button and Christopher D. Chambers and Nathalie Percie du Sert and Uri Simonsohn and Eric-Jan Wagenmakers and Jennifer Ware and John P. A. Ioannidis},
  journal={Nature human behaviour},
  year={2017},
  volume={1}
}
Improving the reliability and efficiency of scientific research will increase the credibility of the published scientific literature and accelerate discovery. Here we argue for the adoption of measures to optimize key elements of the scientific process: methods, reporting and dissemination, reproducibility, evaluation and incentives. There is some evidence from both simulations and empirical studies supporting the likely effectiveness of these measures, but their broad adoption by researchers… 

How open science norms improve scientific practices

: Empirical findings indicate that various scientific fields are in serious replication crisis. One source of low reproducibility can be attributed to the so-called Questionable Research Practices.

Fostering Robust, Reliable, and Replicable Research at the Journal of Management

Structural changes made at the Journal of Management and to its review process designed to increase transparency and establish new standards of robust, reliable, and replicable research are described.

The reproducibility debate is an opportunity, not a crisis

There are many factors that contribute to the reproducibility and replicability of scientific research. There is a need to understand the research ecosystem, and improvements will require combined

Arguments against efficiency in science

A recent commentary critiqued the embrace of performance metrics at research universities. Drawing on our research studying the metascience movement, we suggest that the drive to maximize efficiency

Quality Control for Scientific Research: Addressing Reproducibility, Responsiveness, and Relevance

It is argued that one quality control metric—the probability that a research hypothesis is true—is required to address at least relevance and may also be part of the solution for improving responsiveness and reproducibility.

Improving the Efficiency of Grant and Journal Peer Review: Registered Reports Funding.

  • M. Munafo
  • Medicine, Political Science
    Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco
  • 2017
Peer review—the process whereby scientific research is evaluated by independent experts within the field—remains a cornerstone of scientific research, and acts as a critical gatekeeper in relation to

Improving transparency and scientific rigor in academic publishing

An overview of how authors can write manuscripts in a transparent and thorough manner is provided, including a set of reporting criteria that can be used for publishing, and recommendations on reporting the experimental design and statistical approaches are introduced.

Improving transparency and scientific rigor in academic publishing

An overview of how authors can write manuscripts in a transparent and thorough manner is provided, including a set of reporting criteria that can be used for publishing, and recommendations on reporting the experimental design and statistical approaches are introduced.

Improving transparency and scientific rigor in academic publishing

An overview of how authors can write manuscripts in a transparent and thorough manner is provided, including a set of reporting criteria that can be used for publishing, and recommendations on reporting the experimental design and statistical approaches are introduced.
...

References

SHOWING 1-10 OF 100 REFERENCES

Meta-research: Evaluation and Improvement of Research Methods and Practices

A map of ongoing efforts is provided and plans for connecting the multiple meta-research efforts across science worldwide are discussed.

Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions

An optimality model is developed that predicts the most rational research strategy, in terms of the proportion of research effort spent on seeking novel results rather than on confirmatory studies, and the amount ofResearch effort per exploratory study.

Scientific Utopia

Strategies for improving scientific practices and knowledge accumulation are developed that account for ordinary human motivations and biases and can reduce the persistence of false findings.

Promoting an open research culture

Author guidelines for journals could help to promote transparency, openness, and reproducibility Transparency, openness, and reproducibility are readily recognized as vital features of science (1,

Registered Reports A Method to Increase the Credibility of Published Results

Ignoring replications and negative results is bad for science. This special issue presents a novel publishing format – Registered Reports – as a partial solution. Peer review occurs prior to data

Reproducibility in Science: Improving the Standard for Basic and Preclinical Research

The reproducibility problems in basic and preclinical biomedical research are reviewed, some of the complexities are highlighted, and potential solutions that may help improve research quality and reproducible are discussed.

Preventing the ends from justifying the means: withholding results to address publication bias in peer-review

BMC Psychology is launching a pilot to trial a new ‘results-free’ peer-review process, whereby editors and reviewers are blinded to the study’s results, initially assessing manuscripts on the scientific merits of the rationale and methods alone.

Modelling the effects of subjective and objective decision making in scientific peer review

It is demonstrated that exercising some subjectivity in reviewer decisions, which serves to curb the herding process, can be beneficial for the scientific community in processing available information to estimate truth more accurately, and provides a new perspective on the ongoing discussion of how the peer-review process may be improved.

Reproducible Research Practices and Transparency across the Biomedical Literature

There is a growing movement to encourage reproducibility and transparency practices in the scientific community, including public access to raw data and protocols, the conduct of replication studies,
...