Reproducibility in Science: Improving the Standard for Basic and Preclinical Research

@article{Begley2015ReproducibilityIS,
  title={Reproducibility in Science: Improving the Standard for Basic and Preclinical Research},
  author={C Glenn Begley and John P. A. Ioannidis},
  journal={Circulation Research},
  year={2015},
  volume={116},
  pages={116–126}
}
Medical and scientific advances are predicated on new knowledge that is robust and reliable and that serves as a solid foundation on which further advances can be built. In biomedical research, we are in the midst of a revolution with the generation of new data and scientific publications at a previously unprecedented rate. However, unfortunately, there is compelling evidence that the majority of these discoveries will not stand the test of time. To a large extent, this reproducibility crisis… 
View on Wolters Kluwer
ahajournals.org
691 Citations
Highly Influential Citations
16
Background Citations
219
Methods Citations
15
Results Citations
12

Tables from this paper

691 Citations

Citation Type

Citation Type

Reproducibility and research integrity: the role of scientists and institutions
TLDR
Comment on research reproducibility in basic medical and life sciences with regards to issues arising and outline the role of stakeholders such as research institutions and their employees in addressing this crisis.
Chapter 1 – Reproducibility in Biomedical Research
Special Issue on Reproducible Research for Biomedical Informatics
Reagent Validation to Facilitate Experimental Reproducibility
TLDR
This overview discusses how a lack of validation of research reagents negatively impact experimental reproducibility, and provides guidelines to avoid these pitfalls.
Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps.
Minimum Information in In Vivo Research.
TLDR
This chapter describes literature highlighting factors that constitute the minimum information that is needed to be included in the reporting of in vivo research and presents a table distinguishing information necessary to be recorded in a laboratory notebook or another form of internal protocols versus information that should be reported in a paper.
New Initiatives to Improve the Rigor and Reproducibility of Articles Published in Circulation Research.
  • R. Bolli
  • Medicine
    Circulation research
  • 2017
TLDR
A study is published showing that only a minority of preclinical animal experiments reported in leading cardiovascular journals adheres to basic criteria necessary to assure rigor, which means that it will be impossible to augment reproducibility without augmenting methodological rigor.
Bolli New Initiatives to Improve Rigor and Reproducibility 473
  • Medicine
  • 2017
TLDR
The purpose of this editorial is to announce new initiatives aimed at enhancing the rigor, transparency, and reproducibility—and, thus, the overall robustness—of articles published in Circulation Research.
Biomedical Research in the 21st Century: Multiple Challenges in Resolving Reproducibility Issues
Article-level assessment of influence and translation in biomedical research
TLDR
The Relative Citation Ratio (RCR), a metric that was designed to serve in that capacity, measures the influence of each publication on its respective area of research and can serve as one component of a multifaceted metric that provides an effective data-driven supplement to expert opinion.
...
...

References

SHOWING 1-10 OF 120 REFERENCES
NIH plans to enhance reproducibility
TLDR
Leaders of the US National Institutes of Health (NIH) discuss initiatives that the complex system for ensuring the reproducibility of biomedical research is failing and is in need of restructuring.
Quality really matters: the need to improve specimen quality in biomedical research
TLDR
The BRISQ guidelines (Biospecimen Reporting for Improved Study Quality) provide a logical framework for reporting key pre-analytical variables for translational science, biomarker discovery, clinical trials, technology development, and diagnostic-assay and therapeutics development.
A Survey on Data Reproducibility in Cancer Research Provides Insights into Our Limited Ability to Translate Findings from the Laboratory to the Clinic
TLDR
The results suggest that the problem of data reproducibility is real and biomedical science needs to establish processes to decrease the problem and adjudicate discrepancies in findings when they are discovered.
Translating stem cell research from the bench to the clinic: a need for better quality data.
TLDR
Regulators and investors appear to be voicing the same concerns: insufficient high-quality data to provide confidence regarding the claims of medical benefit, an insufficient understanding of the mechanism of action, and a lack of identification of essential characteristics for product release criteria and for assuring reproducibility in manufacturing.
A call for transparent reporting to optimize the predictive value of preclinical research
TLDR
The main workshop recommendation is that at a minimum studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data.
Believe it or not: how much can we rely on published data on potential drug targets?
1. This indicates the limitations of the predictivity of disease models and also that the validity of the targets being investigated is frequently questionable, which is a crucial issue to address if…
Editorial: Do you see what I see? Quality, reliability, and reproducibility in biomedical research.
  • W. Kraus
  • Education
    Molecular endocrinology
  • 2014
TLDR
The unique self-critical and self-correcting nature of science has allowed the synthesis of the most accurate view of the natural world known to human kind—a view that has been so integrated into their daily lives that the authors sometimes fail to recognize its provenance.
Ten Simple Rules for Reproducible Computational Research
TLDR
It is emphasized that reproducibility is not only a moral responsibility with respect to the scientific field, but that a lack of reproducible can also be a burden for you as an individual researcher.
Assessing value in biomedical research: the PQRST of appraisal and reward.
TLDR
The criteria by which scientists and their teams are rewarded for their efforts by agencies that fund them and institutions that host them should be revisited, aligning criteria with the desired outcomes: research that is productive, high-quality, reproducible, shareable, and translatable.
Biospecimens, biomarkers, and burgeoning data: the imperative for more rigorous research standards.
  • G. Poste
  • Biology, Medicine
    Trends in molecular medicine
  • 2012
...
...