Reproducibility and Replication of Experimental Particle Physics Results

  title={Reproducibility and Replication of Experimental Particle Physics Results},
  author={Thomas Junk and L. Lyons},
  journal={Issue 2.4, Fall 2020},
The recent "replication crisis" has caused practitioners and journal editors in many fields in science to examine closely their methodologies and publishing criteria. Experimental particle physicists are no exceptions to this, but some of the unique features of this sub-field of physics make the issues of reproduction and replication of results a very interesting and informative topic. The experiments take many years to design, construct, and operate. Because the equipment is so large and… 

Figures and Tables from this paper

Comment on "Reproducibility and Replication of Experimental Particle Physics Results"
I would like to thank Junk and Lyons [1] for beginning a discussion about replication in high-energy physics (HEP). Junk and Lyons ultimately argue that HEP learned its lessons the hard way through
Simple and statistically sound strategies for analysing physical theories
Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to parameter estimation. Many models in particle physics,
Simple and statistically sound recommendations for analysing physical theories
Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics,
Ideas and Perspectives: When ocean acidification experiments are not the same, reproducibility is not tested
Can experimental studies on the behavioural impacts of ocean acidification be trusted? That question was raised in early 2020 when a high-profile paper failed to corroborate previously observed
Ideas and perspectives: When ocean acidification experiments are not the same, repeatability is not tested
New information on the methodologies used in the replicated studies now provides the explanation: the experimental conditions were substantially different, leading to high sensitivity to test conditions.
A self-governing, self-regulating system for assessing scientific predictive power
The main purpose of the present document is to motivate the project, to explain its underlying philosophy, to explains the details of the consensus protocol on which it is based, to describe plans for its future development, and ultimately to attract additional collaborators.
Beyond online participant crowdsourcing: The benefits and opportunities of big team addiction science
Participant crowdsourcing platforms (e.g., MTurk, Prolific) offer numerous advantages to addiction science, permitting access to hard-to-reach populations and enhancing the feasibility of complex


Shifting Standards: Experiments in Particle Physics in the Twentieth Century
Overall, Allan Franklin finds that despite the metamorphosis of the process, the role of experimentation has remained remarkably consistent through the years: to test theories and provide factual basis for scientific knowledge, to encourage new theories, and to reveal new phenomenon.
Blind Analysis in Nuclear and Particle Physics
▪ Abstract During the past decade, blind analysis has become a widely used tool in nuclear and particle physics measurements. A blind analysis avoids the possibility of experimenters biasing their
Not Normal: the uncertainties of scientific measurements
Reports of scientific uncertainties were studied by analysing 41 000 measurements of 3200 quantities from medicine, nuclear and particle physics, and interlaboratory comparisons ranging from chemistry to toxicology, finding contributions to measurement uncertainty from mistakes and unknown problems are not completely unpredictable.
Review of Particle Physics.
The ALICE experiment at the CERN LHC
ALICE (A Large Ion Collider Experiment) is a general-purpose, heavy-ion detector at the CERN LHC which focuses on QCD, the strong-interaction sector of the Standard Model. It is designed to address
Machine learning and the physical sciences
This article reviews in a selective way the recent research on the interface between machine learning and the physical sciences, including conceptual developments in ML motivated by physical insights, applications of machine learning techniques to several domains in physics, and cross fertilization between the two fields.
Selective Inference: The Silent Killer of Replicability
It is argued that addressing selective inference is a missing statistical cornerstone of enhancing replicability, and a way to ensure that some replication effort will be an inherent part of every study is outlined.
On the conundrum of the pentaquark
The pentaquark is proposed to be made from four quarks and one antiquark, which is an allowed combination by the theory of quantum chromodynamics. However, there was no convincing experimental
A Unified Approach to the Classical Statistical Analysis of Small Signals
We give a classical confidence belt construction which unifies the treatment of upper confidence limits for null results and two-sided confidence intervals for non-null results. The unified treatment
Robust Independent Validation of Experiment and Theory: Rivet version 3
First released in 2010, the Rivet library forms an important repository for analysis code, facilitating comparisons between measurements of the final state in particle collisions and theoretical