Specification Curve: Descriptive and Inferential Statistics on All Reasonable Specifications

@inproceedings{Simonsohn2015SpecificationCD,
  title={Specification Curve: Descriptive and Inferential Statistics on All Reasonable Specifications},
  author={Uri Simonsohn and Joseph P. Simmons and Leif D. Nelson},
  year={2015}
}
Empirical results often hinge on data analytic decisions that are simultaneously defensible, arbitrary, and motivated. To mitigate this problem we introduce Specification-Curve Analysis, which consists of three steps: (i) identifying the set of theoretically justified, statistically valid, and non-redundant analytic specifications, (ii) displaying alternative results graphically, allowing the identification of decisions producing different results, and (iii) conducting statistical tests to… CONTINUE READING

Figures and Tables from this paper.

Similar Papers

Citations

Publications citing this paper.
SHOWING 1-10 OF 19 CITATIONS

Detecting and avoiding likely false-positive findings - a practical guide.

  • Biological reviews of the Cambridge Philosophical Society
  • 2017
VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

False-Positive Citations.

  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2018

References

Publications referenced by this paper.
SHOWING 1-10 OF 25 REFERENCES

Let's Take the Con Out of Econometrics

VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL

Are female hurricanes really deadlier than male hurricanes?

  • Proceedings of the National Academy of Sciences of the United States of America
  • 2014
VIEW 3 EXCERPTS

Estimation and Accuracy after Model Selection.

  • Journal of the American Statistical Association
  • 2014
VIEW 1 EXCERPT

Female hurricanes are not deadlier than male hurricanes.

  • Proceedings of the National Academy of Sciences of the United States of America
  • 2014
VIEW 3 EXCERPTS

Population matters when modeling hurricane fatalities.

  • Proceedings of the National Academy of Sciences of the United States of America
  • 2014
VIEW 3 EXCERPTS

Statistics show no evidence of gender bias in the public's hurricane preparedness.

  • Proceedings of the National Academy of Sciences of the United States of America
  • 2014
VIEW 3 EXCERPTS