When more data steer us wrong: replications with the wrong dependent measure perpetuate erroneous conclusions

@article{Rotello2015WhenMD,
  title={When more data steer us wrong: replications with the wrong dependent measure perpetuate erroneous conclusions},
  author={C. Rotello and E. Heit and Chad Dub{\'e}},
  journal={Psychonomic Bulletin & Review},
  year={2015},
  volume={22},
  pages={944-954}
}
There is a replication crisis in science, to which psychological research has not been immune: Many effects have proven uncomfortably difficult to reproduce. Although the reliability of data is a serious concern, we argue that there is a deeper and more insidious problem in the field: the persistent and dramatic misinterpretation of empirical results that replicate easily and consistently. Using a series of four highly studied “textbook” examples from different research domains (eyewitness… Expand
52 Citations
Making replication mainstream
  • 167
Assessing Theoretical Conclusions With Blinded Inference to Investigate a Potential Inference Crisis
  • 4
  • PDF
Characterizing belief bias in syllogistic reasoning: A hierarchical Bayesian meta-analysis of ROC data
  • 7
  • PDF
Interaction effects on common measures of sensitivity: choice of measure, type I error, and power
  • 6
  • Highly Influenced
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 103 REFERENCES
The Long Way From α-Error Control to Validity Proper
  • 133
Assessing the belief bias effect with ROCs: it's a response bias effect.
  • 89
  • PDF
Too good to be true: Publication bias in two prominent studies from experimental psychology
  • G. Francis
  • Psychology, Medicine
  • Psychonomic bulletin & review
  • 2012
  • 166
  • PDF
Investigating variation in replicability: A “Many Labs” replication project
  • 591
  • PDF
Sources of bias in the Goodman-Kruskal gamma coefficient measure of association: implications for studies of metacognitive processes.
  • M. Masson, C. Rotello
  • Psychology, Medicine
  • Journal of experimental psychology. Learning, memory, and cognition
  • 2009
  • 138
  • PDF
On the Applied Implications of the “Verbal Overshadowing Effect”
  • L. Mickes, J. Wixted
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2015
  • 17
  • PDF
The SDT model of belief bias: complexity, time, and cognitive ability mediate the effects of believability.
  • 48
  • PDF
...
1
2
3
4
5
...