The file drawer problem and tolerance for null results

@article{Rosenthal1979TheFD,
  title={The file drawer problem and tolerance for null results},
  author={Robert Rosenthal},
  journal={Psychological Bulletin},
  year={1979},
  volume={86},
  pages={638-641}
}
  • R. Rosenthal
  • Published 1979
  • Computer Science
  • Psychological Bulletin
For any given research area, one cannot tell how many studies have been conducted but never reported. The extreme view of the "file drawer problem" is that journals are filled with the 5% of the studies that show Type I errors, while the file drawers are filled with the 95% of the studies that show nonsignificant results. Quantitative procedures for computing the tolerance for filed and future null results are reported and illustrated, and the implications are discussed. (15 ref) (PsycINFO… Expand
View via Publisher
pages.ucsd.edu
6,420 Citations
Highly Influential Citations
335
Background Citations
1,901
Methods Citations
892
Results Citations
360

Topics from this paper

6,420 Citations

Citation Type

Citation Type

Estimating the Effect of the File Drawer Problem in Meta-Analysis
TLDR
The table shows that distortions exaggerating the effect size are substantial and that the exaggerations of effects are strongest when the true effect size approaches zero, meaning that a meta-analysis could be very misleading were thetrue effect size close to zero. Expand
P-Curve: A Key to the File Drawer
TLDR
By telling us whether the authors can rule out selective reporting as the sole explanation for a set of findings, p-curve offers a solution to the age-old inferential problems caused by file-drawers of failed studies and analyses. Expand
A Novel Application of the File Drawer Formula: Rejected Study Bias in Meta-Analysis
  • Justy Reed
  • Psychology, Medicine
  • Psychological reports
  • 2009
TLDR
A novel use of Orwin's 1983 formula is proposed that produces an estimate of the potential bias in the mean ES due to missing ESs from studies that were located and retrieved, but rejected because of insufficient data for ES calculation. Expand
File drawer problem
This dissertation provides normative, descriptive, and prescriptive analyses of a scientist’s decision to share data. The normative analysis (Chapter Two) concludes that, although there is no logical… Expand
fiddle: a tool to combat publication bias by getting research out of the file drawer and into the scientific community
TLDR
The fiddle tool is a match-making Shiny app designed to help biomedical researchers to identify the most appropriate publication format for their data, which will assist scientists in getting otherwise inaccessible, hidden data out of the file drawer into the scientific community and literature. Expand
Do Research Literatures Give Correct Answers?
The rationale for insisting on properly designed studies is to ensure the construction of research literatures that are not influenced by biases of any sort. Once a literature is established,… Expand
Revisiting the file drawer problem in meta‐analysis: An assessment of published and nonpublished correlation matrices.
The file drawer problem rests on the assumption that statistically non-significant results are less likely to be published in primary-level studies and less likely to be included in meta-analytic… Expand
Publication Bias: The "File-Drawer" Problem in Scientific Inference
Publication bias arises whenever the probability that a study is published depends on the statistical significance of its results. This bias, often called the file-drawer effect since the unpublished… Expand
Selection Models and the File Drawer Problem
Meta-analysis consists of quantitative methods for combining evidence from different studies about a particular issue. A frequent criticism of meta-analysis is that it may be based on a biased sample… Expand
p-Curve and Effect Size
Journals tend to publish only statistically significant evidence, creating a scientific record that markedly overstates the size of effects. We provide a new tool that corrects for this bias without… Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 19 REFERENCES
Publication Decisions and their Possible Effects on Inferences Drawn from Tests of Significance—or Vice Versa
Abstract There is some evidence that in fields where statistical tests of significance are commonly used, research which yields nonsignificant results is not published. Such research being unknown to… Expand
Some Methods for Strengthening the Common χ 2 Tests
Since the x2 tests of goodness of fit and of association in contingency tables are presented in many courses on statistical methods for beginners in the subject, it is not surprising that x2 has… Expand
Further Evidence for the Cliff Effect in the Interpretation of Levels of Significance
In a recent study by Rosenthal and Gaito (1963) a group of faculty members and a group of graduate students in psychology rated their degree of confidence or belief in 12 p values ranging from .001… Expand
Statistical Power Analysis for the Behavioral Sciences
Contents: Prefaces. The Concepts of Power Analysis. The t-Test for Means. The Significance of a Product Moment rs (subscript s). Differences Between Correlation Coefficients. The Test That a… Expand
Meta-analysis of psychotherapy outcome studies.
Results of nearly 400 controlled evalua- tions of psychotherapy and counseling were coded and integrated statistically. The findings provide convincing evidence of the efficacy of psychotherapy. On… Expand
Gender Effects in Decoding Nonverbal Cues
This article summarizes results of 7S studies that reported accuracy for males and females at decoding nonverbal communication. The following attributes of the studies were coded: year, sample size,… Expand
The Handbook of Social Psychology
VOLUME 2. Part III: The Social World. 21. EVOLUTIONARY SOCIAL PSYCHOLOGY (Steven L. Neuberg, Douglas T. Kenrick, and Mark Schaller). 22. MORALITY (Jonathan Haidt and Selin Kesebir). 23. AGGRESSION… Expand
The Interpretation of Levels of Significance by Psychological Researchers
Combining results of independent studies.
Experimenter effects in behavioral research, Enlarged ed.
...
1
2
...