Bias-Correction Techniques Alone Cannot Determine Whether Ego Depletion is Different from Zero: Commentary on Carter, Kofler, Forster, & McCullough, 2015

@inproceedings{Inzlicht2015BiasCorrectionTA,
  title={Bias-Correction Techniques Alone Cannot Determine Whether Ego Depletion is Different from Zero: Commentary on Carter, Kofler, Forster, \& McCullough, 2015},
  author={Michael Inzlicht and Will M. Gervais and Elliot T. Berkman},
  year={2015}
}
Carter, Kofler, Forster, & McCullough (2015) conducted a bias-corrected meta-analysis of the so-called ego depletion effect to determine its real size and robustness. Their efforts have raised awareness of how badly meta-analyses can mislead when the articles that go into them are products of publication bias. Despite our genuine enthusiasm for their work, we worry that in their zeal to correct the record of publication bias, they have drawn too heavily on largely untested statistical… Expand

Figures and Tables from this paper

Can the ego be depleted? : Attempts to replicate the ego depletion effect and integrate its explanations
Although self-control is so important that no one from any corner of the world would dispute, it is often difficult and vulnerable. Continuous exertion is one of the most influential factors that areExpand
Is Ego Depletion Real? An Analysis of Arguments
TLDR
It is concluded that despite several hundred published studies, the available evidence is inconclusive and both additional empirical and theoretical works are needed to make a compelling case for either side of the debate. Expand
No Evidence of the Ego-Depletion Effect across Task Characteristics and Individual Differences: A Pre-Registered Study
TLDR
Examination of the robustness of the ego-depletion effect aimed to maximize the likelihood of detecting the effect by using one of the most widely used depletion tasks and by considering task characteristics and individual differences that potentially moderate the effect. Expand
Potential Publication Bias in the Stereotype Threat Literature: Comment on Nguyen and Ryan (2008)
  • L. Zigerell
  • Psychology, Medicine
  • The Journal of applied psychology
  • 2017
TLDR
Caution is warranted both for citing Nguyen and Ryan (2008) as evidence of a meaningful stereotype threat effect and for claiming that the stereotypethreat effect size is negligible based on these adjustments, given that the detected small study effects might be due to unexplored moderators instead of publication bias. Expand
Assessing and adjusting for publication bias in the relationship between anxiety and the error-related negativity.
  • Blair Saunders, M. Inzlicht
  • Medicine, Psychology
  • International journal of psychophysiology : official journal of the International Organization of Psychophysiology
  • 2020
TLDR
The results suggest that the anxiety-ERN relationship survives multiple corrections for publication bias, albeit not among all sub-types and populations of anxiety, and applies a range of methods to test for and correct publication bias. Expand
The Past, Present, and Future of Ego Depletion
Abstract. At the center of social psychology just a few years ago, ego depletion is now widely seen as a controversial topic, one of the chief victims of the replication crisis. Despite over 600Expand
The Limits of Ego Depletion
Abstract. Evidence on the existence of the ego depletion phenomena as well as the size of the effects and potential moderators and mediators are ambiguous. Building on a crossover design that enablesExpand
Development of a Within-Subject, Repeated-Measures Ego-Depletion Paradigm: Inconsistent Results and Future Recommendations
Ego depletion is under scrutiny for low replicability, possibly reflecting the limited statistical power available in between-subject designs. In response, we created a within-subject,Expand
Misguided Effort With Elusive Implications
  • R. Baumeister, K. Vohs
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2016
TLDR
The Registered Replication Report on ego depletion was misguided to focus merely on the simple structure of procedures while disregarding the underlying psychological processes, and the weaknesses seem more serious than the authors had understood. Expand
A meta-analysis of the survival-processing advantage in memory
TLDR
Overall, researchers can expect to find medium to large survival-processing effects, with selective reporting and bias-correcting techniques typically estimating lower effect sizes than traditional meta-analytic techniques. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 33 REFERENCES
Publication bias and the limited strength model of self-control: has the evidence for ego depletion been overestimated?
TLDR
Until greater certainty about the size of the depletion effect can be established, circumspection about the existence of this phenomenon is warranted, and rather than elaborating on the model, research efforts should focus on establishing whether the basic effect exists. Expand
Meta-analyses are no substitute for registered replications: a skeptical perspective on religious priming
TLDR
A conclusive resolution of the debate about the effect of religious priming on prosocial behavior – and about theoretically disputed effects more generally – requires a large-scale, preregistered replication project, which is considered to be the sole remedy for the adverse effects of experimenter bias and publication bias. Expand
Meta-analysis using effect size distributions of only statistically significant studies.
Publication bias threatens the validity of meta-analytic results and leads to overestimation of the effect size in traditional meta-analysis. This particularly applies to meta-analyses that featureExpand
Meta-regression approximations to reduce publication selection bias.
TLDR
A quadratic approximation without a linear term, precision-effect estimate with standard error (PEESE), is shown to have the smallest bias and mean squared error in most cases and to outperform conventional meta-analysis estimators, often by a great deal. Expand
A series of meta-analytic tests of the depletion effect: Self-control does not seem to rely on a limited resource.
TLDR
A series of focused, meta-analytic tests that address the limitations in prior appraisals of the evidence find very little evidence that the depletion effect is a real phenomenon, at least when assessed with the methods most frequently used in the laboratory. Expand
A Monte Carlo Analysis of Alternative Meta-Analysis Estimators in the Presence of Publication Bias
Abstract A meta-analysis (MA) aggregates estimated effects from many studies to calculate a single, overall effect. There is no one, generally accepted procedure for how to do this. SeveralExpand
False-Positive Psychology
TLDR
It is shown that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings, flexibility in data collection, analysis, and reporting dramatically increases actual false- positive rates, and a simple, low-cost, and straightforwardly effective disclosure-based solution is suggested. Expand
Could It Be Better to Discard 90% of the Data? A Statistical Paradox
TLDR
This work investigates a very simple method to reduce the effects of publication bias and to improve the efficiency of summary estimates of accumulated empirical research results that averages the most precise 10% of the reported estimates (i.e., ‘Top10’). Expand
Ego depletion and the strength model of self-control: a meta-analysis.
TLDR
Support for motivation and fatigue as alternative explanations for ego depletion indicate a need to integrate the strength model with other theories and provide preliminary support for the ego-depletion effect and strength model hypotheses. Expand
Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study
TLDR
Regression-based adjustments for publication bias and other small study effects are easy to conduct and outperformed more established methods over a wide range of simulation scenarios. Expand
...
1
2
3
4
...