Bias-Correction Techniques Alone Cannot Determine Whether Ego Depletion is Different from Zero: Commentary on Carter, Kofler, Forster, & McCullough, 2015

@inproceedings{Inzlicht2015BiasCorrectionTA,
  title={Bias-Correction Techniques Alone Cannot Determine Whether Ego Depletion is Different from Zero: Commentary on Carter, Kofler, Forster, \& McCullough, 2015},
  author={Michael Inzlicht and Will M. Gervais and Elliot T. Berkman},
  year={2015}
}
Carter, Kofler, Forster, & McCullough (2015) conducted a bias-corrected meta-analysis of the so-called ego depletion effect to determine its real size and robustness. Their efforts have raised awareness of how badly meta-analyses can mislead when the articles that go into them are products of publication bias. Despite our genuine enthusiasm for their work, we worry that in their zeal to correct the record of publication bias, they have drawn too heavily on largely untested statistical… 

Figures and Tables from this paper

Can the ego be depleted? : Attempts to replicate the ego depletion effect and integrate its explanations

Although self-control is so important that no one from any corner of the world would dispute, it is often difficult and vulnerable. Continuous exertion is one of the most influential factors that are

Is Ego Depletion Real? An Analysis of Arguments

It is concluded that despite several hundred published studies, the available evidence is inconclusive and both additional empirical and theoretical works are needed to make a compelling case for either side of the debate.

No Evidence of the Ego-Depletion Effect across Task Characteristics and Individual Differences: A Pre-Registered Study

Examination of the robustness of the ego-depletion effect aimed to maximize the likelihood of detecting the effect by using one of the most widely used depletion tasks and by considering task characteristics and individual differences that potentially moderate the effect.

Potential Publication Bias in the Stereotype Threat Literature: Comment on Nguyen and Ryan (2008)

  • L. Zigerell
  • Psychology
    The Journal of applied psychology
  • 2017
Caution is warranted both for citing Nguyen and Ryan (2008) as evidence of a meaningful stereotype threat effect and for claiming that the stereotypethreat effect size is negligible based on these adjustments, given that the detected small study effects might be due to unexplored moderators instead of publication bias.

Assessing and adjusting for publication bias in the relationship between anxiety and the error-related negativity.

  • Blair SaundersM. Inzlicht
  • Psychology
    International journal of psychophysiology : official journal of the International Organization of Psychophysiology
  • 2020

The Past, Present, and Future of Ego Depletion

At the center of social psychology just a few years ago, ego depletion is now widely seen as a controversial topic, one of the chief victims of the replication crisis. Despite over 600 studies of

The Limits of Ego Depletion

Abstract. Evidence on the existence of the ego depletion phenomena as well as the size of the effects and potential moderators and mediators are ambiguous. Building on a crossover design that enables

Development of a Within-Subject, Repeated-Measures Ego-Depletion Paradigm: Inconsistent Results and Future Recommendations

Ego depletion is under scrutiny for low replicability, possibly reflecting the limited statistical power available in between-subject designs. In response, we created a within-subject,

Misguided Effort With Elusive Implications

  • R. BaumeisterK. Vohs
  • Psychology
    Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2016
The Registered Replication Report on ego depletion was misguided to focus merely on the simple structure of procedures while disregarding the underlying psychological processes, and the weaknesses seem more serious than the authors had understood.

A meta-analysis of the survival-processing advantage in memory

Overall, researchers can expect to find medium to large survival-processing effects, with selective reporting and bias-correcting techniques typically estimating lower effect sizes than traditional meta-analytic techniques.
...

References

SHOWING 1-10 OF 33 REFERENCES

Publication bias and the limited strength model of self-control: has the evidence for ego depletion been overestimated?

Until greater certainty about the size of the depletion effect can be established, circumspection about the existence of this phenomenon is warranted, and rather than elaborating on the model, research efforts should focus on establishing whether the basic effect exists.

Meta-analyses are no substitute for registered replications: a skeptical perspective on religious priming

A conclusive resolution of the debate about the effect of religious priming on prosocial behavior – and about theoretically disputed effects more generally – requires a large-scale, preregistered replication project, which is considered to be the sole remedy for the adverse effects of experimenter bias and publication bias.

Meta-analysis using effect size distributions of only statistically significant studies.

Publication bias threatens the validity of meta-analytic results and leads to overestimation of the effect size in traditional meta-analysis. This particularly applies to meta-analyses that feature

A series of meta-analytic tests of the depletion effect: Self-control does not seem to rely on a limited resource.

A series of focused, meta-analytic tests that address the limitations in prior appraisals of the evidence find very little evidence that the depletion effect is a real phenomenon, at least when assessed with the methods most frequently used in the laboratory.

Meta‐regression approximations to reduce publication selection bias

A quadratic approximation without a linear term, precision-effect estimate with standard error (PEESE), is shown to have the smallest bias and mean squared error in most cases and to outperform conventional meta-analysis estimators, often by a great deal.

A Monte Carlo Analysis of Alternative Meta-Analysis Estimators in the Presence of Publication Bias

Abstract A meta-analysis (MA) aggregates estimated effects from many studies to calculate a single, overall effect. There is no one, generally accepted procedure for how to do this. Several

False-Positive Psychology

It is shown that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings, flexibility in data collection, analysis, and reporting dramatically increases actual false- positive rates, and a simple, low-cost, and straightforwardly effective disclosure-based solution is suggested.

Could It Be Better to Discard 90% of the Data? A Statistical Paradox

This work investigates a very simple method to reduce the effects of publication bias and to improve the efficiency of summary estimates of accumulated empirical research results that averages the most precise 10% of the reported estimates (i.e., ‘Top10’).

Ego depletion and the strength model of self-control: a meta-analysis.

Support for motivation and fatigue as alternative explanations for ego depletion indicate a need to integrate the strength model with other theories and provide preliminary support for the ego-depletion effect and strength model hypotheses.

Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study

Regression-based adjustments for publication bias and other small study effects are easy to conduct and outperformed more established methods over a wide range of simulation scenarios.