Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research

@article{Leichsenring2016BiasesIR,
  title={Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research},
  author={F. Leichsenring and A. Abbass and M. Hilsenroth and F. Leweke and P. Luyten and J. R. Keefe and N. Midgley and S. Rabung and S. Salzer and C. Steinert},
  journal={Psychological Medicine},
  year={2016},
  volume={47},
  pages={1000–1011}
}
Replicability of findings is an essential prerequisite of research. For both basic and clinical research, however, low replicability of findings has recently been reported. Replicability may be affected by research biases not sufficiently controlled for by the existing research standards. Several biases such as researcher allegiance or selective reporting are well-known for affecting results. For psychotherapy and pharmacotherapy research, specific additional biases may affect outcome (e.g… Expand
Methodological issues in psychological treatment research : applications to gambling research and therapist effects
Over the last couple of decades evidence-based psychotherapies have flourished, and there are now therapies that are well-established for a wide range of problems. At the same time the mental-healthExpand
Cochrane’s risk of bias tool in the context of psychotherapy outcome research
  • T. Munder, J. Barth
  • Medicine, Psychology
  • Psychotherapy research : journal of the Society for Psychotherapy Research
  • 2018
TLDR
The rationale of a widely used tool to assess the methodological quality of primary studies for meta-analysis is discussed and suggestions for its use in the context of psychotherapy outcome research are provided. Expand
The New Caucus-Race: Methodological Considerations for Meta-Analyses of Psychotherapy Outcome
The Dodo Bird Verdict (DBV)—the proposition that all psychotherapies are equally effective—remains bitterly contested by researchers, who have mainly used meta-analyses as the primary tool toExpand
Psychodynamic Therapy: As Efficacious as Other Empirically Supported Treatments? A Meta-Analysis Testing Equivalence of Outcomes.
TLDR
Results suggest equivalence of psychodynamic therapy to treatments established in efficacy is suggested, and who benefits most from which treatment is examined. Expand
Treatment Refusal and Premature Termination in Psychotherapy, Pharmacotherapy, and Their Combination: A Meta-Analysis of Head-to-Head Comparisons
TLDR
Differences in refusal rates for pharmacotherapy and psychotherapy were particularly evident for depressive disorders, panic disorder, and social anxiety disorder and providers of these treatments should seek to employ strategies to reduce their occurrence. Expand
The Research-Practice Psychotherapy Wars: The Case of Group Psychotherapy in the Treatment of PTSD
ABSTRACT In light of two recent meta-analyses of the efficacy of group psychotherapy in treating posttraumatic stress disorder (PTSD), this article critically reviews the randomized control trialExpand
Bias Toward Psychodynamic Therapy: Framing the Problem and Working Toward a Solution.
  • E. Plakun
  • Medicine, Psychology
  • Journal of psychiatric practice
  • 2017
TLDR
Current evidence for PDT is summarized, existing biases are described, and a set of recommendations are formulated to foster a more balanced perspective on PDT. Expand
Bias Toward Psychodynamic Therapy: Framing the Problem and Working Toward a Solution.
TLDR
Current evidence for PDT is summarized, existing biases are described, and a set of recommendations are formulated to foster a more balanced perspective on PDT. Expand
A commentary on research rigour in clinical psychological science: How to avoid throwing out the innovation baby with the research credibility bath water in the depression field.
TLDR
There is the potential for research credibility principles to stifle innovation and exacerbate type II error, but only if they are applied too rigidly and beyond their intended scope by funders, journals and scientists. Expand
The fallacy of the placebo-controlled clinical trials: Are positive outcomes the result of ‘indirect’ treatment effects?
TLDR
It is argued that placebo effects have a larger influence and may better explain clinical trial outcomes compared to purported treatment effects currently attributed to clinical treatments and that clinical trials of bio/neurofeedback treatments carefully consider the important and consequential influences of placebos when interpreting the results of trial outcomes. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 122 REFERENCES
Researcher allegiance in psychotherapy outcome research: an overview of reviews.
TLDR
The findings of this meta-meta-analysis suggest that the RA-outcome association is substantial and robust across several moderating variables including characteristics of treatment, population, and the type of RA assessment. Expand
Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias
TLDR
The effects of psychotherapy for adult depression seem to be overestimated considerably because of publication bias. Expand
Disclosure of researcher allegiance in meta-analyses and randomised controlled trials of psychotherapy: a systematic appraisal
TLDR
Stringent guidelines should be adopted by journals in order to improve reporting and attenuate possible effects of RA in future research, though meta-analyses perform slightly better than RCTs. Expand
Psychotherapist effects in meta-analyses: How accurate are treatment effects?
TLDR
Reexamining meta-analyses that found statistically significant differences between treatments for a variety of disorders by correcting the treatment effects according to the variability in outcomes known to be associated with psychotherapists demonstrated that after adjusting the results based on most small estimates of therapist effects, ∼80% of the reported treatment effects would still be statistically significant. Expand
The Effects of Blinding on the Outcomes of Psychotherapy and Pharmacotherapy for Adult Depression: a Meta-Analysis
TLDR
Comparisons between psychotherapy and pharmacotherapy in which both groups of patients (and therapists) are not blinded (no placebo condition is included) result in a very small, but significantly higher effect for pharmacotherapy. Expand
Replication and contradiction of highly cited research papers in psychiatry: 10-year follow-up
TLDR
Assessing how highly cited studies in psychiatry are replicated by subsequent studies found that among 83 articles recommending effective interventions, 40 had not been subject to any attempt at replication, 16 were contradicted, 11 were found to have substantially smaller effects and only 16 were replicated. Expand
Can psychotherapists function as their own controls? Meta-analysis of the crossed therapist design in comparative psychotherapy trials.
TLDR
Results suggest that researchers strongly allied to a treatment may ignore therapist allegiance, potentially skewing outcomes, and all clinical trials, and especially crossed therapist designs, should measure psychotherapist allegiance to evaluate this possible bias. Expand
A Meta-Analysis of Cognitive-Behavioural Therapy for Adult Depression, Alone and in Comparison with other Treatments
TLDR
There is no doubt that CBT is an effective treatment for adult depression, although the effects may have been overestimated until now. Expand
Is the allegiance effect an epiphenomenon of true efficacy differences between treatments? a meta-analysis.
TLDR
This study does not support the true efficacy hypothesis, which predicted the RA-outcome association to be zero; however, a substantial association was found and was found to be a significant predictor of outcome and explained 12% of the variance in outcomes. Expand
Psychodynamic therapy meets evidence-based medicine: a systematic review using updated criteria.
TLDR
The methodological requirements for proofs of efficacy are described, the evidence for use of PDT to treat mental health disorders is summarized and several meta-analyses suggest PDT is as efficacious as treatments established in efficacy. Expand
...
1
2
3
4
5
...