Can meta-analyses be trusted?

@article{Thompson1991CanMB,
  title={Can meta-analyses be trusted?},
  author={Simon G Thompson and Stuart J Pocock},
  journal={The Lancet},
  year={1991},
  volume={338},
  pages={1127-1130}
}
The enthusiasm for meta-analyses (or overviews) expressed by their proponents is not always shared by the broader medical community. To encourage constructive debate, we adopt a critical perspective on the conduct and interpretation of meta-analysis. We focus particularly on some of the statistical issues, especially heterogeneity between studies, and also on the extrapolation of meta-analysis findings to clinical practice. We conclude that meta-analysis is not an exact statistical science that… Expand
A practical guide to meta-analysis.
TLDR
This work discusses the steps needed to perform a meta-analysis as a guideline for those interested in pursuing this type of research and suggests a thoughtful and well-planned analysis is a valuable tool in providing a high level of evidence. Expand
The logic and role of meta-analysis in clinical research
The term meta-analysis refers to the quantitative combination of data from independent trials. Where the result of such combination is a descriptive summary of the weight of the available evidence,Expand
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
TLDR
This paper distinguishes between the concepts of clinical and statistical heterogeneity and exemplifies the importance of investigating heterogeneity by using published meta-analyses of epidemiological studies of serum cholesterol concentration and clinical trials of its reduction. Expand
Meta-Analysis: A Statistical Method to Integrate Information Provided by Different Studies
Meta-analyses are a supplement to RCTs, which remain the gold standard for evaluating the efficacy of therapeutic interventions, but need to be supplemented by meta-analyses in order to broaden theExpand
Meta-Analysis: Methodology, Utility, and Limitations
TLDR
This article will focus on the components of a properly performed meta-analysis and the many sources of bias inherent in a literature review of this magnitude. Expand
Meta-Analysis
TLDR
Meta-analysis has been employed in many clinical settings to evaluate efficacy and safety of a variety of therapeutic interventions and it is likely that it will continue to have a role in extrapolating data from clinical trials for use in the clinic. Expand
A guide to understanding meta-analysis.
TLDR
The purpose of this commentary is to assist clinicians in understanding meta-analysis as a statistical tool using both published articles and explanations of components of the technique. Expand
The use and misuse of meta‐analysis in clinical medicine
TLDR
In this chapter, it is demonstrated, using data from the literature, how such a study can be carried out and analysed, and what data are needed and some of the statistical methods that can be used are described. Expand
The uses and abuses of meta-analysis.
TLDR
Meta-analysis is a quantitative process of summary and interpretation which involves pooling information from independent studies concerning a single theme in order to draw conclusions and can only be directly applied to a target population when the ' meta-protocol' and 'meta-population' match the target situation in all relevant particulars. Expand
Systematic Reviews and Meta-Analyses in Surgery
TLDR
This chapter provides a structural framework to perform a meta-analysis that guides the clinician on a journey from the identification of the correct clinical question to data analysis and through to producing a structured report and highlights the limitations and pitfalls associated with the meta-analytical technique. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 18 REFERENCES
Meta-analysis in clinical trials.
TLDR
This paper examines eight published reviews each reporting results from several related trials in order to evaluate the efficacy of a certain treatment for a specified medical condition and suggests a simple noniterative procedure for characterizing the distribution of treatment effects in a series of studies. Expand
A general parametric approach to the meta-analysis of randomized clinical trials.
TLDR
A general parametric approach is presented, which utilizes efficient score statistics and Fisher's information, and relates this to different methods suggested by previous authors. Expand
A cohort study of summary reports of controlled trials.
TLDR
The hypotheses that clinical trials would be more likely to be followed by full reports if, on the basis of the information provided in the summary report, the trial was judged to be methodologically sound, the results favored the test treatment, and the sample size was relatively large are tested. Expand
The potential and limitations of meta-analysis.
TLDR
The differing applications and limitations of meta analysis are discussed, with a review of the analytic methods used and the problems and biases encountered. Expand
Publication bias and clinical trials.
TLDR
It appears that nonpublication was primarily a result of failure to write up and submit the trial results rather than rejection of submitted manuscripts, implying the existence of a publication bias of importance both to meta-analysis and the interpretation of statistically significant positive trials. Expand
Publication bias in clinical research
TLDR
The presence of publication bias in a cohort of clinical research studies is confirmed and it is suggested that conclusions based only on a review of published data should be interpreted cautiously, especially for observational studies. Expand
A method for assessing the quality of a randomized control trial.
TLDR
A reasonable standard design and conduct of trials will facilitate the interpretation of those with conflicting results and help in making valid combinations of undersized trials. Expand
Statistical aspects of the analysis of data from retrospective studies of disease.
The role and limitations of retrospective investigations of factors possibly associated with the occurrence of a disease are discussed and their relationship to forward-type studies emphasized.Expand
Confidence intervals rather than P values: estimation rather than hypothesis testing.
TLDR
Some methods of calculating confidence intervals for means and differences between means are given, with similar information for proportions, and the paper also gives suggestions for graphical display. Expand
Perusing the literature: comparison of MEDLINE searching with a perinatal trials database.
TLDR
Efficiency will be best facilitated by authors and editors keeping the MeSH terms used by MEDLINE indexers in mind when they compose titles and abstracts, and by adding new medical subject heading terms (MeSH) such as RANDOM ALLOCATION. Expand
...
1
2
...