Meta-analysis and the science of research synthesis

  title={Meta-analysis and the science of research synthesis},
  author={Jessica Gurevitch and Julia Koricheva and Shinichi Nakagawa and Gavin B. Stewart},
Meta-analysis is the quantitative, scientific synthesis of research results. Since the term and modern approaches to research synthesis were first introduced in the 1970s, meta-analysis has had a revolutionary effect in many scientific fields, helping to establish evidence-based practice and to resolve seemingly contradictory research outcomes. At the same time, its implementation has engendered criticism and controversy, in some cases general and others specific to particular disciplines. Here… Expand

Figures and Tables from this paper

The synthesis of scientific shreds of evidence: a critical appraisal on systematic review and meta-analysis methodology.
Systematic reviews and meta-analyses, conducted by subsequent strict protocols to guarantee reproducibility and decrease bias, have become more common in the synthesis of evidence. Expand
Meta-Analysis and Meta-Synthesis Methodologies: Rigorously Piecing Together Research
For a variety of reasons, education research can be difficult to summarize. Varying contexts, designs, levels of quality, measurement challenges, definition of underlying constructs, and treatmentsExpand
The Application of Meta-Analysis in Econometric
Meta-analysis can enhance the statistical efficiency of data processing in academic research, effectively save the cost of scientific research and improve the strength of argumentation. To be able toExpand
Introducing our series: research synthesis and meta-research in biology
The Research Synthesis Series is brought to BMC Biology to promote meta-analyses, other research syntheses including meta-research studies, and research synthesis methodologies in biology, facilitating their dissemination to broader communities. Expand
A practical guide to preclinical systematic review and meta-analysis
The aim of this review is to highlight the exciting possibilities a preclinical systematic review can bring to your research toolkit, and demonstrate the importance of preclinical SRs in generating empirical evidence to aid robust experimental design, inform research strategy, and support funding applications. Expand
The science of evidence synthesis in hematopoietic stem‐cell transplantation: Meta‐analysis and quality assessment
A meta‐analysis is a statistical analysis that combines the results of multiple scientific studies. After being introduced in the 1970s, meta‐analysis significantly influenced decision making in manyExpand
Good Statistical Practices for Contemporary Meta-Analysis: Examples Based on a Systematic Review on COVID-19 in Pregnancy
  • Yuxi Zhao, Lifeng Lin
  • Medicine
  • BioMedInformatics
  • 2021
An overview of select good practices for performing meta-analyses from statistical perspectives is provided, based on a recent systematic review on COVID-19 in pregnancy. Expand
The REPRISE project: protocol for an evaluation of REProducibility and Replicability In Syntheses of Evidence
The REPRISE project takes a systematic approach to determine how reliable systematic reviews of interventions are and aims to explore various aspects relating to the transparency, reproducibility and replicability of several components of systematic reviews with meta-analysis of the effects of health, social, behavioural and educational interventions. Expand
Implications of the open science era for educational psychology research syntheses
Abstract Extensive debate of potentially common, yet questionable research practices that lead to biased findings within social and health sciences has emerged over the last decade. These challengesExpand
Comparison of four heterogeneity measures for meta-analysis.
  • Lifeng Lin
  • Medicine, Mathematics
  • Journal of evaluation in clinical practice
  • 2019
The I2 and R ̂ I statistics are recommended for measuring heterogeneity and meta-analysts should use the heterogeneity measures as descriptive statistics which have intuitive interpretations from the clinical perspective, instead of determining the significance of heterogeneity simply based on their magnitudes. Expand


Making Sense of Meta-Analysis: A Critique of “Effectiveness of Long-Term Psychodynamic Psychotherapy”
Evidence-based practice depends in part on knowledge derived from relevant research. For any given topic, there are likely to be many, potentially relevant studies; a careful appraisal and synthesisExpand
Meta-analysis: synthesizing research findings in ecology and evolution.
The growing number of empirical studies performed in ecology and evolution creates a need for quantitative summaries of research domains to generate higher-order conclusions about general trends andExpand
The meta-analytic big bang.
Why meta-analysis came to be in the 1970s in the social sciences through the work of Gene Glass, Robert Rosenthal, and Frank Schmidt, each of whom developed similar theories of meta- analysis at about the same time is examined. Expand
Synthesizing evidence: shifting the focus from individual studies to the body of evidence.
5 reasons to shift the collective focus from single studies to the accumulating body of evidence are offered. Expand
Methodological issues and advances in biological meta-analysis
It is shown how the marriage between mixed-effects (hierarchical/multilevel) models and phylogenetic comparative methods has resolved most of the issues under discussion and how the use of within-study meta-analysis can improve many empirical studies typical of ecology and evolution. Expand
The Handbook of Research Synthesis and Meta-Analysis
The chapter on stochastically dependent effect sizes by Gleser and Olkin (2009) in The handbook of research synthesis and meta-analysis (2nd ed.) describes. Download Here: WhenExpand
Meta-analysis in ecology
How difficulties resulting from missing data, publication bias, data quality and data exclusion, non-independence among observations, and the combination of dissimilar data sets may affect the perceived utility of meta-analysis in these fields and the soundness of conclusions drawn from its application is examined. Expand
Meta-analysis at middle age: a personal history.
  • G. Glass
  • Computer Science, Medicine
  • Research synthesis methods
  • 2015
The 40-year history of meta-analysis is traced from the vantage point of one of its originators, and some directions for future development of research synthesis methods are suggested. Expand
Relative citation impact of various study designs in the health sciences.
Overall, the citation impact of various study designs is commensurate with most proposed hierarchies of evidence, and meta-analyses received more citations than randomized trials when limited to studies addressing treatment effects. Expand
Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?
Whether exclusion of grey literature, compared with its inclusion in meta-analysis, provides different estimates of the effectiveness of interventions assessed in randomised trials is examined. Expand