• Corpus ID: 219966056

ASReview: Open Source Software for Efficient and Transparent Active Learning for Systematic Reviews

  title={ASReview: Open Source Software for Efficient and Transparent Active Learning for Systematic Reviews},
  author={Rens van de Schoot and Jonathan de Bruin and Raoul Schram and Parisa Zahedi and Jan de Boer and Felix Weijdema and Bianca Kramer and Martijn Huijts and Maarten Hoogerwerf and Gerbrich Ferdinands and Albert Harkema and Joukje Willemsen and Yongchao Ma and Qixiang Fang and Lars G Tummers and Daniel L. Oberski},
For many tasks -- including guideline development for medical doctors and systematic reviews for research fields -- the scientific literature needs to be checked systematically. The current practice is that scholars and practitioners screen thousands of studies by hand to find which studies to include in their review. This is error prone and inefficient. We therefore developed an open source machine learning (ML)-aided pipeline: Active learning for Systematic Reviews (ASReview). We show that by… 

Figures and Tables from this paper

An open source machine learning framework for efficient and transparent systematic reviews
An open source machine learning-aided pipeline applying active learning: ASReview is developed and it is demonstrated by means of simulation studies that active learning can yield far more efficient reviewing than manual reviewing while providing high quality.
Open Source Software for Efficient and Transparent Reviews.
An open source machine learning-aided pipeline applying active learning: ASReview is developed and it is demonstrated by means of simulation studies that ASReview can yield far more efficient reviewing than manual reviewing, while providing high quality.
MSˆ2: Multi-Document Summarization of Medical Studies
This work releases MSˆ2 (Multi-Document Summarization of Medical Studies), a dataset of over 470k documents and 20K summaries derived from the scientific literature that facilitates the development of systems that can assess and aggregate contradictory evidence across multiple studies, and is the first large-scale, publicly available multi-document summarization dataset in the biomedical domain.
Text mining approaches for dealing with the rapidly expanding literature on COVID-19
This review discusses the corpora, modeling resources, systems and shared tasks that have been introduced for COVID-19, and lists 39 systems that provide functionality such as search, discovery, visualization and summarization over the CO VID-19 literature.
AI-Assisted Systematic Reviewing: Selecting Studies to Compare Bayesian Versus Frequentist SEM for Small Sample Sizes
A systematic review to characterize the performance of Bayesian and frequentist estimation for SEM with small sample sizes found that frequentist estimates outperform Bayesian estimates when the sample size is small.
Targeted optical fluorescence imaging: a meta-narrative review and future perspectives
An overview of the current status of targeted optical fluorescence imaging in the field of oncology, cardiovascular, infectious and inflammatory diseases to further promote clinical translation and a meta-narrative approach was taken to systematically describe the relevant literature.
Harnessing the Power of Smart and Connected Health to Tackle COVID-19: IoT, AI, Robotics, and Blockchain for a Better World
Several complementary and multidisciplinary techniques to combat COVID-19 are proposed, which offer opportunities for more holistic studies, and accelerate knowledge acquisition and scientific discoveries in pandemic research.
Parent-Child Play and the Emergence of Externalizing and Internalizing Behavior Problems in Childhood: A Systematic Review
It has widely been accepted that play has a major role in human development. The play situation is considered a save and controlled space in which children can learn to express their problems and to


Finding better active learners for faster literature reviews
This paper finds and implements FASTREAD, a faster technique for studying a large corpus of documents, combining and parametrizing the most efficient active learning algorithms.
Toward systematic review automation: a practical guide to using machine learning tools in research synthesis
An overview of current machine learning methods that have been proposed to expedite evidence synthesis is provided, including which of these are ready for use, their strengths and weaknesses, and how a systematic review team might go about using them in practice.
Semi-automated screening of biomedical citations for systematic reviews
A semi-automated citation screening algorithm for systematic reviews has the potential to substantially reduce the number of citations reviewers have to manually screen, without compromising the quality and comprehensiveness of the review.
Technology-assisted title and abstract screening for systematic reviews: a retrospective evaluation of the Abstrackr machine learning tool
Abstrackr’s reliability and the workload savings varied by screening task, and how this might affect the results and conclusions of SRs needs to be evaluated.
Viewpoint Paper: Towards Automatic Recognition of Scientifically Rigorous Clinical Research Evidence
The results demonstrate that a high quality gold standard and advanced classification methods can help clinicians acquire best evidence from the medical literature.
Software tools to support title and abstract screening for systematic reviews in healthcare: an evaluation
Covidence and Rayyan are recommended to systematic reviewers looking for suitable and easy to use tools to support T&Ab screening within healthcare research because they consistently demonstrated good alignment with user requirements.
Prioritising references for systematic reviews with RobotAnalyst: A user study
This is the first large‐scale study using technology‐assisted screening to perform new reviews, and the positive results provide empirical evidence that RobotAnalyst can accelerate the identification of relevant studies.
Using text mining for study identification in systematic reviews: a systematic review of current approaches
Using text mining to prioritise the order in which items are screened should be considered safe and ready for use in ‘live’ reviews, and the use of text mining as a ‘second screener’ may also be used cautiously.
Error rates of human reviewers during abstract screening in systematic reviews
To determine citation false inclusion and false exclusion rates during abstract screening by pairs of independent reviewers, this study identified all systematic reviews conducted between 2010 and 2017 by an evidence-based practice center in the United States.
Research Paper: Reducing Workload in Systematic Review Preparation Using Automated Citation Classification
Whether automated classification of document citations can be useful in reducing the time spent by experts reviewing journal articles for inclusion in updating systematic reviews of drug class efficacy for treatment of disease is investigated.