An overview of realist evaluation for simulation-based education

@article{Graham2018AnOO,
  title={An overview of realist evaluation for simulation-based education},
  author={A Graham and Sean John McAleer},
  journal={Advances in Simulation},
  year={2018},
  volume={3}
}
This article describes the key features of realist (realistic) evaluation and illustrates their application using, as an example, a simulation-based course for final year medical students. The use of simulation-based education (SBE) is increasing and so too is the evidence supporting its value as a powerful technique which can lead to substantial educational benefits. Accompanying these changes is a call for research into its use to be more theory-driven and to investigate both ‘Did it work… 

Improving the Use of Simulation in Nursing Education: Protocol for a Realist Review

TLDR
This review aims to understand how, why, and in what circumstances the use of simulation affects learning as part of the bachelor’s program in nursing.

Realist Approach: How to Evaluate Complex Interventions and Educational Programs Based on Scientific Methodology

TLDR
An outline of the realist approach is introduced using an inter-professional shadowing program evaluation conducted for medical students at a community hospital as an example and it is the authors’ goal that scientific evaluation applying realist principles be employed in the field of primary care.

A realist evaluation of student use of a virtual reality smartphone application in undergraduate legal education

TLDR
This paper provides a realist evaluation of the Open Justice virtual reality (VR) smartphone app, designed to develop presentation skills for students on an undergraduate legal education module, and provides a detailed example of how realist methodology can be utilised to evaluate educational technology in real-world settings.

P24 So you think you can sim? Realist evaluation of an introductory ENT in-situ simulation

TLDR
A realist evaluation was designed to assess effectiveness of this in-situ simulation and inform future faculty development and it was found the ‘take home messages’ demonstrated that intended learning outcomes were delivered successfully.

Perception of Realism and Acquisition of Clinical Skills in Simulated Pediatric Dentistry Scenarios.

TLDR
This research suggests that the creation of scenarios using handmade mannequins and simulated participants achieves a high level of realism, increasing the level of clinical competence perceived by dental students.

Program evaluation: An educator's portal into academic scholarship

Program evaluation is an “essential responsibility” but is often not seen as a scholarly pursuit. While Boyer expanded what qualifies as educational scholarship, many still need to engage in

The Degree of Knowledge and Use of Authentic Assessment Tools by Basic Elementary Teachers' According to some Variables

Evaluation is one of the most important elements of  teaching process. The recent trends in evaluation and educational reform movements have called for using alternative evaluation, which focuses on

Realist Research in Pharmacy Practice

Research is a creative process and the topic of research methodology particularly realist methods is complex and varied. This chapter is designed to introduce beginners to the basics of realist

A Mixed-Methods Realist Analysis of an Interdisciplinary Simulation Intervention for Psychiatry Residents

TLDR
A mixed-methods realist analysis of an interdisciplinary simulation intervention administered to psychiatry residents identifies possible mechanisms for residents’ self-reported improvements in learning and confidence, which may help programs tailor interventions.

References

SHOWING 1-10 OF 53 REFERENCES

Realist evaluation as a framework for the assessment of teaching about the improvement of care.

TLDR
The unique qualities of the realist evaluation, the basic components and steps in a realists evaluation, and an example that uses this technique to evaluate teaching about improvement of care in a clinical setting are described.

The utility of simulation in medical education: what is the evidence?

TLDR
Multiple studies have demonstrated the effectiveness of simulation in the teaching of basic science and clinical knowledge, procedural skills, teamwork, and communication as well as assessment at the undergraduate and graduate medical education levels.

Simulation and learning in healthcare: moving the field forward

  • N. Sevdalis
  • Medicine
    BMJ Simulation & Technology Enhanced Learning
  • 2014
TLDR
In the past two decades, the field of simulation in healthcare has experienced a dramatic expansion, and simulation has now permeated mainstream general and specialty-specific clinical meetings, such that simulation studies are also regularly presented to clinical audiences at large.

Technology-enhanced simulation for health professions education: a systematic review and meta-analysis.

TLDR
In comparison with no intervention, technology-enhanced simulation training in health professions education is consistently associated with large effects for outcomes of knowledge, skills, and behaviors and moderate effects for patient-related outcomes.

Reporting guidelines for health care simulation research: Extensions to the CONSORT and STROBE statements

TLDR
The quality of reporting in health professions education research is inconsistent and sometimes poor, and failure to adequately describe the key elements of a research study impairs the efforts of editors, reviewers and readers to critically appraise strengths and weaknesses.

Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review

TLDR
While research in this field needs improvement in terms of rigor and quality, high-fidelity medical simulations are educationally effective and simulation-based education complements medical education in patient care settings.

Designing and Conducting Simulation-Based Research

TLDR
This article describes, from a pediatric perspective, the 2 main types of simulation-based research: studies that assess the efficacy of simulation as a training methodology and studies where simulation is used as an investigative methodology.

Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research

TLDR
This review maps how the concepts of realist evaluation are applied in health systems research and which methodological problems are encountered and found a great diversity in the depth of application of the philosophical concepts, use of terminology and scope of application in the research process.

Classifying simulation-based studies using the description, justification and clarification framework: a review of simulation conference abstracts

TLDR
The low proportion of Clarification studies found in the SBME conference abstracts reflects previous findings highlighting the lack of medical education studies that establish how and why SBME works.

Revisiting ‘A critical review of simulation‐based medical education research: 2003–2009’

TLDR
The most cited articles from each 5-year interval were identified and the original authors of one of them were asked to comment on the state of the field at the time of the publication, the impact of the article, and what the authors have learned since then.
...