Does the Modality Effect Exist? and if So, Which Modality Effect?

  title={Does the Modality Effect Exist? and if So, Which Modality Effect?},
  author={Joachim Reinwein},
  journal={Journal of Psycholinguistic Research},
  • Joachim Reinwein
  • Published 1 February 2012
  • Psychology
  • Journal of Psycholinguistic Research
The modality effect is a central issue in multimedia learning [see Mayer (Cambridge University Press, 2005a), for a review]. Sweller’s Cognitive Load Theory (CLT), for example, presumes that an illustrated text is better understood when presented visually rather than orally. The predictive power of CLT lies in how it links in to Baddeley’s (1986) model of working memory and Penney’s (Mem Cognit 17:398–442, 1989) Separate-Streams Hypothesis. Ginns’s (Learn Instr 4:313–331, 2005) recent meta… 

Null Effects of Perceptual Disfluency on Learning Outcomes in a Text-Based Educational Context: a Meta-analysis

Recent research in a text-based educational context has demonstrated a seemingly paradoxical disfluency effect in reading, namely that learning with hard-to-read (disfluent) materials helps learners

Modality Effects Examined by Means of an Online Sentence-Picture Comparison Task.

Are oral sentences accompanied by pictures easier to understand than written sentences accompanied by the same pictures? This question-intensely discussed for more than two decades in educational,

Algorithm Visualization and the Elusive Modality Effect

The findings suggest that the modality effect is difficult to apply reliably and computing educators should not rush to integrate audio into visualizations in expectation of the effect.

Multimedia Design for Learning: An Overview of Reviews With Meta-Meta-Analysis

An overview of systematic reviews that tested the effects of multimedia design on learning or cognitive load found 11 design principles that demonstrated significant, positive, meta-analytic effects on learning and five that significantly improved management of cognitive load.

Picture This: A Review of Research Relating to Narrative Processing by Moving Image Versus Language

It is concluded that verbal narrative generates more diverse responses than moving image narrative, and the possibility of identifying lower level processing mechanisms that might distinguish cognition of the two media is investigated.

Well-Being as a Cognitive Load Reducing Agent: A Review of the Literature

Cognitive Load Theory is an evolutionary based theory of learning centered upon the cognitive architecture of the brain, which outlines a series of empirically based instructional effects that ensure

Using multimedia for e-learning

  • R. Mayer
  • Psychology
    J. Comput. Assist. Learn.
  • 2017
12 research-based principles for how to design computer-based multimedia instructional materials to promote academic learning are reviewed, starting with the multimedia principle, which holds that people learn better from computer- based instruction containing words and graphics rather than words alone.

The modality effect in a mobile learning environment: Learning from spoken text and real objects

Using 58 fifth-grade and sixth-grade elementary school children as participants, this work investigated whether the modality effect can also be found in a mobile learning environment (MLE) on plants' leaf morphology, in which students had to learn by integrating information from text and real plants in the physical environment.

Heterogeneity of research results: New perspectives on psychological science

Replicability of research findings is a key issue in psychology, and has been the subject of considerable discussion by researchers. Replication is crucial to scientific principles, and underpins the



The modality effect: a result of methodology?

It was concluded that the LTM modality effect is less robust than that found in STM and that no modality difference existed in LTM.

Multimedia instructions and cognitive load theory: effects of modality and cueing.

Only a weak cueing effect and even a reverse modality effect have been found, indicating that both effects do not easily generalise to non-laboratory settings.

The role of working memory components in multimedia comprehension

Universite´ Rennes 2, FranceSUMMARYThis article argues that conducting experiments involving the ability to control and even manipulatethe cognitive load in working memory (WM; storage and or

Altering the Modality of Instructions to Facilitate Imagination: Interactions between the Modality and Imagination Effects

Under some conditions, learning is improved by using a dual mode presentation involving for example, visual diagrams and auditory, rather than written text (modality effect). Under other conditions,

The Role of Visual Indicators in Dual Sensory Mode Instruction

Advances in our knowledge of the structure of working memory suggest that under some circumstances, effectively more processing capacity is available to learners if instructional materials use

Meta-Analysis of the Modality Effect.

Does the modality principle hold for different media? A test of the method-affects-learning hypothesis

  • R. Moreno
  • Sociology
    J. Comput. Assist. Learn.
  • 2006
A theoretical framework from which effective instructional methods can be derived is proposed and a set of studies where one method, the modality principle, was tested across different media and found to produce significant learning benefits are reported.

A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory

Students viewed a computer-generated animation depicting the process of lightning formation (Experiment 1) or the operation of a car's braking system (Experiment 2). In each experiment, students

Cognitive processes in children's multimedia text learning

The cognitive processes underlying children's multimedia text learning were studied using a self-paced task and authentic school texts with mostly representational pictures in an elementary school