Locating the Semiotic Power of Multimodality
@article{Hull2005LocatingTS, title={Locating the Semiotic Power of Multimodality}, author={Glynda Hull and Mark Evan Nelson}, journal={Written Communication}, year={2005}, volume={22}, pages={224 - 261} }
This article reports research that attempts to characterize what is powerful about digital multimodal texts. Building from recent theoretical work on understanding the workings and implications of multimodal communication, the authors call for a continuing empirical investigation into the roles that digital multimodal texts play in real-world contexts, and they offer one example of how such investigations might be approached. Drawing on data from the practice of multimedia digital storytelling…
647 Citations
Multimodal Synthesis and the Voice of the Multimedia Author in a Japanese EFL Context
- Art
- 2008
It is argued that in the current semiotic climate, characterised by the increasing availability and complexity of communication tools and ready appropriation of available designs, practices of multimedia authorship truly can evince expression that is authentically multiplicative.
MODE, MEANING, AND SYNAESTHESIA IN MULTIMEDIA L2 WRITING
- Art
- 2006
This study of digital storytelling attempts to apply Kress's (2003) notions of synaesthesia, transformation, and transduction to the analysis of four undergraduate L2 writers' multimedia text creation processes to show how synaesthetically derived meaning may be a natural part of the process of creating multimodal texts.
Challenges of Multimedia Self-Presentation
- Art
- 2008
One privilege enjoyed by new-media authors is the opportunity to realize representations of Self that are rich textual worlds in themselves and also to engage the wider world, with a voice, a smile,…
Beyond elocution: Multimodal narrative discourse analysis of L2 storytelling
- SociologyReCALL
- 2018
Abstract Drawing upon research on narrative and speech styles and on digital and multimodal communication, the author proposes multimodal narrative discourse analysis (MNDA) with associated…
The intersection of multimodality and critical perspective: Multimodality as subversion
- Sociology
- 2015
The findings reveal that, on the one hand, the students were able to identify the power relations between characters as well as how particular characters are marginalized in the media texts they viewed by paying attention to the multiple modes that make up the text’s representation.
mStories: exploring semiotics and praxis of user-generated mobile stories
- Computer Science
- 2014
A semiotic analysis found that the user-generated content demonstrated complex and sophisticated multimodal sense relations, but control over the textual or compositional meta-function of the text was determined largely by the computer interface, with users habituated to relinquishing authorial control over this element.
Empowering the point: Pains and gains of a writer's traversals between print-based writing and multimodal composing
- EducationLinguistics and Education
- 2019
Developing Voice in Digital Storytelling Through Creativity, Narrative and Multimodality
- ArtSeminar.net
- 2010
For Simon, who is nine years old, reading and writing are obstacles rather than tools. However, when offered the opportunity to create digital stories, Simon becomes deeply engaged. He creates…
The sliding of the signified: multimodal sign operations in a youth-created experimental digital video
- Sociology
- 2018
This study offers conceptualizations of multimodal discursive units that can be used to interpret and analyze the interactions of visual and spoken signifiers in films and digital videos.
Drawing bodies and spaces in telecollaboration: a view of research potential in synaesthesia and multimodality, from the outside
- Art
- 2014
While much scholarship on the multisensory and transmodal phenomenon of synaesthesia seeks to uncover its psychophysiological and neurological bases, recent research in multimodal literacy and…
References
SHOWING 1-10 OF 92 REFERENCES
Expanding the web of meaning: Thought and emotion in an intergenerational reading and writing program
- Psychology
- 2004
This study explores informants' experiences in a reading/writing program that paired eighth-grade language arts students with elderly volunteers. Twenty-three pairs were followed over an academic…
Discourses of Power, The Dialectics of Understanding, The Power of Literacy *
- Psychology
- 1983
The study of literacy has recently been made a major focus of attention in socio-, psycho-, and anthropological linguistics. Our understanding of how literacy affects both consciousness and social…
Travels in hypermodality
- Art
- 2002
A semiotic scheme for the analysis of composite verbal-visual meanings and some discussions of the semiotic politics of visual communication in hypermedia design are offered.
A pedagogy of Multiliteracies Designing Social Futures
- Education
- 1996
THE NEW LONDON GROUP 1 In this article, the New London Group presents a theoretical overoiew of the connec tions between the changing social environment facing students and teachers and a new…
The Social construction of literacy
- Education
- 1986
This book presents a social perspective on literacy and on its acquisition. The term 'literacy' is notoriously vague, and in the opening chapter of this collection, Jenny Cook-Gumperz examines the…
Forms of talk
- Sociology
- 1981
Forms of Talk extends Erving Goffman's interactional analyses of face-to-face communication to ordinary conversations and vebal exchanges. In this, his most sociolinguistic work, Goffman relates to…
Literacy in the New Media Age
- Art
- 2003
The futures of literacy: modes, logics and affordances, Literacy and multimodality: a theoretical framework, and some items for an agenda of further thinking.
Understanding Media: The Extensions of Man
- Art
- 1964
This reissue of Understanding Media marks the thirtieth anniversary (1964-1994) of Marshall McLuhan's classic expose on the state of the then emerging phenomenon of mass media. Terms and phrases such…
Handbook of Literacy and Technology : Transformations in A Post-typographic World
- Education
- 1998
This chapter discusses the transformation of Literacy in a Post-Typographic World through the design of new technologies for Literacy and Learning in Teachers' Instructional Needs and the role of technology in this transformation.