New Perspectives on Narrative and Multimodality

This study investigates the richly diverse but integrated semiotic potential of storytelling. Unlike other interdisciplinary approaches to narrative studies which have privileged the study of words in storytelling, this unique collection provides a much needed analysis of how narrative operates using combinations of visual, typographic, aural, gestural and haptic resources. Although both multimodal theory and narrative studies have been invigorated by a variety of theoretical approaches, this volume seeks to avoid a single dominant paradigm. Instead, the contributors use literary criticism, linguistics and new media frameworks in a series of critical studies that are directly engaged with a range of multimodal stories. The contributors analyze works that include oral accounts of personal experience, opera, cartoons, print literature and new media forms of storytelling such as experimental digital fiction and fanfiction.

The contributors in this collection question what kinds of relationships hold between narrative studies and the recently established field of multimodality, evaluate how we might develop an analytical vocabulary which recognizes that stories do not consist of words alone, and demonstrate the ways in which multimodality brings into fresh focus the embodied nature of narrative production and processing. Engaging with a spectrum of multimodal storytelling, from ‘low tech’ examples encompassing face-to-face stories, comic books, printed literature, through to opera, film adaptation and television documentary, stretching beyond to narratives that employ new media such as hypertext, performance art, and interactive museum guides, this volume examines the interplay of semiotic codes (visual, oral, aural, haptic, physiological) within each case under scrutiny, thereby exposing both points of commonality and difference in the range of multimodal narrative experiences.