Locating the semiotic power of multimodality

被引:318
作者
Hull, GA [1 ]
Nelson, ME [1 ]
机构
[1] Univ Calif Berkeley, Grad Sch Educ, Berkeley, CA 94720 USA
关键词
multimodal texts; semiotics; multiliteracies; New London Group; multimedia; digital stories;
D O I
10.1177/0741088304274170
中图分类号
G2 [信息与知识传播];
学科分类号
05 ; 0503 ;
摘要
This article reports reearch that attempts to characterize what is powerful about digital multimodal texts. Building from recent theoretical work on understanding the workings and implications of multimodal communication, the authors call for a continuing empirical investigation into the roles that digital multimodal texts play in real-world contexts, and they offer one example of how such investigations might be approached. Drawing on data from the practice of multimedia digital storytelling, specifically a piece titled "Lyfe-N-Rhyme," created by Oakland, California, artist Randy Young (accessible at http://www.oaklanddusty.org/videos.php), the authors detail the method and results of a finegrained multimodal analysis, revealing semiotic relationships between and among different, copresent modes. It is in these relationships, the authors argue, that the expressive power of multimodality resides. © 2005 Sage Publications.
引用
收藏
页码:224 / 261
页数:38
相关论文
共 52 条
  • [1] [Anonymous], SOCIAL CONSTRUCTION
  • [2] [Anonymous], READING SCI
  • [3] [Anonymous], SELECTED PHILOS WRIT
  • [4] [Anonymous], 2004, READ RISK SURV LIT R
  • [5] [Anonymous], 2003, NEGL R NEED WRIT REV
  • [6] [Anonymous], 2003, LIT NEW MEDIA AGE
  • [7] [Anonymous], LIT THEORY PRACTICE
  • [8] [Anonymous], 2006, Beautiful evidence
  • [9] [Anonymous], DISCOURSE SOCIAL POW
  • [10] BENNETT AT, 1991, REWRITING LIT CULTUR, P13