Multimodal pedagogy

Last updated
Chart using the five modes of communication to explain multimodality. Multimodality chart.png
Chart using the five modes of communication to explain multimodality.

Multimodal pedagogy is an approach to the teaching of writing that implements different modes of communication. [1] [2] Multimodality refers to the use of visual, aural, linguistic, spatial, and gestural modes in differing pieces of media, each necessary to properly convey the information it presents. [3] [4]

Contents

The visual mode conveys meaning via images and the visible elements of a text such as typography and color. The aural mode refers to sound in the form of music, sound effects, silence, etc. The linguistic mode includes written and spoken language. The spatial mode focuses on the physical arrangement of elements in a text. The gestural mode refers to physical movements such facial expressions and how these are interpreted. A multimodal text is characterized by the combination of any two or more modes to express meaning. [5]

Multimodality as a term was coined in the late 20th century, [6] but its use predates its naming, with it being used as early as Egyptian hieroglyphs and classical rhetoric. [7] Compositionists and writing theorists have been exploring how the five modes of communication interact with each other and how multimodality can be used in the teaching of writing since the 20th century. [8]

Multimodal pedagogy encourages the use of these modes as teaching tools in the classroom to facilitate learning. Although lack of experience with new technologies and limited access to resources can make multimodal instruction difficult for teachers, [9] it is important for students to learn to interpret and create meaning across multiple modes of communication in order to navigate a multimodal world. [10]

Background

Some compositionists, such as Jason Palmeri, have suggested that writing has always been multimodal, with writing always containing different modes, such as visual, aural, spatial, and gestural. [8] Multimodal pedagogy in that sense has existed since before multimodality was properly named in the mid-1990s. [6]

The School of Athens by Raphael portrays Ancient Greek rhetoricians Aristotle and Plato. The School of Athens Fresco by Raphael (Ank Kumar, Infosys Limited) 02.jpg
The School of Athens by Raphael portrays Ancient Greek rhetoricians Aristotle and Plato.

Rhetoric began as the art of oral persuasion, and classical rhetoric was always meant to be delivered via voice. [11] In the 1960s, auditory art as it related to writing pedagogy began to be studied by compositionists. [8] In his article “What Do We Mean When We Talk about Voice in Texts?” Peter Elbow introduced his audible voice theory. Elbow’s theory posits that words are multimodal and that readers experience sound in their heads even as they read silently. Audible voice theory argues that reading out loud lets writers understand how voice plays a part in writing and how text sounds to others. This understanding of speech can then improve understanding of communication and writing. [12]

In the 1970s, the Process Theory of Composition focused on writing as a process. Linda Flower and John Hayes studied problem finding and solving, and argued this was a creative cognitive activity that writing and art had in common. [13] Flower and Hayes also argue that writing is multimodal thinking, because writers don’t think in just words. Writing includes the forming of ideas, creation of organization and rhetorical goals, and experiencing the world through our senses. [13]

Kathleen Blake Yancey contends that literacy “is in the midst of tectonic change” and that technology has resulted in an increase in multimodal genres in writing. [14] In one of the National Council of Teachers of English's position statements, they state that all texts are multimodal, and that composing as a whole has changed as a result of technology and its advances. [15] The NCTE asserts that multimodality should be part of definitions for composition and that excluding multimodality is outdated. [15]

Currently, print based literacy has undergone a transformation into hyphenated, plural or multiple literacies, acknowledging the diversity of media and information sources. Both technology and literacy are not mutually exclusive, now existing as a merged vocabulary used in current educational debates. [16] Instructional practices, reading, learning, writing and literacy practices as a whole are being transformed, causing concern amongst teachers and educational educators, to be mediated by microcomputers, the Internet and educational software. The process of reading and writing has shifted, even though the core principles have not, going from print text into multimodal text-image information. [16]

Teachers understand that multimodality composition assignments provide students with valuable opportunities to build their rhetoric skills. An example is an assignment that challenges students to "translate" a text based ethnography to a photo essay, which can cause a change to research ethics. [17] In various scenarios are students able to build the following skills: to properly consider the forms of communication required in every given circumstance, to select resources and materials that will aid in the creation of an effective text, must consider the audience and meet the objectives in correspondence to them, have the finished text be and avenue for improved communication, and to have the text influence positive action. [17]

Goals

Multimodal pedagogy aims to help students express themselves more accurately within their work. This approach allows students to engage deeply with their learning process, possibly increasing their investment in their work by identifying the modes that best suit their subject or personal preferences. [18] With the different kinds of multimodal texts, it allows students to look at other forms of media with the thought of multimodality. Students' individual processing of texts shows different ways of understanding and using multimodality in learning. [18]

Students have four primary learning styles: visual, auditory, reading/writing, and kinesthetic, each with specific sources of learning. [19] Visual learners are those that get their learning from anything that stimulates their eyes. They primarily use infographics, videos, and illustrations as their source of learning. Aural learners like to use anything they can simply listen to in order to take in information. Their sources of learning mainly come from podcasts, an audiobook, and group discussions. Reading and writing is the most traditional form of multimodal learning. These learners use documents, books, and PDF’s as their primary sources. Lastly, kinesthetic learning is one that gets its learners active. It commonly uses multiple learning types together at once. The main ways of learning are through demonstrations and multimedia presentations. [19]

Multimodal pedagogy aids in enhancing students' comprehension of topics and issues by allowing them to explore information from various perspectives through different modes. [18]

Application to the college writing classroom

Multimodal pedagogy can be applied in many different areas within the college writing classroom. Assignments that incorporate the multimodal modes of communication (visual, spatial, gestural, audio, and linguistic) [3] [4] encourage students to think about which method communicates ideas and information in the most efficient way. [20] Technological advances have facilitated access to and creation of new learning materials for students, and multimodal pedagogy makes use of these innovations. [20]

Students who have a harder time engaging with traditional teaching methods may engage better with multimodal materials. Assignments that use multiple modes of communication increase learning and comprehension skills. [20] In addition, multimodal pedagogy allows for the development of multiliteracy skills and modal adaptability using a creative approach. [4]

Multimodal pedagogy can be implemented into required and supplementary learning materials in the form of podcasts, video essays, infographics, or graphic novels (to name a few). [21]

Podcasts help the students learn the importance is lingual communication, which incorporates word choice, tone of delivery, and organization of phrases and ideas. [22] It also teaches the importance of audio — music, sound effects, ambient noise, silence, and volume — when it comes to conveying information. [22]

Zines are one type of multimodal projects created by students. Zine workshop with the SUNY New Paltz Zine Community and Design Society .png
Zines are one type of multimodal projects created by students.

Graphic novels exemplify the use of the visual communication mode, utilizing color, layout, style, size, and perspective to convey a story or message. [23] The use of visual and graphic novels in the college writing classroom can increase engagement in the material whilst promoting Visual Literacy. [23] Illustrations strengthen information by depicting its content or supplementing it, as seen in The Fragile Framework, an academic comic book published by The International Weekly Journal of Science 'NATURE'. [24]

Zines allow students to engage in multimodal text creation in way that is accessible and inexpensive. Students are able to cut and paste images and text into pamphlet pages requiring that they make choices regarding the visual, linguistic, and spatial aspects of the text and examine these modes in relation to another. [25]

Educational institutions have implemented multimodal pedagogy directly through curriculum design. [10] Universities such as Iowa State and Georgia Tech use a WOVE curriculum in their composition courses. The acronym stands for written, oral, visual, and electronic communication. This curriculum recognizes the interconnectedness of these communicative modes and is designed to prepare students with a range of literacy skills that extends across multiple modes and media. [26]

Challenges

Inexperience with new media poses a challenge for teachers in multimodal classrooms. [9] Some teachers, such as Bremen Vance of Iowa State University, express anxiety and discomfort in incorporating new modes and technologies as they lack the skills to confidently engage with these, let alone guide students in their engagement. [26] The rapid development of new media available to teachers further complicates the task of staying up to date and equipped with the skills to utilize these. While the multimodal pedagogical approach has expanded what qualifies as writing and how teachers can go about its instruction, thorough knowledge and planning is required in order to be effectively implemented. [10] Writing instructors need to be able to contextualize their use of multimodal texts and lead students to rhetorically analyze how these create meaning. [9]

Lack of resources has limited the ability of public school teachers to integrate new technologies that facilitate multimodal learning in their classrooms. Often times, they are forced to resort to older technologies and poorly functioning equipment such as overhead projectors and art supplies. [10]

Related Research Articles

A teaching method is a set of principles and methods used by teachers to enable student learning. These strategies are determined partly on subject matter to be taught, partly by the relative expertise of the learners, and partly by constraints caused by the learning environment. For a particular teaching method to be appropriate and efficient it has take into account the learner, the nature of the subject matter, and the type of learning it is supposed to bring about.

A graphic organizer, also known as a knowledge map, concept map, story map, cognitive organizer, advance organizer, or concept diagram, is a pedagogical tool that uses visual symbols to express knowledge and concepts through relationships between them. The main purpose of a graphic organizer is to provide a visual aid to facilitate learning and instruction.

Computers and writing is a sub-field of college English studies about how computers and digital technologies affect literacy and the writing process. The range of inquiry in this field is broad including discussions on ethics when using computers in writing programs, how discourse can be produced through technologies, software development, and computer-aided literacy instruction. Some topics include hypertext theory, visual rhetoric, multimedia authoring, distance learning, digital rhetoric, usability studies, the patterns of online communities, how various media change reading and writing practices, textual conventions, and genres. Other topics examine social or critical issues in computer technology and literacy, such as the issues of the "digital divide", equitable access to computer-writing resources, and critical technological literacies. Many studies by scientists have shown that writing on computer is better than writing in a book

<span class="mw-page-title-main">Digital rhetoric</span> Forms of communication via digital mediums

Digital rhetoric can be generally defined as communication that exists in the digital sphere. As such, digital rhetoric can be expressed in many different forms, including text, images, videos, and software. Due to the increasingly mediated nature of our contemporary society, there are no longer clear distinctions between digital and non-digital environments. This has expanded the scope of digital rhetoric to account for the increased fluidity with which humans interact with technology.

<span class="mw-page-title-main">Composition studies</span>

Composition studies is the professional field of writing, research, and instruction, focusing especially on writing at the college level in the United States.

<span class="mw-page-title-main">First-year composition</span> Introductory core curriculum writing course in US colleges and universities

First-year composition is an introductory core curriculum writing course in US colleges and universities. This course focuses on improving students' abilities to write in a university setting and introduces students to writing practices in the disciplines and professions. These courses are traditionally required of incoming students, thus the previous name, "Freshman Composition." Scholars working within the field of composition studies often have teaching first-year composition (FYC) courses as the practical focus of their scholarly work.

Commonly called new media theory or media-centered theory of composition, stems from the rise of computers as word processing tools. Media theorists now also examine the rhetorical strengths and weakness of different media, and the implications these have for literacy, author, and reader.

The cultural studies theory of composition is a field of composition studies that examines both writing as an artifact of culture and the contexts of writing situations. It also examines what happens to writing when cultures come into contact with each other, situations often referred to as "contact zones".

English studies is an academic discipline taught in primary, secondary, and post-secondary education in English-speaking countries. This is not to be confused with English taught as a foreign language, which is a distinct discipline. The English studies discipline involves the study, analysis, and exploration of English literature through texts.

Learning Through Art is an educational program of the Solomon R. Guggenheim Museum. LTA pairs practicing artists with participating public elementary school classrooms throughout the five boroughs of New York City. These resident artists spend one day a week for a period of 10 or 20 weeks working with classroom instructors to create and execute an art curriculum for the students that ties in with current Guggenheim exhibitions and supports the core curriculum learning inside of the classroom. Participating classrooms visit the Guggenheim multiple times throughout the duration of their program, and student artwork is shown in a culminating exhibition at the Guggenheim Museum in their annual A Year With Children showcase.

Multiliteracy is an approach to literacy theory and pedagogy coined in the mid-1990s by the New London Group. The approach is characterized by two key aspects of literacy – linguistic diversity and multimodal forms of linguistic expressions and representation. It was coined in response to two major changes in the globalized environment. One such change was the growing linguistic and cultural diversity due to increased transnational migration. The second major change was the proliferation of new mediums of communication due to advancement in communication technologies e.g the internet, multimedia, and digital media. As a scholarly approach, multiliteracy focuses on the new "literacy" that is developing in response to the changes in the way people communicate globally due to technological shifts and the interplay between different cultures and languages.

A significant construct in language learning research, identity is defined as "how a person understands his or her relationship to the world, how that relationship is structured across time and space, and how the person understands possibilities for the future". Recognizing language as a social practice, identity highlights how language constructs and is constructed by a variety of relationships. Because of the diverse positions from which language learners can participate in social life, identity is theorized as multiple, subject to change, and a site of struggle.

Efforts to teach writing in the United States at a national scale using methods other than direct teacher–student tutorial were first implemented in the 19th century. The positive association between students' development of the ability to use writing to refine and synthesize their thinking and their performance in other disciplines is well-documented.

A dialogue journal is an ongoing written interaction between two people to exchange experiences, ideas, knowledge or reflections. It is used most often in education as a means of sustained written interaction between students and teachers at all education levels. It can be used to promote second language learning and learning in all areas.

<span class="mw-page-title-main">Visual rhetoric and composition</span>

The study and practice of visual rhetoric took a more prominent role in the field of composition studies towards the end of the twentieth century and onward. Proponents of its inclusion in composition typically point to the increasingly visual nature of society, and the increasing presence of visual texts. Literacy, they argue, can no longer be limited only to written text and must also include an understanding of the visual.

<span class="mw-page-title-main">Multimodality</span> Phenomenon of human communication having different forms that combine

Multimodality is the application of multiple literacies within one medium. Multiple literacies or "modes" contribute to an audience's understanding of a composition. Everything from the placement of images to the organization of the content to the method of delivery creates meaning. This is the result of a shift from isolated text being relied on as the primary source of communication, to the image being utilized more frequently in the digital age. Multimodality describes communication practices in terms of the textual, aural, linguistic, spatial, and visual resources used to compose messages.

Translanguaging is a term that can refer to different aspects of multilingualism. It can describe the way bilinguals and multilinguals use their linguistic resources to make sense of and interact with the world around them. It can also refer to a pedagogical approach that utilizes more than one language within a classroom lesson. The term "translanguaging" was coined in the 1980s by Cen Williams in his unpublished thesis titled “An Evaluation of Teaching and Learning Methods in the Context of Bilingual Secondary Education.” Williams used the term to describe the practice of using two languages in the same lesson, which differed from many previous methods of bilingual education that tried to separate languages by class, time, or day. In addition, Vogel and Garcia argued that translanguaging theory posits that rather than possessing two or more autonomous language systems, as previously thought when scholars described bilingual or multilingual speakers, bilinguals and multilingual speakers select and deploy their languages from a unitary linguistic repertoire. However, the dissemination of the term, and of the related concept, gained traction decades later due in part to published research by Ofelia García, among others. In this context, translanguaging is an extension of the concept of languaging, the discursive practices of language speakers, but with the additional feature of using multiple languages, often simultaneously. It is a dynamic process in which multilingual speakers navigate complex social and cognitive demands through strategic employment of multiple languages.

<span class="mw-page-title-main">Kathleen Blake Yancey</span>

Kathleen Blake Yancey is the Kellogg W. Hunt Professor of English at Florida State University in the rhetoric and composition program. Her research interests include composition studies, writing knowledge, creative non-fiction, and writing assessment.

<span class="mw-page-title-main">Digital media in education</span>

Digital Media in education is measured by a person's ability to access, analyze, evaluate, and produce media content and communication in a variety of forms. These media may involve incorporating multiple digital softwares, devices, and platforms as a tool for learning. The use of digital media in education is growing rapidly in today's age, competing with books for the leading form of communication. This form of education is slowly combating the traditional forms of education that have been around for a long time. With the introduction of virtual education, there has been a need for more incorporation of new digital platforms in online classrooms.

Musical literacy is the reading, writing, and playing of music, as well an understanding of cultural practice and historical and social contexts.

References

  1. ↑ Sanders, Jennifer; Albers, Peggy (2010). "Multimodal Literacies: An Introduction". Literacies, the Arts, and Multimodality. NCTE. ISBN   978-0814132142.
  2. ↑ Halliday, M.A.K. (2004). An Introduction to Functional Grammar (3rd ed.). Hodder Education Publishers. ISBN   978-0340761670.
  3. 1 2 Murray, Joddy (2014). "Composing Multimodality". In Lutkewitte, Claire (ed.). Multimodal Composition: A Critical Sourcebook (1st ed.). Bedford/St. Martin's. ISBN   978-1457615498.
  4. 1 2 3 GRAPIN, SCOTT (2019). "Multimodality in the New Content Standards Era: Implications for English Learners". TESOL Quarterly. 53 (1): 30–55. ISSN   0039-8322.
  5. ↑ Varaporn, Savika; Sitthitikul, Pragasit (April 2019). "Effects of multimodal tasks on students' critical reading ability and perceptions" (PDF). Reading in a Foreign Language. 31 (1): 81–108.
  6. 1 2 Jewitt, Carey; Bezemer, Jeff; O'Halloran, Kay (2016). Introducing Multimodality (1st ed.). Routledge. ISBN   978-0415639262.
  7. ↑ Welch, Kathleen E.; Barrett, Edward (1999). Electric Rhetoric: Classical Rhetoric, Oral ism, and a New Literacy. The MIT Press. ISBN   978-0262519472.
  8. 1 2 3 Palmeri, Jason (2012). Remixing Composition: A History of Multimodal Writing Pedagogy. Southern Illinois University Press. ISBN   978-0-8093-3089-8. OCLC   1039082032.
  9. 1 2 3 Ryan, Josephine; Scott, Anne; Walsh, Maureen (August 2010). "Pedagogy in the multimodal classroom: an analysis of the challenges and opportunities for teachers". Teachers and Teaching. 16 (4): 477–489. doi:10.1080/13540601003754871. ISSN   1354-0602.
  10. 1 2 3 4 Albers, Peggy (2006). "Imagining the Possibilities in Multimodal Curriculum Design". English Education. 38 (2): 75–101. ISSN   0007-8204.
  11. ↑ Corbett, Edward P.J. (1967). "A New Look at Old Rhetoric". In Gorell, Robert M. (ed.). Rhetoric: Theories for Application. Champaign, IL: NCTE. ISBN   978-0814141373.
  12. ↑ Elbow, Peter (1994). What Do We Mean When We Talk about Voice in Texts?. Urbana, IL: NCTE. ISBN   978-0814156346.
  13. 1 2 Flower, Linda; Hayes, John R. (1980). "The Cognition of Discovery: Defining a Rhetorical Problem". College Composition and Communication. 31 (1): 21–32. doi:10.2307/356630. ISSN   0010-096X.
  14. ↑ Yancey, Kathleen Blake (2004). "Made Not Only in Words: Composition in a New Key". College Composition and Communication. 56 (2).
  15. 1 2 "Professional Knowledge for the Teaching of Writing". National Council of Teachers of English. Retrieved 2023-04-13.
  16. 1 2 Luke, Carmen (2003). "Pedagogy, Connectivity, Multimodality, and Interdisciplinarity". Reading Research Quarterly. 38 (3): 397–403. ISSN   0034-0553.
  17. 1 2 "Teaching Multimodal Composition | U-M LSA Sweetland Center for Writing". lsa.umich.edu. Retrieved 2023-04-13.
  18. 1 2 3 Bridging the Multimodal Gap: From Theory to Practice. University Press of Colorado. 2019. ISBN   978-1-60732-796-7.
  19. 1 2 Caroline (2019-10-24). "Multimodal Learning: Engaging Your Learner's Senses". LearnUpon. Retrieved 2023-04-13.
  20. 1 2 3 Arms, Valarie M. (2012). "Hybrids, Multi-modalities and Engaged Learners: A Composition Program for the Twenty-First Century". Rocky Mountain Review. 66 (2): 194–211. ISSN   1948-2825.
  21. ↑ Bouchey, Bettyjo; Castek, Jill; Thygeson, John (2021), Ryoo, Jungwoo; Winkelmann, Kurt (eds.), "Multimodal Learning", Innovative Learning Environments in STEM Higher Education: Opportunities, Challenges, and Looking Forward, Cham: Springer International Publishing, pp. 35–54, doi:10.1007/978-3-030-58948-6_3, ISBN   978-3-030-58948-6 , retrieved 2024-03-28
  22. 1 2 "Adapting the Framework: Podcasts | U-M LSA Sweetland Center for Writing". lsa.umich.edu. Retrieved 2023-04-13.
  23. 1 2 Dallacqua, Ashley K. (2012). "Exploring Literary Devices in Graphic Novels". Language Arts. 89 (6): 365–378. ISSN   0360-9170.
  24. ↑ Monastersky, Richard; Sousanis, Nick (2015-11-01). "The fragile framework". Nature. 527 (7579): 427–435. doi: 10.1038/527427a . ISSN   1476-4687.
  25. ↑ Buchanan, Rebekah (2012). "Zines in the Classroom: Reading Culture". The English Journal. 102 (2): 71–77. ISSN   0013-8274.
  26. 1 2 Vance, Bremen (2017). "No Teacher is an Island: Strategies for Enacting Multimodal Pedagogies". The CEA Forum . 46 (2): 127–140 – via MLA International Bibliography.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.