DEVELOPMENT OF STUDENTS’ MULTIMODAL LITERACY IN FOREIGN LANGUAGE CLASSES IN HIGHER EDUCATION INSTITUTIONS

Keywords: mode of expression, polycode discourse, materiality, conciseness, semioticity.

Abstract

Improving education quality level and increasing the higher education students’ motivation requires to transfer a monomodal (monocodal) way of gaining knowledge into a multimodal (multicode) format of educational and teaching methods. The current polycode nature of education is accompanied by the permanent development of multimedia technologies, which leads to a new understanding of what it means to be literate. There is a need to study the basics of multimodal literacy – the ability to understand and produce language using different modes of expression. The article is devoted to the issue of intensification the multimodal literacy teaching in foreign language classes in higher education institutions. The scientific investigation considers the Ukrainian and foreign scientists latest research. The article identifies specific qualities of the creolized text (materiality, conciseness, semioticity), the work on the improvement of which ensures high efficiency of polycode perception and production. Materiality is realized through the two-dimensional functioning of interactive signs (syntagmatic and paradigmatic), as well as through the transformation and integration of signs into various modes of expression. The conciseness of the multimodal text simultaneously contributes to its reduction and increase of volume. Semioticity is manifested through the qualitative perception and use of paralingual and extralingual elements of discourse both separately and in their interaction. The article examines the benefits of multimodal format for the development of students' sociocultural competence. The study demonstrates that the multimodal content is effectively implemented through cultural and social examples of language interaction. The study offers a detailed consideration of content and structural aspects of the methodology for developing students' multimodal literacy in foreign language classes in higher education institutions. It was determined that the choice of a method for working with a multimodal text depends on its content. Theoretical materials in a multicode format contribute to highquality understanding and memorization. Fiction style, previously presented monomodally, becomes an effective tool for creating own multimodal product. Universal content in a colloquial or journalistic style allows to develop multimodal literacy at all stages: perception, analysis, partial modeling and full production of polycode text. Content analysis serves as the basis for determining a methodologically appropriate methods for work in a foreign language class. It has been proven that the qualitative development of multimodal literacy includes the development of skills to perceive and produce semiotic (lingual, paralingual) and sensory-perceptual signs, integrate them into various materials, and concisely convey them through polycode means of expression. The creation of methodological tools for the development of such literacy takes into account the content and structural aspects of multimodal text.

References

1. Крекотень О. В. Використання іншомовних мультимодальних текстів в університеті технологічного профілю. Педагогіка формування творчої особистості у вищій і загальноосвітній школах 2021 р., № 76, Т. 2. С. 93–97 DOI https://doi.org/10.32840/1992-5786.2021.76-2.16
2. Лещенко Т. О., Жовнір М. М., Юфименко В. Г. Навчальний текст як мультимодальний лінгвовізуальний феномен: цілісність, зв’язність, інформативність. Теорія і методика професійної освіти. Випуск 47. 2022. С. 185–190
3. Adami, Elisabetta (2013) A social semiotic multimodal analysis framework for website interactivity. NCRM Working Paper. NCRM, London, UK. https://eprints.ncrm. ac.uk/id/eprint/3074/4/website_interactivity_Adami.pdf
4. Ajayi, L. (2009), English as a Second Language Learners' Exploration of Multimodal Texts in a Junior High School. Journal of Adolescent & Adult Literacy, 52: 585-595. https:// doi.org/10.1598/JAAL.52.7.4
5. Albers, P., & Sanders, J.L. (2010). Multimodal literacies : An introduction. In Sanders, J. Albers, P. (Eds.), literacies, the arts and multimodality (pp. 1-25).
6. Chenkai Chi, Sefton T.(2020) The creation of multimodal texts of adult English language learners in a Canadian universitt. A case study. Educational Role of Language Journal. Volume 2020-2(4). (Re-)Shaping One’s Identity with Language, pp. 100-114. DOI: https://doi.org/10.36534/erlj.2020.02.11
7. Halliday, M.A.K. (1978). Language as social semiotic: The social interpretation of language and meaning. London: University Park Press.
8. Iedema, R. (2003) Multimodality, Resemiotization: Extending the Analysis of Discourse as Multi-Semiotic Practice. Visual Communication, 2, 29-57. http://dx.doi. org/10.1177/1470357203002001751
9. Kress, G, & Van Leeuwen, T. (1996). Reading Images: The Grammar of Visual Design. New York: Routledge.
10. Kress G, Jewitt C (2003) Introduction. In: Jewitt C, Kress G (eds) Multimodal Literacy. New York: Peter Lang, 1–18.
11. Luke, C. (2003). Pedagogy, Connectivity, Multimodality, and Interdisciplinarity. Reading Research Quarterly, 38(3), 397–403. http://www.jstor.org/stable/4151827
12. Mills, K.A. (2010). The Multiliteracies Classroom. Bristol, U.K.: Multilingual Matters. 2011b file:///C:/Users/ALLA/ Downloads/Sample_Chapter_Multiliteracies_Classroom. pdf
13. Mills, K.A. (2015). Literacy Theories for the Digital Age: Social, Critical, Multimodal, Spatial, Material and Sensory Lenses. Bristol, U.K.: Multilingual Matters, 207p.
14. Mills, K.A., & Doyle, K. (2019). Visual arts: a multimodal language for Indigenous education. Language and Education, 33, 521 – 543. DOI:10.1080/09500782.2019.1 635618
15. Sewell, W. C., & Denton, S. (2011). Multimodal Literacies in the Secondary English Classroom. The English Journal, 100(5), 61–65. http://www.jstor.org/stable/23047804
16. Stein, P. (2007). Multimodal Pedagogies in Diverse Classrooms: Representation, Rights and Resources (1st ed.). Routledge. https://doi.org/10.4324/9780203935804
Published
2025-02-24
Pages
36-42
Section
СЕКЦІЯ 2 МІЖКУЛЬТУРНА КОМУНІКАЦІЯ