scholarly journals Verbalization of Emotional States in Multimodal Text: Intersemiotic Translation (Based on the Material of the English and Ukrainian Languages)

The article highlights the problem of translation of visual texts, meaning-making based on the analyses and comparison of descriptions of emotions, feelings, sensations and associations in the multimodal text; the paper considers the notions of multimodality, intersemiotic translation, interpretation of the visual text of illustration; the article investigates the communicative function of multimodal texts that contain the signs of different semiotic systems and represent one referential situation by different means of semiotics; it outlines the features of the artistic language of illustration; the article looks at the issues of interoception and basic emotions; it carries out the semiotic analysis of figures, forms, lines and colors, as well as the analyses of the reviews of English-speaking film critics and the film ,the interpretations of illustration symbols by the Ukrainian-speaking subjects of the associative experiment; the work conducts the comparative analysis of the interpretations of emotional states in both the English critical articles and the representatives of Ukrainian culture.

2021 ◽  
Vol 8 (1) ◽  
pp. 1-20
Author(s):  
Zekai Ayık ◽  
Bayram Coştu

Numerous studies demonstrated that the meaning-making of scientific knowledge is affected by the design of multimodal science texts. Various modes are co-operated together in certain inter-semiotic mechanisms to produce meaning in multimodal texts. Based on this perspective, this research seeks to investigate the effect of mode level in science texts and compositional arrangement on the meaning-making of science concepts and processes. In this context, four science texts with the same content (transformation of energy) at different mode densities and two science texts with the same content (covalent bonding) one of which is arranged in accordance with variation theory of learning are designed. By using the case study method, this research explored six experienced science teachers’ views about the effects of mode level and multimodal text composition on meaning-making. The data were collected with semi-structured interviews. The thematic analysis was employed for data analysis. The findings demonstrated that mode density may affect meaning-making and so learning since different modes have affordance to represent different meaning and meaning relationship types. Besides, multimodal text composition may foreground the critical aspects of content, and help to design a coherent multimodal science text.


2017 ◽  
Vol 1 (1) ◽  
pp. 80
Author(s):  
Indro Moerdisuroso

This article outlines a visual text reading based on social semiotics approach, that is the visual grammar. It is an account of the explicit and implicit knowledge and practices around a resource, consisting of the elements and rules underlying a culture-specific form of visual communication. It required a general comprehension of social semiotics to obtain a deeply understanding to visual grammar. The differences between social semiotics and general semiotics expressed to accomplish its purpose. The concern of visual grammar is the relationship between ‘drawn participants’ and social life. Visual grammar can be positioned as a contemporary approach to visual texts meaning-making. Study of visual arts seems to entail visual grammar to play a more important role amid the phenomenon of visual culture that increasingly characterizes the lives of today’s society.


2018 ◽  
pp. 43-68
Author(s):  
Katarina Cederlund ◽  
Sylvana Sofkova Hashemi

The article reports on a study where teachers in early primary school were presented to tools to approach texts and meaning-­making from a multimodal perspective. The study aims to develop knowledge of enabling and constraining factors for the development of a multimodal assessment practice. To do so, we examine how teachers’ understanding of quality in students’ multimodal texts is manifested in assessments, and how this relates to available tools. The findings are discussed with the help of Bernstein's (1990; 2000) theoretical framework and focus on the conditions for teachers' work and learning. The study demonstrates teachers’ attention to multimodal text quality as ability to follow writing conventions, organize text and communicate content with several interacting resources. Available tools shape and broaden what is noticed. However, to give content to the metalanguage further knowledge on the use of different semiotic resources is needed. The study hereby raises the importance of interdisciplinary perspective on multimodal assessment.


Author(s):  
Larysa Masimova

The paper examines the specifics of tropes of a mass-media visual text. In particularly it describes the mechanism of generation of visual tropes, identifying their types and determining the functional characteristics of tropes in a composite structure of the mass-media visual text. The study founds that the mechanism for generation of visual tropes is run after identifying clearly an idea of the text and its objectives at the planning phase of visual text when it becomes a symbios of image and word. At the third level of coding (the level of tropes) the mass-media visual texts generate syncretic codes that is due to structural and semantic proximity of visual and verbal tropes. This proximity allows us to speak about the tropes of a mass-media visual text in terms of linguistics: epithet, litotes, hyperbole, oxymoron, metaphor, comparison. It has been revealed that functional characteristic of the tropes is realized by the means of: meaning-making, composition, appraisive and communicative functions


Author(s):  
Tatiana Nikolskaya ◽  
Svetlana Pavlina

The article investigates inter-cultural artistic communication which occurs through multimodal texts in general and feature films in particular. Artistic communication faces a challenge when its source and target belong to different ethnic and/or generational cohorts. The similarity or difference of communication codes depends on the level of adequacy of the sender's and the recipient's discursive competences. Discursive competences imply the ability to provide an adequate interpretation of situations depicted in the film, it is based on the knowledge and understanding of cultural, social and historical peculiarities of the society to which the creator belongs and which he or she depicts in the film. If the recipients ignore one of the semiotic systems incorporated in the multimodal text, the complete comprehension of the artistic text message can become unattainable. The authors conduct comparative analysis of how the Russian film "Moscow Does Not Believe in Tears" is perceived by Russian and American college 'Gen Z' students. In case the culture codes of the work of art contradict some rules and codes ingrained in the society to which the recipient belongs, the interpretation of the author's message can be hindered, which entails the artistic communication disruption. The analysis yields factors that determine the interpretation of an artistic message. The authors find that the differences in ethno-cultural backgrounds present a greater obstacle to the creator's artistic message successful decoding than a generation gap between the creator and the recipients.


Author(s):  
Markus Jiuhanteng ◽  
Acep Iwan Saidi ◽  
R. Drajatno Widi Utomo

<p>Abstract This paper is a study of Andreas Gursky’s photo Rhein II. In this study, the post-structural semiotic analysis method is used to interpret meaning based on signs on the Rhein II. The post-structural semiotic analysis becomes the basis for interpreting meanings using related references. In the study of Rhein II photo objects, visual text analysis is expected to provide positive benefits for the development of photography, especially academically. Rhein II is a photo by Andreas Gursky. In Rhein II’s photograph, a contemporary photo is presented as a multi-reality representation analyzed using the post-structural semiotic method. The object of research is interpreted as a text that has a layer of meaning that is squeezed out of its essence by semiotics. The deconstruction of the signification system in the visual element is identified by reading the structural postal semiotic theory codes: text analysis process, creation process. The results of semiotic extraction produce an interpretive study of Rhein II which is full of meaning.</p><p>Keyword: imagery, photography, semiotica</p><p>Abstrak Makalah ini merupakan kajian dari foto Rhein II karya Andreas Gursky. Dalam kajian ini digunakan metode analisis semiotika post struktural untuk menginterpretasikan makna berdasarkan tanda-tanda pada Rhein. Analisis semiotika post struktural menjadi landasan dalam menginterpretasikan makna-makna dengan menggunakan referensi terkait. analisis teks visual, dalam kajian objek foto Rhein II diharapkan dapat memberikan kebermanfaatan yang positif bagi perkembangan fotografi khususnya secara akademis. Rhein II adalah foto karya Andreas Gursky. Dalam karya Rhein II, sebuah foto kontemporer dihadirkan sebagai representasi multi realitas yang dianalisis menggunakan metode semiotika post struktural. Objek penelitian dimaknai sebagai teks yang memiliki lapisan makna yang terperas esensinya oleh semiotika. Dekonstruksi sistem penandaan dalam elemen visual diidentifikasikan dengan pembacaan kode-kode teori semiotika pos struktural. Proses analisis teks, proses penciptaan. Hasil ekstraksi semiotika menghasilkan kajian interpretatif Rhein II yang sarat makna.</p><p>Kata kunci: citra imaji, fotografi, semiotika</p>


2009 ◽  
Vol 9 (2) ◽  
pp. 188-210 ◽  
Author(s):  
Kate Pahl

This article examines the relationship between children's talk in the classroom and their multimodal texts. The article uses an analytic framework derived from Bourdieu's concept of habitus to examine how 6—7-year-old children's regular ways of being and doing can be found in their multimodal texts together with their talk (Bourdieu, 1977, 1990). The concept of pedagogic habitus is used to make sense of the teacher's regular ways of being and doing within the classroom (Grenfell, 1996). Improvisations upon these ways of being and doing were considered with reference to data collected over two years. In this article, the term `multimodal text' refers to panorama boxes created from shoe boxes to represent an environment such as the ocean or a jungle. The article concludes that it is important to pay attention to the interrelationship between the talk and the boxes to make sense of children's multimodal texts. The concept of improvisations upon the habitus provides an important context for this understanding.


2016 ◽  
Vol 12 (8) ◽  
pp. 64
Author(s):  
Zillasafarina Ja'afar ◽  
Noraini Md. Yusof ◽  
Noraini Ibrahim

<p>Recent interest in multimodality recognizes the integration of text and image in meaning-making as representing reality. It has also been argued that with the use of digital communication, the meanings of visual and verbal data can be easily manipulated rendering them unreliable. As such, a close and critical reading of the text is required to discover what is hidden, absent, or inconsistent with it. In a deconstruction of a multimodal digital composition of a poem that involves revisioning of history, this paper privileges the absences of cultural and historical texts to signify socio-political issues. An eclectic use of theoretical concepts on meaning-making, especially those proposed by Kress and van Leeuwen, Foucault and Baudrillard, constructs the discussion of the analysis. The digital poem entitled ‘Revenge’ is deconstructed to further discover such absence in the text. The findings reveal that language and images are used by the learner as a source of power to negotiate the boundaries of identity. It has also been discovered that the message in rhetoric and visuals complement each other to support the process of meaning-making.</p>


2019 ◽  
Vol 9 (9) ◽  
pp. 1160
Author(s):  
Yong Hu ◽  
Qing Qiu

As a special type of multimodal text, picture books for children are highly valued in the creation of meaning by the integrative use of verbal and visual semiotic resources. Informed by Painter and Martin’s framework of visual narratives, this paper primarily deals with the interpersonal meanings encoded and expressed by the two semiotics (image and verbiage) within the Chinese picture books. It aims to analyse the visual and verbal choices available for writers to establish engagement between various participants. In the hope of investigating the collaboration and interplay of verbal and visual semiotics to construe interpersonal meanings, it examines the attitudinal meanings inscribed or invoked in picture books, exploring the ways in which visual and verbal resources are co-instantiated to encode attitudinal convergence and also divergence.


2019 ◽  
Vol 8 (3) ◽  
Author(s):  
Shirzad Tayefi ◽  
Mohammad Hossein Ramezani Fookulaee

Contrary to the French school of comparative literature, according to which it is merely possible to compare the two written texts in terms of conditions, in the American approach, the adaptation of literary texts to various arts, including cinema, is possible, which leads to a better understanding of literature. Since novels and films have many similarities, they are in many respects similar to each other, and two genres are considered analogous.These commons provide a good ground for discussing a movie from the perspective of a new literary theory and critique, and allow us to use the concepts and terminology we normally know as a tool for discussing the novel to critically explore the structure and art and the themes of the film. On the other hand, in recent years, the term "postmodernism" has been widely criticized about the novel in our country, and many new fiction writers also have a fascination with postmodern style fiction. Therefore, in this research, first, reviewing the views of some of the most important postmodern literature scholars, nineteen techniques used in postmodern novels are explored, and their qualitative method of applying them to Naser al-Dinshah film actor have been investigated.The results of the study show the relationship between literature and cinema (as a visual text) and the ability to compare the two written and visual texts; as many techniques used in the writing of postmodern novels are also with a high frequency have been used in the studied film


Sign in / Sign up

Export Citation Format

Share Document