scholarly journals ChiCo: A Multimodal Corpus for the Study of Child Conversation

2021 ◽  
Author(s):  
Kübra Bodur ◽  
Mitja Nikolaus ◽  
Fatima Kassim ◽  
Laurent Prévot ◽  
Abdellah Fourtassi
Keyword(s):  
Multimodal Corpus

scholarly journals A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals

2021 ◽  
Author(s):  
Mark Snaith ◽  
Nicholas Conway ◽  
Tessa Beinema ◽  
Dominic De Franco ◽  
Alison Pease ◽  
...  
Keyword(s):  
Healthcare Professionals ◽  
Ethical Issues ◽  
Upper Body ◽  
Language Resources ◽  
Close Analysis ◽  
Medical Consultations ◽  
Multimodal Corpus ◽  
Clear Identification ◽  
Patient Consultation ◽  
Design Construction

AbstractLanguage resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise for effective treatment. In this paper, we present the design, construction and output of the Patient Consultation Corpus, a multimodal corpus of simulated consultations between a patient portrayed by an actor, and at least two healthcare professionals with different areas of expertise. As well as the transcribed text from each consultation, the corpus also contains audio and video where for each consultation: the audio consists of individual tracks for each participant, allowing for clear identification of speakers; the video consists of two framings for each participant—upper-body and face—allowing for close analysis of behaviours and gestures. Having presented the design and construction of the corpus, we then go on to briefly describe how the multi-modal nature of the corpus allows it to be analysed from several different perspectives.

scholarly journals A Tradução Intersemiótica na construção da personagem Holly Golithly em Breakfast at Tiffany’s: entre o romance e o cinema

2018 ◽  
Vol 1 (44) ◽  
pp. 246-259
Author(s):  
Sinara De Oliveira Branco ◽  
Mariana Assis Maciel
Keyword(s):  
Image Analysis ◽  
Theoretical Framework ◽  
Film Adaptation ◽  
The Novel ◽  
Multimodal Corpus ◽  
The Relationship

The purpose of this text is to analyze the intersemiotic construction of Holly Golithly in two contexts: the novel and the film Breakfast at Tiffany's (1961). Along the film adaptation, the focus will be on the observation of how people and places influence her behaviour, taking into consideration the relationship between the imagetic and the verbal contexts (word-image relationship). The theoretical framework used is based on the Theory of Adaptation; the Intersemiotic Translation; Subtitling; Image Analysis and Film Narrative. The multimodal corpus compiled involves the selected scenes from the film, offering frames and subtitles, as well as excerpts from the novel. Results have shown how the character has changed in the film adaptation regarding her construction in the film narrative. With the application of intersemiotic translation, it was possible to observe how the analysis of the scenes and subtitles help with the construction and the interpretation of the character.

Distant time, distant gesture: speech and gesture correlate to express temporal distance

Semiotica ◽  
2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Daniel Alcaraz Carrión ◽  
Javier Valenzuela
Keyword(s):  
Television News ◽  
Space Time ◽  
The Body ◽  
Temporal Distance ◽  
Distant Future ◽  
Axis Direction ◽  
Spatial Properties ◽  
Multimodal Corpus ◽  
Future Data ◽  
Near Future

Abstract This study investigates whether there is a relation between the semantics of linguistic expressions that indicate temporal distance and the spatial properties of their co-speech gestures. To this date, research on time gestures has focused on features such as gesture axis, direction, and shape. Here we focus on a gesture property that has been overlooked so far: the distance of the gesture in relation to the body. To achieve this, we investigate two types of temporal linguistic expressions are addressed: proximal (e.g., near future, near past) and distal (e.g., distant past, distant future). Data was obtained through the NewsScape library, a multimodal corpus of television news. A total of 121 co-speech gestures were collected and divided into the two categories. The gestures were later annotated in terms of gesture space and classified in three categories: (i) center, (ii) periphery, and (iii) extreme periphery. Our results suggest that gesture and language are coherent in the expression of temporal distance: when speakers locate an event far from them, they tend to gesture further from their body; similarly, when locating an event close to them, they gesture closer to their body. These results thus reveal how co-speech gestures also reflect a space-time mapping in the dimension of distance.

Metatextual indicators and phraseological units in a multimodal corpus

2019 ◽  
Vol 5 (3) ◽  
pp. 241-258
Author(s):  
Jorge Leiva Rojo
Keyword(s):  
Spoken Language ◽  
Combined Use ◽  
Starting Point ◽  
Different Types ◽  
Multimodal Corpus ◽  
Main Factor

Abstract The present work aims to address the combined use of phraseological units and metatextual indicators in spoken language, that is, the mechanisms used to introduce phraseological units to listeners. Exhaustive knowledge of how metatextual indicators are employed in discourse is, no doubt, highly valuable in identifying phraseological units in cases where immediacy is a main factor, as is common in different types of interpreting. The main characteristics of metatextual indicators are considered, along with their different categories to date, taking as a starting point such works as those of Čermák (2005) and Goddard (2009). An analysis is also provided of the 100 most recent uses of the metatextual indicator as the saying goes from a search in the multimodal NewsScape corpus. Studying these 100 uses leads to the general conclusion that this indicator tends to precede phraseological units – overwhelmingly proverbs – and that the phraseological units tend to be used without any modifying mechanisms. However, there are numerous cases, while still a minority, of quotations and, within them, allusions to elements that go beyond their classic conception – such as the notable inclusion of cases where the speaker manipulates the canonical meaning of phraseological units.

scholarly journals Brexit means Brexit: a constructionist analysis

2019 ◽  
Vol 27 ◽  
pp. 1-37
Author(s):  
Jose A. Mompean ◽  
Javier Valenzuela Manzanares
Keyword(s):  
Discourse Analysis ◽  
Cultural Context ◽  
Cognitive Models ◽  
Linguistic Meaning ◽  
Full Understanding ◽  
Linguistic Form ◽  
Multimodal Discourse ◽  
The Social ◽  
Multimodal Corpus ◽  
Fluid Interaction

This paper presents a corpus-assisted discourse analysis of the Brexit means Brexit tautology from a constructionist perspective. A multimodal corpus of instances of the construction was compiled and analyzed, paying attention to the components of the construction such as its phonetic-phonological and gestural features as well as the idealized cognitive models underlying the use of the tautology in discourse. This study also addresses how different semantic-pragmatic uses have an impact on the linguistic form (e.g. prosody, gesture) and emphasizes the fluid interaction between linguistic meaning/form and the social and cultural context in which language is used. It is argued that a full understanding of any construction requires a multimodal, discourse-based analysis. 

scholarly journals The future of multimodal corpora

2011 ◽  
Vol 11 (2) ◽  
pp. 391-415 ◽  
Author(s):  
Dawn Knight
Keyword(s):  
Corpus Linguistics ◽  
State Of The Art ◽  
Future Developments ◽  
The Past ◽  
Current State ◽  
Linguistic Research ◽  
Multimodal Corpora ◽  
The Future ◽  
Multimodal Corpus ◽  
Critical Overview

This paper takes stock of the current state-of-the-art in multimodal corpus linguistics, and proposes some projections of future developments in this field. It provides a critical overview of key multimodal corpora that have been constructed over the past decade and presents a wish-list of future technological and methodological advancements that may help to increase the availability, utility and functionality of such corpora for linguistic research.

Sign in / Sign up

Export Citation Format

Share Document