scholarly journals Speech Driven Gaze in a Face-to-Face Interaction

2021 ◽  
Vol 15 ◽  
Author(s):  
Ülkü Arslan Aydin ◽  
Sinan Kalkan ◽  
Cengiz Acartürk
Keyword(s):  
Multimodal Communication ◽  
Gaze Direction ◽  
Social Signals ◽  
Job Interview ◽  
Communication Modality ◽  
Face To Face ◽  
Social Gaze ◽  
Speech Features ◽  
High Level

Gaze and language are major pillars in multimodal communication. Gaze is a non-verbal mechanism that conveys crucial social signals in face-to-face conversation. However, compared to language, gaze has been less studied as a communication modality. The purpose of the present study is 2-fold: (i) to investigate gaze direction (i.e., aversion and face gaze) and its relation to speech in a face-to-face interaction; and (ii) to propose a computational model for multimodal communication, which predicts gaze direction using high-level speech features. Twenty-eight pairs of participants participated in data collection. The experimental setting was a mock job interview. The eye movements were recorded for both participants. The speech data were annotated by ISO 24617-2 Standard for Dialogue Act Annotation, as well as manual tags based on previous social gaze studies. A comparative analysis was conducted by Convolutional Neural Network (CNN) models that employed specific architectures, namely, VGGNet and ResNet. The results showed that the frequency and the duration of gaze differ significantly depending on the role of participant. Moreover, the ResNet models achieve higher than 70% accuracy in predicting gaze direction.

scholarly journals Multimodal positioning and reference in argumentative talk-in-interaction

2018 ◽  
Vol 10 (2) ◽  
pp. 198-218
Author(s):  
Jérôme Jacquin
Keyword(s):  
Context Dependency ◽  
Gaze Direction ◽  
Or Management ◽  
Public Debates ◽  
Activity Types ◽  
High Level ◽  
Data Collections ◽  
Participation Frameworks ◽  
Oriented Approach

Abstract Drawing on a descriptive and language-oriented approach to argumentation, this paper explores the multimodal dimension of argumentation in talk-in-interaction by considering the various resources used by an opponent to refer to and position themselves in relation to the target of their opposition, namely the adverse position and/or the person who expressed it. More specifically, it studies how speakers exploit multimodal strategies in order to both maintain their discourse at a high level of generality (orientation to context-independency) and guarantee the indexicality of the position taken in the interaction and the disagreement (orientation to context-dependency). The analysis is based on two data collections documenting settings where all participants are temporally and spatially co-present: (i) a video-recorded corpus of Swiss French public debates and (ii) a video-recorded corpus of New Zealand English management meetings. Examining the role of multimodal orchestration of choices in gaze direction, deictic gestures, and speech in establishing different positions in argumentative events such as public debates or management meetings reveals specific contextual features of the activity types, participation frameworks, and sociolinguistic backgrounds involved in an argument.

Visual and Multimodal Communication

2020 ◽  
Author(s):  
Charles Forceville
Keyword(s):  
Cognitive Linguistics ◽  
Relevance Theory ◽  
Multimodal Communication ◽  
Face To Face ◽  
Successful Communication ◽  
The Difference ◽  
Verbal Messages ◽  
The Impact ◽  
Relevance Principle

Successful communication requires optimal relevance to a target audience. Relevance theory (RT) provides an excellent model based on this insight, but the impact of the theory has until now been restricted due to an almost exclusive focus on spoken face-to-face communication. Visual and Multimodal Communication: Applying the Relevance Principle is the first book to systematically demonstrate how RT can fulfill its promise to develop into an inclusive theory of communication. In this book, Charles Forceville refines and adapts RT’s original claims to show its applicability to static visuals and multimodal discourses in popular culture genres. Using colorful examples, he explains how RT can be expanded and adapted to accommodate mass-communicative visual and visual-plus-verbal messages. Forceville addresses issues such as the difference between drawing prospective addressees’ attention to a message and persuading them to accept it; the thorny continuum from implicit to explicit information; and the role of genre. Case studies of pictograms, advertisements, cartoons, and comics provide contemporary and accessible examples of the importance of genre and of how the RT model can be connected to other approaches. By expanding the application of relevance theory to include mass-communicative messages, Visual and Multimodal Communication reintroduces a central framework of cognitive linguistics and pragmatics to a new audience and paves the way for an inclusive theory of communication.

scholarly journals Social partner gaze direction and conversational phase; factors affecting social attention during face-to-face conversations in autistic adults?

Autism ◽  
2018 ◽  
Vol 23 (2) ◽  
pp. 503-513 ◽  
Author(s):  
Megan Freeth ◽  
Patricia Bugembe
Keyword(s):  
Social Attention ◽  
Gaze Direction ◽  
Social Partner ◽  
Comprehensive Overview ◽  
Systematic Analysis ◽  
Factors Affecting ◽  
Face To Face ◽  
The Social ◽  
Social Gaze ◽  
Autistic Adults

Social attention is atypical in autism. However, the majority of evidence for this claim comes from studies where the social partner is not physically present and the participants are children. Consequently, to ensure acquisition of a comprehensive overview of social attention in autism, systematic analysis of factors known to influence face-to-face social attention in neurotypicals is necessary and evidence from adulthood is required. This study assessed the influence of experimenter gaze direction (direct or averted) and conversational phase (speaking or listening) on social attention during a face-to-face conversation. Eye-tracking analyses indicated that when the experimenter looked directly at the participant, autistic adults looked at the experimenter’s face less than did neurotypical adults. However, this between-group difference was significantly reduced when the experimenter’s gaze was averted. Therefore, opportunities for reciprocal social gaze are missed by autistic adults when the social partner makes direct eye contact. A greater proportion of time was spent fixating the experimenter’s eye region when participants were speaking compared to listening in both neurotypical and autistic adults. Overall, this study provides a rich picture of the nature of social attention in face-to-face conversations adopted by autistic adults and demonstrates individual variation in social attention styles.

scholarly journals Aspetti emotivi e relazionali nell'e-learning

2008 ◽  
Keyword(s):  
Natural Language ◽  
Cognitive Processes ◽  
Multimodal Communication ◽  
Face To Face ◽  
Computer Communication ◽  
E Learning ◽  
Machine Interface ◽  
Man Machine Interface

This book investigates the role of emotions and multimodal communication in face-to-face teaching and in e-learning, and assesses the incidence of these not merely verbal components on the cognitive processes of the student. It also presents certain types of man-machine interface that utilise natural language in written, vocal and multimodal form; the latter implement a new metaphor of interaction with the computer that is more human-oriented. This is, therefore, a new and interdisciplinary theme of research that highlights the technical and theoretical complexity that e-learning specialists and scholars of multimodal communication and emotions address in order to devise new systems of human-computer communication that are more natural and more motivating for learning.

scholarly journals The Revolt of French Soldiers Against the Failing Immigration Policy

2021 ◽  
Vol 30 (4) ◽  
pp. 3-22
Author(s):  
Jan Eichler
Keyword(s):  
Civil War ◽  
Immigration Policy ◽  
Armed Forces ◽  
Face To Face ◽  
Security Levels ◽  
The Republic ◽  
High Level ◽  
Young Immigrants

The article is about the revolt of French soldiers against the failing immigration policy of their country. It explains its rational causes at the historical, geopolitical as well as security levels. It analyses its three main acts since 2013 until today and presents their key actors: the high level generals and politicians. These acts are presented as historical accidents. The article shows that French soldiers refuse to be silent face to face big stakes, especially on the field of defence of the Republic against the growing violence of young immigrants. The text continues with the analysis of two manifests of French soldiers from spring 2021 that evoke the threat of the civil war in France and the role of the Armed forces in such a scenario.

Collection of Ego-Centered Network Data with Computer-Assisted Interviews

Methodology ◽  
2006 ◽  
Vol 2 (1) ◽  
pp. 7-15 ◽  
Author(s):  
Joachim Gerich ◽  
Roland Lehner
Keyword(s):  
Survey Methods ◽  
A Priori ◽  
Dynamic Structure ◽  
Computer Assisted ◽  
Network Data ◽  
Great Effort ◽  
Self Administration ◽  
Face To Face ◽  
Full Network

Although ego-centered network data provide information that is limited in various ways as compared with full network data, an ego-centered design can be used without the need for a priori and researcher-defined network borders. Moreover, ego-centered network data can be obtained with traditional survey methods. However, due to the dynamic structure of the questionnaires involved, a great effort is required on the part of either respondents (with self-administration) or interviewers (with face-to-face interviews). As an alternative, we will show the advantages of using CASI (computer-assisted self-administered interview) methods for the collection of ego-centered network data as applied in a study on the role of social networks in substance use among college students.

Searching for ‘success’: generation, gender and onward migration in the Iranian diaspora

2017 ◽  
Vol 14 (1) ◽  
pp. 101-112 ◽  
Author(s):  
Melissa Kelly
Keyword(s):  
Life History ◽  
Young Age ◽  
Onward Migration ◽  
Social Fields ◽  
Transnational Social Fields ◽  
High Level ◽  
Iranian Diaspora

This article uses the concepts of ‘transnational social fields’ and ‘habitus’ to explore the multifaceted role families play in shaping the aspirations of onward migrating youth. The article draws on biographical life history interviews conducted with the children of Iranian migrants who were raised in Sweden but moved to London, UK as adults. The findings of the study suggest that from a young age, all the participants were pressured by their parents to perform well academically, and to achieve high level careers. These goals were easier to achieve in London than in Sweden for several reasons. Interestingly, however, participants’ understandings of what constituted success and their motivations for onward migration were nuanced and varied considerably by gender. The study contributes to an understanding of the role of multi-sited transnational social fields in shaping the aspirations of migrant youths, as well as the strategies taken up by these migrants to achieve their goals.

Decision making power of college girls in relation to clothing

2018 ◽  
Vol 9 (01) ◽  
Author(s):  
Parul Gill ◽  
Poonam Malik ◽  
Pankaj Gill
Keyword(s):  
Decision Making ◽  
Satisfaction Level ◽  
College Going ◽  
Level Of Satisfaction ◽  
High Level ◽  
Garment Design ◽  
Structured Questionnaire

The present study was undertaken to explore the decision making patterns of college girls in relation to clothing and their satisfaction level with these decision making patterns. Thirty under graduate college girls from Panipat city were approached to record their responses regarding decision making in relation to clothing and satisfaction level through a well structured questionnaire. It was found that most of the girls (56.66%) themselves made the decisions about the type of garment (Indian, western or both) they wear and majority of girls (70%) were highly satisfied with this decision making. Parents performed the role of buyers for their college going daughters' garments in most of the cases (63.33%) and the 73.33% girls had high level of satisfaction with this. In most of the cases (60%) the decision about the garment design was made by the girls themselves and they were highly satisfied with it. Keywords: clothing, college, girls, decision making.

Сирия (аш-Шам) в системе османских владений (XVI – начало XX в.)

2019 ◽  
Author(s):  
D.R. Zhantiev
Keyword(s):  
Ottoman Empire ◽  
19Th Century ◽  
Social Mechanisms ◽  
Checks And Balances ◽  
Local Elites ◽  
The Balkans ◽  
The Face ◽  
High Level ◽  
The 19Th Century

Аннотация В статье рассматривается роль и место Сирии (включая Ливан и Палестину) в системе османских владений на протяжении нескольких веков от османского завоевания до периода правления султана Абдул-Хамида II. В течение четырех столетий османского владычества территория исторической Сирии (Билад аш-Шам) была одним из важнейших компонентов османской системы и играла роль связующего звена между Анатолией, Египтом, Ираком и Хиджазом. Необходимость ежегодной организации хаджа с символами султанской власти и покровительства над святынями Мекки и Медины определяла особую стратегическую важность сирийских провинций Османской империи. Несмотря на ряд серьезных угроз во время общего кризиса османской государственности (конец XVI начало XIX вв.), имперскому центру удалось сохранить контроль над Сирией путем создания сдержек и противовесов между местными элитами. В XIX в. и особенно в период правления Абдул- Хамида II (18761909 гг.), сохранение Сирии под османским контролем стало вопросом существования Османской империи, которая перед лицом растущего европейского давления и интервенции потеряла большую часть своих владений на Балканах и в Северной Африке. Задача укрепления связей между имперским центром и периферией в сирийских вилайетах в последней четверти XIX в. была в целом успешно решена. К началу XX в. Сирия была одним из наиболее политически спокойных и прочно связанных со Стамбулом регионов Османской империи. Этому в значительной степени способствовали довольно высокий уровень общественной безопасности, развитие внешней торговли, рост образования и постепенная интеграция местных элит (как мусульман, так и христиан) в османские государственные и социальные механизмы. Положение Сирии в системе османских владений показало, что процесс ослабления и территориальной дезинтеграции Османской империи в эпоху реформ не был линейным и наряду с потерей владений и влияния на Балканах, в азиатской части империи в течение XIX и начала XX вв. происходил параллельный процесс имперской консолидации.Abstract The article examines the role and place of Greater Syria (including Lebanon and Palestine) in the system of Ottoman possessions over several centuries from the Ottoman conquest to the period of the reign of Abdul Hamid II. For four centuries of Ottoman domination, the territory of historical Syria (Bilad al-Sham) was one of the most important components in the Ottoman system and played the role of a link between Anatolia, Egypt, Iraq and Hijaz. The need to ensure the Hajj with symbols of Sultan power and patronage over the shrines of Mecca and Medina each year determined the special strategic importance of the Syrian provinces of the Ottoman Empire. Despite a number of serious threats during the general crisis of the Ottoman state system (late 16th early 19th centuries), the imperial center managed to maintain control over Syria by creating checks and balances between local elites. In the 19th century. And especially during the reign of Abdul Hamid II (18761909), keeping Syria under Ottoman control became a matter of existence for the Ottoman Empire, which, in the face of increasing European pressure and intervention, lost most of its possessions in the Balkans and North Africa. The task of strengthening ties between the imperial center and the periphery in Syrian vilayets in the last quarter of the 19th century was generally successfully resolved. By the beginning of the 20th century, Syria was one of the most politically calm and firmly connected with Istanbul regions of the Ottoman Empire. This was greatly facilitated by a fairly high level of public safety, the development of foreign trade, the growth of education and the gradual integration of local elites (both Muslims and Christians) into Ottoman state and social mechanisms. Syrias position in the system of Ottoman possessions clearly showed that the process of weakening and territorial disintegration of the Ottoman Empire during the era of reform was not linear, and along with the loss of possessions and influence in the Balkans, in the Asian part of the empire during the 19th and early 20th centuries there was a parallel process of imperial consolidation.

Changing Role of Agriculture in Income and Employment, and Trends of Agricultural Worker Productivity in Indian States

2020 ◽  
pp. 183-189
Keyword(s):  
Green Revolution ◽  
Positive Trend ◽  
Worker Productivity ◽  
Indian States ◽  
Agricultural Worker ◽  
The Sixties ◽  
High Level ◽  
The Cost ◽  
Changing Role

The productivity of land has been often discussed and deliberated by the academia and policymakers to understand agriculture, however, very few studies have focused on the agriculture worker productivity to analyze this sector. This study concentrates on the productivity of agricultural workers from across the states taking two-time points into consideration. The agriculture worker productivity needs to be dealt with seriously and on a time series basis so that the marginal productivity of worker can be ascertained but also the dependency of worker on agriculture gets revealed. There is still disguised unemployment in all the states and high level of labour migration, yet most of the states showed the dependency has gone down. Although a state like Madhya Pradesh is doing very well in terms of income earned but that is at the cost of increased worker power in agriculture as a result of which, the productivity of worker has gone down. States like Mizoram, Meghalaya, Nagaland and Tripura, though small in size showed remarkable growth in productivity and all these states showed a positive trend in terms of worker shifting away from agriculture. The traditional states which gained the most from Green Revolution of the sixties are performing decently well, but they need to have the next major policy push so that they move to the next orbit of growth.

Sign in / Sign up

Export Citation Format

Share Document