scholarly journals Facial Signals and Social Actions in Multimodal Face-to-Face Interaction

2021 ◽  
Vol 11 (8) ◽  
pp. 1017
Author(s):  
Naomi Nota ◽  
James P. Trujillo ◽  
Judith Holler
Keyword(s):  
Social Action ◽  
Visual Information ◽  
The Body ◽  
Human Language ◽  
Face To Face ◽  
Social Actions ◽  
Timely Response ◽  
Asking Questions

In a conversation, recognising the speaker’s social action (e.g., a request) early may help the potential following speakers understand the intended message quickly, and plan a timely response. Human language is multimodal, and several studies have demonstrated the contribution of the body to communication. However, comparatively few studies have investigated (non-emotional) conversational facial signals and very little is known about how they contribute to the communication of social actions. Therefore, we investigated how facial signals map onto the expressions of two fundamental social actions in conversations: asking questions and providing responses. We studied the distribution and timing of 12 facial signals across 6778 questions and 4553 responses, annotated holistically in a corpus of 34 dyadic face-to-face Dutch conversations. Moreover, we analysed facial signal clustering to find out whether there are specific combinations of facial signals within questions or responses. Results showed a high proportion of facial signals, with a qualitatively different distribution in questions versus responses. Additionally, clusters of facial signals were identified. Most facial signals occurred early in the utterance, and had earlier onsets in questions. Thus, facial signals may critically contribute to the communication of social actions in conversation by providing social action-specific visual information.

MENELUSURI JEJAK DAN KIPRAH KIAI MOHAMMAD HASAN GENGGONG; DALAM MEMBANGUN KEPEMIMPINAN SPRITUAL-TRANSFORMATIF

2018 ◽  
Vol 2 (1) ◽  
pp. 17
Author(s):  
Ahmad Fauzi ◽  
Chusnul Muali
Keyword(s):  
Social Action ◽  
Boarding School ◽  
Transformative Leadership ◽  
Social Recognition ◽  
School Students ◽  
Value System ◽  
Social Actions ◽  
The People ◽  
The Social ◽  
Islamic Science

Pesantren and social value system is the result of constructing kiai's thoughts and social actions as an inseparable entity. This study aims to interpret the role and social action of kiai Moh Hasan, both as a fighter (al-haiah al-jihaadi li'izzi al-Islaami wal muslimin) in the community as well as guidance and guidance for the community (al-haiah al ta 'awuny wa al takafuly wal al ittijaahi) and teaching in educational institutions (al-haiah al ta'lim wa al-tarbiyah), significantly contributes greatly to the social realities of society in Indonesia. Portrait of central figure kiai Moh Hasan can not be separated from the depth of his field of Islamic science, simplicity, kezuhudan, struggle, sincerity and generosity. This view, not only recognized among the people around the boarding school, students and colleagues, but also spread in some areas in Indonesia. The fame of kiai Moh Hasan among scholars, habaib and society has many karamah and some other privileges, not even a few from the social recognition of kiai Moh Hasan Genggong, because the kiai are believed to have closeness with God, thus perceived as auliya'Allah. Thus the role and social actions of the kiai above, gave birth to the value system, so as to influence and move the social action of other individuals. The internalization of the aforementioned values becomes social capital in building a spiritual-based transformative leadership, as a strong leadership model and conducts various changes in the social field, by transforming the value of the ethical values.

scholarly journals The Kinematics of Social Action: Visual Signals Provide Cues for What Interlocutors Do in Conversation

2021 ◽  
Vol 11 (8) ◽  
pp. 996
Author(s):  
James P. Trujillo ◽  
Judith Holler
Keyword(s):  
Social Action ◽  
Motion Tracking ◽  
Time Window ◽  
Semantic Content ◽  
Visual Signals ◽  
Manual Annotation ◽  
Conversational Interaction ◽  
Fine Grained ◽  
Social Actions ◽  
Rapid Processing

During natural conversation, people must quickly understand the meaning of what the other speaker is saying. This concerns not just the semantic content of an utterance, but also the social action (i.e., what the utterance is doing—requesting information, offering, evaluating, checking mutual understanding, etc.) that the utterance is performing. The multimodal nature of human language raises the question of whether visual signals may contribute to the rapid processing of such social actions. However, while previous research has shown that how we move reveals the intentions underlying instrumental actions, we do not know whether the intentions underlying fine-grained social actions in conversation are also revealed in our bodily movements. Using a corpus of dyadic conversations combined with manual annotation and motion tracking, we analyzed the kinematics of the torso, head, and hands during the asking of questions. Manual annotation categorized these questions into six more fine-grained social action types (i.e., request for information, other-initiated repair, understanding check, stance or sentiment, self-directed, active participation). We demonstrate, for the first time, that the kinematics of the torso, head and hands differ between some of these different social action categories based on a 900 ms time window that captures movements starting slightly prior to or within 600 ms after utterance onset. These results provide novel insights into the extent to which our intentions shape the way that we move, and provide new avenues for understanding how this phenomenon may facilitate the fast communication of meaning in conversational interaction, social action, and conversation.

scholarly journals Speakers exhibit a multimodal Lombard effect in noise

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
James Trujillo ◽  
Asli Özyürek ◽  
Judith Holler ◽  
Linda Drijvers
Keyword(s):  
Motion Capture ◽  
Natural Environment ◽  
Language Use ◽  
Human Language ◽  
Visual Channel ◽  
Lombard Effect ◽  
Face To Face ◽  
Acoustic Analyses ◽  
Acoustic Modulation ◽  
Action Verbs

AbstractIn everyday conversation, we are often challenged with communicating in non-ideal settings, such as in noise. Increased speech intensity and larger mouth movements are used to overcome noise in constrained settings (the Lombard effect). How we adapt to noise in face-to-face interaction, the natural environment of human language use, where manual gestures are ubiquitous, is currently unknown. We asked Dutch adults to wear headphones with varying levels of multi-talker babble while attempting to communicate action verbs to one another. Using quantitative motion capture and acoustic analyses, we found that (1) noise is associated with increased speech intensity and enhanced gesture kinematics and mouth movements, and (2) acoustic modulation only occurs when gestures are not present, while kinematic modulation occurs regardless of co-occurring speech. Thus, in face-to-face encounters the Lombard effect is not constrained to speech but is a multimodal phenomenon where the visual channel carries most of the communicative burden.

scholarly journals Cyber-Flirting: An Examination of Men's and Women's Flirting Behaviour Both Offline and on the Internet

2004 ◽  
Vol 21 (2) ◽  
pp. 115-126 ◽  
Author(s):  
Monica T. Whitty
Keyword(s):  
Physical Attractiveness ◽  
The Body ◽  
Nonverbal Cues ◽  
Future Research ◽  
The Internet ◽  
Research Needs ◽  
Men And Women ◽  
Face To Face ◽  
Online Interactions

AbstractWhile flirting is a relatively underresearched area within psychology, even less is known about how people cyber-flirt. This paper explores how often individuals flirt offline compared to online. Moreover, it attempts to examine how men and women flirt within these different spaces. Five thousand, six hundred and ninety-seven individuals, of which 3554 (62%) were women and 2143 (38%) were men, completed a survey about their flirting behaviour both in face-to-face interactions and in chatrooms. The first hypothesis, which stated that the body would be used to flirt with as frequently online as offline, was partly supported. However, it was found that individuals downplayed the importance of physical attractiveness online. Women flirted by displaying nonverbal signals (offline) or substitutes for nonverbal cues (online), to a greater extent than men. In chatrooms men were more likely than women to initiate contact. It is concluded that cyber-flirting is more than simply a meeting of minds and that future research needs to consider the role of the body in online interactions.

Religious social action and its organizational profiles

2019 ◽  
Vol 8 (1) ◽  
pp. 95-108 ◽  
Author(s):  
Angel Belzunegui-Eraso ◽  
David Duenas-Cid ◽  
Inma Pastor-Gosálbez
Keyword(s):  
Social Action ◽  
Social Impact ◽  
Personal Autonomy ◽  
Participant Observation ◽  
Functional Dependence ◽  
Welfare States ◽  
Content Type ◽  
Social Actions ◽  
The Social ◽  
The Church

Purpose Social action implemented by the Church via its affiliated entities, foundations and associations may be viewed as a uniform activity. In reality, however, several organizational profiles exist that depend on the origin of these organizations (lay or religious), the scope of their activities (local or general) and their dependence on resources (whether from public administration or civil society). The paper aims to discuss these issues. Design/methodology/approach In this paper, the authors examine this diversity based on a 2015 study of every Catholic Church social organization with headquarters in Catalonia. For the study, the authors conducted a detailed analysis of these organizations in order to determine their nature, scope and structure. The methodology combined questionnaire, interviews and non-participant observation. Findings The social actions of these organizations lead to interesting debates, such as those on: charity/assistentialism vs social justice; professionalization vs voluntarism; and personal autonomy vs functional dependence resulting from the action. This study also highlights how important it is that Church organizations carry out social actions to generate social welfare in the welfare states of southern European countries. Originality/value It is the first time that a study of the social impact of the church and its organizational implications in Spain has been made.

The supine position of postnatal human infants

2009 ◽  
Vol 10 (2) ◽  
pp. 252-269 ◽  
Author(s):  
Hideko Takeshita ◽  
Masako Myowa-Yamakoshi ◽  
Satoshi Hirata
Keyword(s):  
Supine Position ◽  
Postnatal Period ◽  
The Body ◽  
Body Parts ◽  
Human Infants ◽  
Face To Face ◽  
Developmental Continuity ◽  
Exploratory Movements ◽  
Locomotor Ability ◽  
Development And Evolution

In this review, we discuss the implications of placing an infant in the supine position with respect to human cognitive development and evolution. When human infants are born, they are relatively large and immature in terms of postural and locomotor ability as compared with their closest relatives, the great apes. Hence, human mothers seemingly adopt a novel pattern of caring for their large and heavy infants, i.e., placing their infants in the supine position; this promotes face-to-face communication with their infants. Moreover, infants in the supine position can interact with other nearby individuals in the same manner from an early age. In addition, the infants can also explore their own body parts and/or objects with their hands since the hands are not required to support the body and are therefore, free to move. These activities are considered to be fundamental to the early development of human social and nonsocial cognition, including knowledge of self, in the first six months after birth. Further, developmental continuity in the voluntary exploratory movements in the prenatal period (in utero) to the early postnatal period is also discussed.

scholarly journals Social action in Suroan tradition in Javanese Society

2020 ◽  
Vol 17 (4) ◽  
pp. 133-148
Author(s):  
Muhammad Fadlan ◽  
◽  
Sudjarwo ◽  
Risma Margaretha Sinaga ◽  
◽  
...  
Keyword(s):  
Social Action ◽  
Head Group ◽  
Rational Action ◽  
Interactive Model ◽  
Social Actions ◽  
True Meaning ◽  
Descriptive Qualitative

Suroan is known as a tradition which resulting from acculturation between the Saka and Islamic calendar. This tradition is performed to beg blessings and protections from misery and disasters. The implementation of Suroan became a custom in society, involving some trusted agents through social actions. However, most of Suroan performed in society is not in accordance with its true meaning. Regarding this problem, the purpose of this research is to obtain the action in the Suroan tradition. The method used is descriptive qualitative, while the kind of research is ethnography using Miles and Huberman’s interactive model. The data was collected through interview and observation in Bangunharjo, Taman Sari village. The result shows that social actions performed by Bangunharjo society are: a) traditional action through Suroan implementation is performed; b) affective action in a form of burial of the goat’s head, group prayers and puppet shows; c) instrument rational action in a form of physic, material, and emotional involving; d) rational action of value in a form of ubarampe. Thus, it can be concluded that Bangunharjo society still conserves the Suroan tradition.

scholarly journals Konseptualisasi Citra Hara ‘Perut’ dalam Idiom Bahasa Jepang

2018 ◽  
Vol 1 (1) ◽  
pp. 65-78
Author(s):  
Akhmad Saifudin
Keyword(s):  
Cognitive Linguistics ◽  
Conceptual Metaphor ◽  
Human Life ◽  
Human Perception ◽  
The Body ◽  
Human Language ◽  
Japanese People ◽  
Conceptual Metaphor Theory ◽  
Metaphor Theory ◽  
Cognitive Experience

 Hara simply means belly, but for Japanese people it means more than physical. Hara is a concept, an important concept related to Japanese human life. This paper discusses the conceptualization of hara image for Japanese people. The study utilizes 25 idioms that contain hara ‘belly’ word that are obtained from several dictionaries of Japanese idioms. This paper is firmly grounded in cognitive linguistics, which relates linguistic expressions to human cognitive experience. The tool for analysis employed in this paper is the “conceptual metaphor theory” pioneered by Lakoff and Johnson. This theory considers human perception, parts of the body, and people’s worldview as the basis for the structure of human language. The analysis of this paper results that metaphorically, hara ‘belly’ is an entity and a container, which contains important elements for humans, such as life, mind, feeling, mentality, and physical. The concept of hara 'belly' for Japanese people is to have a spiritual, psychological, social and cultural, biological, and physical image. Keywords: conceptualization, conceptual metaphor, hara ‘belly’,  idioms, imagee.

scholarly journals Media społecznościowe jako przestrzeń eksponowania ciała

2018 ◽  
Vol 8 ◽  
pp. 97-109
Author(s):  
Sebastian Surendra
Keyword(s):  
Social Media ◽  
Sexual Abuse ◽  
The Body ◽  
Social Actions ◽  
Naked Body

Social media as a space for displaying the bodyIn this text, I analyze various aspects of exhibiting the body in social media focusing on Instagram and Facebook. I examine the rules of insertion the images depicting naked and half-naked body, and social actions contesting these regulations. I also examine the level of social ap­proval of publishing photos marked by sexual abuse. Moreover, I show some examples of displaying the naked body having no sexual connotation.

scholarly journals How does gaze to faces support face-to-face interaction? A review and perspective

2019 ◽  
Author(s):  
Roy S Hessels
Keyword(s):  
Visual Information ◽  
Relevant Information ◽  
Observational Research ◽  
Future Research ◽  
Dynamic Systems Theory ◽  
Face To Face ◽  
Vision Science ◽  
Literature Overview ◽  
Social Gaze ◽  
Human Social Behaviour

Gaze – where one looks, how long, and when – plays an essential part in human social behaviour. While many aspects of social gaze have been reviewed, there is no comprehensive review or theoretical framework that describes how gaze to faces supports face-to-face interaction. In this review, I address the following questions: (1) When does gaze need to be allocated to a particular region of a face in order to provide the relevant information for successful interaction; (2) How do humans look at other people, and faces in particular, regardless of whether gaze needs to be directed at a particular region to acquire the relevant visual information; (3) How does gaze support the regulation of interaction? The work reviewed spans psychophysical research, observational research and eye-tracking research in both lab-based and interactive contexts. Based on the literature overview, I sketch a framework for future research based on dynamic systems theory. The framework holds that gaze should be investigated in relation to sub-states of the interaction, encompassing sub-states of the interactors, the content of the interaction as well as the interactive context. The relevant sub-states for understanding gaze in interaction vary over different timescales from microgenesis to ontogenesis and phylogenesis. The framework has important implications for vision science, psychopathology, developmental science and social robotics.

Sign in / Sign up

Export Citation Format

Share Document