scholarly journals Incorporating Interpersonal Synchronization Features for Automatic Emotion Recognition from Visual and Audio Data during Communication

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5317
Author(s):  
Jingyu Quan ◽  
Yoshihiro Miyake ◽  
Takayuki Nozawa
Keyword(s):  
Social Interaction ◽  
Emotion Recognition ◽  
Main Experiment ◽  
Speaker Independent ◽  
Audio Data ◽  
Individual Features ◽  
Time Lagged ◽  
The Individual

During social interaction, humans recognize others’ emotions via individual features and interpersonal features. However, most previous automatic emotion recognition techniques only used individual features—they have not tested the importance of interpersonal features. In the present study, we asked whether interpersonal features, especially time-lagged synchronization features, are beneficial to the performance of automatic emotion recognition techniques. We explored this question in the main experiment (speaker-dependent emotion recognition) and supplementary experiment (speaker-independent emotion recognition) by building an individual framework and interpersonal framework in visual, audio, and cross-modality, respectively. Our main experiment results showed that the interpersonal framework outperformed the individual framework in every modality. Our supplementary experiment showed—even for unknown communication pairs—that the interpersonal framework led to a better performance. Therefore, we concluded that interpersonal features are useful to boost the performance of automatic emotion recognition tasks. We hope to raise attention to interpersonal features in this study.

EXPRESS: Remembered Together: Social interaction facilitates retrieval while reducing individuation of features within bound representations.

2021 ◽  
pp. 174702182110564
Author(s):  
Tim Vestner ◽  
Jonathan Flavell ◽  
Richard Cook ◽  
Steven Tipper
Keyword(s):  
Social Interaction ◽  
Social Interactions ◽  
Joint Attention ◽  
Automatic Detection ◽  
Strategic Processing ◽  
Binding Process ◽  
Individual Features ◽  
The Individual ◽  
Individual Objects

When encountering social scenes, there appears to be rapid and automatic detection of social interactions. Representations of interacting people appear to be bound together via a mechanism of joint attention, which results in enhanced memory, even when participants are unaware that memory is required. However, even though access is facilitated for socially bound representations, we predicted that the individual features of these representations are less efficiently encoded, and features can therefore migrate between the constituent interacting individuals. This was confirmed in Experiment 1, where overall memory for interacting compared to non-interacting dyads was facilitated but binding of features within an individual was weak, resulting in feature migration errors. Experiment 2 demonstrated the role of conscious strategic processing, where participants were aware that memory would be tested. With such awareness, attention can be focused on individual objects allowing the binding of features. The results support an account of two forms of processing: An initial automatic social binding process where interacting individuals are represented as one episode in memory facilitating access; and a further stage where attention can be focused on each individual enabling the binding of features within individual objects.

Penggunaan Social Stories untuk Menurunkan Perilaku Nonadaptif Saat Berada dalam Kendaraan Bagi Autisme Dewasa

2020 ◽  
Vol 1 (2) ◽  
pp. 103
Author(s):  
Markus Nanang Irawan ◽  
Sri Widyawati
Keyword(s):  
Social Interaction ◽  
Behavior Problems ◽  
Adaptive Behavior ◽  
Behavioral Problems ◽  
Research Method ◽  
Social Stories ◽  
Steering Wheel ◽  
Graph Analysis ◽  
Adult Autism ◽  
The Individual

<pre><span>Individuals autism often have non-adaptive behavioral problems because of their barriers in communication and social interaction. The problem of non-adaptive behavior is often a nuisance to others because its appearance is not appropriate and not in accordance with the environment, age, and expectations of responsibility. One case of non-adaptive behavior that arises is the behavior while in a vehicle where the individual shows the behavior of singing loudly, knocking windows, pinching the driver, even holding the steering wheel. Based on these problems, this study aims to reduce non-adaptive behavior while in a vehicle. Participant is an adult autism. The research method is experiment by giving Social Stories to participants before riding the vehicle then recording to the possibility appearance of non adaptive behavior. The results of graph analysis showed a decrease in non adaptive behavior of adult autism adults while in a vehicle. This study became one of the important studies because it tries to understand the dynamics of behavior problems of individual autisme in adulthood.<strong></strong></span></pre><pre><span> </span></pre>

Designing the Person: Sociological Assumptions Embodied within the Architecture of Charles Rennie Mackintosh and Le Corbusier

2005 ◽  
Vol 14 (1) ◽  
pp. 141-162
Author(s):  
Clare Spencer
Keyword(s):  
Social Interaction ◽  
Comparative Study ◽  
Le Corbusier ◽  
Western Society ◽  
Architectural Practice ◽  
Individual Person ◽  
Interesting Insight ◽  
Starting Point ◽  
The Individual ◽  
Insight Into

This essay presents a comparative study of the sociological assumptions implicit, and to some extent explicit, in the work of two famous architects, Charles Rennie Mackintosh and Le Corbusier. The inhabitant implied through the architectural practice of Le Corbusier resembles Elias's homo clausus (closed person), the mode of self experience viewed by Elias as the dominant one in Western society and one which sees the individual person as a ‘thinking subject’ and the starting point of knowledge. Mackintosh's designs, in contrast, imply individual people closer to Elias‘s homines aperti, social beings who are shaped through social interaction and interdependence. This paper demonstrates how, as well as fulfilling social, cultural and political needs, architecture carries, within in its designs, certain assumptions about how people and how they do, and should, live. The adoption of an Eliasian perspective provides an interesting insight into how these assumptions can shape self-experience and social interaction in the buildings of each architect.

scholarly journals Self-esteem, social comparison, and Facebook use

2018 ◽  
Vol 14 (4) ◽  
pp. 831-845 ◽  
Author(s):  
Elisa Bergagna ◽  
Stefano Tartaglia
Keyword(s):  
Social Interaction ◽  
Social Comparison ◽  
Technology Use ◽  
Structural Equation ◽  
Structural Equation Models ◽  
Self Esteem ◽  
Self Report ◽  
Individual Traits ◽  
Facebook Use ◽  
The Individual

Facebook use is very popular among young people, but many open issues remain regarding the individual traits that are antecedents of different behaviours enacted online. This study aimed to investigate whether the relationship between self-esteem and the amount of time on Facebook could be mediated by a tendency towards social comparison. Moreover, three different modalities of Facebook use were distinguished, i.e., social interaction, simulation, and search for relations. Because of gender differences in technology use and social comparison, the mediation models were tested separately for males and females. Data were collected by means of a self-report questionnaire with a sample of 250 undergraduate and graduate Italian students (mean age: 22.18 years). The relations were examined empirically by means of four structural equation models. The results revealed the role of orientation to social comparison in mediating the relations between low self-esteem and some indicators of Facebook use, i.e., daily hours on Facebook and the use of Facebook for simulation. For females, the use of Facebook for social interaction was directly influenced by high self-esteem and indirectly influenced by low self-esteem. Globally, the dimension of social comparison on Facebook emerged as more important for females than for males.

scholarly journals Review: Posed vs. Genuine Facial Emotion Recognition and Expression in Autism and Implications for Intervention

2021 ◽  
Vol 12 ◽  
Author(s):  
Paula J. Webster ◽  
Shuo Wang ◽  
Xin Li
Keyword(s):  
Social Interaction ◽  
Emotion Recognition ◽  
Facial Expressions ◽  
Autism Spectrum ◽  
Facial Emotion Recognition ◽  
Facial Emotion ◽  
Dynamic Stimuli ◽  
Behavioral Studies ◽  
Facial Expressions Of Emotion ◽  
Cartoon Characters

Different styles of social interaction are one of the core characteristics of autism spectrum disorder (ASD). Social differences among individuals with ASD often include difficulty in discerning the emotions of neurotypical people based on their facial expressions. This review first covers the rich body of literature studying differences in facial emotion recognition (FER) in those with ASD, including behavioral studies and neurological findings. In particular, we highlight subtle emotion recognition and various factors related to inconsistent findings in behavioral studies of FER in ASD. Then, we discuss the dual problem of FER – namely facial emotion expression (FEE) or the production of facial expressions of emotion. Despite being less studied, social interaction involves both the ability to recognize emotions and to produce appropriate facial expressions. How others perceive facial expressions of emotion in those with ASD has remained an under-researched area. Finally, we propose a method for teaching FER [FER teaching hierarchy (FERTH)] based on recent research investigating FER in ASD, considering the use of posed vs. genuine emotions and static vs. dynamic stimuli. We also propose two possible teaching approaches: (1) a standard method of teaching progressively from simple drawings and cartoon characters to more complex audio-visual video clips of genuine human expressions of emotion with context clues or (2) teaching in a field of images that includes posed and genuine emotions to improve generalizability before progressing to more complex audio-visual stimuli. Lastly, we advocate for autism interventionists to use FER stimuli developed primarily for research purposes to facilitate the incorporation of well-controlled stimuli to teach FER and bridge the gap between intervention and research in this area.

scholarly journals Fostering Emotion Recognition in Children with Autism Spectrum Disorder

2021 ◽  
Vol 5 (10) ◽  
pp. 57
Author(s):  
Vinícius Silva ◽  
Filomena Soares ◽  
João Sena Esteves ◽  
Cristina P. Santos ◽  
Ana Paula Pereira
Keyword(s):  
Autism Spectrum Disorder ◽  
Social Interaction ◽  
Emotion Recognition ◽  
Facial Expressions ◽  
Social Communication ◽  
Autism Spectrum ◽  
Spectrum Disorder ◽  
Support Vector ◽  
Robotic Platform ◽  
Children With Asd

Facial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind® robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel® RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills.

scholarly journals KONSEP DIRI SEORANG DA'I

2019 ◽  
Vol 1 (2) ◽  
pp. 207
Author(s):  
Noormawanti, Iswati
Keyword(s):  
Social Interaction ◽  
The Self ◽  
Self Concept ◽  
Social Aspects ◽  
The Core ◽  
Self Development ◽  
The World ◽  
Entire Complex ◽  
The Individual ◽  
Beliefs And Attitudes

The concept of self is an understanding of the attitude of the individual towards himself so that it results in the interaction of two or more people. Self-concept is a factor that communicates with others. The concept of self is the views and attitudes of individuals towards themselves, characteristics and individual and self-motivation. The self-view includes not only individual strengths but also weaknesses and even failures. This self-concept is psychological, social and physical. Self-concept is our views and feelings about ourselves, which include physical, psychological and social aspects. The concept of self is not just a descriptive picture, but also an assessment of ourselves, including what we think and how we feel. Anita Taylor defines self-concept as "all you think and feel about you, the entire complex of beliefs and attitudes you hold abaout yourself '. Human behavior is a product of their interpretation of the world around them through social interaction. Behavior is often a choice as a feasible thing to do based on how it defines the existing situation. The definition they give to other people, situations, objects and even themselves determines their behavior. So it is individuals who are considered active to regulate and determine their own behavior and environment. While the core of the individual is consciousness (consciousness). self-development depends on communication with others, which shape or influence themselves

scholarly journals Study of Human and Robot Social Interaction Using Artificial Cognition Methods

2020 ◽  
pp. 458-464
Author(s):  
Rupal Chaudhary
Keyword(s):  
Social Interaction ◽  
Control Systems ◽  
Mathematical Thinking ◽  
Point Of View ◽  
Wide Scope ◽  
Long Run ◽  
Normal Human ◽  
Express Information ◽  
The Individual ◽  
Human Robot Collaboration

Abstract. HRI challenges AI in numerous regards: dynamic, somewhat obscure conditions that were not initially intended for robots; a wide scope of circumstances with rich semantics to comprehend and decipher; physical associations with people that require fine, low-inactivity, yet socially satisfactory control systems; regular and multimodal correspondence. This paper is an endeavor to describe these difficulties and to introduce a lot of key dynamic issues that should be tended to for an intellectual robot to effectively impart space and assignments to a person. To begin with, we distinguish the individual and community oriented intellectual aptitudes required: mathematical thinking and circumstance appraisal dependent on point of view taking and cost-adequacy investigation; securing and the article talks about every one of these capacities, presents work executions and shows how they consolidate in a sound and unique human-robot collaboration deliberative design. Fortified by the aftereffects of the preliminary, we should in the long run exhibit how the board's express information, both symbolic and quantitative, is instrumental to more extravagant and more normal human-robot associations by squeezing for certain, human-level semantics inside the robot framework.

scholarly journals IMPROVED SPEAKER-INDEPENDENT EMOTION RECOGNITION FROM SPEECH USING TWO-STAGE FEATURE REDUCTION

2015 ◽  
Vol 14 ◽  
pp. 57-76
Author(s):  
Hasrul Mohd Nazid ◽  
Hariharan Muthusamy ◽  
Vikneswaran Vijean ◽  
Sazali Yaacob
Keyword(s):  
Emotion Recognition ◽  
Feature Reduction ◽  
Two Stage ◽  
Speaker Independent
Sign in / Sign up

Export Citation Format

Share Document