scholarly journals Affective Recognition for Multimedia Environments A Review

Author(s):  
Mohammadhossein Moghimi ◽  
Robert Stone ◽  
Pia Rotshtein

Detecting emotional responses in multimedia environments is an academically and technologically challenging research issue. In the domain of Affective Computing, from non-interactive and static stimuli (e.g. affective image) to highly interactive and dynamic environments (affective virtual realities), researchers have employed a wide range of affective stimuli to measure and interpret human psychological and physiological emotional behaviours. Various psychophysiological parameters (e.g. Electroencephalography, Galvanic Skin Response, Heart Rate, etc.) have been employed and investigated, in order to detect and quantify human affective states. In this paper, we present a detailed literature review of over 33 affective computing studies, undertaken since 1993. All aspects of these studies (stimuli type, pre-processing, windowing, features, classification technique, etc.) have been reported in detail. We believe that this paper not only summarises the breadth of research over the past 20 years, but also serves to clarify various significant aspects and details of this increasingly valuable and relevant research area.

Author(s):  
Luma Tabbaa ◽  
Ryan Searle ◽  
Saber Mirzaee Bafti ◽  
Md Moinul Hossain ◽  
Jittrapol Intarasisrisawat ◽  
...  

The paper introduces a multimodal affective dataset named VREED (VR Eyes: Emotions Dataset) in which emotions were triggered using immersive 360° Video-Based Virtual Environments (360-VEs) delivered via Virtual Reality (VR) headset. Behavioural (eye tracking) and physiological signals (Electrocardiogram (ECG) and Galvanic Skin Response (GSR)) were captured, together with self-reported responses, from healthy participants (n=34) experiencing 360-VEs (n=12, 1--3 min each) selected through focus groups and a pilot trial. Statistical analysis confirmed the validity of the selected 360-VEs in eliciting the desired emotions. Preliminary machine learning analysis was carried out, demonstrating state-of-the-art performance reported in affective computing literature using non-immersive modalities. VREED is among the first multimodal VR datasets in emotion recognition using behavioural and physiological signals. VREED is made publicly available on Kaggle1. We hope that this contribution encourages other researchers to utilise VREED further to understand emotional responses in VR and ultimately enhance VR experiences design in applications where emotional elicitation plays a key role, i.e. healthcare, gaming, education, etc.


Author(s):  
Maja Pantic

We seem to be entering an era of enhanced digital connectivity. Computers and Internet have become so embedded in the daily fabric of people’s lives that people simply cannot live without them (Hoffman, Novak, & Venkatesh, 2004). We use this technology to work, to communicate, to shop, to seek out new information, and to entertain ourselves. With this ever-increasing diffusion of computers in society, human–computer interaction (HCI) is becoming increasingly essential to our daily lives. HCI design was first dominated by direct manipulation and then delegation. The tacit assumption of both styles of interaction has been that the human will be explicit, unambiguous, and fully attentive while controlling the information and command flow. Boredom, preoccupation, and stress are unthinkable even though they are “very human” behaviors. This insensitivity of current HCI designs is fine for well-codified tasks. It works for making plane reservations, buying and selling stocks, and, as a matter of fact, almost everything we do with computers today. But this kind of categorical computing is inappropriate for design, debate, and deliberation. In fact, it is the major impediment to having flexible machines capable of adapting to their users and their level of attention, preferences, moods, and intentions. The ability to detect and understand affective states of a person we are communicating with is the core of emotional intelligence. Emotional intelligence (EQ) is a facet of human intelligence that has been argued to be indispensable and even the most important for a successful social life (Goleman, 1995). When it comes to computers, however, not all of them will need emotional intelligence and none will need all of the related skills that we need. Yet human–machine interactive systems capable of sensing stress, inattention, and heedfulness, and capable of adapting and responding appropriately to these affective states of the user are likely to be perceived as more natural, more efficacious, and more trustworthy. The research area of machine analysis of human affective states and employment of this information to build more natural, flexible (affective) HCI goes by a general name of affective computing, introduced first by Picard (1997).


Author(s):  
Mohamed Abdul – Rahim ◽  
Zheng – Sheng Yu

Image mosaicing is one of the most important subjects of research in computer vision at current. Image mocaicing requires the integration of direct techniques and feature based techniques. Direct techniques are found to be very useful for mosaicing large overlapping regions, small translations and rotations while feature based techniques are useful for small overlapping regions. Feature based image mosaicing is a combination of corner detection, corner matching, motion parameters estimation and image stitching. Furthermore, image mosaicing is considered the process of obtaining a wider field-of-view of a scene from a sequence of partial views, which has been an attractive research area because of its wide range of applications, including motion detection, resolution enhancement, monitoring global land usage, and medical imaging. Numerous algorithms for image mosaicing have been proposed over the last two decades. In this paper the authors present a review on different approaches for image mosaicing and the literature over the past few years in the field of image masaicing methodologies. The authors take an overview on the various methods for image mosaicing. This review paper also provides an in depth survey of the existing image mosaicing algorithms by classifying them into several groups. For each group, the fundamental concepts are first clearly explained. Finally this paper also reviews and discusses the strength and weaknesses of all the mosaicing groups.


Author(s):  
A. Strojnik ◽  
J.W. Scholl ◽  
V. Bevc

The electron accelerator, as inserted between the electron source (injector) and the imaging column of the HVEM, is usually a strong lens and should be optimized in order to ensure high brightness over a wide range of accelerating voltages and illuminating conditions. This is especially true in the case of the STEM where the brightness directly determines the highest resolution attainable. In the past, the optical behavior of accelerators was usually determined for a particular configuration. During the development of the accelerator for the Arizona 1 MEV STEM, systematic investigation was made of the major optical properties for a variety of electrode configurations, number of stages N, accelerating voltages, 1 and 10 MEV, and a range of injection voltages ϕ0 = 1, 3, 10, 30, 100, 300 kV).


2019 ◽  
Vol 62 (12) ◽  
pp. 4335-4350 ◽  
Author(s):  
Seth E. Tichenor ◽  
J. Scott Yaruss

Purpose This study explored group experiences and individual differences in the behaviors, thoughts, and feelings perceived by adults who stutter. Respondents' goals when speaking and prior participation in self-help/support groups were used to predict individual differences in reported behaviors, thoughts, and feelings. Method In this study, 502 adults who stutter completed a survey examining their behaviors, thoughts, and feelings in and around moments of stuttering. Data were analyzed to determine distributions of group and individual experiences. Results Speakers reported experiencing a wide range of both overt behaviors (e.g., repetitions) and covert behaviors (e.g., remaining silent, choosing not to speak). Having the goal of not stuttering when speaking was significantly associated with more covert behaviors and more negative cognitive and affective states, whereas a history of self-help/support group participation was significantly associated with a decreased probability of these behaviors and states. Conclusion Data from this survey suggest that participating in self-help/support groups and having a goal of communicating freely (as opposed to trying not to stutter) are associated with less negative life outcomes due to stuttering. Results further indicate that the behaviors, thoughts, and experiences most commonly reported by speakers may not be those that are most readily observed by listeners.


2020 ◽  
Vol 04 (04) ◽  
pp. 369-372
Author(s):  
Paul B. Romesser ◽  
Christopher H. Crane

AbstractEvasion of immune recognition is a hallmark of cancer that facilitates tumorigenesis, maintenance, and progression. Systemic immune activation can incite tumor recognition and stimulate potent antitumor responses. While the concept of antitumor immunity is not new, there is renewed interest in tumor immunology given the clinical success of immune modulators in a wide range of cancer subtypes over the past decade. One particularly interesting, yet exceedingly rare phenomenon, is the abscopal response, characterized by a potent systemic antitumor response following localized tumor irradiation presumably attributed to reactivation of antitumor immunity.


2020 ◽  
Vol 1 (2) ◽  
pp. 157-172
Author(s):  
Thomas Leitch

Building on Tzvetan Todorov's observation that the detective novel ‘contains not one but two stories: the story of the crime and the story of the investigation’, this essay argues that detective novels display a remarkably wide range of attitudes toward the several pasts they represent: the pasts of the crime, the community, the criminal, the detective, and public history. It traces a series of defining shifts in these attitudes through the evolution of five distinct subgenres of detective fiction: exploits of a Great Detective like Sherlock Holmes, Golden Age whodunits that pose as intellectual puzzles to be solved, hardboiled stories that invoke a distant past that the present both breaks with and echoes, police procedurals that unfold in an indefinitely extended present, and historical mysteries that nostalgically fetishize the past. It concludes with a brief consideration of genre readers’ own ambivalent phenomenological investment in the past, present, and future each detective story projects.


What did it mean to be a man in Scotland over the past nine centuries? Scotland, with its stereotypes of the kilted warrior and the industrial ‘hard man’, has long been characterised in masculine terms, but there has been little historical exploration of masculinity in a wider context. This interdisciplinary collection examines a diverse range of the multiple and changing forms of masculinities from the late eleventh to the late twentieth century, exploring the ways in which Scottish society through the ages defined expectations for men and their behaviour. How men reacted to those expectations is examined through sources such as documentary materials, medieval seals, romances, poetry, begging letters, police reports and court records, charity records, oral histories and personal correspondence. Focusing upon the wide range of activities and roles undertaken by men – work, fatherhood and play, violence and war, sex and commerce – the book also illustrates the range of masculinities that affected or were internalised by men. Together, the chapters illustrate some of the ways Scotland’s gender expectations have changed over the centuries and how, more generally, masculinities have informed the path of Scottish history


Author(s):  
Corey Kai Nelson Schultz

This book examines how the films of the Chinese Sixth Generation filmmaker Jia Zhangke evoke the affective “felt” experience of China’s contemporary social and economic transformations, by examining the class figures of worker, peasant, soldier, intellectual, and entrepreneur that are found in the films. Each chapter analyzes a figure’s socio-historical context, its filmic representation, and its recurring cinematic tropes in order to understand how they create what Raymond Williams calls “structures of feeling” – feelings that concretize around particular times, places, generations, and classes that are captured and evoked in art – and charts how this felt experience has changed over the past forty years of China’s economic reforms. The book argues that that Jia’s cinema should be understood not just as narratives that represent Chinese social change, but also as an effort to engage the audience’s emotional responses during this period of China’s massive and fast-paced transformation.


2015 ◽  
Vol 2 (2) ◽  
pp. 85-94
Author(s):  
Christina Landman

Dullstroom-Emnotweni is the highest town in South Africa. Cold and misty, it is situated in the eastern Highveld, halfway between the capital Pretoria/Tswane and the Mozambique border. Alongside the main road of the white town, 27 restaurants provide entertainment to tourists on their way to Mozambique or the Kruger National Park. The inhabitants of the black township, Sakhelwe, are remnants of the Southern Ndebele who have lost their land a century ago in wars against the whites. They are mainly dependent on employment as cleaners and waitresses in the still predominantly white town. Three white people from the white town and three black people from the township have been interviewed on their views whether democracy has brought changes to this society during the past 20 years. Answers cover a wide range of views. Gratitude is expressed that women are now safer and HIV treatment available. However, unemployment and poverty persist in a community that nevertheless shows resilience and feeds on hope. While the first part of this article relates the interviews, the final part identifies from them the discourses that keep the black and white communities from forming a group identity that is based on equality and human dignity as the values of democracy.


Sign in / Sign up

Export Citation Format

Share Document