scholarly journals DeepFlow: Detecting Optimal User Experience From Physiological Data Using Deep Neural Networks

Author(s):  
Marco Maier ◽  
Daniel Elsner ◽  
Chadly Marouane ◽  
Meike Zehnle ◽  
Christoph Fuchs

Flow is an affective state of optimal experience, total immersion and high productivity. While often associated with (professional) sports, it is a valuable information in several scenarios ranging from work environments to user experience evaluations, and we expect it to be a potential reward signal for human-in-the-loop reinforcement learning systems. Traditionally, flow has been assessed through questionnaires which prevents its use in online, real-time environments. In this work, we present our findings towards estimating a user's flow state based on physiological signals measured using wearable devices. We conducted a study with participants playing the game Tetris in varying difficulty levels, leading to boredom, stress, and flow. Using an end-to-end deep learning architecture, we achieve an accuracy of 67.50% in recognizing high flow vs. low flow states and 49.23% in distinguishing all three affective states boredom, flow, and stress.

2021 ◽  
Author(s):  
Valentin Holzwarth ◽  
Johannes Schneider ◽  
Joshua Handali ◽  
Joy Gisler ◽  
Christian Hirt ◽  
...  

AbstractInferring users’ perceptions of Virtual Environments (VEs) is essential for Virtual Reality (VR) research. Traditionally, this is achieved through assessing users’ affective states before and after being exposed to a VE, based on standardized, self-assessment questionnaires. The main disadvantage of questionnaires is their sequential administration, i.e., a user’s affective state is measured asynchronously to its generation within the VE. A synchronous measurement of users’ affective states would be highly favorable, e.g., in the context of adaptive systems. Drawing from nonverbal behavior research, we argue that behavioral measures could be a powerful approach to assess users’ affective states in VR. In this paper, we contribute by providing methods and measures evaluated in a user study involving 42 participants to assess a users’ affective states by measuring head movements during VR exposure. We show that head yaw significantly correlates with presence, mental and physical demand, perceived performance, and system usability. We also exploit the identified relationships for two practical tasks that are based on head yaw: (1) predicting a user’s affective state, and (2) detecting manipulated questionnaire answers, i.e., answers that are possibly non-truthful. We found that affective states can be predicted significantly better than a naive estimate for mental demand, physical demand, perceived performance, and usability. Further, manipulated or non-truthful answers can also be estimated significantly better than by a naive approach. These findings mark an initial step in the development of novel methods to assess user perception of VEs.


Vision ◽  
2021 ◽  
Vol 5 (2) ◽  
pp. 17
Author(s):  
Maria Elisa Della-Torre ◽  
Daniele Zavagno ◽  
Rossana Actis-Grosso

E-motions are defined as those affective states the expressions of which—conveyed either by static faces or body posture—embody a dynamic component and, consequently, convey a higher sense of dynamicity than other emotional expressions. An experiment is presented, aimed at testing whether e-motions are perceived as such also by individuals with autism spectrum disorders (ASDs), which have been associated with impairments in emotion recognition and in motion perception. To this aim we replicate with ASD individuals a study, originally conducted with typically developed individuals (TDs), in which we showed to both ASD and TD participants 14 bodiless heads and 14 headless bodies taken from eleven static artworks and four drawings. The Experiment was divided into two sessions. In Session 1 participants were asked to freely associate each stimulus to an emotion or an affective state (Task 1, option A); if they were unable to find a specific emotion, the experimenter showed them a list of eight possible emotions (words) and asked them to choose one from such list, that best described the affective state portrayed in the image (Task 1, option B). After their choice, they were asked to rate the intensity of the perceived emotion on a seven point Likert scale (Task 2). In Session 2 participants were requested to evaluate the degree of dynamicity conveyed by each stimulus on a 7 point Likert scale. Results showed that ASDs and TDs shared a similar range of verbal expressions defining emotions; however, ASDs (i) showed an impairment in the ability to spontaneously assign an emotion to a headless body, and (ii) they more frequently used terms denoting negative emotions (for both faces and bodies) as compared to neutral emotions, which in turn were more frequently used by TDs. No difference emerged between the two groups for positive emotions, with happiness being the emotion better recognized in both faces and in bodies. Although overall there are no significant differences between the two groups with respect to the emotions assigned to the images and the degree of perceived dynamicity, the interaction Artwork x Group showed that for some images ASDs assigned a different value than TDs to perceived dynamicity. Moreover, two images were interpreted by ASDs as conveying completely different emotions than those perceived by TDs. Results are discussed in light of the ability of ASDs to resolve ambiguity, and of possible different cognitive styles characterizing the aesthetical/emotional experience.


Author(s):  
Said Alsidawi ◽  
Sana Khan ◽  
Sorin V. Pislaru ◽  
Jeremy J. Thaden ◽  
Edward A. El-Am ◽  
...  

Background: Atrial fibrillation (AF) is a low-flow state and may underestimate aortic stenosis (AS) severity. Single-high Doppler signals (HS) consistent with severe AS (peak velocity ≥4 m/s or mean gradient ≥40 mm Hg) are averaged down in current practice. The objective for the study was to determine the significance of HS in AF low-gradient AS (LGAS). Methods: One thousand five hundred forty-one patients with aortic valve area ≤1 cm 2 and left ventricular ejection fraction ≥50% were identified and classified as high-gradient AS (HGAS) (≥40 mm Hg) and LGAS (<40 mm Hg), and AF versus sinus rhythm (SR). Available computed tomography aortic valve calcium scores (AVCS) were retrieved from the medical record. Outcomes were assessed. Results: Mean age was 76±11 years, female 47%. Mean gradient was 51±12 in SR-HGAS, 48±10 in AF-HGAS, 31±5 in SR-LGAS, and 29±7 mm Hg in AF-LGAS, all P ≤0.001 versus SR-HGAS; HS were present in 33% of AF-LGAS. AVCS were available in 34%. Compared with SR-HGAS (2409 arbitrary units; interquartile range, 1581–3462) AVCS were higher in AF-HGAS (2991 arbitrary units; IQR1978–4229, P =0.001), not different in AF-LGAS (2399 arbitrary units; IQR1817–2810, P =0.47), and lower in SR-LGAS (1593 arbitrary units; IQR945–1832, P <0.001); AVCS in AF-LGAS were higher when HS were present ( P =0.048). Compared with SR-HGAS, the age-, sex-, comorbidity index-, and time-dependent aortic valve replacement-adjusted mortality risk was higher in AF-HGAS (hazard ratio=1.82 [1.40–2.36], P <0.001) and AF-LGAS with HS (hazard ratio=1.54 [1.04–2.26], P =0.03) but not different in AF-LGAS without HS or SR-LGAS (both P =not significant). Conclusions: Severe AS was common in AF-LGAS. AVCS in AF-LGAS were not different from SR-HGAS. AVCS were higher and mortality worse in AF-LGAS when HS were present.


2016 ◽  
Vol 6 (2) ◽  
pp. 1 ◽  
Author(s):  
Michael Fartoukh ◽  
Lucile Chanquoy

<p>We analysed the influence of classroom activities on children’s affective states. Children perform many different activities in the course of an ordinary school day, some of which may trigger changes in their affective state and thus in the availability of their cognitive resources and their degree of motivation. To observe the effects of two such activities (listening to a text and performing a dictation) on affective state, according to grade, we asked 39 third graders and 40 fifth graders to specify their affective state at several points in the day. Results showed that this state varied from one activity to another, and was also dependent on grade level. Third graders differed from fifth graders in the feelings elicited by the activities. The possible implications of these findings for the field of educational psychology and children’s academic performance are discussed.</p>


1994 ◽  
pp. 271-275 ◽  
Author(s):  
H. W. Ch. Töns ◽  
M. Polivoda ◽  
M. Anurov ◽  
Ch. Klein ◽  
A. Öttinger ◽  
...  
Keyword(s):  
Low Flow ◽  

Proceedings ◽  
2018 ◽  
Vol 2 (19) ◽  
pp. 1202 ◽  
Author(s):  
Carlos Bailon ◽  
Miguel Damas ◽  
Hector Pomares ◽  
Daniel Sanabria ◽  
Pandelis Perakakis ◽  
...  

The fluctuation of affective states is a contributing factor to sport performance variability. The context surrounding athletes during their daily life and the evolution of their physiological variables beyond sport events are relevant factors, as they modulate the affective state of the subject over time. However, traditional procedures to assess the affective state are limited to self-reported questionnaires within controlled settings, thus removing the impact of the context. This work proposes a multimodal, context-aware platform that combines the data acquired through smartphones and wearable sensors to assess the affective state of the athlete. The platform is aimed at ubiquitously monitoring the fluctuations of affective states during longitudinal studies within naturalistic environments, overcoming the limitations of previous studies and allowing for the complete evaluation of the factors that could modulate the affective state. This system will also facilitate and expedite the analysis of the relationship between affective states and sport performance.


2020 ◽  
Vol 375 (1800) ◽  
pp. 20190267 ◽  
Author(s):  
Jitka Fialová ◽  
Vít Třebický ◽  
Radim Kuba ◽  
David Stella ◽  
Jakub Binter ◽  
...  

Dominance hierarchy is often established via repeated agonistic encounters where consistent winners are considered dominant. Human body odour contains cues to psychological dominance and competition, but it is not known whether competition outcome (a marker of a change in dominance hierarchy) affects the hedonic quality of human axillary odour. Therefore, we investigated the effect of winning and losing on odour quality. We collected odour samples from Mixed Martial Arts fighters approximately 1 h before and immediately after a match. Raters then assessed samples for pleasantness, attractiveness, masculinity and intensity. We also obtained data on donors' affective state and cortisol and testosterone levels, since these are known to be associated with competition and body odour quality. Perceived body odour pleasantness, attractiveness and intensity significantly decreased while masculinity increased after a match irrespective of the outcome. Nonetheless, losing a match affected the pleasantness of body odour more profoundly, though bordering formal level of significance. Moreover, a path analysis revealed that match loss led to a decrease in odour attractiveness, which was mediated by participants’ negative affective states. Our study suggests that physical competition and to some extent also its outcome affect the perceived quality of human body odour in specific real-life settings, thus providing cues to dominance-related characteristics. This article is part of the Theo Murphy meeting issue ‘Olfactory communication in humans’.


2019 ◽  
Vol 24 (04) ◽  
pp. 2050033
Author(s):  
TOBIAS ROETH ◽  
PATRICK SPIETH ◽  
VERENA JOACHIM

Decision-makers often struggle to terminate unsuccessful new product development (NPD) projects, so that escalating commitment occurs. Although research shows that rational and intuitive decision-making styles (DMS) as well as a decision-maker’s affective state determines the performance of NPD decisions, little is known about their influences on escalating commitment. By applying the affect infusion model in an experimental study, we investigate how a decision-maker’s affective state influence their escalating commitment by focusing on their use of a rational and an intuitive DMS. Our findings, based on 366 respondents, show that a rational DMS is unable to reduce commitment escalation. Surprisingly, an intuitive DMS is able to reduce a decision-maker’s commitment in the case of a positive affect, whereas a rational DMS increases their commitment in the case of a negative affect. Thus, our interdisciplinary research on affect and decision-making extends and contributes to research into decision-making during the NPD process as well as into escalating commitment.


2019 ◽  
Vol 40 (Supplement_1) ◽  
Author(s):  
J T Museli ◽  
L Zambruno ◽  
N Coria ◽  
G Giunta ◽  
J F Salmo ◽  
...  

Abstract Introduction Aortic stenosis (AS) patients are heterogeneous. The relationship between stenosis severity, transvalvular flow state and gradients is conflictive and non-linear. Objective To evaluate the relationship between transvalvular flow state and gradients with the anatomopathological aortic valve characteristics and perioperative morbimortality among patients (pt) submitted to aortic valve replacement (AVR). Methods We analyzed 516 pt with symptomatic severe AS (effective valve area <1 cm2) with preserved left ventricular ejection fraction (>50%) submitted to AVR. Perioperative mortality and a combined endpoint (death, low cardiac output syndrome and acute renal injury) were analyzed dividing the population by transvalvular flow (35 ml/m2) and mean gradient (40 mmHg), both measured by echocardiography. A morphologic evaluation of 383 operatively excised native cardiac valves was performed. Valvular thickening and calcification were categorized in mild, moderate and severe. Results Male subjects represented 52.9% (283 pt). Mean age were 69±11.5 years. Pt showed a mean ejection fraction of 61±4.8%, the peak gradient was 86.2±24 mmHg, and mean gradient was 53±18 mmHg. Cardiac low output syndrome (normal flow (NF) – 14%, low flow (LF) – 23%; p<0,02), IABP (NF 1,8%, LF 6%, p<0,02) and perioperative mortality (NF 2,7%, LF 7%, p<0,02) were more frequent in low flow pt (185 – 35%). Bicuspid valves represented 24.5% of the whole population. Bicuspid patients were younger 64±9 vs 73±12 years (p<0.05) and had more moderate–severe calcification (MSC) 93.4% vs 75.6% (p<0.05). No difference was found in moderate -severe thickening (MSTh) and MSC when analyzing the population by flow (35 ml/m2). On the contrary, low gradient pt (<40mmHg) had lower MSC and MSTh. (Table) Finally, 4 groups were considered: normal flow–high gradient NFHG (52.2%), normal flow–low gradient NFLG (12%), low flow–high gradient LFHG (25.5%) and low flow–low gradient LFLG (10.1%). A trend toward more perioperative events was seen in the LF-LG group despite less calcified and thickened valves. (Figure) Table 1 Normal Flow Low Flow P value Normal gradient Low gradient P value M-S thickening 143 (58.1%) 80 (58.3%) NS 186 (62.4%) 37 (43.5%) 0.0018 M-S calcification 195 (79.2%) 119 (86.8%) NS 263 (88.2%) 51 (60%) <0.05 Bicuspid valve 62 (25%) 32 (23%) NS 62 (25.2%) 32 (23.3%) NS M-S: Moderate-Severe. Figure 1 Conclusions In our population of severe symptomatic AS with preserved ejection fraction submitted to AVR, low gradient pts had less calcified and thickened valves. LFLG pts presented a trend towards more perioperative events despite having less valvular calcification.


Sign in / Sign up

Export Citation Format

Share Document