A Survey of Full-Body Motion Reconstruction in Immersive Virtual Reality Applications

2020 ◽  
Vol 26 (10) ◽  
pp. 3089-3108 ◽  
Author(s):  
Polona Caserman ◽  
Augusto Garcia-Agundez ◽  
Stefan Gobel
Keyword(s):  
Virtual Reality ◽  
Body Motion ◽  
Immersive Virtual Reality ◽  
Motion Reconstruction ◽  
Full Body

scholarly journals Embodied virtual reality for the study of real-world motor learning

PLoS ONE ◽  
2021 ◽  
Vol 16 (1) ◽  
pp. e0245717
Author(s):  
Shlomi Haar ◽  
Guhan Sundar ◽  
A. Aldo Faisal
Keyword(s):  
Virtual Reality ◽  
Motor Learning ◽  
Visual Feedback ◽  
Real World ◽  
Motion Tracking ◽  
Body Motion ◽  
Controlled Environment ◽  
Short Term ◽  
Learning And Adaptation ◽  
Full Body

Motor-learning literature focuses on simple laboratory-tasks due to their controlled manner and the ease to apply manipulations to induce learning and adaptation. Recently, we introduced a billiards paradigm and demonstrated the feasibility of real-world-neuroscience using wearables for naturalistic full-body motion-tracking and mobile-brain-imaging. Here we developed an embodied virtual-reality (VR) environment to our real-world billiards paradigm, which allows to control the visual feedback for this complex real-world task, while maintaining sense of embodiment. The setup was validated by comparing real-world ball trajectories with the trajectories of the virtual balls, calculated by the physics engine. We then ran our short-term motor learning protocol in the embodied VR. Subjects played billiard shots when they held the physical cue and hit a physical ball on the table while seeing it all in VR. We found comparable short-term motor learning trends in the embodied VR to those we previously reported in the physical real-world task. Embodied VR can be used for learning real-world tasks in a highly controlled environment which enables applying visual manipulations, common in laboratory-tasks and rehabilitation, to a real-world full-body task. Embodied VR enables to manipulate feedback and apply perturbations to isolate and assess interactions between specific motor-learning components, thus enabling addressing the current questions of motor-learning in real-world tasks. Such a setup can potentially be used for rehabilitation, where VR is gaining popularity but the transfer to the real-world is currently limited, presumably, due to the lack of embodiment.

scholarly journals Embodied virtual reality for the study of real-world motor learning

2020 ◽  
Author(s):  
Shlomi Haar ◽  
Guhan Sundar ◽  
A. Aldo Faisal
Keyword(s):  
Virtual Reality ◽  
Motor Learning ◽  
Brain Imaging ◽  
Visual Feedback ◽  
Real World ◽  
Motion Tracking ◽  
Body Motion ◽  
Controlled Environment ◽  
Learning And Adaptation ◽  
Full Body

AbstractMotor-learning literature focuses on simple laboratory-tasks due to their controlled manner and the ease to apply manipulations to induce learning and adaptation. Recently, we introduced a billiards paradigm and demonstrated the feasibility of real-world-neuroscience using wearables for naturalistic full-body motion-tracking and mobile-brain-imaging. Here we developed an embodied virtual-reality (VR) environment to our real-world billiards paradigm, which allows to control the visual feedback for this complex real-world task, while maintaining sense of embodiment. The setup was validated by comparing real-world ball trajectories with the trajectories of the virtual balls, calculated by the physics engine. We then ran our learning protocol in the embodied VR. Subjects played billiard shots when they held the physical cue and hit a physical ball on the table while seeing it all in VR. We found comparable learning trends in the embodied VR to those we previously reported in the physical real-world task. Embodied VR can be used for learning real-world tasks in a highly controlled environment which enables applying visual manipulations, common in laboratory-tasks and rehabilitation, to a real-world full-body task. Embodied VR enables to manipulate feedback and apply perturbations to isolate and assess interactions between specific motor-learning components, thus enabling addressing the current questions of motor-learning in real-world tasks. Such a setup can be used for rehabilitation, where VR is gaining popularity but the transfer to the real-world is currently limited, presumably, due to the lack of embodiment.

scholarly journals Comparison between Full Body Motion Recognition Camera Interaction and Hand Controllers Interaction used in Virtual Reality Exposure Therapy for Acrophobia

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1244 ◽  
Author(s):  
Jacob Kritikos ◽  
Chara Zoitaki ◽  
Giannis Tzannetos ◽  
Anxhelino Mehmeti ◽  
Marilina Douloudi ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Anxiety Disorders ◽  
Exposure Therapy ◽  
Body Motion ◽  
Entire Body ◽  
Natural Interaction ◽  
Motion Recognition ◽  
Virtual Reality Exposure Therapy ◽  
Virtual Reality Exposure ◽  
Full Body

Virtual Reality has already been proven as a useful supplementary treatment tool for anxiety disorders. However, no specific technological importance has been given so far on how to apply Virtual Reality with a way that properly stimulates the phobic stimulus and provide the necessary means for lifelike experience. Thanks to technological advancements, there is now a variety of hardware that can help enhance stronger emotions generated by Virtual Reality systems. This study aims to evaluate the feeling of presence during different hardware setups of Virtual Reality Exposure Therapy, and, particularly how the user’s interaction with those setups can affects their sense of presence during the virtual simulation. An acrophobic virtual scenario is used as a case study by 20 phobic individuals and the Witmer–Singer presence questionnaire was used for presence evaluation by the users of the system. Statistical analysis on their answers revealed that the proposed full body Motion Recognition Cameras system generates a better feeling of presence compared to the Hand Controllers system. This is thanks to the Motion Recognition Cameras, which track and allow display of the user’s entire body within the virtual environment. Thus, the users are enabled to interact and confront the anxiety-provoking stimulus as in real world. Further studies are recommended, in which the proposed system could be used in Virtual Reality Exposure Therapy trials with acrophobic patients and other anxiety disorders as well, since the proposed system can provide natural interaction in various simulated environments.

scholarly journals Results and Guidelines From a Repeated-Measures Design Experiment Comparing Standing and Seated Full-Body Gesture-Based Immersive Virtual Reality Exergames: Within-Subjects Evaluation (Preprint)

2020 ◽  
Author(s):  
Wenge Xu ◽  
Hai-Ning Liang ◽  
Qiuyu He ◽  
Xiang Li ◽  
Kangyou Yu ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Intrinsic Motivation ◽  
Motion Sickness ◽  
Fear Of Falling ◽  
Rating Of Perceived Exertion ◽  
Immersive Virtual Reality ◽  
Repeated Measures Design ◽  
Wide Range ◽  
Significant Difference ◽  
Full Body

BACKGROUND Although full-body seated exercises have been studied in a wide range of settings (ie, homes, hospitals, and daycare centers), they have rarely been converted to seated exergames. In addition, there is an increasing number of studies on immersive virtual reality (iVR) full-body gesture-based standing exergames, but the suitability and usefulness of seated exergames remain largely unexplored. OBJECTIVE This study aimed to evaluate the difference between playing a full-body gesture-based iVR standing exergame and seated exergame in terms of gameplay performance, intrinsic motivation, and motion sickness. METHODS A total of 52 participants completed the experiment. The order of the game mode (standing and sitting) was counterbalanced. Gameplay performance was evaluated by action or gesture completion time and the number of missed gestures. Exertion was measured by the average heart rate (HR) percentage (AvgHR%), increased HR%, calories burned, and the Borg 6-20 questionnaire. Intrinsic motivation was assessed with the Intrinsic Motivation Inventory (IMI), whereas motion sickness was assessed via the Motion Sickness Assessment Questionnaire (MSAQ). In addition, we measured the fear of falling using a 10-point Likert scale questionnaire. RESULTS Players missed more gestures in the seated exergame than in the standing exergame, but the overall miss rate was low (2.3/120, 1.9%). The analysis yielded significantly higher AvgHR%, increased HR%, calories burned, and Borg 6-20 rating of perceived exertion values for the seated exergame (all <i>P</i>&lt;.001). The seated exergame was rated significantly higher on peripheral sickness (<i>P</i>=.02) and sopite-related sickness (MSAQ) (<i>P</i>=.004) than the standing exergame. The score of the subscale “value/usefulness” from IMI was reported to be higher for the seated exergame than the standing exergame. There was no significant difference between the seated exergame and standing exergame in terms of intrinsic motivation (interest/enjoyment, <i>P</i>=.96; perceived competence, <i>P</i>=.26; pressure/tension, <i>P</i>=.42) and the fear of falling (<i>P</i>=.25). CONCLUSIONS Seated iVR full-body gesture-based exergames can be valuable complements to standing exergames. Seated exergames have the potential to lead to higher exertion, provide higher value to players, and be more applicable in small spaces compared with standing exergames. However, gestures for seated exergames need to be designed carefully to minimize motion sickness, and more time should be given to users to perform gestures in seated exergames compared with standing exergames.

scholarly journals Learning My Way: A Pilot Study of Navigation Skills in Cerebral Palsy in Immersive Virtual Reality

2020 ◽  
Vol 11 ◽  
Author(s):  
Emilia Biffi ◽  
Chiara Gagliardi ◽  
Cristina Maghini ◽  
Chiara Genova ◽  
Daniele Panzeri ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Cerebral Palsy ◽  
Everyday Life ◽  
Cognitive Abilities ◽  
Real Life ◽  
Body Motion ◽  
Immersive Virtual Reality ◽  
Visual Spatial ◽  
The Individual ◽  
Navigation Strategies

Purpose: Human navigation skills are essential for everyday life and rely on several cognitive abilities, among which visual-spatial competences that are impaired in subjects with cerebral palsy (CP). In this work, we proposed navigation tasks in immersive virtual reality (IVR) to 15 children with CP and 13 typically developing (TD) peers in order to assess the individual navigation strategies and their modifiability in a situation resembling real life.Methods: We developed and adapted to IVR an application based on a 5-way maze in a playground that was to be navigated to find a reward. The learning process, navigation strategies, and adaptation to changes were compared between participants with CP and their TD peers and correlated with visual-spatial abilities and cognitive competences.Results: Most participants with CP needed more attempts than TD participants to become proficient in navigation. Furthermore, the learning phase was correlated to visual-spatial memory but not with cognitive competences. Interestingly, navigation skills were comparable between groups after stabilization. While TD participants mainly relied on allocentric strategies based on environmental cues, egocentric (self-centered) strategies based on body motion prevailed in participants with CP. Furthermore, participants with CP had more difficulties in modifying their navigation strategies, caused by difficulties in executive processes beyond the visual-perceptual impairment, with an inefficient shift between implicit and explicit competences.Conclusions: The navigation abilities in participants with CP seem to be different from their TD peers in terms of learning and adaptation to new conditions; this could deeply affect their everyday life and ultimately participation and inclusion. A regular assessing and focused rehabilitative plans could help to better navigate the environment and affect self-perception.

Sign in / Sign up

Export Citation Format

Share Document