Opti-speech: a real-time, 3d visual feedback system for speech training

Author(s):  
William Katz ◽  
Thomas F. Campbell ◽  
Jun Wang ◽  
Eric Farrar ◽  
J. Coleman Eubanks ◽  
...  
2021 ◽  
Author(s):  
Satoshi Miura ◽  
Kento Nakagawa ◽  
Kazumasa Hirooka ◽  
Yuya Matsumoto ◽  
Yumi Umesawa ◽  
...  

Abstract Sports-assisting technologies have been developed; however, most are to improve performances in individual sports such as ski, batting, and swimming. Few studies focused on team sports which require not only motor ability of individual players but also perceptual abilities to grasp positions of their own and others. In the present study, we aim to validate the feasibility of a visual feedback system for the improvement of space perception in relation to other persons that is necessary. Herein, the visual feedback system is composed of a flying drone that transmits the image to the participant’s smart glasses. With and without the system, the participant was able to see his/her own relative position in real time though the glass. Nine participants tried to position themselves on the line between two experimenters 30 m away from each other, which simulated the situation of a baseball cutoff man. As a result, the error distance between the participants’ position and the line significantly decreased when using the system than that without the system. Furthermore, after participants practiced the task with the system the error decreased compared to that before the practice. In conclusion, the real-time feedback system from the bird’s-eye view would work for improving the accuracy of space perception.


Author(s):  
Jeffrey R. Gould ◽  
Lisa Campana ◽  
Danielle Rabickow ◽  
Richard Raymond ◽  
Robert Partridge

2021 ◽  
Author(s):  
Randy Tan

This thesis presents a real-time human activity analysis system, where a user’s activity can be quantitatively evaluated with respect to a ground truth recording. Multiple Kinects are used to solve the problem of self-occlusion while performing an activity. The Kinects are placed in locations with different perspectives to extract the optimal joint positions of a user using Singular Value Decomposition (SVD) and Sequential Quadratic Programming (SQP). The extracted joint positions are then fed through our Incremental Dynamic Time Warping (IDTW) algorithm so that an incomplete sequence of an user can be optimally compared against the complete sequence from an expert (ground truth). Furthermore, the user’s performance is communicated through a novel visual feedback system, where colors on the skeleton present the user’s level of performance. Experimental results demonstrate the impact of our system, where through elaborate user testing we show that our IDTW algorithm combined with visual feedback improves the user’s performance quantitatively.


Proceedings ◽  
2020 ◽  
Vol 49 (1) ◽  
pp. 40
Author(s):  
Hiroki Yokota ◽  
Munekazu Naito ◽  
Naoki Mizuno ◽  
Shigemichi Ohshima

In this research, we propose a visual-feedback system and evaluate it based on motion-sensing and computational technologies. This system will help amateur athletes imitate the motor skills of professionals. Using a self-organizing map (SOM) to visualize high-dimensional time-series motion data, we recorded the cyclic motion information, including the muscle activities, of a male subject as he pedaled a bicycle ergometer. To clarify the difference between the subject’s motor skill and the target motor skill in a cyclic movement, we used the modified SOM algorithm; a visual-feedback system was developed, which displayed the target motion as a circular trajectory on a two-dimensional motor skills map. The subject trained by observing only the displayed static target trajectory; the subject’s real-time trajectory was constructed from the subject’s real-time motion. We validated our proposed framework for the visual-feedback system by evaluating the motion performance of a subject using feedback training.


In this paper, an adaptive visual feedback system and controller has been designed and implemented in real-time to control the movements of a line follower robot to be smoother and faster. The robot consists of a couple of motorized wheels, the real-time controller and a CMOS camera as the only sensor for detecting line and feedback. The measurement based on real-time image processing and motor drive feedback used in this robot makes it robust to the obstacles and surface disturbances that may deviate robot. The image processing algorithm is adaptive to the line’s color and width too. Image processing techniques have been implemented in real-time to detect the line in the image frame and extract the necessary information (like line’s edge, coordinates and angle). A NI myRIO module is used as a stand-alone hardware unit and RT (Real-Time) target for implementation of controllers and image processing in LabVIEW environment. Both results of real-time and non-real-time implementation of controllers have been compared. To show the performance of real-time image processing in the control of this robot, three types of controllers (i.e. P, PI and Fuzzy controllers) have been implemented for line following tests and the results have been compared. At the end, it was found that the fuzzy controller controls the robot movements smoother, faster, with less errors and quicker response time compare to the other controllers


2020 ◽  
Author(s):  
I-Lin Wang ◽  
Li-I Wang ◽  
Shi-Jie Xue ◽  
Rui Hu ◽  
Yu Su ◽  
...  

Abstract Background: The body maintains stability by integrating inputs from the central nervous system of vision, hearing, proprioception, and multiple senses. With the development of smart wearable devices, smart wearable devices can provide real-time center of pressure (COP) position-assisted balance control, which is beneficial to maintain physical balance.Methods: Forty healthy college students (20 male-20 female) participated in this study, and the posture balance actions of left-leg stance non-visual feedback, left -leg stance visual feedback, right-leg stance non-visual feedback, and right-leg stance visual feedback are performed. Visual feedback provides smart insoles matching Podoon APP on a tablet computer with the COP position displayed by a dot as real-time visual feedback. A mixed-design two-way ANOVA was performed and included the study.Results: The experimental results show that the displacement, velocity, radius, and area of the COP decreased significantly in the left-leg stance visual feedback/right-leg stance visual feedback, the test compared with the parameters in the eft-leg stance non-visual feedback/right-leg stance non-visual feedback (P < 0.05). Providing visual feedback through intelligent insoles can reduce the movement of the center of mass (COM) and maintain physical stability for healthy young people of different genders. In the one leg visual/non-visual in standing, the COP maximum anteroposterior displacement, COP anteroposterior velocity, COP radius, and COP area of women are significantly decreased than men (P < 0.05). Women have better real-time balance control ability than men with smart insoles.Conclusion: The simple intelligent wearable assisted devices can immediately increase the control ability in static stance of men and women, and women have better real-time balance control ability than men.


2021 ◽  
Author(s):  
Randy Tan

This thesis presents a real-time human activity analysis system, where a user’s activity can be quantitatively evaluated with respect to a ground truth recording. Multiple Kinects are used to solve the problem of self-occlusion while performing an activity. The Kinects are placed in locations with different perspectives to extract the optimal joint positions of a user using Singular Value Decomposition (SVD) and Sequential Quadratic Programming (SQP). The extracted joint positions are then fed through our Incremental Dynamic Time Warping (IDTW) algorithm so that an incomplete sequence of an user can be optimally compared against the complete sequence from an expert (ground truth). Furthermore, the user’s performance is communicated through a novel visual feedback system, where colors on the skeleton present the user’s level of performance. Experimental results demonstrate the impact of our system, where through elaborate user testing we show that our IDTW algorithm combined with visual feedback improves the user’s performance quantitatively.


2021 ◽  
Vol 23 (1) ◽  
Author(s):  
I-Lin Wang ◽  
Li-I Wang ◽  
Shi-Jie Xue ◽  
Rui Hu ◽  
Rong-Jiun Jian ◽  
...  

Purpose: The body maintains stability by integrating inputs from the central nervous system of vision, hearing, proprioception, and multiple senses. With the development of smart wearable devices, smart wearable devices can provide real-time center of pressure position-assisted balance control, which is beneficial to maintain physical balance. Methods: Forty healthy college students (20 male, 20 female) participated in this study, and the posture balance actions of left-leg stance non-visual feedback, left-leg stance visual feedback, right-leg stance non-visual feedback, and right-leg stance visual feedback were performed. Visual feedback provided smart insoles matching Podoon APP on a tablet computer with the COP position displayed by a dot as real-time visual feedback. Results: The experimental results show that the displacement, velocity, radius, and area of the COP decreased significantly in the left-leg stance visual feedback/right-leg stance visual feedback, the test compared the parameters in the left-leg stance non-visual feedback/right-leg stance nonvisual feedback (P < 0.05). Providing visual feedback through intelligent insoles can reduce the movement of the center of mass and maintain physical stability for healthy young people of different genders. In the one leg visual/non-visual in standing, the COP maximum anteroposterior displacement, COP anteroposterior velocity, COP radius, and COP area in women are significantly smaller than in men (P < 0.05). Women have better real-time balance control ability than men with smart insoles. Conclusions: The simple intelligent wearable assisted devices can immediately increase the control ability in static stance of men and women, and women have better real-time balance control ability than men.


Sign in / Sign up

Export Citation Format

Share Document