Usability study of auditory feedback and visual feedback in an immersive virtual assembly system

Author(s):  
Yue Han ◽  
Liang Chen ◽  
Zhiyuan Zhang ◽  
Huaiyu Liu
Author(s):  
Wakana Ishihara ◽  
Karen Moxon ◽  
Sheryl Ehrman ◽  
Mark Yarborough ◽  
Tina L. Panontin ◽  
...  

This systematic review addresses the plausibility of using novel feedback modalities for brain–computer interface (BCI) and attempts to identify the best feedback modality on the basis of the effectiveness or learning rate. Out of the chosen studies, it was found that 100% of studies tested visual feedback, 31.6% tested auditory feedback, 57.9% tested tactile feedback, and 21.1% tested proprioceptive feedback. Visual feedback was included in every study design because it was intrinsic to the response of the task (e.g. seeing a cursor move). However, when used alone, it was not very effective at improving accuracy or learning. Proprioceptive feedback was most successful at increasing the effectiveness of motor imagery BCI tasks involving neuroprosthetics. The use of auditory and tactile feedback resulted in mixed results. The limitations of this current study and further study recommendations are discussed.


2014 ◽  
Vol 621 ◽  
pp. 558-563
Author(s):  
X.M. Li ◽  
Ya Lin Shen ◽  
L.H. Zhu

On the basis of analyzing assembly process of main structural components in CA6140 lathe, 3D models for those components were established with CAD software UGNX6.0. Virtual assembly and motion simulation of the structure parts were performed with virtual technology. A set of virtual assembly system of CA6140 engine lathe was developed with programming software Visual Basic 6.0. It contains six main modules about spindle box, feed box, apron, tailstock, turret, etc. Dynamic simulation and motion simulation of the corresponding components in entity lathe can be realized, respectively. And also, mechanical structure, working principle, assembly relation between different components and motion transmission process of the lathe can be realistically reproduced with the system. This virtual assembly system not only can be used to analyze and transform old products, but also can be used in new products development, and to some extent, can be used to replace the prototype. It is an indispensable tool in the employee training and mechanical engineering activities.


2013 ◽  
Vol 483 ◽  
pp. 229-233
Author(s):  
Yi Liu ◽  
Shi Qi Li ◽  
Jun Feng Wang

This paper presents a feasible approach for modeling and locating of assembly\disassembly tools in the virtual scene: First, a novel point-vector model for tool is presented by means of abstracting the locating constraints of tools; Then, the mapping relationship for locating constraints between tools and parts is detailed; Finally, the best matching constraints algorithm is proposed on basis of point-vector model, which can calculate the locating constraints to the triangle model of part in real time. The proposed method has been integrated in the virtual assembly system to solve practical assembly problems.


2018 ◽  
Vol 39 (14) ◽  
pp. 1075-1080 ◽  
Author(s):  
Eric Ching ◽  
Winko An ◽  
Ivan Au ◽  
Janet Zhang ◽  
Zoe Chan ◽  
...  

AbstractVisual feedback gait retraining has been reported to successfully reduce impact loading in runners, even when the runners were distracted. However, auditory feedback is more feasible in real life application. Hence, this study compared the peak positive acceleration (PPA), vertical average (VALR) and instantaneous (VILR) loading rate during distracted running before and after a course of auditory feedback gait retraining in 16 runners. The runners were asked to land with softer footfalls with and without auditory feedback. Low or high sound pitch was generated according to the impact of particular footfall, when compared with the preset target. Runners then received a course of auditory gait retraining, and after the gait retraining, runners completed a reassessment. Runners before gait retraining exhibited lower PPA, VALR and VILR with augmented auditory feedback (p<0.049). We found a reduction in PPA, VALR and VILR after gait retraining, regardless of the presence of feedback (p<0.018). However, runners after gait retraining did not demonstrate further reduction in PPA and VALR with auditory feedback (p>0.104). A small effect of auditory feedback on VILR in runners after gait retraining was observed (p=0.032). Real time auditory feedback gait retraining is effective in impact loading reduction, even when the runners were distracted.


2020 ◽  
Author(s):  
Douglas M. Shiller ◽  
Takashi Mitsuya ◽  
Ludo Max

ABSTRACTPerceiving the sensory consequences of our actions with a delay alters the interpretation of these afferent signals and impacts motor learning. For reaching movements, delayed visual feedback of hand position reduces the rate and extent of visuomotor adaptation, but substantial adaptation still occurs. Moreover, the detrimental effect of visual feedback delay on reach motor learning—selectively affecting its implicit component—can be mitigated by prior habituation to the delay. Auditory-motor learning for speech has been reported to be more sensitive to feedback delay, and it remains unknown whether habituation to auditory delay reduces its negative impact on learning. We investigated whether 30 minutes of exposure to auditory delay during speaking (a) affects the subjective perception of delay, and (b) mitigates its disruptive effect on speech auditory-motor learning. During a speech adaptation task with real-time perturbation of vowel spectral properties, participants heard this frequency-shifted feedback with no delay, 75 ms delay, or 115 ms delay. In the delay groups, 50% of participants had been exposed to the delay throughout a preceding 30-minute block of speaking whereas the remaining participants completed this block without delay. Although habituation minimized awareness of the delay, no improvement in adaptation to the spectral perturbation was observed. Thus, short-term habituation to auditory feedback delays is not effective in reducing the negative impact of delay on speech auditory-motor adaptation. Combined with previous findings, the strong negative effect of delay and the absence of an influence of delay awareness suggest the involvement of predominantly implicit learning mechanisms in speech.HIGHLIGHTSSpeech auditory-motor adaptation to a spectral perturbation was reduced by ~50% when feedback was delayed by 75 or 115 ms.Thirty minutes of prior delay exposure without perturbation effectively reduced participants’ awareness of the delay.However, habituation was ineffective in remediating the detrimental effect of delay on speech auditory-motor adaptation.The dissociation of delay awareness and adaptation suggests that speech auditory-motor learning is mostly implicit.


2010 ◽  
Vol 431-432 ◽  
pp. 237-240 ◽  
Author(s):  
Peng Chen ◽  
Ping Jun Xia ◽  
Yue Dong Lang ◽  
Ying Xue Yao

In this paper, a Colored Petri Net modeling method for early stage design of virtual assembly operation is presented. The characteristics of virtual assembly system, Petri Net and Colored Petri Net are analyzed. Some previous work in Petri Net application in assembly and virtual assembly system is discussed. The theoretical aspects of Colored Petri Net are introduced mathematically. Based on the mathematical presentation and the process of fasteners assembly operation, a Colored Petri Net model is constructed for the simulation of assembly operation in virtual environment. With CPN Tools software package, the simulation for evaluating the feasibility of modeling is implemented. It is demonstrated that the modeling approach can support the early stage design of virtual assembly system.


2012 ◽  
Vol 588-589 ◽  
pp. 1178-1183 ◽  
Author(s):  
Du Jiang ◽  
Kai Qiang Ji

We proposed a theory of assembly constraint transformation (ACT), and achieved the display and free rotation of 3D model using OpenGL graphics standard as interface, VC+ + 6.0 as the development tool, and ArcBall algorithms as the basic application, making it easy to accomplish Human-Computer Interaction through the mouse control in virtual assembly.


1981 ◽  
Vol 9 ◽  
pp. 112-118
Author(s):  
Kees de Bot

A description is given of an experiment in which we tried to show that visual feedback is more effective in intonation learning than auditory feedback. The factors in the experiment were feedback mode and practice time. The results showed a significant effect of visual feedback over auditory feedback, whereas amount of practice time doesn't seem to be a major factor. An analysis of learning behaviour of the subjects in the experiment revealed that feedback mode influences learning behaviour: subjects with visual feedback tend to practise more intensively than subjects with auditory feedback. Future research will concentrate on various factors related to intonation learning and the effectiveness of visual feedback, such as the role of age, mothertongue and degree of fluency in the second language.


Sign in / Sign up

Export Citation Format

Share Document