scholarly journals Motion tracking glove for augmented reality and virtual reality

2019 ◽  
Vol 10 (1) ◽  
pp. 160-166 ◽  
Author(s):  
Vu Trieu Minh ◽  
Nikita Katushin ◽  
John Pumwa

AbstractThis project designs a smart glove, which can be used for motion tracking in real time to a 3D virtual robotic arm in a PC. The glove is low cost with the price of less than 100 € and uses only internal measurement unit for students to develop their projects on augmented and virtual reality applications. Movement data from the glove is transferred to the PC via UART DMA. The data is set as the motion reference path for the 3D virtual robotic arm to follow. APID feedback controller controls the 3D virtual robot to track exactly the haptic glove movement with zero error in real time. This glove can be used also for remote control, tele-robotics and tele-operation systems.

Author(s):  
Zahari Taha ◽  
Mohd Yashim Wong ◽  
Hwa Jen Yap ◽  
Amirul Abdullah ◽  
Wee Kian Yeo

Immersion is one of the most important aspects in ensuring the applicability of Virtual Reality systems to training regimes aiming to improve performance. To ensure that this key aspect is met, the registration of motion between the real world and virtual environment must be made as accurate and as low latency as possible. Thus, an in-house developed Inertial Measurement Unit (IMU) system is developed for use in tracking the movement of the player’s racquet. This IMU tracks 6 DOF motion data and transmits it to the mobile training system for processing. Physically, the custom motion is built into the shape of a racquet grip to give a more natural sensation when swinging the racquet. In addition to that, an adaptive filter framework is also established to cope with different racquet movements automatically, enabling real-time 6 DOF tracking by balancing the jitter and latency. Experiments are performed to compare the efficacy of our approach with other conventional tracking methods such as the using Microsoft Kinect. The results obtained demonstrated noticeable accuracy and lower latency when compared with the aforementioned methods.


2020 ◽  
Vol 6 (3) ◽  
pp. 127-130
Author(s):  
Max B. Schäfer ◽  
Kent W. Stewart ◽  
Nico Lösch ◽  
Peter P. Pott

AbstractAccess to systems for robot-assisted surgery is limited due to high costs. To enable widespread use, numerous issues have to be addressed to improve and/or simplify their components. Current systems commonly use universal linkage-based input devices, and only a few applicationoriented and specialized designs are used. A versatile virtual reality controller is proposed as an alternative input device for the control of a seven degree of freedom articulated robotic arm. The real-time capabilities of the setup, replicating a system for robot-assisted teleoperated surgery, are investigated to assess suitability. Image-based assessment showed a considerable system latency of 81.7 ± 27.7 ms. However, due to its versatility, the virtual reality controller is a promising alternative to current input devices for research around medical telemanipulation systems.


2020 ◽  
Vol 13 (6) ◽  
pp. 512-521
Author(s):  
Mohamed Taha ◽  
◽  
Mohamed Ibrahim ◽  
Hala Zayed ◽  
◽  
...  

Vein detection is an important issue for the medical field. There are some commercial devices for detecting veins using infrared radiation. However, most of these commercial solutions are cost-prohibitive. Recently, veins detection has attracted much attention from research teams. The main focus is on developing real-time systems with low-cost hardware. Systems developed to reduce costs suffer from low frame rates. This, in turn, makes these systems not suitable for real-world applications. On the other hand, systems that use powerful processors to produce high frame rates suffer from high costs and a lack of mobility. In this paper, a real-time vein mapping prototype using augmented reality is proposed. The proposed prototype provides a compromised solution to produce high frame rates with a low-cost system. It consists of a USB camera attached to an Android smartphone used for real-time detection. Infrared radiation is employed to differentiate the veins using 20 Infrared Light Emitting Diodes (LEDs). The captured frames are processed to enhance vein detection using light computational algorithms to improve real-time processing and increase frame rate. Finally, the enhanced view of veins appears on the smartphone screen. Portability and economic cost are taken into consideration while developing the proposed prototype. The proposed prototype is tested with people of different ages and gender, as well as using mobile devices of different specifications. The results show a high vein detection rate and a high frame rate compared to other existing systems.


2018 ◽  
Vol 141 (3) ◽  
Author(s):  
Francesco Paparella ◽  
Satja Sivcev ◽  
Daniel Toal ◽  
John V. Ringwood

The measurement of the motion of a small-scale wave energy device during wave tank tests is important for the evaluation of its response to waves and the assessment of power production. Usually, the motion of a small-scale wave energy converter (WEC) is measured using an optical motion tracking system with high precision and sampling rate. However, the cost for an optical motion tracking system can be considerably high and, therefore, the overall cost for tank testing is increased. This paper proposes a low-cost capture system composed of an inertial measurement unit and ultrasound sensors. The measurements from the ultrasound sensors are combined optimally with the measurements from the inertial measurement unit through an extended Kalman filter (EKF) in order to obtain an accurate estimation of the motion of a WEC.


Author(s):  
Luis Almeida ◽  
Paulo Menezes ◽  
Jorge Dias

The socialization between elderly people assumes a key role on their mind and body well-being while loneliness expects to be one of major problems of our increasing age society. This research aims to study and develop a framework to support elderly people socialization when they are confined to their homes for some reason. It can be also adequate for people following some neurological or physical rehabilitation treatment remotely or monitoring behaviors in order to prevent potential diseases. This work proposes a framework that supports the socialization through Augmented Reality (AR) based on telepresence. The aim is a low cost solution that enables users to communicate and interact remotely, experiencing the benefits of a face-to-face meeting. The authors explore computers graphics, spatial audio, and artificial vision to induce sensations of being physical in the presence of other people and exploit the potential activities that such frameworks enable. TV and phones are elderly common companion devices that should be complementarily used with emergent AR technologies to enhance and create the remote presence feeling, minimizing the loneliness. Inspired by Virtual Reality (VR) studies, one of the authors’ goals is to explore if VR presence measurement instruments are useful in the AR context by reviewing literature on the area.


Author(s):  
Thiago D'Angelo ◽  
Saul Emanuel Delabrida Silva ◽  
Ricardo A. R. Oliveira ◽  
Antonio A. F. Loureiro

Virtual Reality and Augmented Reality Head-Mounted Displays (HMDs) have been emerging in the last years. These technologies sound like the new hot topic for the next years. Head-Mounted Displays have been developed for many different purposes. Users have the opportunity to enjoy these technologies for entertainment, work tasks, and many other daily activities. Despite the recent release of many AR and VR HMDs, two major problems are hindering the AR HMDs from reaching the mainstream market: the extremely high costs and the user experience issues. In order to minimize these problems, we have developed an AR HMD prototype based on a smartphone and on other low-cost materials. The prototype is capable of running Eye Tracking algorithms, which can be used to improve user interaction and user experience. To assess our AR HMD prototype, we choose a state-of-the-art method for eye center location found in the literature and evaluate its real-time performance in different development boards.


Biosensors ◽  
2019 ◽  
Vol 9 (1) ◽  
pp. 29 ◽  
Author(s):  
Tam Nguyen ◽  
Jonathan Young ◽  
Amanda Rodriguez ◽  
Steven Zupancic ◽  
Donald Lie

Balance disorders present a significant healthcare burden due to the potential for hospitalization or complications for the patient, especially among the elderly population when considering intangible losses such as quality of life, morbidities, and mortalities. This work is a continuation of our earlier works where we now examine feature extraction methodology on Dynamic Gait Index (DGI) tests and machine learning classifiers to differentiate patients with balance problems versus normal subjects on an expanded cohort of 60 patients. All data was obtained using our custom designed low-cost wireless gait analysis sensor (WGAS) containing a basic inertial measurement unit (IMU) worn by each subject during the DGI tests. The raw gait data is wirelessly transmitted from the WGAS for real-time gait data collection and analysis. Here we demonstrate predictive classifiers that achieve high accuracy, sensitivity, and specificity in distinguishing abnormal from normal gaits. These results show that gait data collected from our very low-cost wearable wireless gait sensor can effectively differentiate patients with balance disorders from normal subjects in real-time using various classifiers. Our ultimate goal is to be able to use a remote sensor such as the WGAS to accurately stratify an individual’s risk for falls.


Robotics ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 3
Author(s):  
Marlon Aguero ◽  
Dilendra Maharjan ◽  
Maria del Pilar Rodriguez ◽  
David Dennis Lee Mascarenas ◽  
Fernando Moreu

Wireless sensor networks (WSN) are used by engineers to record the behavior of structures. The sensors provide data to be used by engineers to make informed choices and prioritize decisions concerning maintenance procedures, required repairs, and potential infrastructure replacements. However, reliable data collection in the field remains a challenge. The information obtained by the sensors in the field frequently needs further processing, either at the decision-making headquarters or in the office. Although WSN allows data collection and analysis, there is often a gap between WSN data analysis results and the way decisions are made in industry. The industry depends on inspectors’ decisions, so it is of vital necessity to improve the inspectors’ access in the field to data collected from sensors. This paper presents the results of an experiment that shows the way Augmented Reality (AR) may improve the availability of WSN data to inspectors. AR is a tool which overlays the known attributes of an object with the corresponding position on the headset screen. In this way, it allows the integration of reality with a virtual representation provided by a computer in real time. These additional synthetic overlays supply data that may be unavailable otherwise, but it may also display additional contextual information. The experiment reported in this paper involves the application of a smart Strain Gauge Platform, which automatically measures strain for different applications, using a wireless sensor. In this experiment, an AR headset was used to improve actionable data visualization. The results of the reported experiment indicate that since the AR headset makes it possible to visualize information collected from the sensors in a graphic form in real time, it enables automatic, effective, reliable, and instant communication from a smart low-cost sensor strain gauge to a database. Moreover, it allows inspectors to observe augmented data and compare it across time and space, which then leads to appropriate prioritization of infrastructure management decisions based on accurate observations.


Sign in / Sign up

Export Citation Format

Share Document