Small Marker Tracking with Low-Cost, Unsynchronized, Movable Consumer Cameras For Augmented Reality Surgical Training

Author(s):  
Nicholas Rewkowski ◽  
Andrei State ◽  
Henry Fuchs
2021 ◽  
Vol 11 (3) ◽  
pp. 1038
Author(s):  
Sara Condino ◽  
Giuseppe Turini ◽  
Virginia Mamone ◽  
Paolo Domenico Parchi ◽  
Vincenzo Ferrari

Simulation for surgical training is increasingly being considered a valuable addition to traditional teaching methods. 3D-printed physical simulators can be used for preoperative planning and rehearsal in spine surgery to improve surgical workflows and postoperative patient outcomes. This paper proposes an innovative strategy to build a hybrid simulation platform for training of pedicle screws fixation: the proposed method combines 3D-printed patient-specific spine models with augmented reality functionalities and virtual X-ray visualization, thus avoiding any exposure to harmful radiation during the simulation. Software functionalities are implemented by using a low-cost tracking strategy based on fiducial marker detection. Quantitative tests demonstrate the accuracy of the method to track the vertebral model and surgical tools, and to coherently visualize them in either the augmented reality or virtual fluoroscopic modalities. The obtained results encourage further research and clinical validation towards the use of the simulator as an effective tool for training in pedicle screws insertion in lumbar vertebrae.


Author(s):  
Bing Yi ◽  
Renkai Sun ◽  
Long Liu ◽  
Yongfeng Song ◽  
Yinggui Zhang

Abstract It is a challenge for the dynamic inspection of railway route for freight car transporting cargo that out-of-gauge. One possible way is using the inspection frame installed in the inspection train to simulate the whole procedure for cargo transportation, which costs a lot of manpower and material resources as well as time. To overcome the above problem, this paper proposes an augmented reality (AR) based dynamic inspection method for visualized railway routing of freight car with out-of-gauge. First, the envelope model of the dynamic moving train with out-of-gauge cargo is generated by using the orbital spectrum of the railway, and the envelope model is matched with a piece of homemade calibration equipment located on the position of the railway that needs to be inspected. Then, the structure from motion (SFM) algorithm is used to reconstruct the environment where the virtual envelope model occludes the buildings or equipment along the railway. Finally, the distance function is adopted to calculate the distance between the obstacle and the envelope of the freight car with out-of-gauge, determining whether the freight car can pass a certain line. The experimental results show that the proposed method performs well for the route selection of out-of-gauge cargo transportation with low cost, high precision, and high efficiency. Moreover, the digital data of the environments along the railway and the envelope of the freight car can be reused, which will increase the digitalization and intelligence for route selection of out-of-gauge cargo transportation.


2008 ◽  
Author(s):  
Robert Sitnik ◽  
Slawomir Pasko ◽  
Maciej Karaszewski ◽  
Marcin Witkowski

2020 ◽  
Vol 13 (1) ◽  
pp. 58-63
Author(s):  
Pengcheng Yu ◽  
Jia Luan ◽  
Xidong Cui ◽  
Xumao Li ◽  
Xinqi Hu ◽  
...  

Objectives. The simulation of microlaryngeal skills is rarely seen in surgical training, but it is particularly important in phonomicrosurgery. This study described and validated the laryngeal surgical simulator through surgical training.Methods. A simple and low-cost simulator was developed for the fixation of the suspension laryngoscope and porcine larynges. Twenty participants with work skills and experience did preparation before training, and performed suture and carbon dioxide (CO2) laser cordectomy for simulator evaluation. The results were proposed by the aspects of time taken for each procedure, the global rating scale, a procedure-specific assessment, and a post-simulation questionnaire.Results. All participants completed the preparation within 9 minutes and reached the conclusion that the microlaryngeal surgical simulator was helpful in improving their surgical skills. The performance of experts was superior to that of novices in both suture and CO2 laser cordectomy.Conclusion. This simulator could be easily assembled and was successfully validated by microlaryngeal surgical training both subjectively and objectively. It may be helpful to clinicians in microlaryngeal skills.


2020 ◽  
Vol 13 (6) ◽  
pp. 512-521
Author(s):  
Mohamed Taha ◽  
◽  
Mohamed Ibrahim ◽  
Hala Zayed ◽  
◽  
...  

Vein detection is an important issue for the medical field. There are some commercial devices for detecting veins using infrared radiation. However, most of these commercial solutions are cost-prohibitive. Recently, veins detection has attracted much attention from research teams. The main focus is on developing real-time systems with low-cost hardware. Systems developed to reduce costs suffer from low frame rates. This, in turn, makes these systems not suitable for real-world applications. On the other hand, systems that use powerful processors to produce high frame rates suffer from high costs and a lack of mobility. In this paper, a real-time vein mapping prototype using augmented reality is proposed. The proposed prototype provides a compromised solution to produce high frame rates with a low-cost system. It consists of a USB camera attached to an Android smartphone used for real-time detection. Infrared radiation is employed to differentiate the veins using 20 Infrared Light Emitting Diodes (LEDs). The captured frames are processed to enhance vein detection using light computational algorithms to improve real-time processing and increase frame rate. Finally, the enhanced view of veins appears on the smartphone screen. Portability and economic cost are taken into consideration while developing the proposed prototype. The proposed prototype is tested with people of different ages and gender, as well as using mobile devices of different specifications. The results show a high vein detection rate and a high frame rate compared to other existing systems.


Author(s):  
Luis Almeida ◽  
Paulo Menezes ◽  
Jorge Dias

The socialization between elderly people assumes a key role on their mind and body well-being while loneliness expects to be one of major problems of our increasing age society. This research aims to study and develop a framework to support elderly people socialization when they are confined to their homes for some reason. It can be also adequate for people following some neurological or physical rehabilitation treatment remotely or monitoring behaviors in order to prevent potential diseases. This work proposes a framework that supports the socialization through Augmented Reality (AR) based on telepresence. The aim is a low cost solution that enables users to communicate and interact remotely, experiencing the benefits of a face-to-face meeting. The authors explore computers graphics, spatial audio, and artificial vision to induce sensations of being physical in the presence of other people and exploit the potential activities that such frameworks enable. TV and phones are elderly common companion devices that should be complementarily used with emergent AR technologies to enhance and create the remote presence feeling, minimizing the loneliness. Inspired by Virtual Reality (VR) studies, one of the authors’ goals is to explore if VR presence measurement instruments are useful in the AR context by reviewing literature on the area.


Author(s):  
Thiago D'Angelo ◽  
Saul Emanuel Delabrida Silva ◽  
Ricardo A. R. Oliveira ◽  
Antonio A. F. Loureiro

Virtual Reality and Augmented Reality Head-Mounted Displays (HMDs) have been emerging in the last years. These technologies sound like the new hot topic for the next years. Head-Mounted Displays have been developed for many different purposes. Users have the opportunity to enjoy these technologies for entertainment, work tasks, and many other daily activities. Despite the recent release of many AR and VR HMDs, two major problems are hindering the AR HMDs from reaching the mainstream market: the extremely high costs and the user experience issues. In order to minimize these problems, we have developed an AR HMD prototype based on a smartphone and on other low-cost materials. The prototype is capable of running Eye Tracking algorithms, which can be used to improve user interaction and user experience. To assess our AR HMD prototype, we choose a state-of-the-art method for eye center location found in the literature and evaluate its real-time performance in different development boards.


Sign in / Sign up

Export Citation Format

Share Document