Augmented Reality Overlay System for Computer-guided Needle Procedures

1969 ◽  
Author(s):  
Zachary Baum
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Region Of Interest ◽  
Calibration Method ◽  
Position Error ◽  
Ct Image ◽  
Entire System ◽  
Projected Image ◽  
Needle Interventions

Purpose: Augmented reality overlay systems can be used to project a CT image directly onto a patient during procedures. They have been actively trialed for computer-guided procedures, however they have not become commonplace in practice due to restrictions of previous systems. Previous systems have not been handheld, and have had complicated calibration procedures. We put forward a handheld tablet-based system for assisting with needle interventions. Methods: The system consists of a tablet display and a 3-D printed reusable and customizable frame. A simple and accurate calibration method was designed to align the patient to the projected image. The entire system is tracked via camera, with respect to the patient, and the projected image is updated in real time as the system is moved around the region of interest. Results: The resulting system allowed for 0.99mm mean position error in the plane of the image, and a mean position error of 0.61mm out of the plane of the image. This accuracy was thought to be clinically acceptable for tool using computer-guidance in several procedures that involve musculoskeletal needle placements. Conclusion: Our calibration method was developed and tested using the designed handheld system. Our results illustrate the potential for the use of augmented reality handheld systems in computer-guided needle procedures. 

scholarly journals High-Quality On-Patient Medical Data Visualization in a Markerless Augmented Reality Environment

2014 ◽  
Vol 5 (3) ◽  
pp. 1
Author(s):  
Márcio Cerqueira de Farias Macedo ◽  
Antônio Lopes Apolinário Júnior ◽  
Antonio Carlos dos Santos Souza ◽  
Gilson Antônio Giraldi
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Data Visualization ◽  
Volume Rendering ◽  
Reference Model ◽  
Region Of Interest ◽  
Image Data ◽  
Visual Quality ◽  
Medical Data ◽  
High Quality

To provide on-patient medical data visualization, a medical augmented reality environment must support volume rendering, accurate tracking, real-time performance and high visual quality in the final rendering. Another interesting feature is markerless registration, to solve the intrusiveness introduced by the use of fiducial markers for tracking. In this paper we address the problem of on-patient medical data visualization in a real-time high-quality markerless augmented reality environment. The medical data consists of a volume reconstructed from 3D computed tomography image data. Markerless registration is done by generating a 3D reference model of the region of interest in the patient and tracking it from the depth stream of an RGB-D sensor. From the estimated camera pose, the volumetric medical data and the reference model are combined allowing a visualization of the patient as well as part of his anatomy. To improve the visual perception of the scene, focus+context visualization is used in the augmented reality scene to dynamically define which parts of the medical volume will be visualized in the context of the patient’s image. Moreover, context-preserving volume rendering is employed to dynamically control which parts of the volume will be rendered. The results obtained show that the markerless environment runs in real-time and the techniques applied greatly improve the visual quality of the final rendering.

Pengembangan Media Pembelajaran Mengenal Organ Pencernaan Manusia Menggunakan Teknologi Augmented Reality

2015 ◽  
Vol 6 (2) ◽  
Author(s):  
Rujianto Eko Saputro ◽  
Dhanar Intan Surya Saputra
Keyword(s):  
Augmented Reality ◽  
Real Time

Media pembelajaran ternyata selalu mengikuti perkembangan teknologi yangada, mulai dari teknologi cetak, audio visual, komputer sampai teknologi gabunganantara teknologi cetak dengan komputer. Saat ini media pembelajaran hasil gabunganteknologi cetak dan komputer dapat diwujudkan dengan media teknologi AugmentedReality (AR). Augmented Reality (AR) adalah teknologi yang digunakan untukmerealisasikan dunia virtual ke dalam dunia nyata secara real-time. Organ pencernaanmanusia terdiri atas Mulut, Kerongkongan atau esofagus, Lambung, Usus halus, danUsus besar. Media pembelajaran mengenal organ pencernaan manusia pada saat inisangat monoton, yaitu melalui gambar, buku atau bahkan alat proyeksi lainnya.Menggunakan Augmented Reality yang mampu merealisasikan dunia virtual ke dunianyata, dapat mengubah objek-objek tersebut menjadi objek 3D, sehingga metodepembelajaran tidaklah monoton dan anak-anak jadi terpacu untuk mengetahuinya lebihlanjut, seperti mengetahui nama organ dan keterangan dari masing-masing organtersebut.

A Simple and Practical Method for Incorporating Augmented Reality into the Classroom and Laboratory

2018 ◽  
Author(s):  
Kyle Plunkett
Keyword(s):  
Organic Chemistry ◽  
Augmented Reality ◽  
Real Time ◽  
Real World ◽  
Smart Phone ◽  
Practical Method ◽  
Virtual Expert ◽  
Video Projection

This manuscript provides two demonstrations of how Augmented Reality (AR), which is the projection of virtual information onto a real-world object, can be applied in the classroom and in the laboratory. Using only a smart phone and the free HP Reveal app, content rich AR notecards were prepared. The physical notecards are based on Organic Chemistry I reactions and show only a reagent and substrate. Upon interacting with the HP Reveal app, an AR video projection shows the product of the reaction as well as a real-time, hand-drawn curved-arrow mechanism of how the product is formed. Thirty AR notecards based on common Organic Chemistry I reactions and mechanisms are provided in the Supporting Information and are available for widespread use. In addition, the HP Reveal app was used to create AR video projections onto laboratory instrumentation so that a virtual expert can guide the user during the equipment setup and operation.

scholarly journals Augmented Reality Maintenance Assistant Using YOLOv5

2021 ◽  
Vol 11 (11) ◽  
pp. 4758
Author(s):  
Ana Malta ◽  
Mateus Mendes ◽  
Torres Farinha
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Object Recognition ◽  
Augmented Reality ◽  
Real Time ◽  
Recognition System ◽  
High Accuracy ◽  
Video Streams ◽  
The Neural Network ◽  
Deep Learning Neural Network

Maintenance professionals and other technical staff regularly need to learn to identify new parts in car engines and other equipment. The present work proposes a model of a task assistant based on a deep learning neural network. A YOLOv5 network is used for recognizing some of the constituent parts of an automobile. A dataset of car engine images was created and eight car parts were marked in the images. Then, the neural network was trained to detect each part. The results show that YOLOv5s is able to successfully detect the parts in real time video streams, with high accuracy, thus being useful as an aid to train professionals learning to deal with new equipment using augmented reality. The architecture of an object recognition system using augmented reality glasses is also designed.

scholarly journals A Calibration Method of Phase Error Caused by Target’s Position Error

2021 ◽  
Vol 187 ◽  
pp. 188-193
Author(s):  
Fang Liu ◽  
Ming Lyn ◽  
Haohao Hou
Keyword(s):  
Phase Error ◽  
Calibration Method ◽  
Position Error

scholarly journals Research of Calibration Method for Industrial Robot Based on Error Model of Position

2021 ◽  
Vol 11 (3) ◽  
pp. 1287
Author(s):  
Tianyan Chen ◽  
Jinsong Lin ◽  
Deyu Wu ◽  
Haibin Wu
Keyword(s):  
Coordinate System ◽  
Industrial Robot ◽  
Calibration Method ◽  
Error Model ◽  
Position Error ◽  
Industrial Robots ◽  
Positioning Error ◽  
Robot Position ◽  
General Measurement ◽  
Parameter Error

Based on the current situation of high precision and comparatively low APA (absolute positioning accuracy) in industrial robots, a calibration method to enhance the APA of industrial robots is proposed. In view of the "hidden" characteristics of the RBCS (robot base coordinate system) and the FCS (flange coordinate system) in the measurement process, a comparatively general measurement and calibration method of the RBCS and the FCS is proposed, and the source of the robot terminal position error is classified into three aspects: positioning error of industrial RBCS, kinematics parameter error of manipulator, and positioning error of industrial robot end FCS. The robot position error model is established, and the relation equation of the robot end position error and the industrial robot model parameter error is deduced. By solving the equation, the parameter error identification and the supplementary results are obtained, and the method of compensating the error by using the robot joint angle is realized. The Leica laser tracker is used to verify the calibration method on ABB IRB120 industrial robot. The experimental results show that the calibration method can effectively enhance the APA of the robot.

Sign in / Sign up

Export Citation Format

Share Document