Augmented reality supported cervical transpedicular fixation on 3D-printed vertebrae model: an experimental education study

Simulation for surgical training is increasingly being considered a valuable addition to traditional teaching methods. 3D-printed physical simulators can be used for preoperative planning and rehearsal in spine surgery to improve surgical workflows and postoperative patient outcomes. This paper proposes an innovative strategy to build a hybrid simulation platform for training of pedicle screws fixation: the proposed method combines 3D-printed patient-specific spine models with augmented reality functionalities and virtual X-ray visualization, thus avoiding any exposure to harmful radiation during the simulation. Software functionalities are implemented by using a low-cost tracking strategy based on fiducial marker detection. Quantitative tests demonstrate the accuracy of the method to track the vertebral model and surgical tools, and to coherently visualize them in either the augmented reality or virtual fluoroscopic modalities. The obtained results encourage further research and clinical validation towards the use of the simulator as an effective tool for training in pedicle screws insertion in lumbar vertebrae.

Download Full-text

Wearable Augmented Reality Platform for Aiding Complex 3D Trajectory Tracing

Sensors ◽

10.3390/s20061612 ◽

2020 ◽

Vol 20 (6) ◽

pp. 1612 ◽

Cited By ~ 3

Author(s):

Sara Condino ◽

Benish Fida ◽

Marina Carbone ◽

Laura Cercenelli ◽

Giovanni Badiali ◽

...

Keyword(s):

Augmented Reality ◽

High Precision ◽

Ad Hoc ◽

User Study ◽

Peripersonal Space ◽

Planar Structures ◽

3D Printed ◽

Quantitative Results ◽

Manual Tasks ◽

Wearable Augmented Reality

Augmented reality (AR) Head-Mounted Displays (HMDs) are emerging as the most efficient output medium to support manual tasks performed under direct vision. Despite that, technological and human-factor limitations still hinder their routine use for aiding high-precision manual tasks in the peripersonal space. To overcome such limitations, in this work, we show the results of a user study aimed to validate qualitatively and quantitatively a recently developed AR platform specifically conceived for guiding complex 3D trajectory tracing tasks. The AR platform comprises a new-concept AR video see-through (VST) HMD and a dedicated software framework for the effective deployment of the AR application. In the experiments, the subjects were asked to perform 3D trajectory tracing tasks on 3D-printed replica of planar structures or more elaborated bony anatomies. The accuracy of the trajectories traced by the subjects was evaluated by using templates designed ad hoc to match the surface of the phantoms. The quantitative results suggest that the AR platform could be used to guide high-precision tasks: on average more than 94% of the traced trajectories stayed within an error margin lower than 1 mm. The results confirm that the proposed AR platform will boost the profitable adoption of AR HMDs to guide high precision manual tasks in the peripersonal space.

Download Full-text

3D camera-based markerless navigation system for robotic osteotomies

at - Automatisierungstechnik ◽

10.1515/auto-2020-0032 ◽

2020 ◽

Vol 68 (10) ◽

pp. 863-879

Author(s):

Tim Übelhör ◽

Jonas Gesenhues ◽

Nassim Ayoub ◽

Ali Modabber ◽

Dirk Abel

Keyword(s):

Augmented Reality ◽

Particle Filter ◽

Navigation System ◽

Setup Time ◽

Cadaver Study ◽

Phantom Study ◽

Depth Images ◽

3D Camera ◽

One Step ◽

3D Printed

AbstractA markerless system for the registration of a bone’s pose is presented which reduces the setup time and the damage to the bone to a minimum. For the registration, a particle filter is implemented which is able to estimate a bone’s pose using depth images. In a phantom study, the pose of 3D-printed bones has been estimated at a rate of 90 Hz and with a precision of a few millimeters. The particle filter is stable under partial occlusions and only diverges when the bone is fully occluded. During a cadaver study, the preoperatively planned cutting edges have been projected as augmented reality (AR) templates onto the hip bones of five cadavers. By cutting manually along the AR templates, surgeons were able to extract ten transplants in the same time as with conventional osteotomy templates. Using the presented navigation system can save hours spent on the construction and production of conventional templates. In conclusion, this work represents one step towards a broader acceptance of robotic osteotomies.

Download Full-text

Augmented reality in computer‐assisted interventions based on patient‐specific 3D printed reference

Healthcare Technology Letters ◽

10.1049/htl.2018.5072 ◽

2018 ◽

Vol 5 (5) ◽

pp. 162-166 ◽

Cited By ~ 8

Author(s):

Rafael Moreta‐Martinez ◽

David García‐Mato ◽

Mónica García‐Sevilla ◽

Rubén Pérez‐Mañanes ◽

José Calvo‐Haro ◽

...

Keyword(s):

Augmented Reality ◽

Patient Specific ◽

Computer Assisted ◽

3D Printed

Download Full-text

Augmented Reality, Surgical Navigation, and 3D Printing for Transcanal Endoscopic Approach to the Petrous Apex

OTO Open ◽

10.1177/2473974x18804492 ◽

2018 ◽

Vol 2 (4) ◽

pp. 2473974X1880449 ◽

Cited By ~ 8

Author(s):

Samuel R. Barber ◽

Kevin Wong ◽

Vivek Kanumuri ◽

Ruwan Kiringoda ◽

Judith Kempfle ◽

...

Keyword(s):

Augmented Reality ◽

Skull Base ◽

Surgical Planning ◽

Preoperative Planning ◽

Endoscopic Approach ◽

Physical Models ◽

Petrous Apex ◽

Patient Specific ◽

Lateral Skull Base ◽

3D Printed

Otolaryngologists increasingly use patient-specific 3-dimensional (3D)–printed anatomic physical models for preoperative planning. However, few reports describe concomitant use with virtual models. Herein, we aim to (1) use a 3D-printed patient-specific physical model with lateral skull base navigation for preoperative planning, (2) review anatomy virtually via augmented reality (AR), and (3) compare physical and virtual models to intraoperative findings in a challenging case of a symptomatic petrous apex cyst. Computed tomography (CT) imaging was manually segmented to generate 3D models. AR facilitated virtual surgical planning. Navigation was then coupled to 3D-printed anatomy to simulate surgery using an endoscopic approach. Intraoperative findings were comparable to simulation. Virtual and physical models adequately addressed details of endoscopic surgery, including avoidance of critical structures. Complex lateral skull base cases may be optimized by surgical planning via 3D-printed simulation with navigation. Future studies will address whether simulation can improve patient outcomes.

Download Full-text

An augmented reality-based multimedia environment for experimental education

Multimedia Tools and Applications ◽

10.1007/s11042-020-09684-x ◽

2020 ◽

Author(s):

Zhenning Zhang ◽

Zichen Li ◽

Meng Han ◽

Zhiyong Su ◽

Weiqing Li ◽

...

Keyword(s):

Augmented Reality ◽

Experimental Education ◽

Multimedia Environment

Download Full-text

Choledochoscopic Examination of a 3-Dimensional Printing Model Using Augmented Reality Techniques: A Preliminary Proof of Concept Study

Surgical Innovation ◽

10.1177/1553350618781622 ◽

2018 ◽

Vol 25 (5) ◽

pp. 492-498 ◽

Cited By ~ 5

Author(s):

Rui Tang ◽

Longfei Ma ◽

Ang Li ◽

Lihan Yu ◽

Zhixia Rong ◽

...

Keyword(s):

Augmented Reality ◽

Bile Ducts ◽

Hepatic Duct ◽

Biliary Tree ◽

Caudate Lobe ◽

Biliary Duct ◽

3 Dimensional ◽

Operator Interface ◽

3D Printed ◽

The Right

Background. We applied augmented reality (AR) techniques to flexible choledochoscopy examinations. Methods. Enhanced computed tomography data of a patient with intrahepatic and extrahepatic biliary duct dilatation were collected to generate a hollow, 3-dimensional (3D) model of the biliary tree by 3D printing. The 3D printed model was placed in an opaque box. An electromagnetic (EM) sensor was internally installed in the choledochoscope instrument channel for tracking its movements through the passages of the 3D printed model, and an AR navigation platform was built using image overlay display. The porta hepatis was used as the reference marker with rigid image registration. The trajectories of the choledochoscope and the EM sensor were observed and recorded using the operator interface of the choledochoscope. Results. Training choledochoscopy was performed on the 3D printed model. The choledochoscope was guided into the left and right hepatic ducts, the right anterior hepatic duct, the bile ducts of segment 8, the hepatic duct in subsegment 8, the right posterior hepatic duct, and the left and the right bile ducts of the caudate lobe. Although stability in tracking was less than ideal, the virtual choledochoscope images and EM sensor tracking were effective for navigation. Conclusions. AR techniques can be used to assist navigation in choledochoscopy examinations in bile duct models. Further research is needed to determine its benefits in clinical settings.

Download Full-text

A Comparison of Contemporary Prototyping Methods

Proceedings of the Design Society: International Conference on Engineering Design ◽

10.1017/dsi.2019.137 ◽

2019 ◽

Vol 1 (1) ◽

pp. 1313-1322 ◽

Cited By ~ 3

Author(s):

Euan Ross Coutts ◽

Andrew Wodehouse ◽

Jason Robertson

Keyword(s):

Decision Making ◽

Virtual Reality ◽

Augmented Reality ◽

Comparative Study ◽

Product Design ◽

Communication Aid ◽

Physical Prototype ◽

3D Printed ◽

Tablet Device ◽

Inform Decision Making

AbstractPrototypes are a common feature of many product design and development endeavours. An ever widening range of prototyping options are available to designers and engineers. May particular options be superior to others, or more appropriate for particular endeavours? This paper reviews current literature on the nature of what constitutes a prototype and the benefits they offer to the discipline. They principally facilitate communication, aid learning, help gain and provide feedback, inform decision making and generally provide superior design outcomes. In order to determine if any particular manner of prototype is preferable for achieving these benefits a comparative study of some of the contemporary prototyping methods is subsequently conducted: A 3D printed prototype (physical prototype), a CAD prototype (represented using a computer monitor), an augmented reality prototype (represented using a tablet device) and a virtual reality prototype (represented using a stereo projector and polarised glasses). The results indicate that while all provide benefits, overall the physical prototype performs best and the augmented reality prototype performs most poorly.

Download Full-text

Patient-specific 3D printed and augmented reality kidney and prostate cancer models: impact on patient education

3D Printing in Medicine ◽

10.1186/s41205-019-0041-3 ◽

2019 ◽

Vol 5 (1) ◽

Cited By ~ 24

Author(s):

Nicole Wake ◽

Andrew B. Rosenkrantz ◽

Richard Huang ◽

Katalina U. Park ◽

James S. Wysock ◽

...

Keyword(s):

Prostate Cancer ◽

Patient Education ◽

Augmented Reality ◽

Patient Specific ◽

Cancer Models ◽

3D Printed

Download Full-text

Development of Augmented Reality Based Crawl Swimming Learning Module For Students of The UNU Blitar Sport Education Study Program

Journal of Development Research ◽

10.28926/jdr.v4i2.154 ◽

2020 ◽

Vol 4 (2) ◽

pp. 144-150

Author(s):

Peni Nohantiya ◽

Fatra Nonggala Putra

Keyword(s):

Augmented Reality ◽

Product Development ◽

Industrial Revolution ◽

Evaluation Criteria ◽

Sport Education ◽

Study Program ◽

Learning Module ◽

Education Study ◽

Compulsory Subject ◽

Group Trial

Swimming is a compulsory subject in the UNU Blitar Sports Education Study Program curriculum. Has a fairly high Semester Credit Unit (SKS) weight of 4 credits. The crawl style swimming is the basis of all styles so that it needs to be studied more deeply according to the era of the industrial revolution 4.0, namely with a touch of Augmented Reality (AR) technology. This study aims to develop a learning module for swimming crawl style which is integrated with Augmented Reality (AR). The method used by researchers is the Research and Development developed by Dick and Carey which consists of 10 steps. However, due to existing limitations, the researcher only carried out 9 steps. The module was validated by 3 experts, namely: media expert, learning expert, and swimming expert. The input from experts is used to complement the product. Subsequently carried out small group trials totaling 6 students while 30 students as large group trial subjects. The results obtained are: the criteria for product clarity obtained by a percentage of 91.17647% are very valid, the strategic criteria obtained by a percentage of 83.33% are quite valid, the evaluation criteria obtained by a presentation of 75% are quite valid. All criteria have met product eligibility. Product development of the module is declared valid enough and fit for use as a medium to maximize the learning process.

Download Full-text