scholarly journals In Situ Visualization for 3D Ultrasound-Guided Interventions with Augmented Reality Headset

2021 ◽  
Vol 8 (10) ◽  
pp. 131
Author(s):  
Nadia Cattari ◽  
Sara Condino ◽  
Fabrizio Cutolo ◽  
Mauro Ferrari ◽  
Vincenzo Ferrari
Keyword(s):  
Augmented Reality ◽  
Ultrasound Imaging ◽  
High Precision ◽  
Soft Tissues ◽  
Imaging System ◽  
3D Ultrasound ◽  
Integrated System ◽  
Head Mounted Display ◽  
Manual Tasks

Augmented Reality (AR) headsets have become the most ergonomic and efficient visualization devices to support complex manual tasks performed under direct vision. Their ability to provide hands-free interaction with the augmented scene makes them perfect for manual procedures such as surgery. This study demonstrates the reliability of an AR head-mounted display (HMD), conceived for surgical guidance, in navigating in-depth high-precision manual tasks guided by a 3D ultrasound imaging system. The integration between the AR visualization system and the ultrasound imaging system provides the surgeon with real-time intra-operative information on unexposed soft tissues that are spatially registered with the surrounding anatomic structures. The efficacy of the AR guiding system was quantitatively assessed with an in vitro study simulating a biopsy intervention aimed at determining the level of accuracy achievable. In the experiments, 10 subjects were asked to perform the biopsy on four spherical lesions of decreasing sizes (10, 7, 5, and 3 mm). The experimental results showed that 80% of the subjects were able to successfully perform the biopsy on the 5 mm lesion, with a 2.5 mm system accuracy. The results confirmed that the proposed integrated system can be used for navigation during in-depth high-precision manual tasks.

scholarly journals Validation of Scolioscan Air-Portable Radiation-Free Three-Dimensional Ultrasound Imaging Assessment System for Scoliosis

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2858
Author(s):  
Kelly Ka-Lee Lai ◽  
Timothy Tin-Yan Lee ◽  
Michael Ka-Shing Lee ◽  
Joseph Chi-Ho Hui ◽  
Yong-Ping Zheng
Keyword(s):  
Ultrasound Imaging ◽  
Imaging System ◽  
Outcome Measurement ◽  
Three Dimensional ◽  
3D Ultrasound ◽  
Mean Difference ◽  
Assessment System ◽  
Absolute Difference ◽  
Data Sets ◽  
Low Profile

To diagnose scoliosis, the standing radiograph with Cobb’s method is the gold standard for clinical practice. Recently, three-dimensional (3D) ultrasound imaging, which is radiation-free and inexpensive, has been demonstrated to be reliable for the assessment of scoliosis and validated by several groups. A portable 3D ultrasound system for scoliosis assessment is very much demanded, as it can further extend its potential applications for scoliosis screening, diagnosis, monitoring, treatment outcome measurement, and progress prediction. The aim of this study was to investigate the reliability of a newly developed portable 3D ultrasound imaging system, Scolioscan Air, for scoliosis assessment using coronal images it generated. The system was comprised of a handheld probe and tablet PC linking with a USB cable, and the probe further included a palm-sized ultrasound module together with a low-profile optical spatial sensor. A plastic phantom with three different angle structures built-in was used to evaluate the accuracy of measurement by positioning in 10 different orientations. Then, 19 volunteers with scoliosis (13F and 6M; Age: 13.6 ± 3.2 years) with different severity of scoliosis were assessed. Each subject underwent scanning by a commercially available 3D ultrasound imaging system, Scolioscan, and the portable 3D ultrasound imaging system, with the same posture on the same date. The spinal process angles (SPA) were measured in the coronal images formed by both systems and compared with each other. The angle phantom measurement showed the measured angles well agreed with the designed values, 59.7 ± 2.9 vs. 60 degrees, 40.8 ± 1.9 vs. 40 degrees, and 20.9 ± 2.1 vs. 20 degrees. For the subject tests, results demonstrated that there was a very good agreement between the angles obtained by the two systems, with a strong correlation (R2 = 0.78) for the 29 curves measured. The absolute difference between the two data sets was 2.9 ± 1.8 degrees. In addition, there was a small mean difference of 1.2 degrees, and the differences were symmetrically distributed around the mean difference according to the Bland–Altman test. Scolioscan Air was sufficiently comparable to Scolioscan in scoliosis assessment, overcoming the space limitation of Scolioscan and thus providing wider applications. Further studies involving a larger number of subjects are worthwhile to demonstrate its potential clinical values for the management of scoliosis.

scholarly journals A Tumbling Magnetic Microrobot System for Biomedical Applications

Micromachines ◽  
2020 ◽  
Vol 11 (9) ◽  
pp. 861
Author(s):  
Elizabeth E. Niedert ◽  
Chenghao Bi ◽  
Georges Adam ◽  
Elly Lambert ◽  
Luis Solorio ◽  
...  
Keyword(s):  
Ultrasound Imaging ◽  
Biomedical Applications ◽  
Imaging System ◽  
Ex Vivo ◽  
Negative Control ◽  
Circular Path ◽  
Rotational Axis ◽  
Significant Difference

A microrobot system comprising an untethered tumbling magnetic microrobot, a two-degree-of-freedom rotating permanent magnet, and an ultrasound imaging system has been developed for in vitro and in vivo biomedical applications. The microrobot tumbles end-over-end in a net forward motion due to applied magnetic torque from the rotating magnet. By turning the rotational axis of the magnet, two-dimensional directional control is possible and the microrobot was steered along various trajectories, including a circular path and P-shaped path. The microrobot is capable of moving over the unstructured terrain within a murine colon in in vitro, in situ, and in vivo conditions, as well as a porcine colon in ex vivo conditions. High-frequency ultrasound imaging allows for real-time determination of the microrobot’s position while it is optically occluded by animal tissue. When coated with a fluorescein payload, the microrobot was shown to release the majority of the payload over a 1-h time period in phosphate-buffered saline. Cytotoxicity tests demonstrated that the microrobot’s constituent materials, SU-8 and polydimethylsiloxane (PDMS), did not show a statistically significant difference in toxicity to murine fibroblasts from the negative control, even when the materials were doped with magnetic neodymium microparticles. The microrobot system’s capabilities make it promising for targeted drug delivery and other in vivo biomedical applications.

scholarly journals Wearable Augmented Reality Platform for Aiding Complex 3D Trajectory Tracing

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1612 ◽  
Author(s):  
Sara Condino ◽  
Benish Fida ◽  
Marina Carbone ◽  
Laura Cercenelli ◽  
Giovanni Badiali ◽  
...  
Keyword(s):  
Augmented Reality ◽  
High Precision ◽  
Ad Hoc ◽  
User Study ◽  
Peripersonal Space ◽  
Planar Structures ◽  
3D Printed ◽  
Quantitative Results ◽  
Manual Tasks ◽  
Wearable Augmented Reality

Augmented reality (AR) Head-Mounted Displays (HMDs) are emerging as the most efficient output medium to support manual tasks performed under direct vision. Despite that, technological and human-factor limitations still hinder their routine use for aiding high-precision manual tasks in the peripersonal space. To overcome such limitations, in this work, we show the results of a user study aimed to validate qualitatively and quantitatively a recently developed AR platform specifically conceived for guiding complex 3D trajectory tracing tasks. The AR platform comprises a new-concept AR video see-through (VST) HMD and a dedicated software framework for the effective deployment of the AR application. In the experiments, the subjects were asked to perform 3D trajectory tracing tasks on 3D-printed replica of planar structures or more elaborated bony anatomies. The accuracy of the trajectories traced by the subjects was evaluated by using templates designed ad hoc to match the surface of the phantoms. The quantitative results suggest that the AR platform could be used to guide high-precision tasks: on average more than 94% of the traced trajectories stayed within an error margin lower than 1 mm. The results confirm that the proposed AR platform will boost the profitable adoption of AR HMDs to guide high precision manual tasks in the peripersonal space.

Performance evaluation of a medical robotic 3D-ultrasound imaging system

2008 ◽  
Vol 12 (3) ◽  
pp. 275-290 ◽  
Author(s):  
Marie-Ange Janvier ◽  
Louis-Gilles Durand ◽  
Marie-Hélène Roy Cardinal ◽  
Isabelle Renaud ◽  
Boris Chayer ◽  
...  
Keyword(s):  
Performance Evaluation ◽  
Ultrasound Imaging ◽  
Imaging System ◽  
3D Ultrasound

scholarly journals Ambiguity-Free Optical–Inertial Tracking for Augmented Reality Headsets

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1444 ◽  
Author(s):  
Fabrizio Cutolo ◽  
Virginia Mamone ◽  
Nicola Carbonaro ◽  
Vincenzo Ferrari ◽  
Alessandro Tognetti
Keyword(s):  
Augmented Reality ◽  
Optical Tracking ◽  
Tracking Data ◽  
Tracking Accuracy ◽  
Short Baseline ◽  
Head Mounted Display ◽  
Lighting Conditions ◽  
Mobile Graphics ◽  
Custom Made ◽  
Manual Tasks

The increasing capability of computing power and mobile graphics has made possible the release of self-contained augmented reality (AR) headsets featuring efficient head-anchored tracking solutions. Ego motion estimation based on well-established infrared tracking of markers ensures sufficient accuracy and robustness. Unfortunately, wearable visible-light stereo cameras with short baseline and operating under uncontrolled lighting conditions suffer from tracking failures and ambiguities in pose estimation. To improve the accuracy of optical self-tracking and its resiliency to marker occlusions, degraded camera calibrations, and inconsistent lighting, in this work we propose a sensor fusion approach based on Kalman filtering that integrates optical tracking data with inertial tracking data when computing motion correlation. In order to measure improvements in AR overlay accuracy, experiments are performed with a custom-made AR headset designed for supporting complex manual tasks performed under direct vision. Experimental results show that the proposed solution improves the head-mounted display (HMD) tracking accuracy by one third and improves the robustness by also capturing the orientation of the target scene when some of the markers are occluded and when the optical tracking yields unstable and/or ambiguous results due to the limitations of using head-anchored stereo tracking cameras under uncontrollable lighting conditions.

Sign in / Sign up

Export Citation Format

Share Document