P4357Implementation of interactive mixed reality display of three-dimensional echocardiography during percutaneous structural interventions

2019 ◽  
Vol 40 (Supplement_1) ◽  
Author(s):  
J D Kasprzak ◽  
M Kierepka ◽  
J Z Peruga ◽  
D Dudek ◽  
B Machura ◽  
...  
Keyword(s):  
Real Time ◽  
Volume Rendering ◽  
Real World ◽  
Mixed Reality ◽  
Transfer Functions ◽  
World View ◽  
Three Dimensional ◽  
Display Device ◽  
Time Data ◽  
Color Flow

Abstract Background Three-dimensional (3D) echocardiographic data acquired from transesophageal (TEE) window are commonly used in planning and during percutaneous structural cardiac interventions (PSCI). Purpose We hypothesized that innovative, interactive mixed reality display can be integrated with procedural PSCI workflow to improve perception and interpretation of 3D data representing cardiac anatomy. Methods 3D TEE datasets were acquired before, during and after the completion of PSCI in 8 patients (occluders: 2 atrial appendage, 2 patent foramen ovale and 3 atrial septal implantations and percutaneous mitral commissurotomy). 30 Carthesian DICOM files were used to test the feasibility of mixed reality with commercially available head-mounted device (overlying hologram of 3D TEE data onto real-world view) as display for the interventional or imaging operator. Dedicated software was used for files conversion and 3D rendering of data to display device (in 1 case real-time Wi-Fi streaming from echocardiograph) and spatial manipulation of hologram during PSCI. Custom viewer was used to perform volume rendering and adjustment (cropping, transparency and shading control). Results Pre- and intraprocedural 3D TEE was performed in all 8 patients (5 women, age 40–83). Thirty selected 3DTEE datasets were successfully transferred and displayed in mixed reality head-mounted device as a holographic image overlying the real world view. The analysis was performed both before and during the procedure and compared with flatscreen 2-D display of the echocardiograph. In one case, real-time data transfer was successfully implemented during mitral balloon commissurotomy. The quality of visualization was judged as good without diagnostic content loss in all (100%) datasets. Both target structures and additional anatomical details were clearly presented including fenestrations of atrial septal defect, prominent Eustachian valve and earlier cardiac implants. Volume rendered views were touchlessly manipulated and displayed with a selection of intensity windows, transfer functions, and filters. Detail display was judged comparable to current 2-D volume-rendering on commercial workstations and touchless user interface - comfortable for optimization of views during PSCI. Conclusions Mixed reality display using a commercially available head-mounted device can be successfully integrated with preparation and execution of PSCI. The benefits of this solution include touchless image control and unobstructed real world viewing facilitating intraprocedural use, thus showing superiority over virtual or enhanced reality solutions. Expected progress includes integration of color flow data and optimization of real-time streaming option.

scholarly journals Proposed implementation of various imaging modes of OCT on FPGA

2021 ◽  
Author(s):  
Vitaliy Mykhaylychenko
Keyword(s):  
Real Time ◽  
Three Dimensional ◽  
Time Data ◽  
Cross Sectional ◽  
Color Flow ◽  
System Generator ◽  
Data Processor ◽  
Recorded Data ◽  
Time Acquisition

Optical Coherence Tomography (OCT) is three-dimensional imaging technique, capable of producing high resolution cross-sectional images through homogeneous samples, such as biological tissue. Real-time acquisition rates are a significant advantage in OCT. However, when images are generated by first acquiring data and then postprocessed on PC to extract information this advantage is cancelled out. In this project a system which can provide estimation of pixel values for three imaging modes: Structural, Color-flow Doppler and Velocity Variance is designed. The proposed system is standalone data processor using FPGA. The system was designed to process recorded data for verification purposes; however, it can be easily modified to process real-time data. Since the system has three modes of visualization it can be used for detecting in vivo blood flow. The proposed system was completed at MATLAB, Xilinx System Generator (XSG) and VHDL levels and the results show consistency between theoretical results, MATLAB, XSG and VHDL.

scholarly journals Proposed implementation of various imaging modes of OCT on FPGA

2021 ◽  
Author(s):  
Vitaliy Mykhaylychenko
Keyword(s):  
Real Time ◽  
Three Dimensional ◽  
Time Data ◽  
Cross Sectional ◽  
Color Flow ◽  
System Generator ◽  
Data Processor ◽  
Recorded Data ◽  
Time Acquisition

Optical Coherence Tomography (OCT) is three-dimensional imaging technique, capable of producing high resolution cross-sectional images through homogeneous samples, such as biological tissue. Real-time acquisition rates are a significant advantage in OCT. However, when images are generated by first acquiring data and then postprocessed on PC to extract information this advantage is cancelled out. In this project a system which can provide estimation of pixel values for three imaging modes: Structural, Color-flow Doppler and Velocity Variance is designed. The proposed system is standalone data processor using FPGA. The system was designed to process recorded data for verification purposes; however, it can be easily modified to process real-time data. Since the system has three modes of visualization it can be used for detecting in vivo blood flow. The proposed system was completed at MATLAB, Xilinx System Generator (XSG) and VHDL levels and the results show consistency between theoretical results, MATLAB, XSG and VHDL.

Modeling and volume rendering approach of underwater three-dimensional acoustic energy field

2016 ◽  
Vol 07 (03) ◽  
pp. 1650019
Author(s):  
Yanyang Zeng ◽  
Panpan Jia
Keyword(s):  
Real Time ◽  
Volume Rendering ◽  
Underwater Acoustics ◽  
Three Dimensional ◽  
Texture Mapping ◽  
Propagation Model ◽  
Acoustic Energy ◽  
Frame Rate ◽  
Volume Data ◽  
Energy Field

The underwater acoustics is primary and most effective method for underwater object detection and the complex underwater acoustics battlefield environment can be visually described by the three-dimensional (3D) energy field. Through solving the 3D propagation models, the traditional underwater acoustics volume data can be obtained, but it is large amount of calculation. In this paper, a novel modeling approach, which transforms two-dimensional (2D) wave equation into 2D space and optimizes energy loss propagation model, is proposed. In this way, the information for the obtained volume data will not be lost too much. At the same time, it can meet the requirements of data processing for the real-time visualization. In the process of volume rendering, 3D texture mapping methods is used. The experimental results are evaluated on data size and frame rate, showing that our approach outperforms other approaches and the approach can achieve better results in real time and visual effects.

An Explicit Non-Real Time Data Reduction Method of Triple Sensors Hot-Wire Anemometer in Three-Dimensional Flow

1988 ◽  
Vol 110 (2) ◽  
pp. 110-119 ◽  
Author(s):  
Y. T. Chew ◽  
R. L. Simpson
Keyword(s):  
Real Time ◽  
Three Dimensional ◽  
Computation Time ◽  
Reynolds Stresses ◽  
Hot Wire ◽  
Time Data ◽  
Three Dimensional Flow ◽  
Mean Velocity ◽  
Dimensional Flow ◽  
The Mean

An explicit non-real time method of reducing triple sensor hot-wire anenometer data to obtain the three mean velocity components and six Reynolds stresses, as well as their turbulence spectra in three-dimensional flow is proposed. Equations which relate explicitly the mean velocity components and Reynolds stresses in laboratory coordinates to the mean and mean square sensors output voltages in three stages are derived. The method was verified satisfactorily by comparison with single sensor hot-wire anemometer measurements in a zero pressure gradient incompressible turbulent boundary layer flow. It is simple and requires much lesser computation time when compared to other implicit non-real time method.

Design on Light Geodesic Instrument Semi-Physical Simulation Training System Based on Virtual Scene

2014 ◽  
Vol 926-930 ◽  
pp. 1517-1521
Author(s):  
Xiang Jin Wang ◽  
Guo Dong Li ◽  
Zhi Lu Zhang ◽  
Zhe Li
Keyword(s):  
Real Time ◽  
Simulation Training ◽  
Physical Simulation ◽  
Low Cost ◽  
Three Dimensional ◽  
General Purpose ◽  
Training System ◽  
Time Data ◽  
Virtual Scene ◽  
Geodesic Instrument

This paper takes the light geodesic instrument as the research object, puts forward a design idea of the semi-physical simulation training system based on the virtual scene and realizes three-dimensional modeling, real-time scene drawing and real-time data driving display through Virtools and Visual C++. ARM7 and the general-purpose single-chip microcomputer are adopted to realize the function simulation of the equipment. This simulation training system has the characteristics of low cost, low power consumption and high simulation degree.

scholarly journals Effects of Different Parameter Settings for 3D Data Smoothing and Mesh Simplification on Towards Near Real-Time 3D Reconstruction of High Resolution Bioceramic Bone Void Filling Medical Images

2021 ◽  
Author(s):  
Daniel Jie Yuan Chin ◽  
Ahmad Sufril Azlan Mohamed ◽  
Khairul Anuar Shariff ◽  
Mohd Nadhir Ab Wahab ◽  
Kunio Ishikawa
Keyword(s):  
Real Time ◽  
Volume Rendering ◽  
Medical Images ◽  
Three Dimensional ◽  
Mesh Simplification ◽  
Surface Rendering ◽  
Reconstruction Accuracy ◽  
Total Execution Time ◽  
Data Smoothing ◽  
Dimensional Reconstruction

Three-dimensional reconstruction plays an important role in assisting doctors and surgeons in diagnosing bone defects’ healing progress. Common three-dimensional reconstruction methods include surface and volume rendering. As the focus is on the shape of the bone, volume rendering is omitted. Many improvements have been made on surface rendering methods like Marching Cubes and Marching Tetrahedra, but not many on working towards real-time or near real-time surface rendering for large medical images, and studying the effects of different parameter settings for the improvements. Hence, in this study, an attempt towards near real-time surface rendering for large medical images is made. Different parameter values are experimented on to study their effect on reconstruction accuracy, reconstruction and rendering time, and the number of vertices and faces. The proposed improvement involving three-dimensional data smoothing with convolution kernel Gaussian size 0.5 and mesh simplification reduction factor of 0.1, is the best parameter value combination for achieving a good balance between high reconstruction accuracy, low total execution time, and a low number of vertices and faces. It has successfully increased the reconstruction accuracy by 0.0235%, decreased the total execution time by 69.81%, and decreased the number of vertices and faces by 86.57% and 86.61% respectively.

Application and Research of Superfine Wood Powder Disintegrator with Multi- Granularity Based on AR Technology

2011 ◽  
Vol 295-297 ◽  
pp. 1389-1392
Author(s):  
Lan Yu Yang ◽  
Xiao Feng Bao
Keyword(s):  
Real World ◽  
3D Model ◽  
Three Dimensional ◽  
Display Device ◽  
Wood Powder ◽  
The Real ◽  
Real Environment ◽  
Sensory Effects ◽  
Virtualization Technology ◽  
Set Up

AR technology can supplement and strengthen the real world, instead of using a virtualization technology to create a completely virtual world to replace the real world. AR technology is introduced during process of designing wood powder disintegrator with multi-granularity, then three-dimensional entity model for the wood powder disintegrator with multi-granularity has been established, and enhanced visual system for the wood powder disintegrator with multi-granularity is set up. Through introduction of the AR design technology, 3D model can be do dynamic interaction rendering, then demonstration effect of superfine wood powder disintegrator with multi-granularity may achieve enhanced effects, and “wood powder disintegrator with multi-granularity” can be put in the real environment, and the virtual objects can be merged together the real environment through display device, a new environment for sensory effects is shown to the users. It has many advantages such as accelerating design, manufacture and debugging process for wood powder disintegrator with multi-granularity, at the same time, it can save manufacture cost.

Interactive volume rendering of real-time three-dimensional ultrasound images

2007 ◽  
Vol 54 (2) ◽  
pp. 313-318 ◽  
Author(s):  
Johnny Kuo ◽  
Gregory Bredthauer ◽  
John Castellucci ◽  
Olaf Von Ramm
Keyword(s):  
Real Time ◽  
Volume Rendering ◽  
Three Dimensional ◽  
Ultrasound Images
Sign in / Sign up

Export Citation Format

Share Document