A Novel Technique for Three-Dimensional Reconstruction for Surgical Simulation Around the Craniocervical Junction Region

2011 ◽  
Vol 96 (3) ◽  
pp. 274-280 ◽  
Author(s):  
Guang-Jiu Liu ◽  
Shao-Xiang Zhang ◽  
Ming-Guo Qiu ◽  
Li-Wen Tan ◽  
Qi-Yu Li ◽  
...  

Abstract Performing surgeries on the craniocervical junction presents a technical challenge for operating surgeons. Three-dimensional (3D) reconstruction and surgical simulation have improved the efficacy and success rate of surgeries. The aim of this study was to create a 3D, digitized visible model of the craniocervical junction region to help realize accurate simulation of craniocervical surgery on a graphic workstation. Transverse sectional anatomy data for the study were chosen from the first Chinese visible human. Manual axial segmentation of the skull base, cervical spine, cerebellum, vertebral artery, internal carotid artery, sigmoid sinus, internal jugular vein, brain stem, and spinal cord were carried out by using Photoshop software. The segmented structures were reconstructed in 3 dimensions with surface and volume rendering to accurately display 3D models spatially. In contrast to conventional 3D reconstruction techniques that are based on computed tomography and magnetic resonance imaging Digital Imaging and Communications in Medicine (DICOM) inputs and provide mostly osseous details, this technique can help to illustrate the surrounding soft tissue structure and provide a realistic surgical simulation. The reconstructed 3D model was successfully used in simulating complex procedures in the virtual environment, including the transoral approach, bone drillings, and clivus resection.

Author(s):  
Chong Yu

Because of the intrinsic complexity in computation, three-dimensional (3D) reconstruction is an essential and challenging topic in computer vision research and applications. The existing methods for 3D reconstruction often produce holes, distortions and obscure parts in the reconstructed 3D models, or can only reconstruct voxelized 3D models for simple isolated objects. So they are not adequate for real usage. From 2014, the Generative Adversarial Network (GAN) is widely used in generating unreal dataset and semi-supervised learning. So the focus of this paper is to achieve high quality 3D reconstruction performance by adopting GAN principle. We propose a novel semi-supervised 3D reconstruction framework, namely SS-3D-GAN, which can iteratively improve any raw 3D reconstruction models by training the GAN models to converge. This new model only takes real-time 2D observation images as the weak supervision, and doesn't rely on prior knowledge of shape models or any referenced observations. Finally, through the qualitative and quantitative experiments & analysis, this new method shows compelling advantages over the current state-of-the-art methods on Tanks & Temples reconstruction benchmark dataset.


2020 ◽  
Vol 64 (2) ◽  
pp. 20506-1-20506-7
Author(s):  
Min Zhu ◽  
Rongfu Zhang ◽  
Pei Ma ◽  
Xuedian Zhang ◽  
Qi Guo

Abstract Three-dimensional (3D) reconstruction is extensively used in microscopic applications. Reducing excessive error points and achieving accurate matching of weak texture regions have been the classical challenges for 3D microscopic vision. A Multi-ST algorithm was proposed to improve matching accuracy. The process is performed in two main stages: scaled microscopic images and regularized cost aggregation. First, microscopic image pairs with different scales were extracted according to the Gaussian pyramid criterion. Second, a novel cost aggregation approach based on the regularized multi-scale model was implemented into all scales to obtain the final cost. To evaluate the performances of the proposed Multi-ST algorithm and compare different algorithms, seven groups of images from the Middlebury dataset and four groups of experimental images obtained by a binocular microscopic system were analyzed. Disparity maps and reconstruction maps generated by the proposed approach contained more information and fewer outliers or artifacts. Furthermore, 3D reconstruction of the plug gauges using the Multi-ST algorithm showed that the error was less than 0.025 mm.


Sensors ◽  
2019 ◽  
Vol 19 (18) ◽  
pp. 4001 ◽  
Author(s):  
Shuhe Chang ◽  
Haoyu Zhang ◽  
Haiying Xu ◽  
Xinghua Sang ◽  
Li Wang ◽  
...  

In the process of electron beam freeform fabrication (EBF3), due to the continuous change of thermal conditions and variability in wire feeding in the deposition process, geometric deviations are generated in the deposition of each layer. In order to prevent the layer-by-layer accumulation of the deviation, it is necessary to perform online geometry measurement for each deposition layer, based on which the error compensation can be done for the previous deposition layer in the next deposition layer. However, the traditional three-dimensional reconstruction method that employs structured laser cannot meet the requirements of long-term stable operation in the manufacturing process of EBF3. Therefore, this paper proposes a method to measure the deposit surfaces based on the position information of electron beam speckle, in which an electron beam is used to bombard the surface of the deposit to generate the speckle. Based on the structured information of the electron beam in the vacuum chamber, the three-dimensional reconstruction of the surface of the deposited parts is realized without need of additional structured laser sensor. In order to improve the detection accuracy, the detection error is theoretically analyzed and compensated. The absolute error after compensation is smaller than 0.1 mm, and the precision can reach 0.1%, which satisfies the requirements of 3D reconstruction of the deposited parts. An online measurement system is built for the surface of deposited parts in the process of electron beam freeform fabrication, which realizes the online 3D reconstruction of the surface of the deposited layer. In addition, in order to improve the detection stability of the whole system, the image processing algorithm suitable for this scene is designed. The reliability and speed of the algorithm are improved by ROI extraction, threshold segmentation, and expansion corrosion. In addition, the speckle size information can also reflect the thermal conditions of the surface of the deposited parts. Hence, it can be used for online detection of defects such as infusion and voids.


2013 ◽  
Vol 365-366 ◽  
pp. 1342-1349
Author(s):  
Xing Hui Wu ◽  
Zhi Xiu Hao

The spherical parameterization is important for the correspondence problem that is a major part of statistical shape modelling for the reconstruction of patient-specific 3D models from medical images. In this paper, we present comparative studies of five common spherical mapping methods applied to the femur and tibia models: the Issenburg et al. method, the Alexa method, the Saba et al. method, the Praun et al. method and the Shen et al. method. These methods are evaluated using three sets of measures: distortion property, geometric error and distance to standard landmarks. Results show that the Praun et al. method performs better than other methods while the Shen et al. method can be regarded as the most reliable one for providing an acceptable correspondence result. We suggest that the area preserving property can be used as a sufficient condition while the angle preserving property is not important when choosing a spherical mapping method for correspondence application.


2020 ◽  
Vol 20 (09) ◽  
pp. 2040002
Author(s):  
MONAN WANG ◽  
HAIYANG LUO ◽  
QI CUI

Based on the standard Marching Cubes (MC) algorithm, this paper proposes an improved MC algorithm. First, the original 15 topological configurations in the MC algorithm are increased to 24, which effectively avoid the generation of voids phenomenon. To further improve the speed of three-dimensional (3D) reconstruction, in this paper, the midpoint selection method is used instead of the linear interpolation method, and the 24 configurations are divided into three types. Each class corresponds to a thread. The multi-thread parallel processing is used to improve the calculation speed. The critical region is used to realize multi-thread synchronization, and then we designed a protocol mapping table according to the idea of the message mapping table. The function pointer is triggered by macro. Processing function is called by function pointer and completes the encapsulation of the protocol mapping table, which maintains the opening and closing principle of the class and ensures the scalability of the class. Through the improved MC algorithm accuracy verification and reconstruction speed verification, it is concluded that the improved MC algorithm can make up for the voids problem. By comparing the calculation time under the two platforms of Windows and Linux, the reconstruction speed of the improved MC algorithm is approximately 30% faster than the standard MC algorithm and 40% faster than the Masala algorithm. Finally, the algorithm is applied to the medical image 3D reconstruction system, and the accuracy and applicability of the algorithm are demonstrated by two sets of examples.


2017 ◽  
Vol 2017 ◽  
pp. 1-7 ◽  
Author(s):  
Andrew J. Hughes ◽  
Cathal DeBuitleir ◽  
Philip Soden ◽  
Brian O’Donnchadha ◽  
Anthony Tansey ◽  
...  

Revision hip arthroplasty requires comprehensive appreciation of abnormal bony anatomy. Advances in radiology and manufacturing technology have made three-dimensional (3D) representation of osseous anatomy obtainable, which provide visual and tactile feedback. Such life-size 3D models were manufactured from computed tomography scans of three hip joints in two patients. The first patient had undergone multiple previous hip arthroplasties for bilateral hip infections, resulting in right-sided pelvic discontinuity and a severe left-sided posterosuperior acetabular deficiency. The second patient had a first-stage revision for infection and recurrent dislocations. Specific metal reduction protocols were used to reduce artefact. The images were imported into Materialise MIMICS 14.12®. The models were manufactured using selective laser sintering. Accurate templating was performed preoperatively. Acetabular cup, augment, buttress, and cage sizes were trialled using the models, before being adjusted, and resterilised, enhancing the preoperative decision-making process. Screw trajectory simulation was carried out, reducing the risk of neurovascular injury. With 3D printing technology, complex pelvic deformities were better evaluated and treated with improved precision. Life-size models allowed accurate surgical simulation, thus improving anatomical appreciation and preoperative planning. The accuracy and cost-effectiveness of the technique should prove invaluable as a tool to aid clinical practice.


2017 ◽  
Vol 44 (1) ◽  
pp. 62 ◽  
Author(s):  
Jonathon A. Gibbs ◽  
Michael Pound ◽  
Andrew P. French ◽  
Darren M. Wells ◽  
Erik Murchie ◽  
...  

There are currently 805 million people classified as chronically undernourished, and yet the World’s population is still increasing. At the same time, global warming is causing more frequent and severe flooding and drought, thus destroying crops and reducing the amount of land available for agriculture. Recent studies show that without crop climate adaption, crop productivity will deteriorate. With access to 3D models of real plants it is possible to acquire detailed morphological and gross developmental data that can be used to study their ecophysiology, leading to an increase in crop yield and stability across hostile and changing environments. Here we review approaches to the reconstruction of 3D models of plant shoots from image data, consider current applications in plant and crop science, and identify remaining challenges. We conclude that although phenotyping is receiving an increasing amount of attention – particularly from computer vision researchers – and numerous vision approaches have been proposed, it still remains a highly interactive process. An automated system capable of producing 3D models of plants would significantly aid phenotyping practice, increasing accuracy and repeatability of measurements.


2018 ◽  
Vol 9 (4) ◽  
pp. 454-458 ◽  
Author(s):  
Sarah A. Chen ◽  
Chin Siang Ong ◽  
Nagina Malguria ◽  
Luca A. Vricella ◽  
Juan R. Garcia ◽  
...  

Purpose: Patients with hypoplastic left heart syndrome (HLHS) present a diverse spectrum of aortic arch morphology. Suboptimal geometry of the reconstructed aortic arch may result from inappropriate size and shape of an implanted patch and may be associated with poor outcomes. Meanwhile, advances in diagnostic imaging, computer-aided design, and three-dimensional (3D) printing technology have enabled the creation of 3D models. The purpose of this study is to create a surgical simulation and training model for aortic arch reconstruction. Description: Specialized segmentation software was used to isolate aortic arch anatomy from HLHS computed tomography scan images to create digital 3D models. Three-dimensional modeling software was used to modify the exported segmented models and digitally design printable customized patches that were optimally sized for arch reconstruction. Evaluation: Life-sized models of HLHS aortic arch anatomy and a digitally derived customized patch were 3D printed to allow simulation of surgical suturing and reconstruction. The patient-specific customized patch was successfully used for surgical simulation. Conclusions: Feasibility of digital design and 3D printing of patient-specific patches for aortic arch reconstruction has been demonstrated. The technology facilitates surgical simulation. Surgical training that leads to an understanding of optimal aortic patch geometry is one element that may potentially influence outcomes for patients with HLHS.


Author(s):  
Sema Ozkadif ◽  
Ayse Haligur ◽  
Emrullah Eken

Three- dimensional (3D) reconstruction obtained by using multidetector computed tomography (MDCT) images have widely been used in anatomical studies. Thorax is one of the most important body cavities necessary for the protection of lungs and heart in mammals. Two adult mongooses (1 male, 1 female) obtained from traffic accidents were used in this study. The images obtained from MDCT were stacked and 3D reconstruction of thorax was performed by overlaying images using a 3D modeling software (Mimics 13.1). Some measurements of thoracic cavity, lungs and sternum were taken from the reconstructive images of mongoose and indexes were calculated from these measurements. The morphometric parameters were recorded for both sexes. From the study, it could be concluded that the thoracic cavity, lungs and sternum imagings and findings revealed by 3D modeling techniques can be utilized for anatomical training of wild animals. This study is expected to help in the diagnosis and treatment of thorax diseases in wild animals.


Sign in / Sign up

Export Citation Format

Share Document