Three-dimensional Reconstruction of Microscopic Image Based on Multi-ST Algorithm

2020 ◽  
Vol 64 (2) ◽  
pp. 20506-1-20506-7
Author(s):  
Min Zhu ◽  
Rongfu Zhang ◽  
Pei Ma ◽  
Xuedian Zhang ◽  
Qi Guo

Abstract Three-dimensional (3D) reconstruction is extensively used in microscopic applications. Reducing excessive error points and achieving accurate matching of weak texture regions have been the classical challenges for 3D microscopic vision. A Multi-ST algorithm was proposed to improve matching accuracy. The process is performed in two main stages: scaled microscopic images and regularized cost aggregation. First, microscopic image pairs with different scales were extracted according to the Gaussian pyramid criterion. Second, a novel cost aggregation approach based on the regularized multi-scale model was implemented into all scales to obtain the final cost. To evaluate the performances of the proposed Multi-ST algorithm and compare different algorithms, seven groups of images from the Middlebury dataset and four groups of experimental images obtained by a binocular microscopic system were analyzed. Disparity maps and reconstruction maps generated by the proposed approach contained more information and fewer outliers or artifacts. Furthermore, 3D reconstruction of the plug gauges using the Multi-ST algorithm showed that the error was less than 0.025 mm.

Sensors ◽  
2019 ◽  
Vol 19 (18) ◽  
pp. 4001 ◽  
Author(s):  
Shuhe Chang ◽  
Haoyu Zhang ◽  
Haiying Xu ◽  
Xinghua Sang ◽  
Li Wang ◽  
...  

In the process of electron beam freeform fabrication (EBF3), due to the continuous change of thermal conditions and variability in wire feeding in the deposition process, geometric deviations are generated in the deposition of each layer. In order to prevent the layer-by-layer accumulation of the deviation, it is necessary to perform online geometry measurement for each deposition layer, based on which the error compensation can be done for the previous deposition layer in the next deposition layer. However, the traditional three-dimensional reconstruction method that employs structured laser cannot meet the requirements of long-term stable operation in the manufacturing process of EBF3. Therefore, this paper proposes a method to measure the deposit surfaces based on the position information of electron beam speckle, in which an electron beam is used to bombard the surface of the deposit to generate the speckle. Based on the structured information of the electron beam in the vacuum chamber, the three-dimensional reconstruction of the surface of the deposited parts is realized without need of additional structured laser sensor. In order to improve the detection accuracy, the detection error is theoretically analyzed and compensated. The absolute error after compensation is smaller than 0.1 mm, and the precision can reach 0.1%, which satisfies the requirements of 3D reconstruction of the deposited parts. An online measurement system is built for the surface of deposited parts in the process of electron beam freeform fabrication, which realizes the online 3D reconstruction of the surface of the deposited layer. In addition, in order to improve the detection stability of the whole system, the image processing algorithm suitable for this scene is designed. The reliability and speed of the algorithm are improved by ROI extraction, threshold segmentation, and expansion corrosion. In addition, the speckle size information can also reflect the thermal conditions of the surface of the deposited parts. Hence, it can be used for online detection of defects such as infusion and voids.


2020 ◽  
Vol 20 (09) ◽  
pp. 2040002
Author(s):  
MONAN WANG ◽  
HAIYANG LUO ◽  
QI CUI

Based on the standard Marching Cubes (MC) algorithm, this paper proposes an improved MC algorithm. First, the original 15 topological configurations in the MC algorithm are increased to 24, which effectively avoid the generation of voids phenomenon. To further improve the speed of three-dimensional (3D) reconstruction, in this paper, the midpoint selection method is used instead of the linear interpolation method, and the 24 configurations are divided into three types. Each class corresponds to a thread. The multi-thread parallel processing is used to improve the calculation speed. The critical region is used to realize multi-thread synchronization, and then we designed a protocol mapping table according to the idea of the message mapping table. The function pointer is triggered by macro. Processing function is called by function pointer and completes the encapsulation of the protocol mapping table, which maintains the opening and closing principle of the class and ensures the scalability of the class. Through the improved MC algorithm accuracy verification and reconstruction speed verification, it is concluded that the improved MC algorithm can make up for the voids problem. By comparing the calculation time under the two platforms of Windows and Linux, the reconstruction speed of the improved MC algorithm is approximately 30% faster than the standard MC algorithm and 40% faster than the Masala algorithm. Finally, the algorithm is applied to the medical image 3D reconstruction system, and the accuracy and applicability of the algorithm are demonstrated by two sets of examples.


Author(s):  
Sema Ozkadif ◽  
Ayse Haligur ◽  
Emrullah Eken

Three- dimensional (3D) reconstruction obtained by using multidetector computed tomography (MDCT) images have widely been used in anatomical studies. Thorax is one of the most important body cavities necessary for the protection of lungs and heart in mammals. Two adult mongooses (1 male, 1 female) obtained from traffic accidents were used in this study. The images obtained from MDCT were stacked and 3D reconstruction of thorax was performed by overlaying images using a 3D modeling software (Mimics 13.1). Some measurements of thoracic cavity, lungs and sternum were taken from the reconstructive images of mongoose and indexes were calculated from these measurements. The morphometric parameters were recorded for both sexes. From the study, it could be concluded that the thoracic cavity, lungs and sternum imagings and findings revealed by 3D modeling techniques can be utilized for anatomical training of wild animals. This study is expected to help in the diagnosis and treatment of thorax diseases in wild animals.


Author(s):  
Cuizhen Wang ◽  
Zhenxue Chen ◽  
Yan Wang ◽  
Zhifeng Wang

Three-dimensional reconstruction of teeth plays an important role in the operation of living dental implants. However, the tissue around teeth and the noise generated in the process of image acquisition bring a serious impact on the reconstruction results, which must be reduced or eliminated. Combined with the advantages of wavelet transform and bilateral filtering, this paper proposes an image denoising method based on the above methods. The method proposed in this paper not only removes the noise but also preserves the image edge details. The noise in high frequency subbands is denoised using a locally adaptive thresholding and the noise in low frequency subbands is filtered by the bilateral filtering. Peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM) and 3D reconstruction using the iso-surface extraction method are used to evaluate the denoising effect. The experimental results show that the proposed method is better than the wavelet denoising and bilateral filtering, and the reconstruction results meet the requirements of clinical diagnosis.


2009 ◽  
Vol 24 (1_suppl) ◽  
pp. 100-112 ◽  
Author(s):  
Yi Zhang ◽  
Jian Qi ◽  
Xiaolin Liu ◽  
Zuo Xiong ◽  
Shengjie Li ◽  
...  

The virtual human plan has been the hot point of recent research. The objective of this study is to explore the possibility of three-dimensional (3D) reconstruction of functional fascicular groups inside short segmental peripheral nerve. A 5 cm length of common peroneal nerve was horizontally sliced at 0.25 mm intervals, and each section was stained with acetycholinesterase histochemical staining. The 2D panorama images were acquired by high-resolution digital camera under 100 x microscope and mosaic software; different functional fascicular groups were distinguished and marked. The topographic database was then matched using image processing software, through the 3D reconstruction achieved using 3D reconstruction software (Amira 3.1). The reconstructed 3D images could be rotated or zoomed in any direction and the intercross and recombination processes of nerve bundles could be observed. Based on the serial histological sections and computer technology, the 3D microstructure of short segmental peripheral nerve functional fascicular groups was reconstructed. These results provide the possibility of 3D reconstruction of long segmental peripheral nerve functional fascicular groups.


Author(s):  
Ziheng Wu ◽  
Zhiliang Xu ◽  
Oleg Kim ◽  
Mark Alber

When a blood vessel ruptures or gets inflamed, the human body responds by rapidly forming a clot to restrict the loss of blood. Platelets aggregation at the injury site of the blood vessel occurring via platelet–platelet adhesion, tethering and rolling on the injured endothelium is a critical initial step in blood clot formation. A novel three-dimensional multi-scale model is introduced and used in this paper to simulate receptor-mediated adhesion of deformable platelets at the site of vascular injury under different shear rates of blood flow. The novelty of the model is based on a new approach of coupling submodels at three biological scales crucial for the early clot formation: novel hybrid cell membrane submodel to represent physiological elastic properties of a platelet, stochastic receptor–ligand binding submodel to describe cell adhesion kinetics and lattice Boltzmann submodel for simulating blood flow. The model implementation on the GPU cluster significantly improved simulation performance. Predictive model simulations revealed that platelet deformation, interactions between platelets in the vicinity of the vessel wall as well as the number of functional GPIb α platelet receptors played significant roles in platelet adhesion to the injury site. Variation of the number of functional GPIb α platelet receptors as well as changes of platelet stiffness can represent effects of specific drugs reducing or enhancing platelet activity. Therefore, predictive simulations can improve the search for new drug targets and help to make treatment of thrombosis patient-specific.


2021 ◽  

Background: Prostate sarcoma is a malignant tumor from the prostate stroma. However, its pathogenesis is unknown. This is a rare type of prostate tumor. Case Presentation: A rare case of prostate leiomyosarcoma has been described. A 55-year-old prostate leiomyosarcoma patient who suffered from progressive dysuria and frequent urination for half a year was examined. Pathology, immunohistochemical staining, and laparoscopic radical prostatectomy were performed using three-dimensional (3D) reconstruction to diagnose prostate leiomyosarcoma. The patient did not receive adjuvant therapy after the operation. Final pathology was used to confirm prostate leiomyosarcoma. After one year of follow-up, the patient regularly underwent a digital rectal examination and abdominal MRI. However, no tumor recurrence or metastasis was found. Discussion: We discussed diagnosis and treatment of prostate leiomyosarcoma and reviewd literatures. Conclusion: Prostate leiomyosarcoma is a rare special type of prostate tumor, and its diagnosis is mainly based on pathological features. Radical excision is the primary treatment for prostate leiomyosarcoma. The 3D reconstruction is essential in the surgery because it can determine the size of the tumor and its relationship to the surrounding tissue. A postoperative adjuvant therapy can also be performed.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Xiaodan Jiang ◽  
Hongwei Deng ◽  
Chun Lung ◽  
Fanyin Wang ◽  
Shuang Li ◽  
...  

Abstract Background Highly myopic eyes differ in morphology from emmetropic eyes, and the correct estimation of the vitreous volume is difficult. To explore an effective method to estimate ocular volume using refractive factors in children. Methods This is a retrospective study of children with high myopia who visited the Shenzhen Shekou People’s Hospital (July-December 2018) before undergoing posterior scleral reinforcement surgery. Data on refractive factors and ocular 3D reconstruction imaging based on high-end CT were collected for linear correlation and linear regression analyses. Results Ten patients (20 eyes) were included. There are nine males and one female. They were 4 to 12 years of age. The spherical equivalent ranges from + 0.25 to -20.00 D. The cylindrical equivalent ranges from − 0.50 to -6.25 D. The AL(axial length, AL) ranges from 21.78 to 33.90 mm. The corneal curvature (mean) ranges from 42.44 to 46.75. The 3D reconstruction of the CT images shows that the ocular volume ranges from 4.591 to 10.988 ml. The ocular volume of the 20 eyes decreases with the increase of diopter and total curvature, both presenting a linear trend, with the Pearson correlation coefficients being − 0.776 (P < 0.001) and − 0.633 (P = 0.003), respectively. The ocular volume of the 20 eyes increases with the increasing AL, also presenting a linear trend, with the Pearson correlation coefficient being 0.939 (P < 0.001). Conclusions In children, the ocular volume is negatively and linearly correlated with the diopter and curvature, and positively and linearly correlated with the AL.


2021 ◽  
Vol 2021 ◽  
pp. 1-4
Author(s):  
Yuanyuan Shi ◽  
Si Chen ◽  
Xue Chen ◽  
Pan Xue

Aim. To study the diagnostic effect of hip fracture in the elderly. In this paper, a total of 100 elderly patients with hip fracture from January 2020 to May 2021 were selected for X-ray and CT examination after admission. The operation was taken as the final criteria for determining hip fracture type, and the diagnosis of hip fracture by CT three-dimensional reconstruction was analyzed and studied. The results showed that the diagnostic rate of CT 3D reconstruction for various types of hip fracture in the elderly was higher than that of CT plain scan and X-ray ( P < 0.05 ). For the diagnosis of intra-articular small bone fragments, the rate of missed diagnosis was 2% (2/100) with CT 3D reconstruction, 10% (10/100) with conventional CT scan, and 20% (20/100) with X-ray. The rate of misdiagnosis was 5.0% (5/100) with CT 3D reconstruction. Routine CT scan was 15% (15/100), X-ray was 30% (30/100), and CT 3D reconstruction was significantly lower than other examinations ( P < 0.05 ). Conclusion. CT 3D reconstruction has high accuracy in the diagnosis of various types of hip fractures in the elderly.


Sign in / Sign up

Export Citation Format

Share Document