Projection-to-image transform frame: a lightweight block reconstruction network (LBRN) for computed tomography

Author(s):  
Genwei Ma ◽  
Xing Zhao ◽  
Yining Zhu ◽  
Huitao Zhang

Abstract To solve the problem of learning based computed tomography (CT) reconstruction, several reconstruction networks were invented. However, applying neural network to tomographic reconstruction still remains challenging due to unacceptable memory space requirement. In this study, we presents a novel lightweight block reconstruction network (LBRN), which transforms the reconstruction operator into a deep neural network by unrolling the filter back-projection (FBP) method. Specifically, the proposed network contains two main modules, which, respectively, correspond to the filter and back-projection of FBP method. The first module of LBRN decouples the relationship of Radon transform between the reconstructed image and the projection data. Therefore, the following module, block back-projection module, can use the block reconstruction strategy. Due to each image block is only connected with part filtered projection data, the network structure is greatly simplified and the parameters of the whole network is dramatically reduced. Moreover, this approach is trained end-to-end, working directly from raw projection data and does not depend on any initial images. Five reconstruction experiments are conducted to evaluate the performance of the proposed LBRN: full angle, low-dose CT, region of interest (ROI), metal artifacts reduction and real data experiment. The results of the experiments show that the LBRN can be effectively introduced into the reconstruction process and has outstanding advantages in terms of different reconstruction problems.

2021 ◽  
Vol 12 (1) ◽  
pp. 404
Author(s):  
Dominik F. Bauer ◽  
Constantin Ulrich ◽  
Tom Russ ◽  
Alena-Kathrin Golla ◽  
Lothar R. Schad ◽  
...  

Metal artifacts are common in CT-guided interventions due to the presence of metallic instruments. These artifacts often obscure clinically relevant structures, which can complicate the intervention. In this work, we present a deep learning CT reconstruction called iCTU-Net for the reduction of metal artifacts. The network emulates the filtering and back projection steps of the classical filtered back projection (FBP). A U-Net is used as post-processing to refine the back projected image. The reconstruction is trained end-to-end, i.e., the inputs of the iCTU-Net are sinograms and the outputs are reconstructed images. The network does not require a predefined back projection operator or the exact X-ray beam geometry. Supervised training is performed on simulated interventional data of the abdomen. For projection data exhibiting severe artifacts, the iCTU-Net achieved reconstructions with SSIM = 0.970±0.009 and PSNR = 40.7±1.6. The best reference method, an image based post-processing network, only achieved SSIM = 0.944±0.024 and PSNR = 39.8±1.9. Since the whole reconstruction process is learned, the network was able to fully utilize the raw data, which benefited from the removal of metal artifacts. The proposed method was the only studied method that could eliminate the metal streak artifacts.


2019 ◽  
Vol 33 (06) ◽  
pp. 1950063 ◽  
Author(s):  
Shailendra Tiwari ◽  
Kavkirat Kaur ◽  
Yadunath Pathak ◽  
Shivendraa Shivani ◽  
Kuldeep Kaur

Computed Tomography (CT) is considered as a significant imaging tool for clinical diagnoses. Due to low-dose radiation in CT, the projection data is highly affected by Gaussian noise which may lead to blurred images, staircase effect, loss of basic fine structure and detailed information. Therefore, there is a demand for an approach that can eliminate noise and can provide high-quality images. To achieve this objective, this paper presents a new statistical image reconstruction method by proposing a suitable regularization approach. The proposed regularization is a hybrid approach of Complex Diffusion and Shock filter as a prior term. To handle the problem of prominent Gaussian noise as well as ill-posedness, the proposed hybrid regularization is further combined with the standard Maximum Likelihood Expectation Maximization (MLEM) reconstruction algorithm in an iterative manner and has been referred to as the proposed CT-Reconstruction (CT-R) algorithm here after. Besides, considering the large sizes of image data sets for medical imaging, distributed storage for images have been employed on Hadoop Distributed File System (HDFS) and the proposed MLEM algorithms have been deployed for improved performance.The proposed method has been evaluated on both the simulated and real test phantoms. The final results are compared with the other standard methods and it is observed that the proposed method has many desirable properties such as better noise robustness, less computational cost and enhanced denoising effect.


Sensors ◽  
2021 ◽  
Vol 21 (24) ◽  
pp. 8164
Author(s):  
Linlin Zhu ◽  
Yu Han ◽  
Xiaoqi Xi ◽  
Lei Li ◽  
Bin Yan

In computed tomography (CT) images, the presence of metal artifacts leads to contaminated object structures. Theoretically, eliminating metal artifacts in the sinogram domain can correct projection deviation and provide reconstructed images that are more real. Contemporary methods that use deep networks for completing metal-damaged sinogram data are limited to discontinuity at the boundaries of traces, which, however, lead to secondary artifacts. This study modifies the traditional U-net and adds two sinogram feature losses of projection images—namely, continuity and consistency of projection data at each angle, improving the accuracy of the complemented sinogram data. Masking the metal traces also ensures the stability and reliability of the unaffected data during metal artifacts reduction. The projection and reconstruction results and various evaluation metrics reveal that the proposed method can accurately repair missing data and reduce metal artifacts in reconstructed CT images.


Author(s):  
P.L. Nikolaev

This article deals with method of binary classification of images with small text on them Classification is based on the fact that the text can have 2 directions – it can be positioned horizontally and read from left to right or it can be turned 180 degrees so the image must be rotated to read the sign. This type of text can be found on the covers of a variety of books, so in case of recognizing the covers, it is necessary first to determine the direction of the text before we will directly recognize it. The article suggests the development of a deep neural network for determination of the text position in the context of book covers recognizing. The results of training and testing of a convolutional neural network on synthetic data as well as the examples of the network functioning on the real data are presented.


2021 ◽  
Vol 24 ◽  
pp. 100573
Author(s):  
Goli Khaleghi ◽  
Mohammad Hosntalab ◽  
Mahdi Sadeghi ◽  
Reza Reiazi ◽  
Seied Rabi Mahdavi

2020 ◽  
Vol 28 (6) ◽  
pp. 829-847
Author(s):  
Hua Huang ◽  
Chengwu Lu ◽  
Lingli Zhang ◽  
Weiwei Wang

AbstractThe projection data obtained using the computed tomography (CT) technique are often incomplete and inconsistent owing to the radiation exposure and practical environment of the CT process, which may lead to a few-view reconstruction problem. Reconstructing an object from few projection views is often an ill-posed inverse problem. To solve such problems, regularization is an effective technique, in which the ill-posed problem is approximated considering a family of neighboring well-posed problems. In this study, we considered the {\ell_{1/2}} regularization to solve such ill-posed problems. Subsequently, the half thresholding algorithm was employed to solve the {\ell_{1/2}} regularization-based problem. The convergence analysis of the proposed method was performed, and the error bound between the reference image and reconstructed image was clarified. Finally, the stability of the proposed method was analyzed. The result of numerical experiments demonstrated that the proposed method can outperform the classical reconstruction algorithms in terms of noise suppression and preserving the details of the reconstructed image.


Cancers ◽  
2021 ◽  
Vol 13 (4) ◽  
pp. 652 ◽  
Author(s):  
Carlo Augusto Mallio ◽  
Andrea Napolitano ◽  
Gennaro Castiello ◽  
Francesco Maria Giordano ◽  
Pasquale D'Alessio ◽  
...  

Background: Coronavirus disease 2019 (COVID-19) pneumonia and immune checkpoint inhibitor (ICI) therapy-related pneumonitis share common features. The aim of this study was to determine on chest computed tomography (CT) images whether a deep convolutional neural network algorithm is able to solve the challenge of differential diagnosis between COVID-19 pneumonia and ICI therapy-related pneumonitis. Methods: We enrolled three groups: a pneumonia-free group (n = 30), a COVID-19 group (n = 34), and a group of patients with ICI therapy-related pneumonitis (n = 21). Computed tomography images were analyzed with an artificial intelligence (AI) algorithm based on a deep convolutional neural network structure. Statistical analysis included the Mann–Whitney U test (significance threshold at p < 0.05) and the receiver operating characteristic curve (ROC curve). Results: The algorithm showed low specificity in distinguishing COVID-19 from ICI therapy-related pneumonitis (sensitivity 97.1%, specificity 14.3%, area under the curve (AUC) = 0.62). ICI therapy-related pneumonitis was identified by the AI when compared to pneumonia-free controls (sensitivity = 85.7%, specificity 100%, AUC = 0.97). Conclusions: The deep learning algorithm is not able to distinguish between COVID-19 pneumonia and ICI therapy-related pneumonitis. Awareness must be increased among clinicians about imaging similarities between COVID-19 and ICI therapy-related pneumonitis. ICI therapy-related pneumonitis can be applied as a challenge population for cross-validation to test the robustness of AI models used to analyze interstitial pneumonias of variable etiology.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Javier Alba-Tercedor ◽  
Wayne B. Hunter ◽  
Ignacio Alba-Alejandre

AbstractThe Asian citrus psyllid (ACP), Diaphorina citri, is a harmful pest of citrus trees that transmits Candidatus Liberibacter spp. which causes Huanglongbing (HLB) (citrus greening disease); this is considered to be the most serious bacterial disease of citrus plants. Here we detail an anatomical study of the external and internal anatomy (excluding the reproductive system) using micro-computed tomography (micro-CT). This is the first complete 3D micro-CT reconstruction of the anatomy of a psylloid insect and includes a 3D reconstruction of an adult feeding on a citrus leaf that can be used on mobile devices. Detailed rendered images and videos support first descriptions of coxal and scapus antennal glands and sexual differences in the internal anatomy (hindgut rectum, mesothoracic ganglion and brain). This represents a significant advance in our knowledge of ACP anatomy, and of psyllids in general. Together the images, videos and 3D model constitute a unique anatomical atlas and are useful tools for future research and as teaching aids.


Sign in / Sign up

Export Citation Format

Share Document