scholarly journals A Hybrid End-to-End Approach Integrating Conditional Random Fields into CNNs for Prostate Cancer Detection on MRI

2020 ◽  
Vol 10 (1) ◽  
pp. 338 ◽  
Author(s):  
Paulo Lapa ◽  
Mauro Castelli ◽  
Ivo Gonçalves ◽  
Evis Sala ◽  
Leonardo Rundo

Prostate Cancer (PCa) is the most common oncological disease in Western men. Even though a growing effort has been carried out by the scientific community in recent years, accurate and reliable automated PCa detection methods on multiparametric Magnetic Resonance Imaging (mpMRI) are still a compelling issue. In this work, a Deep Neural Network architecture is developed for the task of classifying clinically significant PCa on non-contrast-enhanced MR images. In particular, we propose the use of Conditional Random Fields as a Recurrent Neural Network (CRF-RNN) to enhance the classification performance of XmasNet, a Convolutional Neural Network (CNN) architecture specifically tailored to the PROSTATEx17 Challenge. The devised approach builds a hybrid end-to-end trainable network, CRF-XmasNet, composed of an initial CNN component performing feature extraction and a CRF-based probabilistic graphical model component for structured prediction, without the need for two separate training procedures. Experimental results show the suitability of this method in terms of classification accuracy and training time, even though the high-variability of the observed results must be reduced before transferring the resulting architecture to a clinical environment. Interestingly, the use of CRFs as a separate postprocessing method achieves significantly lower performance with respect to the proposed hybrid end-to-end approach. The proposed hybrid end-to-end CRF-RNN approach yields excellent peak performance for all the CNN architectures taken into account, but it shows a high-variability, thus requiring future investigation on the integration of CRFs into a CNN.

Author(s):  
Ratish Puduppully ◽  
Li Dong ◽  
Mirella Lapata

Recent advances in data-to-text generation have led to the use of large-scale datasets and neural network models which are trained end-to-end, without explicitly modeling what to say and in what order. In this work, we present a neural network architecture which incorporates content selection and planning without sacrificing end-to-end training. We decompose the generation task into two stages. Given a corpus of data records (paired with descriptive documents), we first generate a content plan highlighting which information should be mentioned and in which order and then generate the document while taking the content plan into account. Automatic and human-based evaluation experiments show that our model1 outperforms strong baselines improving the state-of-the-art on the recently released RotoWIRE dataset.


Sensors ◽  
2021 ◽  
Vol 21 (18) ◽  
pp. 6302
Author(s):  
Xupei Zhang ◽  
Zhanzhuang He ◽  
Zhong Ma ◽  
Peng Jun ◽  
Kun Yang

Altitude estimation is one of the fundamental tasks of unmanned aerial vehicle (UAV) automatic navigation, where it aims to accurately and robustly estimate the relative altitude between the UAV and specific areas. However, most methods rely on auxiliary signal reception or expensive equipment, which are not always available, or applicable owing to signal interference, cost or power-consuming limitations in real application scenarios. In addition, fixed-wing UAVs have more complex kinematic models than vertical take-off and landing UAVs. Therefore, an altitude estimation method which can be robustly applied in a GPS denied environment for fixed-wing UAVs must be considered. In this paper, we present a method for high-precision altitude estimation that combines the vision information from a monocular camera and poses information from the inertial measurement unit (IMU) through a novel end-to-end deep neural network architecture. Our method has numerous advantages over existing approaches. First, we utilize the visual-inertial information and physics-based reasoning to build an ideal altitude model that provides general applicability and data efficiency for neural network learning. A further advantage is that we have designed a novel feature fusion module to simplify the tedious manual calibration and synchronization of the camera and IMU, which are required for the standard visual or visual-inertial methods to obtain the data association for altitude estimation modeling. Finally, the proposed method was evaluated, and validated using real flight data obtained during a fixed-wing UAV landing phase. The results show the average estimation error of our method is less than 3% of the actual altitude, which vastly improves the altitude estimation accuracy compared to other visual and visual-inertial based methods.


Healthcare ◽  
2020 ◽  
Vol 8 (4) ◽  
pp. 493
Author(s):  
Charis Ntakolia ◽  
Dimitrios E. Diamantis ◽  
Nikolaos Papandrianos ◽  
Serafeim Moustakidis ◽  
Elpiniki I. Papageorgiou

Bone metastasis is among the most frequent in diseases to patients suffering from metastatic cancer, such as breast or prostate cancer. A popular diagnostic method is bone scintigraphy where the whole body of the patient is scanned. However, hot spots that are presented in the scanned image can be misleading, making the accurate and reliable diagnosis of bone metastasis a challenge. Artificial intelligence can play a crucial role as a decision support tool to alleviate the burden of generating manual annotations on images and therefore prevent oversights by medical experts. So far, several state-of-the-art convolutional neural networks (CNN) have been employed to address bone metastasis diagnosis as a binary or multiclass classification problem achieving adequate accuracy (higher than 90%). However, due to their increased complexity (number of layers and free parameters), these networks are severely dependent on the number of available training images that are typically limited within the medical domain. Our study was dedicated to the use of a new deep learning architecture that overcomes the computational burden by using a convolutional neural network with a significantly lower number of floating-point operations (FLOPs) and free parameters. The proposed lightweight look-behind fully convolutional neural network was implemented and compared with several well-known powerful CNNs, such as ResNet50, VGG16, Inception V3, Xception, and MobileNet on an imaging dataset of moderate size (778 images from male subjects with prostate cancer). The results prove the superiority of the proposed methodology over the current state-of-the-art on identifying bone metastasis. The proposed methodology demonstrates a unique potential to revolutionize image-based diagnostics enabling new possibilities for enhanced cancer metastasis monitoring and treatment.


2018 ◽  
Vol 105 ◽  
pp. 175-181 ◽  
Author(s):  
Jon Ander Gómez ◽  
Juan Arévalo ◽  
Roberto Paredes ◽  
Jordi Nin

2020 ◽  
Vol 15 ◽  
pp. 117727192091332 ◽  
Author(s):  
George A Dominguez ◽  
Alexander T Polo ◽  
John Roop ◽  
Anthony J Campisi ◽  
Robert A Somer ◽  
...  

Current screening methods for prostate cancer (PCa) result in a large number of false positives making it difficult for clinicians to assess disease status, thus warranting advancements in screening and early detection methods. The goal of this study was to design a liquid biopsy test that uses flow cytometry–based immunophenotyping and artificial neural network (ANN) analysis to detect PCa. Numerous myeloid and lymphoid cell populations, including myeloid-derived suppressor cells, were measured from 156 patients with PCa, 123 with benign prostatic hyperplasia (BPH), and 99 male healthy donor (HD) controls. Using pattern recognition neural network (PRNN) analysis, a type of ANN, PCa detection compared against HD resulted in 96.6% sensitivity, 87.5% specificity, and an area under the curve (AUC) value of 0.97. Detecting patients with higher risk disease (⩾Gleason 7) against lower risk disease (BPH/Gleason 6) resulted in 92.0% sensitivity, 42.7% specificity, and an AUC of 0.72. This study suggests that analyzing flow cytometry immunophenotyping data with PRNNs may prove to be a useful tool to improve PCa detection and reduce the number of unnecessary prostate biopsies performed each year.


Sign in / Sign up

Export Citation Format

Share Document