scholarly journals Approaches for Handling Immunopathological and Clinical Data Using Deep Learning Methodology: Multiplex IHC/IF Data as a Paradigm

2021 ◽  
Author(s):  
Siting Goh ◽  
Yueda Chua ◽  
Justina Lee ◽  
Joe Yeong ◽  
Yiyu Cai

Recent advancements in deep learning based artificial intelligence have enabled us to analyse complex data in order to provide patients with improved cancer prognosis, which is an important goal in precision health medicine. In this chapter, we would be discussing how deep learning could be applied to clinical data and immunopathological images to accurately determine survival rate prediction for patients. Multiplex immunohistochemistry/immunofluorescence (mIHC/IF) is a relatively new technology for simultaneous detection of multiple specific proteins from a single tissue section. To adopt deep learning, we collected and pre-processed the clinical and mIHC/IF data from a group of patients into three branches of data. These data were subsequently used to train and validate a neural network. The specific process and our recommendations will be further discussed in this chapter. We believe that our work will help the community to better handle their data for AI implementation while improving its performance and accuracy.

Stroke ◽  
2020 ◽  
Vol 51 (11) ◽  
pp. 3361-3365 ◽  
Author(s):  
Fareshte Erani ◽  
Nadezhda Zolotova ◽  
Benjamin Vanderschelden ◽  
Nima Khoshab ◽  
Hagop Sarian ◽  
...  

Background and Purpose: Clinical methods have incomplete diagnostic value for early diagnosis of acute stroke and large vessel occlusion (LVO). Electroencephalography is rapidly sensitive to brain ischemia. This study examined the diagnostic utility of electroencephalography for acute stroke/transient ischemic attack (TIA) and for LVO. Methods: Patients (n=100) with suspected acute stroke in an emergency department underwent clinical exam then electroencephalography using a dry-electrode system. Four models classified patients, first as acute stroke/TIA or not, then as acute stroke with LVO or not: (1) clinical data, (2) electroencephalography data, (3) clinical+electroencephalography data using logistic regression, and (4) clinical+electroencephalography data using a deep learning neural network. Each model used a training set of 60 randomly selected patients, then was validated in an independent cohort of 40 new patients. Results: Of 100 patients, 63 had a stroke (43 ischemic/7 hemorrhagic) or TIA (13). For classifying patients as stroke/TIA or not, the clinical data model had area under the curve=62.3, whereas clinical+electroencephalography using deep learning neural network model had area under the curve=87.8. Results were comparable for classifying patients as stroke with LVO or not. Conclusions: Adding electroencephalography data to clinical measures improves diagnosis of acute stroke/TIA and of acute stroke with LVO. Rapid acquisition of dry-lead electroencephalography is feasible in the emergency department and merits prehospital evaluation.


2021 ◽  
Author(s):  
Benjamin Haibe-Kains ◽  
Michal Kazmierski ◽  
Mattea Welch ◽  
Sejin Kim ◽  
Chris McIntosh ◽  
...  

Abstract Accurate prognosis for an individual patient is a key component of precision oncology. Recent advances in machine learning have enabled the development of models using a wider range of data, including imaging. Radiomics aims to extract quantitative predictive and prognostic biomarkers from routine medical imaging, but evidence for computed tomography radiomics for prognosis remains inconclusive. We have conducted an institutional machine learning challenge to develop an accurate model for overall survival prediction in head and neck cancer using clinical data etxracted from electronic medical records and pre-treatment radiological images, as well as to evaluate the true added benefit of radiomics for head and neck cancer prognosis. Using a large, retrospective dataset of 2,552 patients and a rigorous evaluation framework, we compared 12 different submissions using imaging and clinical data, separately or in combination. The winning approach used non-linear, multitask learning on clinical data and tumour volume, achieving high prognostic accuracy for 2-year and lifetime survival prediction and outperforming models relying on clinical data only, engineered radiomics and deep learning. Combining all submissions in an ensemble model resulted in improved accuracy, with the highest gain from a image-based deep learning model. Our results show the potential of machine learning and simple, informative prognostic factors in combination with large datasets as a tool to guide personalized cancer care.


10.2196/24973 ◽  
2021 ◽  
Vol 9 (1) ◽  
pp. e24973
Author(s):  
Thao Thi Ho ◽  
Jongmin Park ◽  
Taewoo Kim ◽  
Byunggeon Park ◽  
Jaehee Lee ◽  
...  

Background Many COVID-19 patients rapidly progress to respiratory failure with a broad range of severities. Identification of high-risk cases is critical for early intervention. Objective The aim of this study is to develop deep learning models that can rapidly identify high-risk COVID-19 patients based on computed tomography (CT) images and clinical data. Methods We analyzed 297 COVID-19 patients from five hospitals in Daegu, South Korea. A mixed artificial convolutional neural network (ACNN) model, combining an artificial neural network for clinical data and a convolutional neural network for 3D CT imaging data, was developed to classify these cases as either high risk of severe progression (ie, event) or low risk (ie, event-free). Results Using the mixed ACNN model, we were able to obtain high classification performance using novel coronavirus pneumonia lesion images (ie, 93.9% accuracy, 80.8% sensitivity, 96.9% specificity, and 0.916 area under the curve [AUC] score) and lung segmentation images (ie, 94.3% accuracy, 74.7% sensitivity, 95.9% specificity, and 0.928 AUC score) for event versus event-free groups. Conclusions Our study successfully differentiated high-risk cases among COVID-19 patients using imaging and clinical features. The developed model can be used as a predictive tool for interventions in aggressive therapies.


The ability to represent the world as a nested hierarchy of concepts, by defining each concept in relation to abstract representations has promoted deep learning to be widely used as a processing model for solving data science tasks. The era of digitalization has allowed the deep learning technology to flourish and machines with the ability to analyse huge amount of complex data would now be able to give progressively exact outcomes due to its supremacy in terms of accuracy when trained with massive amount of data. Convolutional Neural Networks(CNN), being a deep neural network with their ability to develop an internal representation of a two-dimensional image, allows the model to learn position and scale invariant structures in the data, which is important when working with images. For realizing emotion aware applications, the system must be highly accurate and in real time. In this paper, we provide the design and implementation details of a real time emotion based music player using CNN with the aim to reduce human effort and invoke the feasibility of Human Computer interaction(HCI).


Author(s):  
B. Srivani ◽  
N. Sandhya ◽  
B. Padmaja Rani

Rapid growth in technology and information lead the human to witness the improved growth in velocity, volume of data, and variety. The data in the business organizations demonstrate the development of big data applications. Because of the improving demand of applications, analysis of sophisticated streaming big data tends to become a significant area in data mining. One of the significant aspects of the research is employing deep learning approaches for effective extraction of complex data representations. Accordingly, this survey provides the detailed review of big data classification methodologies, like deep learning based techniques, Convolutional Neural Network (CNN) based techniques, K-Nearest Neighbor (KNN) based techniques, Neural Network (NN) based techniques, fuzzy based techniques, and Support vector based techniques, and so on. Moreover, a detailed study is made by concerning the parameters, like evaluation metrics, implementation tool, employed framework, datasets utilized, adopted classification methods, and accuracy range obtained by various techniques. Eventually, the research gaps and issues of various big data classification schemes are presented.


2016 ◽  
Author(s):  
Saman Sarraf ◽  
Ghassem Tofighi

Over the past decade, machine learning techniques and in particular predictive modeling and pattern recognition in biomedical sciences, from drug delivery systems to medical imaging, have become one of the most important methods of assisting researchers in gaining a deeper understanding of issues in their entirety and solving complex medical problems. Deep learning is a powerful machine learning algorithm in classification that extracts low- to high-level features. In this paper, we employ a convolutional neural network to distinguish an Alzheimer′s brain from a normal, healthy brain. The importance of classifying this type of medical data lies in its potential to develop a predictive model or system in order to recognize the symptoms of Alzheimer′s disease when compared with normal subjects and to estimate the stages of the disease. Classification of clinical data for medical conditions such as Alzheimer′s disease has always been challenging, and the most problematic aspect has always been selecting the strongest discriminative features. Using the Convolutional Neural Network (CNN) and the famous architecture LeNet-5, we successfully classified functional MRI data of Alzheimer′s subjects from normal controls, where the accuracy of testing data reached 96.85%. This experiment suggests that the shift and scale invariant features extracted by CNN followed by deep learning classification represents the most powerful method of distinguishing clinical data from healthy data in fMRI. This approach also allows for expansion of the methodology to predict more complicated systems.


2020 ◽  
Author(s):  
Jessica Qiuhua Sheng ◽  
Paul Jen-Hwa Hu ◽  
Xiao Liu ◽  
Ting-Shuo Huang ◽  
Yu-Hsien Chen

BACKGROUND Acute diseases have severe complications that develop rapidly, exhibit distinct phenotypes, and have profound effects on patient outcomes. Predictive analytics can enhance physicians’ care and management of acute disease patients by predicting crucial complication phenotypes for timely diagnosis and treatment. However, effective phenotype predictions require overcoming several challenges. First, patient data collected in the early stages of an acute disease (e.g., clinical data, laboratory results) are less informative for predicting phenotypic outcomes. Second, patient data are temporal and heterogeneous; for example, patients receive laboratory tests at different time intervals and frequencies. Third, imbalanced distributions of patient outcomes create an additional complexity for complication phenotype predictions. OBJECTIVE To predict crucial complication phenotypes among patients suffering acute diseases, we propose a novel, deep learning–based method that uses recurrent neural network–based sequence embedding to represent disease progressions, with the consideration of temporal heterogeneities in patient data. Our method incorporates a latent regulator to alleviate data insufficiency constraints by accounting for the underlying mechanisms that are not observed in patient data. The proposed method also includes cost-sensitive learning to address imbalanced outcome distributions in patient data for improved predictions. METHODS From a major health care organization in Taiwan, we obtain a sample of 10,354 electronic health records that pertain to 6,545 peritonitis patients. The proposed method projects these temporal, heterogeneous, clinical data into a substantially reduced feature space, then incorporates a latent regulator (latent parameter matrix) to obviate data insufficiencies and account for variations in phenotypic expressions. In addition, our method employs cost-sensitive learning to increase predictive performance further. RESULTS We evaluate the proposed method’s efficacy for predicting two hepatic complication phenotypes for peritonitis patients: acute hepatic encephalopathy (A-HE) and hepatorenal syndrome (HRS). The evaluation includes three benchmark techniques: temporal case-based reasoning (T-MMCBR), temporal short long-term memory (T-SLTM) networks, and time fusion convolutional neural network (CNN). For A-HE predictions, our method attains an area under the curve (AUC) of 0.82, which outperforms T-MMCBR by 64%, T-SLTM by 26%, and time fusion CNN by 26%. For HRS predictions, our method achieves an AUC of 0.64, which is 29% better than that of T-MMCBR (0.54). Overall, the evaluation results show that the proposed method significantly outperforms all the benchmarks, as measured by recall, F-measure, and AUC, while maintaining comparable precision values. CONCLUSIONS The proposed method learns a short-term temporal representation from patient data to predict complication phenotypes, and it offers greater predictive utilities than prevalent data-driven techniques. This method is generalizable and can be applied to different acute disease (illness) scenarios that are characterized by insufficient patient clinical data availability, temporal heterogeneities, and imbalanced distributions of important patient outcomes. CLINICALTRIAL


2020 ◽  
Author(s):  
Sanghun Choi ◽  
Jae-Kwang Lim ◽  
Thao Thi Ho ◽  
Jongmin Park ◽  
Taewoo Kim ◽  
...  

BACKGROUND Many COVID-19 patients rapidly progress into respiratory failure with a broad range of severity. Identification of the high-risk cases is critical for early intervention. OBJECTIVE The aim of this study is to develop deep learning models that can rapidly diagnose high-risk COVID-19 patients based on computed tomography (CT) images and clinical data. METHODS We analyzed 297 COVID-19 patients from five hospitals in Daegu, South Korea. A mixed model (ACNN) including an artificial neural network for clinical data and a convolution-neural network for 3D CT imaging data is developed to classify high-risk cases with a severe progression (event) from low-risk COVID-19 patients (event-free). RESULTS By using the mixed ACNN model, we could obtain high classification performance using novel coronavirus pneumonia (NCP) lesion images (93.9% accuracy, 80.8% sensitivity, 96.9% specificity, and 0.916 AUC) and using lung segmentation images (94.3% accuracy, 74.7% sensitivity, 95.9% specificity, and 0.928 AUC) for event vs. event-free groups. CONCLUSIONS Our study has successfully differentiated high-risk cases among COVID-19 patients using the imaging and clinical features of COVID-19 patients. The developed model is potentially utilized as a prediction tool for intervening active therapy.


2019 ◽  
Author(s):  
Rafik Margaryan ◽  
Daniele Della Latta ◽  
Giacomo Bianchi ◽  
Nicola Martini ◽  
Gianmarco Santini ◽  
...  

AbstractObjectiveAbout 10 million people in Europe suffer from mitral valve incompetence. Majority of these entity is mitral valve prolapse in developed countries. Endoscopic mitral valve surgery is a relatively new procedure and preparation in the right intercostal space are crucial for success completion of the procedure. We aimed to explore clinical variables and chest X-rays in order to build most performant model that can predict the right intercostal space for thoracotomy.MethodsOverall 234 patients underwent fully endoscopic mitral valve surgery. All patients had preoperative two projection radiography. Intercostal space for right thoracotomy was decided by expert cardiac surgeons taking in consideration the height, weight, chest radiography, anatomical position of skin incision, nipple position and the sex. In order to predict the right intercostal space we have used clinical data and we have collected all radiographies and feed it to deep neural network algorithm. We have spitted the whole data-set into two subsets: training and testing data-sets. We have used clinical data and build an algorithm (Random Forest) in order to have reference model.ResultsThe best-performing classifier was GoogLeNet neural network (now on we will reffera as Deep Learning) and had an AUC of 0.956. Algorithm based on clinical data (Random Forest) had AUC of 0.529 using only chest x-rays. The deep leaning algorithm predicted correctly in all cases the correct intercostal space on the training datasest except two ladies (96.08% ; with sensitivity of 97.06% and specificity 94.12 %, where the Random Forest was capable to predict right intercostal space in 60.78% cases with sensitivity of 93.33% and specificity 14.29 % (only clinical data).ConclusionArtificial intelligence can be helpful to program the minimally invasive cardiac operation, for right intercostal space selection for thoracotomy, especially in non optimal thoraxes (example, obese short ladies). It learned from the standard imaging (thorax x-ray) which is easy, do routinely to every patient.


Sign in / Sign up

Export Citation Format

Share Document