Developing a Predictive Model for Depressive Disorders Using Stacking Ensemble and Naive Bayesian Nomogram: Using Samples Representing South Korea

This study provided baseline data for preventing depression in female older adults living alone by understanding the degree of their depressive disorders and factors affecting these depressive disorders by analyzing epidemiological survey data representing South Koreans. To achieve the study objective, this study explored the main risk factors of depressive disorders using the stacking ensemble machine technique. Moreover, this study developed a nomogram that could help primary physicians easily interpret high-risk groups of depressive disorders in primary care settings based on the major predictors derived from machine learning. This study analyzed 582 female older adults (≥60 years old) living alone. The depressive disorder, a target variable, was measured using the Korean version of Patient Health Questionnaire-9. This study developed five single predictive models (GBM, Random Forest, Adaboost, SVM, XGBoost) and six stacking ensemble models (GBM + Bayesian regression, RandomForest + Bayesian regression, Adaboost + Bayesian regression, SVM + Bayesian regression, XGBoost + Bayesian regression, GBM + RandomForest + Adaboost + SVM + XGBoost + Bayesian regression) to predict depressive disorders. The naive Bayesian nomogram confirmed that stress perception, subjective health, n-6 fatty acid, n-3 fatty acid, mean hours of sitting per day, and mean daily sleep hours were six major variables related to the depressive disorders of female older adults living alone. Based on the results of this study, it is required to evaluate the multiple risk factors for depression including various measurable factors such as social support.

Pilot Study on Analysis of Electroencephalography Signals from Children with FASD with the Implementation of Naive Bayesian Classifiers

In this paper Naive Bayesian classifiers were applied for the purpose of differentiation between the EEG signals recorded from children with Fetal Alcohol Syndrome Disorders (FASD) and healthy ones. This work also provides a brief introduction to the FASD itself, explaining the social, economic and genetic reasons for the FASD occurrence. The obtained results were good and promising and indicate that EEG recordings can be a helpful tool for potential diagnostics of FASDs children affected with it, in particular those with invisible physical signs of these spectrum disorders.

Analysis of Machine Learning Methods Using Spam Filtering

The paper considers methods of the naive Bayesian classifier. Experiments that show independence between traits are described. Describes the naive Bayesian classifier used to filter spam in messages. The aim of the study is to determine the best method to solve the problem of spam in messages. The paper considers three different variations of the naive Bayesian classifier. The results of experiments and research are given.

Prediction of the Delay in the Portfolio Construction Using Naïve Bayesian Classification Algorithms

Projects suspensions are between the most insistent tasks confronted by the construction field accredited to the sector’s difficulty and its essential delay risk foundations’ interdependence. Machine learning provides a perfect group of techniques, which can attack those complex systems. The study aimed to recognize and progress a wellorganized predictive data tool to examine and learn from delay sources depend on preceding data of construction projects by using decision trees and naïve Bayesian classification algorithms. An intensive review of available data has been conducted to explore the real reasons and causes of construction project delays. The results show that the postponement of delay of interim payments is at the forefront of delay factors caused by the employer’s decision. Even the least one is to leave the job site caused by the contractor’s second part of the contract, the repeated unjustified stopping of the work at the site, without permission or notice from the client’s representatives. The developed model was applied to about 97 projects and used as a prediction model. The decision tree model shows higher accuracy in the prediction.

A Comparative Study of Detection and Classification of Emotions on Social Media Using SVM and Näıve Bayes Techniques

The rapid rate of innovations and dynamics of technology has made humans life more dependent on them. In today’s synopsis Microblogging and Social networking sites like Twitter, Facebook are a part of our lives that cannot be detached from anyone. Through these social media each one of them carry their emotions and fix their opinions based on a particular situations or circumstances. This paper presents a brief comparison about Detection and Classification of Emotions on Social Media using SVM and Näıve Bayesian classifier. Twitter messages has been used as input dataset because they contain a broad, varied, and freely accessible set of emotions. The approach uses hash-tags as labels to train supervised classifiers to detect multiple classes of emotion on potentially large data sets without the need for manual intervention. We look into the usefulness of a number of features for detecting emotions, including unigrams, unigram symbol, negations and punctuations using SVM and Näıve Bayesian Classifiers.

Determining Clinical Course of Diffuse Large B-Cell Lymphoma Using Targeted Transcriptome and Machine Learning Algorithms

Introduction: Multiple studies have demonstrated that diffuse large B-cell lymphoma (DLBCL) can be divided into subgroups based on their biology. However, these biological subgroups overlap clinically. While R-CHOP (rituximab, cyclophosphamide, doxorubicin, vincristine, and prednisone) remains the standard of care for treating patients with DLBCL, predicting which patients will not benefit from such therapy is important so that alternative therapy or clinical trials can be considered. Most of the studies stratifying patients select biomarkers first, then explore how these biomarkers can stratify patients based on outcome. We explored the potential of using machine learning to first group patients with DLBCL based on survival, then isolating the biomarkers necessary for predicting these survival subgroups. Methods: RNA was extracted from tissue paraffin blocks from 379 R-CHOP treated patients with de novo DLBCL, and from 247 patients with extranodal DLBCL. A targeted hybrid capture RNA panel of 1408 genes was used for next generation sequencing (NGS). Sequencing was performed using an Illumina NextSeq 550 System platform. Ten million reads per sample in a single run were required, and the read length was 2 × 150 bp. An expression profile was generated from the sequencing coverage profile of each individual sample using Cufflinks. A machine learning system was developed to classify patients into four groups based on their overall survival. This machine learning approach based on Naïve Bayesian algorithm was also used to discover the relevant subset of genes with which to classify patients into each of the four survival groups. To eliminate the underflow problem commonly associated with the standard Naïve Bayesian classifiers, we applied Geometric Mean Naïve Bayesian (GMNB) as the classifier to predict the survival group for each patient. Results: Using machine learning, patients were first divided into two groups: short survival (S) and long survival (L). To refine this model, we used the same approach and divided the patients in each group into two subgroups, generating four groups: long survival in the long group (LL), short survival in the long group (LS), long survival in the short group (SL), and short survival in the short group (SS). The hazard ratio for this model was 0.174 (confidence interval: 0.120-0.251), and P-value <0.0001. After defining these four groups, a machine learning algorithm was used to discover the biomarkers from the expression data of the 1408 genes from NGS data. To reduce the effects of noise and avoid overfitting, we employed a 12-step cross validation to obtain a robust measure. For an individual gene, a generalized Naïve Bayesian classifier was constructed on the training of one of the 12 subsets and tested on the other 11 testing subsets. This allowed us to limit the prediction process to 60 genes for each separation step. Using the selected biomarkers, we classified the patients in the original set (379 patients) into LL, LS, SL, and SS groups and then evaluated the survival pattern of these groups. As shown in Fig. 1A, the selected biomarkers predicted survival as expected in the overall survival groups prior to biomarker selection. For additional validation of the system, we used the selected biomarkers to classify a completely new set of 247 samples of patients with extranodal DLBCL. As shown in Fig. 1B, these selected biomarkers successfully predicted the overall survival in this group of patients with an HR of 0.530 (confidence interval: 0.234-1.197, P=0.005). This classification correlated with cell of origin classification, TP53 mutation status, MYC expression, and IRF4 expression. However, in a multivariate analysis, only TP53 mutation was independent in predicting prognosis (P=0.005) and age (below or over 60) (P=0.01) along with the survival grouping (P<0.000001). Conclusions: Using a novel machine learning approach with the expression levels of 180 genes, we developed a model that can reliably stratify patients with DLBCL treated with R-CHOP into four survival subgroups. This model can be used to identify patients who may not respond well to R-CHOP to be considered for alternative therapy and clinical trials. Figure 1 Figure 1. Disclosures Hsi: AbbVie Inc, Eli Lilly: Research Funding. Ferreri: Ospedale San Raffaele srl: Patents & Royalties; BMS: Research Funding; Pfizer: Research Funding; Beigene: Research Funding; Hutchison Medipharma: Research Funding; Amgen: Research Funding; Genmab: Research Funding; ADC Therapeutics: Research Funding; Gilead: Membership on an entity's Board of Directors or advisory committees, Research Funding; Novartis: Membership on an entity's Board of Directors or advisory committees, Research Funding; Roche: Membership on an entity's Board of Directors or advisory committees, Research Funding; PletixaPharm: Membership on an entity's Board of Directors or advisory committees; x Incyte: Membership on an entity's Board of Directors or advisory committees; Adienne: Membership on an entity's Board of Directors or advisory committees. Piris: Millenium/Takeda, EUSA, Jansen, NanoString, Kyowa Kirin, Gilead and Celgene.: Membership on an entity's Board of Directors or advisory committees, Speakers Bureau. Winter: BMS: Other: Husband: Data and Safety Monitoring Board; Actinium Pharma: Consultancy; Janssen: Other: Husband: Consultancy; Agios: Other: Husband: Consultancy; Gilead: Other: Husband: Consultancy; Epizyme: Other: Husband: Data and Safety Monitoring Board; Ariad/Takeda: Other: Husband: Data and Safety Monitoring Board; Merck: Consultancy, Honoraria, Research Funding; Novartis: Other: Husband: Consultancy, Data and Safety Monitoring Board; Karyopharm (Curio Science): Honoraria.

Bone Marrow-Based Biomarkers for Predicting aGVHD Using Targeted RNA Next Generation Sequencing and Machine Learning

Introduction: Acute graft-vs.-host disease (aGVHD) remains a major diagnostic and clinical problem in patients after allogenic hematopoietic stem cell transplant (HSCT). Finding biomarkers that play a role in aGVHD not only helps in predicting and diagnosing aGVHD, but might help in developing prophylaxis and therapeutic approaches. Using Next Generation Sequencing (NGS) and targeted RNA sequencing along with a machine learning approach to predict, we investigated the potential of discovering new biomarkers that can predict aGVHD. Methods: RNA extracted from bone marrow aspiration samples collected around day 90 post HSCT from 46 patients were sequenced using 1408 targeted genes. cDNA was first generated, then adapters were ligated. The coding regions of the expressed genes were captured from this library using sequence-specific probes to create the final library. Sequencing was performed using an Illumina NextSeq 550 platform. Ten million reads per sample in a single run were required. Read length was 2 × 150 bp. Expression profile was generated using Cufflinks. A machine learning system is developed to predict the GVHD cases and to discover the relevant genes. A subset of genes relevant to GVHD is automatically selected for the classification system, based on a k-fold cross-validation procedure (with k=10). For an individual gene, a Naïve Bayesian classifier was constructed on the training of k-1 subsets and tested on the other testing subset. To eliminate the underflow problem commonly associated with the standard Naïve Bayesian classifiers, we applied Geometric Mean Naïve Bayesian (GMNB) as the classifier to predict GVHD. The processes of gene selection and GVHD classification are applied iteratively to obtain an optimal classification system and a subset of genes relevant to GVHD. Results: The analyzed bone marrow samples included patients transplanted for aplastic anemia (#1), acute lymphoblastic leukemia (#9), acute myeloid leukemia (#16), mixed phenotype acute leukemia (#1), myelodysplastic syndrome (#10), chronic myelomonocytic leukemia (#5), and myeloproliferative neoplasm (#4). Of the 46 patients, 30 (65%) had a diagnosis of aGVHD (grade 2-4). The GMNB modified Bayesian model selected 7 genes as top classifiers. These top classifier genes included Class II Major Histocompatibility gene (CIITA), B-cell markers genes (CD19 and CD22), early T-cell related gene (TCL1A), hematopoietic-specific transcription factor (IKZF3), a gene involved in protein-protein interaction, and a gene involved in DNA helicase nucleotide excision repair (ERCC3). When these 7 genes were used in GMNB-modified classifier with 10-fold cross validation to predict aGVHD, the model classified 28 of the 30 positive cases accurately and 14 of the 16 negative cases accurately. The sensitivity was 93% (95% CI, 76%-99%). The specificity was 87.5% (95% CI: 60%-97%). The positive predictive value (PPV) was 93% (95% CI: 76%-99%) and the negative predictive value (NPV) was 87.5% (95% CI: 60%-98%). Conclusion: While most biomarker discovery has been focused on inflammatory cytokines, chemokines, and their receptors, our data suggest that hematopoietic proliferation and transcription regulators in bone marrow might provide important information for the diagnosis and prediction of aGVHD. This data suggests that biomarkers related to B-cell, T-cell, and MHC play a role in aGVHD at the bone marrow level. These findings also suggest that targeting these biomarkers in the bone marrow might be a realistic approach for prophylaxis and treatment that needs to be explored. Although further validation is needed, this study suggests that targeted RNA sequencing by NGS combined with machine learning algorithm can be a practical and cost-effective approach for the diagnosis and prediction of aGVHD. Figure 1 Figure 1. Disclosures Pecora: Genetic testing cooperative: Other: equity investor; Genetic testing cooperative: Membership on an entity's Board of Directors or advisory committees. Goy: Rosewell Park: Consultancy; Elsevier's Practice Update Oncology, Intellisphere, LLC(Targeted Oncology): Consultancy; Acerta: Consultancy, Research Funding; Genentech/Hoffman la Roche: Research Funding; Vincerx pharma: Membership on an entity's Board of Directors or advisory committees; Physicians' Education Resource: Consultancy, Other: Meeting/travel support; Vincerx: Honoraria, Membership on an entity's Board of Directors or advisory committees; AstraZeneca: Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding; Xcenda: Consultancy; Janssen: Membership on an entity's Board of Directors or advisory committees; AstraZeneca: Membership on an entity's Board of Directors or advisory committees; Gilead: Membership on an entity's Board of Directors or advisory committees; Janssen: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding; Kite, a Gilead Company: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding; OncLive Peer Exchange: Honoraria; Xcenda: Consultancy, Honoraria; AbbVie/Pharmacyclics: Membership on an entity's Board of Directors or advisory committees; COTA (Cancer Outcome Tracking Analysis): Current holder of stock options in a privately-held company, Membership on an entity's Board of Directors or advisory committees, Other: Leadership role; Elsevier PracticeUpdate: Oncology: Consultancy, Honoraria; Infinity/Verastem: Research Funding; Kite Pharma: Membership on an entity's Board of Directors or advisory committees; Bristol Meyers Squibb: Membership on an entity's Board of Directors or advisory committees; MorphoSys: Honoraria, Other; Genomic Testing Cooperative: Current holder of stock options in a privately-held company, Membership on an entity's Board of Directors or advisory committees, Other: Leadership role; Celgene: Consultancy, Honoraria, Research Funding; Novartis: Consultancy, Honoraria; Hoffman la Roche: Consultancy; Michael J Hennessey Associates INC: Consultancy; LLC(Targeted Oncology): Consultancy; Medscape: Consultancy; Bristol Meyers Squibb: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees; AbbVie/Pharmacyclics: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding; Incyte: Honoraria; Constellation: Research Funding; Janssen: Research Funding; Karyopharm: Research Funding; Phamacyclics: Research Funding; Hackensack Meridian Health, Regional Cancer Care Associates/OMI: Current Employment. Rowley: ReAlta Life Sciences: Consultancy.

An AdaBoost-based tree augmented naive Bayesian classifier for transient stability assessment of power systems

By focusing on the accuracy limitations of the naive Bayesian classifier in the transient stability assessment of power systems, a tree augmented naive Bayesian (TAN) classifier is adopted for the power system transient stability assessment. The adaptive Boosting (AdaBoost) algorithm is used in the TAN classifier to form an AdaBoost-based tree augmented naive Bayesian (ATAN) classifier for further classification performance improvement. To construct the ATAN classifier, eight attributes that reasonably reflect the transient stability or transient instability of a power system are selected as inputs of the proposed classifier. In addition, the class-attribute interdependence maximization (CAIM) algorithm is used to discretize the attributes. Then, the operating mechanism of the power system is used to obtain the dependencies between the attributes, and the parameters of the ATAN classifier are learned according to the Bayes’ theorem and the criterion of maximizing a posterior estimation. Four evaluation indicators of the ATAN classifier are used, that is, the value of Kappa, the area under the receiver operating characteristic curve (AUC), F1 score, and the average evaluation indicator. Lastly, experiments are implemented on the IEEE 3-generator 9-bus system and IEEE 10-generator 39-bus system. The simulation results show that the ATAN classifier can significantly improve the classification performance of the transient stability assessment of the power system.