DeFFusion: CNN-based Continuous Authentication Using Deep Feature Fusion

Smartphones have become crucial and important in our daily life, but the security and privacy issues have been major concerns of smartphone users. In this article, we present DeFFusion, a CNN-based continuous authentication system using Deep Feature Fusion for smartphone users by leveraging the accelerometer and gyroscope ubiquitously built into smartphones. With the collected data, DeFFusion first converts the time domain data into frequency domain data using the fast Fourier transform and then inputs both of them into a designed CNN, respectively. With the CNN-extracted features, DeFFusion conducts the feature selection utilizing factor analysis and exploits balanced feature concatenation to fuse these deep features. Based on the one-class SVM classifier, DeFFusion authenticates current users as a legitimate user or an impostor. We evaluate the authentication performance of DeFFusion in terms of impact of training data size and time window size, accuracy comparison on different features over different classifiers and on different classifiers with the same CNN-extracted features, accuracy on unseen users, time efficiency, and comparison with representative authentication methods. The experimental results demonstrate that DeFFusion has the best accuracy by achieving the mean equal error rate of 1.00% in a 5-second time window size.

Re-wiring and gene expression changes of AC025034.1 and ATP2B1 play complex roles in early-to-late breast cancer progression

Background Elucidating the dynamic topological changes across different stages of breast cancer, called stage re-wiring, could lead to identifying key latent regulatory signatures involved in cancer progression. Such dynamic regulators and their functions are mostly unknown. Here, we reconstructed differential co-expression networks for four stages of breast cancer to assess the dynamic patterns of cancer progression. A new computational approach was applied to identify stage-specific subnetworks for each stage. Next, prognostic traits of genes and the efficiency of stage-related groups were evaluated and validated, using the Log-Rank test, SVM classifier, and sample clustering. Furthermore, by conducting the stepwise VIF-feature selection method, a Cox-PH model was developed to predict patients’ risk. Finally, the re-wiring network for prognostic signatures was reconstructed and assessed across stages to detect gain/loss, positive/negative interactions as well as rewired-hub nodes contributing to dynamic cancer progression. Results After having implemented our new approach, we could identify four stage-specific core biological pathways. We could also detect an essential non-coding RNA, AC025034.1, which is not the only antisense to ATP2B1 (cell proliferation regulator), but also revealed a statistically significant stage-descending pattern; Moreover, AC025034.1 revealed both a dynamic topological pattern across stages and prognostic trait. We also identified a high-performance Overall-Survival-Risk model, including 12 re-wired genes to predict patients’ risk (c-index = 0.89). Finally, breast cancer-specific prognostic biomarkers of LINC01612, AC092142.1, and AC008969.1 were identified. Conclusions In summary new scoring method highlighted stage-specific core pathways for early-to-late progressions. Moreover, detecting the significant re-wired hub nodes indicated stage-associated traits, which reflects the importance of such regulators from different perspectives.

Tutorial on Support Vector Machines

The aim of this tutorial is to help students grasp the theory and applicability of support vector machines (SVMs). The contribution is an intuitive style tutorial that helped students gain insights into SVM from a unique perspective. An internet search will reveal many videos and articles on SVM, but free peer-reviewed tutorials are generally not available or are incomplete. Instructional materials that provide simplified explanations of SVM leave gaps in the derivations that beginning students cannot fill. Most of the free tutorials also lack guidance on practical applications and considerations. The software wrappers in many modern programming libraries of Python and R currently hide the operational complexities. Such software tools often use default parameters that ignore domain knowledge or leave knowledge gaps about the important effects of SVM hyperparameters, resulting in misuse and subpar outcomes. The author uses this tutorial as a course reference for students studying artificial intelligence and machine learning. The tutorial derives the classic SVM classifier from first principles and then derives the practical form that a computer uses to train a classification model. An intuitive explanation about confusion matrices, F1 score, and the AUC metric extend insights into the inherent tradeoff between sensitivity and specificity. A discussion about cross-validation provides a basic understanding of how to select and tune the hyperparameters to maximize generalization by balancing underfitting and overfitting. Even seasoned self-learners with advanced statistical backgrounds have gained insights from this tutorial style of intuitive explanations, with all related considerations for tuning and performance evaluations in one place.

Gender Identification and Classification of Drosophila melanogaster Flies Using Machine Learning Techniques

Drosophila melanogaster is an important genetic model organism used extensively in medical and biological studies. About 61% of known human genes have a recognizable match with the genetic code of Drosophila flies, and 50% of fly protein sequences have mammalian analogues. Recently, several investigations have been conducted in Drosophila to study the functions of specific genes exist in the central nervous system, heart, liver, and kidney. The outcomes of the research in Drosophila are also used as a unique tool to study human-related diseases. This article presents a novel automated system to classify the gender of Drosophila flies obtained through microscopic images (ventral view). The proposed system takes an image as input and converts it into grayscale illustration to extract the texture features from the image. Then, machine learning (ML) classifiers such as support vector machines (SVM), Naive Bayes (NB), and K -nearest neighbour (KNN) are used to classify the Drosophila as male or female. The proposed model is evaluated using the real microscopic image dataset, and the results show that the accuracy of the KNN is 90%, which is higher than the accuracy of the SVM classifier.

Discriminative Analysis of Schizophrenia Patients Using Topological Properties of Structural and Functional Brain Networks: A Multimodal Magnetic Resonance Imaging Study

Interest in the application of machine learning (ML) techniques to multimodal magnetic resonance imaging (MRI) data for the diagnosis of schizophrenia (SZ) at the individual level is growing. However, a few studies have applied the features of structural and functional brain networks derived from multimodal MRI data to the discriminative analysis of SZ patients at different clinical stages. In this study, 205 normal controls (NCs), 61 first-episode drug-naive SZ (FESZ) patients, and 79 chronic SZ (CSZ) patients were recruited. We acquired their structural MRI, diffusion tensor imaging, and resting-state functional MRI data and constructed brain networks for each participant, including the gray matter network (GMN), white matter network (WMN), and functional brain network (FBN). We then calculated 3 nodal properties for each brain network, including degree centrality, nodal efficiency, and betweenness centrality. Two classifications (SZ vs. NC and FESZ vs. CSZ) were performed using five ML algorithms. We found that the SVM classifier with the input features of the combination of nodal properties of both the GMN and FBN achieved the best performance to discriminate SZ patients from NCs [accuracy, 81.2%; area under the receiver operating characteristic curve (AUC), 85.2%; p < 0.05]. Moreover, the SVM classifier with the input features of the combination of the nodal properties of both the GMN and WMN achieved the best performance to discriminate FESZ from CSZ patients (accuracy, 86.2%; AUC, 92.3%; p < 0.05). Furthermore, the brain areas in the subcortical/cerebellum network and the frontoparietal network showed significant importance in both classifications. Together, our findings provide new insights to understand the neuropathology of SZ and further highlight the potential advantages of multimodal network properties for identifying SZ patients at different clinical stages.

Landscape Perception Identification and Classification Based on Electroencephalogram (EEG) Features

This paper puts forward a new method of landscape recognition and evaluation by using aerial video and EEG technology. In this study, seven typical landscape types (forest, wetland, grassland, desert, water, farmland, and city) were selected. Different electroencephalogram (EEG) signals were generated through different inner experiences and feelings felt by people watching video stimuli of the different landscape types. The electroencephalogram (EEG) features were extracted to obtain the mean amplitude spectrum (MAS), power spectrum density (PSD), differential entropy (DE), differential asymmetry (DASM), rational asymmetry (RASM), and differential caudality (DCAU) in the five frequency bands of delta, theta, alpha, beta, and gamma. According to electroencephalogram (EEG) features, four classifiers including the back propagation (BP) neural network, k-nearest neighbor classification (KNN), random forest (RF), and support vector machine (SVM) were used to classify the landscape types. The results showed that the support vector machine (SVM) classifier and the random forest (RF) classifier had the highest accuracy of landscape recognition, which reached 98.24% and 96.72%, respectively. Among the six classification features selected, the classification accuracy of MAS, PSD, and DE with frequency domain features were higher than those of the spatial domain features of DASM, RASM and DCAU. In different wave bands, the average classification accuracy of all subjects was 98.24% in the gamma band, 94.62% in the beta band, and 97.29% in the total band. This study identifies and classifies landscape perception based on multi-channel EEG signals, which provides a new idea and method for the quantification of human perception.

Training a Machine Learning Classifier to Identify ADHD Based on Real-World Clinical Data From Medical Records

The diagnostic process of attention deficit hyperactivity disorder (ADHD) is complex and relies on criteria sensitive to subjective biases. This may cause significant delays in appropriate treatment initiation. An automated analysis relying on subjective and objective measures might not only simplify the diagnostic process and reduce the time to diagnosis, but also improve reproducibility. While recent machine learning studies have succeeded at distinguishing ADHD from healthy controls, the clinical process requires differentiating among other or multiple psychiatric conditions. We trained a linear support vector machine (SVM) classifier to detect participants with ADHD in a population showing a broad spectrum of psychiatric conditions using anonymized data from clinical records (N = 299 participants). We differentiated children and adolescents with ADHD from those not having the condition with an accuracy of 66.1 %. SVM using single features showed slight differences between single features and overlapping standard deviations of the achieved accuracies. An automated feature selection achieved the best performance using a combination 19 features. Real-life clinical data from medical records can be used to automatically identify individuals with ADHD among help-seeking individuals using machine learning. The relevant diagnostic information can be reduced using an automated feature selection without loss of performance. A broad combination of symptoms across different domains, rather than specific domains, seems to indicate an ADHD diagnosis.

Classification of Crop Residue Cover in High-Resolution RGB Images Using Machine Learning

HighlightsA machine learning framework estimated residue cover in RGB images taken at three resolutions from 88 locations.The best results primarily used texture features, the RFE-SVM feature selection method, and the SVM classifier.Accounting for shadows and plants plus modifying and optimizing the texture features may improve performance.An automated system developed using machine learning is a viable strategy to estimate residue cover from RGB images obtained with handheld or UAV platforms.Abstract. Maintaining plant residue on the soil surface contributes to sustainable cultivation of arable land. Applying machine learning methods to RGB images of residue could overcome the subjectivity of manual methods. The objectives of this study were to use supervised machine learning while identifying the best feature selection method, the best classifier, and the most effective image feature types for classifying residue levels in RGB imagery. Imagery was collected from 88 locations in 40 row-crop fields in five Missouri counties between early May and late June in 2018 and 2019 using a tripod-mounted camera (0.014 cm pixel-1 ground sampling distance, GSD) and an unmanned aerial vehicle (UAV, 0.05 and 0.14 GSD). At each field location, 50 contiguous 0.3 × 0.2 m region of interest (ROI) images were extracted from the imagery, resulting in a dataset of 4,400 ROI images at each GSD. Residue percentages for ground truth were estimated using a bullseye grid method (n = 100 points) based on the 0.014 GSD images. Representative color, texture, and shape features were extracted and evaluated using four feature selection methods and two classifiers. Recursive feature elimination using support vector machine (RFE-SVM) was the best feature selection method, and the SVM classifier performed best for classifying the amount of residue as a three-class problem. The best features for this application were associated with texture, with local binary pattern (LBP) features being the most prevalent for all three GSDs. Shape features were irrelevant. The three residue classes were correctly identified with 88%, 84%, and 81% 10-fold cross-validation scores for the 2018 training data and 81%, 69%, and 65% accuracy for the 2019 testing data in decreasing resolution order. Converting image-wise data (0.014 GSD) to location residue estimates using a Bayesian model showed good agreement with the location-based ground truth (r2 = 0.90). This initial assessment documents the use of RGB images to match other methods of estimating residue, with potential to replace or be used as a quality control for line-transect assessments. Keywords: Feature selection, Soil erosion, Support vector machine, Texture features, Unmanned aerial vehicle.

Multiple graph fusion based on Riemannian geometry for motor imagery classification

In motor imagery-based brain-computer interfaces (BCIs), the spatial covariance features of electroencephalography (EEG) signals that lie on Riemannian manifolds are used to enhance the classification performance of motor imagery BCIs. However, the problem of subject-specific bandpass frequency selection frequently arises in Riemannian manifold-based methods. In this study, we propose a multiple Riemannian graph fusion (MRGF) model to optimize the subject-specific frequency band for a Riemannian manifold. After constructing multiple Riemannian graphs corresponding to multiple bandpass frequency bands, graph embedding based on bilinear mapping and graph fusion based on mutual information were applied to simultaneously extract the spatial and spectral features of the EEG signals from Riemannian graphs. Furthermore, with a support vector machine (SVM) classifier performed on learned features, we obtained an efficient algorithm, which achieves higher classification performance on various datasets, such as BCI competition IIa and in-house BCI datasets. The proposed methods can also be used in other classification problems with sample data in the form of covariance matrices.