scholarly journals Feasibility of Using Wearable EMG Armbands combined with Unsupervised Transfer Learning for Seamless Myoelectric Control

2022 ◽  
Author(s):  
M. Hongchul Sohn ◽  
Sonia Yuxiao Lai ◽  
Matthew L. Elwin ◽  
Julius P. A. Dewald
Keyword(s):  
Neural Network ◽  
Transfer Learning ◽  
Operation Mode ◽  
Classification Performance ◽  
Myoelectric Control ◽  
Rehabilitation Robotics ◽  
Case Scenario ◽  
User Intent ◽  
Source Data ◽  
Intuitive Interfaces

Myoelectric control uses electromyography (EMG) signals as human-originated input to enable intuitive interfaces with machines. As such, recent rehabilitation robotics employs myoelectric control to autonomously classify user intent or operation mode using machine learning. However, performance in such applications inherently suffers from the non-stationarity of EMG signals across measurement conditions. Current laboratory-based solutions rely on careful, time-consuming control of the recordings or periodic recalibration, impeding real-world deployment. We propose that robust yet seamless myoelectric control can be achieved using a low-end, easy-to-don and doff wearable EMG sensor combined with unsupervised transfer learning. Here, we test the feasibility of one such application using a consumer-grade sensor (Myo armband, 8 EMG channels @ 200 Hz) for gesture classification across measurement conditions using an existing dataset: 5 users x 10 days x 3 sensor locations. Specifically, we first train a deep neural network using Temporal-Spatial Descriptors (TSD) with labeled source data from any particular user, day, or location. We then apply the Self-Calibrating Asynchronous Domain Adversarial Neural Network (SCADANN), which automatically adjusts the trained TSD to improve classification performance for unlabeled target data from a different user, day, or sensor location. Compared to the original TSD, SCADANN improves accuracy by 12±5.2% (avg±sd), 9.6±5.0%, and 8.6±3.3% across all possible user-to-user, day-to-day, and location-to-location cases, respectively. In one best-case scenario, accuracy improves by 26% (from 67% to 93%), whereas sometimes the gain is modest (e.g., from 76% to 78%). We also show that the performance of transfer learning can be improved by using a better model trained with good (e.g., incremental) source data. We postulate that the proposed approach is feasible and promising and can be further tailored for seamless myoelectric control of powered prosthetics or exoskeletons.

Automated detection of pneumonia cases using deep transfer learning with paediatric chest X-ray images

2021 ◽  
pp. 20201263
Author(s):  
Mohammad Salehi ◽  
Reza Mohammadi ◽  
Hamed Ghaffari ◽  
Nahid Sadighi ◽  
Reza Reiazi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Area Under Curve ◽  
Binary Classification ◽  
Classification Performance ◽  
Learning Approach ◽  
Insufficient Data ◽  
X Ray ◽  
Chest X Ray

Objective: Pneumonia is a lung infection and causes the inflammation of the small air sacs (Alveoli) in one or both lungs. Proper and faster diagnosis of pneumonia at an early stage is imperative for optimal patient care. Currently, chest X-ray is considered as the best imaging modality for diagnosing pneumonia. However, the interpretation of chest X-ray images is challenging. To this end, we aimed to use an automated convolutional neural network-based transfer-learning approach to detect pneumonia in paediatric chest radiographs. Methods: Herein, an automated convolutional neural network-based transfer-learning approach using four different pre-trained models (i.e. VGG19, DenseNet121, Xception, and ResNet50) was applied to detect pneumonia in children (1–5 years) chest X-ray images. The performance of different proposed models for testing data set was evaluated using five performances metrics, including accuracy, sensitivity/recall, Precision, area under curve, and F1 score. Results: All proposed models provide accuracy greater than 83.0% for binary classification. The pre-trained DenseNet121 model provides the highest classification performance of automated pneumonia classification with 86.8% accuracy, followed by Xception model with an accuracy of 86.0%. The sensitivity of the proposed models was greater than 91.0%. The Xception and DenseNet121 models achieve the highest classification performance with F1-score greater than 89.0%. The plotted area under curve of receiver operating characteristics of VGG19, Xception, ResNet50, and DenseNet121 models are 0.78, 0.81, 0.81, and 0.86, respectively. Conclusion: Our data showed that the proposed models achieve a high accuracy for binary classification. Transfer learning was used to accelerate training of the proposed models and resolve the problem associated with insufficient data. We hope that these proposed models can help radiologists for a quick diagnosis of pneumonia at radiology departments. Moreover, our proposed models may be useful to detect other chest-related diseases such as novel Coronavirus 2019. Advances in knowledge: Herein, we used transfer learning as a machine learning approach to accelerate training of the proposed models and resolve the problem associated with insufficient data. Our proposed models achieved accuracy greater than 83.0% for binary classification.

scholarly journals Chili Plant Classification using Transfer Learning models through Object Detection

Mekatronika ◽  
2020 ◽  
Vol 2 (2) ◽  
pp. 23-27
Author(s):  
Amirul Asyraf Abdul Manan ◽  
Mohd Azraai Mohd Razman ◽  
Ismail Mohd Khairuddin ◽  
Muhammad Nur Aiman Shapiee
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Transfer Learning ◽  
Classification Performance ◽  
Experimental Result ◽  
Learning Models ◽  
Robotic Vision ◽  
Efficient Detection ◽  
Plant Image ◽  
Series Of Experiments

This study presents an application of using a Convolutional Neural Network (CNN) based detector to detect chili and its leaves in the chili plant image. Detecting chili on its plant is essential for the development of robotic vision and monitoring. Thus, helps us supervise the plant growth, furthermore, analyses their productivity and quality. This paper aims to develop a system that can monitor and identify bird’s eye chili plants by implementing machine learning. First, the development of methodology for efficient detection of bird’s eye chili and its leaf was made. A dataset of a total of 1866 images after augmentation of bird’s eye chili and its leaf was used in this experiment. YOLO Darknet was implemented to train the dataset. After a series of experiments were conducted, the model is compared with other transfer learning models like YOLO Tiny, Faster R-CNN, and EfficientDet. The classification performance of these transfer learning models has been calculated and compared with each other. The experimental result shows that the Yolov4 Darknet model achieves mAP of 75.69%, followed by EfficientDet at 71.85% for augmented dataset.

scholarly journals Multi-Source Deep Transfer Neural Network Algorithm

Sensors ◽  
2019 ◽  
Vol 19 (18) ◽  
pp. 3992 ◽  
Author(s):  
Jingmei Li ◽  
Weifei Wu ◽  
Di Xue ◽  
Peng Gao
Keyword(s):  
Neural Network ◽  
Probability Distribution ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Classification Performance ◽  
Classification Error ◽  
Target Domain ◽  
Source Domain ◽  
Network Algorithm ◽  
Neural Network Algorithm

Transfer learning can enhance classification performance of a target domain with insufficient training data by utilizing knowledge relating to the target domain from source domain. Nowadays, it is common to see two or more source domains available for knowledge transfer, which can improve performance of learning tasks in the target domain. However, the classification performance of the target domain decreases due to mismatching of probability distribution. Recent studies have shown that deep learning can build deep structures by extracting more effective features to resist the mismatching. In this paper, we propose a new multi-source deep transfer neural network algorithm, MultiDTNN, based on convolutional neural network and multi-source transfer learning. In MultiDTNN, joint probability distribution adaptation (JPDA) is used for reducing the mismatching between source and target domains to enhance features transferability of the source domain in deep neural networks. Then, the convolutional neural network is trained by utilizing the datasets of each source and target domain to obtain a set of classifiers. Finally, the designed selection strategy selects classifier with the smallest classification error on the target domain from the set to assemble the MultiDTNN framework. The effectiveness of the proposed MultiDTNN is verified by comparing it with other state-of-the-art deep transfer learning on three datasets.

scholarly journals Hyperspectral Image Classification Based on a Shuffled Group Convolutional Neural Network with Transfer Learning

2020 ◽  
Vol 12 (11) ◽  
pp. 1780 ◽  
Author(s):  
Yao Liu ◽  
Lianru Gao ◽  
Chenchao Xiao ◽  
Ying Qu ◽  
Ke Zheng ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Classification Performance ◽  
Training Dataset ◽  
Hyperspectral Image Classification ◽  
Different Levels

Convolutional neural networks (CNNs) have been widely applied in hyperspectral imagery (HSI) classification. However, their classification performance might be limited by the scarcity of labeled data to be used for training and validation. In this paper, we propose a novel lightweight shuffled group convolutional neural network (abbreviated as SG-CNN) to achieve efficient training with a limited training dataset in HSI classification. SG-CNN consists of SG conv units that employ conventional and atrous convolution in different groups, followed by channel shuffle operation and shortcut connection. In this way, SG-CNNs have less trainable parameters, whilst they can still be accurately and efficiently trained with fewer labeled samples. Transfer learning between different HSI datasets is also applied on the SG-CNN to further improve the classification accuracy. To evaluate the effectiveness of SG-CNNs for HSI classification, experiments have been conducted on three public HSI datasets pretrained on HSIs from different sensors. SG-CNNs with different levels of complexity were tested, and their classification results were compared with fine-tuned ShuffleNet2, ResNeXt, and their original counterparts. The experimental results demonstrate that SG-CNNs can achieve competitive classification performance when the amount of labeled data for training is poor, as well as efficiently providing satisfying classification results.

scholarly journals Self-Supervised Transfer Learning from Natural Images for Sound Classification

2021 ◽  
Vol 11 (7) ◽  
pp. 3043
Author(s):  
Sungho Shin ◽  
Jongwon Kim ◽  
Yeonguk Yu ◽  
Seongju Lee ◽  
Kyoobin Lee
Keyword(s):  
Neural Network ◽  
Supervised Learning ◽  
Transfer Learning ◽  
Classification Performance ◽  
The Self ◽  
Natural Images ◽  
General Representation ◽  
Sound Classification ◽  
Training Scheme ◽  
Learning Schemes

We propose the implementation of transfer learning from natural images to audio-based images using self-supervised learning schemes. Through self-supervised learning, convolutional neural networks (CNNs) can learn the general representation of natural images without labels. In this study, a convolutional neural network was pre-trained with natural images (ImageNet) via self-supervised learning; subsequently, it was fine-tuned on the target audio samples. Pre-training with the self-supervised learning scheme significantly improved the sound classification performance when validated on the following benchmarks: ESC-50, UrbanSound8k, and GTZAN. The network pre-trained via self-supervised learning achieved a similar level of accuracy as those pre-trained using a supervised method that require labels. Therefore, we demonstrated that transfer learning from natural images contributes to improvements in audio-related tasks, and self-supervised learning with natural images is adequate for pre-training scheme in terms of simplicity and effectiveness.

scholarly journals A Deep Neural Network approach for P300 detection-based BCI using single-channel EEG scalogram images

2021 ◽  
Author(s):  
Sinam Ajitkumar Singh ◽  
Takhellambam Gautam Meitei ◽  
Ningthoujam Dinita Devi ◽  
Swanirbhar Majumder
Keyword(s):  
Neural Network ◽  
Transfer Learning ◽  
Information Transfer ◽  
Deep Neural Network ◽  
Single Channel ◽  
Classification Performance ◽  
Learning Approach ◽  
Neural Network Approach ◽  
Deep Network ◽  
Comparable Performance

Abstract Brain-computer interfaces ( BCIs ) acquire electroencephalogram (EEG) signals and interpret them into a command that helps people with severe motor disabilities using single channel. The goal of BCI is to achieve a prototype that supports disabled people to develop the relevant function. Various studies have been implemented in the literature to achieve a superior design. The main novelty of the proposed P300 detection-based BCI model is associated with the usage of a single-channel. In this work, we introduced a denoising approach using the bandpass filter technique followed by the transformation of scalogram images using continuous wavelet transform. The derived images were trained and validated using a deep neural network based on the transfer learning approach. This paper presents a BCI model based on the deep network that delivers higher performance in terms of classification accuracy and bitrate for disabled subjects using a single-channel EEG signal. The proposed P300 based BCI model has the highest average information transfer rates of 13.23 to 26.48 bits/min for disabled subjects. The classification performance has shown that the deep network based on the transfer learning approach can offer comparable performance with other state-of-the-art-method. This article does not contain any studies with human participants performed by any of the authors. However, the data was collected by EPFL which is available open for the researchers to work upon.

Molecular Generation Targeting Desired Electronic Properties via Deep Generative Models

2019 ◽  
Author(s):  
Qi Yuan ◽  
Alejandro Santana-Bonilla ◽  
Martijn Zwijnenburg ◽  
Kim Jelfs
Keyword(s):  
Neural Network ◽  
Electronic Properties ◽  
Transfer Learning ◽  
Recurrent Neural Network ◽  
Chemical Space ◽  
Generative Models ◽  
Molecular Features ◽  
Donor Acceptor ◽  
Homo Lumo ◽  
Training Sets

<p>The chemical space for novel electronic donor-acceptor oligomers with targeted properties was explored using deep generative models and transfer learning. A General Recurrent Neural Network model was trained from the ChEMBL database to generate chemically valid SMILES strings. The parameters of the General Recurrent Neural Network were fine-tuned via transfer learning using the electronic donor-acceptor database from the Computational Material Repository to generate novel donor-acceptor oligomers. Six different transfer learning models were developed with different subsets of the donor-acceptor database as training sets. We concluded that electronic properties such as HOMO-LUMO gaps and dipole moments of the training sets can be learned using the SMILES representation with deep generative models, and that the chemical space of the training sets can be efficiently explored. This approach identified approximately 1700 new molecules that have promising electronic properties (HOMO-LUMO gap <2 eV and dipole moment <2 Debye), 6-times more than in the original database. Amongst the molecular transformations, the deep generative model has learned how to produce novel molecules by trading off between selected atomic substitutions (such as halogenation or methylation) and molecular features such as the spatial extension of the oligomer. The method can be extended as a plausible source of new chemical combinations to effectively explore the chemical space for targeted properties.</p>

scholarly journals Effectiveness of transfer learning for enhancing tumor classification with a convolutional neural network on frozen sections

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Young-Gon Kim ◽  
Sungchul Kim ◽  
Cristina Eunbee Cho ◽  
In Hye Song ◽  
Hee Jin Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Frozen Section ◽  
Medical Center ◽  
External Validation ◽  
Model Performance ◽  
Classification Model ◽  
Training Dataset

AbstractFast and accurate confirmation of metastasis on the frozen tissue section of intraoperative sentinel lymph node biopsy is an essential tool for critical surgical decisions. However, accurate diagnosis by pathologists is difficult within the time limitations. Training a robust and accurate deep learning model is also difficult owing to the limited number of frozen datasets with high quality labels. To overcome these issues, we validated the effectiveness of transfer learning from CAMELYON16 to improve performance of the convolutional neural network (CNN)-based classification model on our frozen dataset (N = 297) from Asan Medical Center (AMC). Among the 297 whole slide images (WSIs), 157 and 40 WSIs were used to train deep learning models with different dataset ratios at 2, 4, 8, 20, 40, and 100%. The remaining, i.e., 100 WSIs, were used to validate model performance in terms of patch- and slide-level classification. An additional 228 WSIs from Seoul National University Bundang Hospital (SNUBH) were used as an external validation. Three initial weights, i.e., scratch-based (random initialization), ImageNet-based, and CAMELYON16-based models were used to validate their effectiveness in external validation. In the patch-level classification results on the AMC dataset, CAMELYON16-based models trained with a small dataset (up to 40%, i.e., 62 WSIs) showed a significantly higher area under the curve (AUC) of 0.929 than those of the scratch- and ImageNet-based models at 0.897 and 0.919, respectively, while CAMELYON16-based and ImageNet-based models trained with 100% of the training dataset showed comparable AUCs at 0.944 and 0.943, respectively. For the external validation, CAMELYON16-based models showed higher AUCs than those of the scratch- and ImageNet-based models. Model performance for slide feasibility of the transfer learning to enhance model performance was validated in the case of frozen section datasets with limited numbers.

Sign in / Sign up

Export Citation Format

Share Document