scholarly journals EnCNN-UPMWS: Waste Classification by a CNN Ensemble Using the UPM Weighting Strategy

Electronics ◽  
2021 ◽  
Vol 10 (4) ◽  
pp. 427
Author(s):  
Hua Zheng ◽  
Yu Gu
Keyword(s):  
Ensemble Learning ◽  
State Of The Art ◽  
Learning Model ◽  
Predicted Probability ◽  
Proposed Model ◽  
Potential Applications ◽  
Weighting Strategy ◽  
Validation Set ◽  
Weight Coefficients

The accurate and effective classification of household solid waste (HSW) is an indispensable component in the current procedure of waste disposal. In this paper, a novel ensemble learning model called EnCNN-UPMWS, which is based on convolutional neural networks (CNNs) and an unequal precision measurement weighting strategy (UPMWS), is proposed for the classification of HSW via waste images. First, three state-of-the-art CNNs, namely GoogLeNet, ResNet-50, and MobileNetV2, are used as ingredient classifiers to separately predict and obtain three predicted probability vectors, which are significant elements that affect the prediction performance by providing complementary information about the patterns to be classified. Then, the UPMWS is introduced to determine the weight coefficients of the ensemble models. The actual one-hot encoding labels of the validation set and the predicted probability vectors from the CNN ensemble are creatively used to calculate the weights for each classifier during the training phase, which can bring the aggregated prediction vector closer to the target label and improve the performance of the ensemble model. The proposed model was applied to two datasets, namely TrashNet (an open-access dataset) and FourTrash, which was constructed by collecting a total of 47,332 common HSW images containing four types of waste (wet waste, recyclables, harmful waste, and dry waste). The experimental results demonstrate the effectiveness of the proposed method in terms of its accuracy and F1-scores. Moreover, it was found that the UPMWS can simply and effectively enhance the performance of the ensemble learning model, and has potential applications in similar tasks of classification via ensemble learning.

scholarly journals ECG Heartbeat Classification Based on an Improved ResNet-18 Model

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Enbiao Jing ◽  
Haiyang Zhang ◽  
ZhiGang Li ◽  
Yazhi Liu ◽  
Zhanlin Ji ◽  
...  
Keyword(s):  
State Of The Art ◽  
Classification Performance ◽  
Classification Models ◽  
Heartbeat Classification ◽  
Ecg Signals ◽  
Residual Structure ◽  
Proposed Model ◽  
Model Training ◽  
Electrocardiogram Ecg

Based on a convolutional neural network (CNN) approach, this article proposes an improved ResNet-18 model for heartbeat classification of electrocardiogram (ECG) signals through appropriate model training and parameter adjustment. Due to the unique residual structure of the model, the utilized CNN layered structure can be deepened in order to achieve better classification performance. The results of applying the proposed model to the MIT-BIH arrhythmia database demonstrate that the model achieves higher accuracy (96.50%) compared to other state-of-the-art classification models, while specifically for the ventricular ectopic heartbeat class, its sensitivity is 93.83% and the precision is 97.44%.

scholarly journals Image-Based Malware Classification Using VGG19 Network and Spatial Convolutional Attention

Electronics ◽  
2021 ◽  
Vol 10 (19) ◽  
pp. 2444
Author(s):  
Mazhar Javed Awan ◽  
Osama Ahmed Masood ◽  
Mazin Abed Mohammed ◽  
Awais Yasin ◽  
Azlan Mohd Zain ◽  
...  
Keyword(s):  
High Performance ◽  
State Of The Art ◽  
Malware Detection ◽  
Detection Methods ◽  
Learning Framework ◽  
Malware Classification ◽  
Proposed Model ◽  
Communication Devices ◽  
Digital Assets

In recent years the amount of malware spreading through the internet and infecting computers and other communication devices has tremendously increased. To date, countless techniques and methodologies have been proposed to detect and neutralize these malicious agents. However, as new and automated malware generation techniques emerge, a lot of malware continues to be produced, which can bypass some state-of-the-art malware detection methods. Therefore, there is a need for the classification and detection of these adversarial agents that can compromise the security of people, organizations, and countless other forms of digital assets. In this paper, we propose a spatial attention and convolutional neural network (SACNN) based on deep learning framework for image-based classification of 25 well-known malware families with and without class balancing. Performance was evaluated on the Malimg benchmark dataset using precision, recall, specificity, precision, and F1 score on which our proposed model with class balancing reached 97.42%, 97.95%, 97.33%, 97.11%, and 97.32%. We also conducted experiments on SACNN with class balancing on benign class, also produced above 97%. The results indicate that our proposed model can be used for image-based malware detection with high performance, despite being simpler as compared to other available solutions.

scholarly journals A Novel Architecture to Classify Histopathology Images Using Convolutional Neural Networks

2020 ◽  
Vol 10 (8) ◽  
pp. 2929 ◽  
Author(s):  
Ibrahem Kandel ◽  
Mauro Castelli
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
State Of The Art ◽  
Treatment Plan ◽  
Tissue Structure ◽  
Activation Functions ◽  
Proposed Model ◽  
Histopathology Images ◽  
Fully Connected

Histopathology is the study of tissue structure under the microscope to determine if the cells are normal or abnormal. Histopathology is a very important exam that is used to determine the patients’ treatment plan. The classification of histopathology images is very difficult to even an experienced pathologist, and a second opinion is often needed. Convolutional neural network (CNN), a particular type of deep learning architecture, obtained outstanding results in computer vision tasks like image classification. In this paper, we propose a novel CNN architecture to classify histopathology images. The proposed model consists of 15 convolution layers and two fully connected layers. A comparison between different activation functions was performed to detect the most efficient one, taking into account two different optimizers. To train and evaluate the proposed model, the publicly available PatchCamelyon dataset was used. The dataset consists of 220,000 annotated images for training and 57,000 unannotated images for testing. The proposed model achieved higher performance compared to the state-of-the-art architectures with an AUC of 95.46%.

scholarly journals Histopathological Classification of Breast Cancer Images Using a Multi-Scale Input and Multi-Feature Network

Cancers ◽  
2020 ◽  
Vol 12 (8) ◽  
pp. 2031 ◽  
Author(s):  
Taimoor Shakeel Sheikh ◽  
Yonghee Lee ◽  
Migyung Cho
Keyword(s):  
State Of The Art ◽  
Texture Features ◽  
Feature Maps ◽  
Histopathological Classification ◽  
Multi Scale ◽  
Machine Learning Methods ◽  
Proposed Model ◽  
Benchmark Datasets ◽  
Histopathological Images

Diagnosis of pathologies using histopathological images can be time-consuming when many images with different magnification levels need to be analyzed. State-of-the-art computer vision and machine learning methods can help automate the diagnostic pathology workflow and thus reduce the analysis time. Automated systems can also be more efficient and accurate, and can increase the objectivity of diagnosis by reducing operator variability. We propose a multi-scale input and multi-feature network (MSI-MFNet) model, which can learn the overall structures and texture features of different scale tissues by fusing multi-resolution hierarchical feature maps from the network’s dense connectivity structure. The MSI-MFNet predicts the probability of a disease on the patch and image levels. We evaluated the performance of our proposed model on two public benchmark datasets. Furthermore, through ablation studies of the model, we found that multi-scale input and multi-feature maps play an important role in improving the performance of the model. Our proposed model outperformed the existing state-of-the-art models by demonstrating better accuracy, sensitivity, and specificity.

Classification of P2P Traffic Based on a Heteromorphic Ensemble Learning Model

2014 ◽  
Vol 687-691 ◽  
pp. 2693-2697
Author(s):  
Li Ding ◽  
Li Mao ◽  
Xiao Feng Wang
Keyword(s):  
Machine Learning ◽  
Support Vector Machine ◽  
Ensemble Learning ◽  
Classification Accuracy ◽  
Learning Algorithm ◽  
Learning Model ◽  
Support Vector ◽  
Machine Learning Algorithm ◽  
Data Environment

One single machine learning algorithm presents shortcomings when the data environment changes in the process of application. This article puts forward a heteromorphic ensemble learning model made up of bayes, support vector machine (SVM) and decision tree which classifies P2P traffic by voting principle. The experiment shows that the model can significantly improve the classification accuracy, and has a good stability.

scholarly journals A Deep Learning Model for Classification of Endoscopic Gastroesophageal Reflux Disease

2021 ◽  
Vol 18 (5) ◽  
pp. 2428
Author(s):  
Chi-Chih Wang ◽  
Yu-Ching Chiu ◽  
Wei-Liang Chen ◽  
Tzu-Wei Yang ◽  
Ming-Chang Tsai ◽  
...  
Keyword(s):  
Deep Learning ◽  
Gastroesophageal Reflux Disease ◽  
Gastroesophageal Reflux ◽  
Reflux Disease ◽  
Automatic Classification ◽  
Learning Model ◽  
Test Set ◽  
Proposed Model ◽  
Deep Learning Model

Gastroesophageal reflux disease (GERD) is a common disease with high prevalence, and its endoscopic severity can be evaluated using the Los Angeles classification (LA grade). This paper proposes a deep learning model (i.e., GERD-VGGNet) that employs convolutional neural networks for automatic classification and interpretation of routine GERD LA grade. The proposed model employs a data augmentation technique, a two-stage no-freezing fine-tuning policy, and an early stopping criterion. As a result, the proposed model exhibits high generalizability. A dataset of images from 464 patients was used for model training and validation. An additional 32 patients served as a test set to evaluate the accuracy of both the model and our trainees. Experimental results demonstrate that the best model for the development set exhibited an overall accuracy of 99.2% (grade A–B), 100% (grade C–D), and 100% (normal group) using narrow-band image (NBI) endoscopy. On the test set, the proposed model resulted in an accuracy of 87.9%, which was significantly higher than the results of the trainees (75.0% and 65.6%). The proposed GERD-VGGNet model can assist automatic classification of GERD in conventional and NBI environments and thereby increase the accuracy of interpretation of the results by inexperienced endoscopists.

scholarly journals TReC: Transferred ResNet and CBAM for Detecting Brain Diseases

2021 ◽  
Vol 15 ◽  
Author(s):  
Yuteng Xiao ◽  
Hongsheng Yin ◽  
Shui-Hua Wang ◽  
Yu-Dong Zhang
Keyword(s):  
State Of The Art ◽  
Specific Model ◽  
Brain Diseases ◽  
Small Scale ◽  
Brain Images ◽  
New Approach ◽  
Proposed Model ◽  
Residual Block ◽  
Fully Connected

Early diagnosis of pathological brains leads to early interventions in brain diseases, which may help control the illness conditions, prolong the life of patients, and even cure them. Therefore, the classification of brain diseases is a challenging but helpful task. However, it is hard to collect brain images, and the superabundance of images is also a great challenge for computing resources. This study proposes a new approach named TReC: Transferred Residual Networks (ResNet)-Convolutional Block Attention Module (CBAM), a specific model for small-scale samples, to detect brain diseases based on MRI. At first, the ResNet model, which is pre-trained on the ImageNet dataset, serves as initialization. Subsequently, a simple attention mechanism named CBAM is introduced and added into every ResNet residual block. At the same time, the fully connected (FC) layers of the ResNet are replaced with new FC layers, which meet the goal of classification. Finally, all the parameters of our model, such as the ResNet, the CBAM, and new FC layers, are retrained. The effectiveness of the proposed model is evaluated on brain magnetic resonance (MR) datasets for multi-class and two-class tasks. Compared with other state-of-the-art models, our model reaches the best performance for two-class and multi-class tasks on brain diseases.

scholarly journals Joint Detection and Classification of Singing Voice Melody Using Convolutional Recurrent Neural Networks

2019 ◽  
Vol 9 (7) ◽  
pp. 1324 ◽  
Author(s):  
Sangeun Kum ◽  
Juhan Nam
Keyword(s):  
Loss Function ◽  
State Of The Art ◽  
Joint Detection ◽  
Singing Voice ◽  
Pitch Estimation ◽  
Proposed Model ◽  
Pitch Contours ◽  
Multi Level ◽  
Extraction Performance

Singing melody extraction essentially involves two tasks: one is detecting the activity of a singing voice in polyphonic music, and the other is estimating the pitch of a singing voice in the detected voiced segments. In this paper, we present a joint detection and classification (JDC) network that conducts the singing voice detection and the pitch estimation simultaneously. The JDC network is composed of the main network that predicts the pitch contours of the singing melody and an auxiliary network that facilitates the detection of the singing voice. The main network is built with a convolutional recurrent neural network with residual connections and predicts pitch labels that cover the vocal range with a high resolution, as well as non-voice status. The auxiliary network is trained to detect the singing voice using multi-level features shared from the main network. The two optimization processes are tied with a joint melody loss function. We evaluate the proposed model on multiple melody extraction and vocal detection datasets, including cross-dataset evaluation. The experiments demonstrate how the auxiliary network and the joint melody loss function improve the melody extraction performance. Furthermore, the results show that our method outperforms state-of-the-art algorithms on the datasets.

scholarly journals Improved Arabic Alphabet Characters Classification Using Convolutional Neural Networks (CNN)

2022 ◽  
Vol 2022 ◽  
pp. 1-16
Author(s):  
Nesrine Wagaa ◽  
Hichem Kallel ◽  
Nédra Mellouli
Keyword(s):  
Neural Network ◽  
Data Augmentation ◽  
State Of The Art ◽  
Optimization Algorithms ◽  
Convolution Neural Network ◽  
Proposed Model ◽  
Augmentation Techniques ◽  
High Recognition Accuracy ◽  
Suitable Change

Handwritten characters recognition is a challenging research topic. A lot of works have been present to recognize letters of different languages. The availability of Arabic handwritten characters databases is limited. Motivated by this topic of research, we propose a convolution neural network for the classification of Arabic handwritten letters. Also, seven optimization algorithms are performed, and the best algorithm is reported. Faced with few available Arabic handwritten datasets, various data augmentation techniques are implemented to improve the robustness needed for the convolution neural network model. The proposed model is improved by using the dropout regularization method to avoid data overfitting problems. Moreover, suitable change is presented in the choice of optimization algorithms and data augmentation approaches to achieve a good performance. The model has been trained on two Arabic handwritten characters datasets AHCD and Hijja. The proposed algorithm achieved high recognition accuracy of 98.48% and 91.24% on AHCD and Hijja, respectively, outperforming other state-of-the-art models.

LF-LDA

2018 ◽  
Vol 14 (2) ◽  
pp. 18-36 ◽  
Author(s):  
Yongjun Zhang ◽  
Zijian Wang ◽  
Yongtao Yu ◽  
Bolun Chen ◽  
Jialin Ma ◽  
...  
Keyword(s):  
Big Data ◽  
Topic Model ◽  
State Of The Art ◽  
Text Documents ◽  
Data Set ◽  
Proposed Model ◽  
Textual Data ◽  
Noisy Function ◽  
Major Data

This article describes how text documents are a major data structure in the era of big data. With the explosive growth of data, the number of documents with multi-labels has increased dramatically. The popular multi-label classification technology, which is usually employed to handle multinomial text documents, is sensitive to the noise terms of text documents. Therefore, there still exists a huge room for multi-label classification of text documents. This article introduces a supervised topic model, named labeled LDA with function terms (LF-LDA), to filter out the noisy function terms from text documents, which can help to improve the performance of multi-label classification of text documents. The article also shows the derivation of the Gibbs Sampling formulas in detail, which can be generalized to other similar topic models. Based on the textual data set RCV1-v2, the article compared the proposed model with other two state-of-the-art multi-label classifiers, Tuned SVM and labeled LDA, on both Macro-F1 and Micro-F1 metrics. The result shows that LF-LDA outperforms them and has the lowest variance, which indicates the robustness of the LF-LDA classifier.

Sign in / Sign up

Export Citation Format

Share Document