scholarly journals BCNet: A Novel Network for Blood Cell Classification

2022 ◽  
Vol 9 ◽  
Author(s):  
Ziquan Zhu ◽  
Siyuan Lu ◽  
Shui-Hua Wang ◽  
Juan Manuel Górriz ◽  
Yu-Dong Zhang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Blood Cell ◽  
State Of The Art ◽  
Neural Model ◽  
Convolution Neural Network ◽  
Majority Voting ◽  
Cell Classification ◽  
Art Methods ◽  
Deep Convolution Neural Network

Aims: Most blood diseases, such as chronic anemia, leukemia (commonly known as blood cancer), and hematopoietic dysfunction, are caused by environmental pollution, substandard decoration materials, radiation exposure, and long-term use certain drugs. Thus, it is imperative to classify the blood cell images. Most cell classification is based on the manual feature, machine learning classifier or the deep convolution network neural model. However, manual feature extraction is a very tedious process, and the results are usually unsatisfactory. On the other hand, the deep convolution neural network is usually composed of massive layers, and each layer has many parameters. Therefore, each deep convolution neural network needs a lot of time to get the results. Another problem is that medical data sets are relatively small, which may lead to overfitting problems.Methods: To address these problems, we propose seven models for the automatic classification of blood cells: BCARENet, BCR5RENet, BCMV2RENet, BCRRNet, BCRENet, BCRSNet, and BCNet. The BCNet model is the best model among the seven proposed models. The backbone model in our method is selected as the ResNet-18, which is pre-trained on the ImageNet set. To improve the performance of the proposed model, we replace the last four layers of the trained transferred ResNet-18 model with the three randomized neural networks (RNNs), which are RVFL, ELM, and SNN. The final outputs of our BCNet are generated by the ensemble of the predictions from the three randomized neural networks by the majority voting. We use four multi-classification indexes for the evaluation of our model.Results: The accuracy, average precision, average F1-score, and average recall are 96.78, 97.07, 96.78, and 96.77%, respectively.Conclusion: We offer the comparison of our model with state-of-the-art methods. The results of the proposed BCNet model are much better than other state-of-the-art methods.

scholarly journals CapsTM: capsule network for Chinese medical text matching

2021 ◽  
Vol 21 (S2) ◽  
Author(s):  
Xiaoming Yu ◽  
Yedan Shen ◽  
Yuan Ni ◽  
Xiaowei Huang ◽  
Xiaolong Wang ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Network Architecture ◽  
State Of The Art ◽  
Interaction Matrix ◽  
Application Systems ◽  
Input Layer ◽  
Art Methods ◽  
Text Matching

Abstract Background Text Matching (TM) is a fundamental task of natural language processing widely used in many application systems such as information retrieval, automatic question answering, machine translation, dialogue system, reading comprehension, etc. In recent years, a large number of deep learning neural networks have been applied to TM, and have refreshed benchmarks of TM repeatedly. Among the deep learning neural networks, convolutional neural network (CNN) is one of the most popular networks, which suffers from difficulties in dealing with small samples and keeping relative structures of features. In this paper, we propose a novel deep learning architecture based on capsule network for TM, called CapsTM, where capsule network is a new type of neural network architecture proposed to address some of the short comings of CNN and shows great potential in many tasks. Methods CapsTM is a five-layer neural network, including an input layer, a representation layer, an aggregation layer, a capsule layer and a prediction layer. In CapsTM, two pieces of text are first individually converted into sequences of embeddings and are further transformed by a highway network in the input layer. Then, Bidirectional Long Short-Term Memory (BiLSTM) is used to represent each piece of text and attention-based interaction matrix is used to represent interactive information of the two pieces of text in the representation layer. Subsequently, the two kinds of representations are fused together by BiLSTM in the aggregation layer, and are further represented with capsules (vectors) in the capsule layer. Finally, the prediction layer is a connected network used for classification. CapsTM is an extension of ESIM by adding a capsule layer before the prediction layer. Results We construct a corpus of Chinese medical question matching, which contains 36,360 question pairs. This corpus is randomly split into three parts: a training set of 32,360 question pairs, a development set of 2000 question pairs and a test set of 2000 question pairs. On this corpus, we conduct a series of experiments to evaluate the proposed CapsTM and compare it with other state-of-the-art methods. CapsTM achieves the highest F-score of 0.8666. Conclusion The experimental results demonstrate that CapsTM is effective for Chinese medical question matching and outperforms other state-of-the-art methods for comparison.

scholarly journals Joint Image Emotion Classification and Distribution Learning via Deep Convolutional Neural Network

2017 ◽  
Author(s):  
Jufeng Yang ◽  
Dongyu She ◽  
Ming Sun
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Prior Knowledge ◽  
State Of The Art ◽  
Ground Truth ◽  
Majority Voting ◽  
Emotion Classification ◽  
Voting Scheme ◽  
Label Distribution ◽  
Similarity Information

Visual sentiment analysis is attracting more and more attention with the increasing tendency to express emotions through visual contents. Recent algorithms in convolutional neural networks (CNNs) considerably advance the emotion classification, which aims to distinguish differences among emotional categories and assigns a single dominant label to each image. However, the task is inherently ambiguous since an image usually evokes multiple emotions and its annotation varies from person to person. In this work, we address the problem via label distribution learning (LDL) and develop a multi-task deep framework by jointly optimizing both classification and distribution prediction. While the proposed method prefers to the distribution dataset with annotations of different voters, the majority voting scheme is widely adopted as the ground truth in this area, and few dataset has provided multiple affective labels. Hence, we further exploit two weak forms of prior knowledge, which are expressed as similarity information between labels, to generate emotional distribution for each category. The experiments conducted on both distribution datasets, i.e., Emotion6, Flickr_LDL, Twitter_LDL, and the largest single emotion dataset, i.e., Flickr and Instagram, demonstrate the proposed method outperforms the state-of-the-art approaches.

scholarly journals Application Research of Deep Convolutional Neural Network in Computer Vision

2020 ◽  
Vol 2 (2) ◽  
pp. 23
Author(s):  
Lei Wang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Computer Vision ◽  
Face Recognition ◽  
Human Brain ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Convolution Neural Network ◽  
Data Set ◽  
Deep Convolution Neural Network

<p>As an important research achievement in the field of brain like computing, deep convolution neural network has been widely used in many fields such as computer vision, natural language processing, information retrieval, speech recognition, semantic understanding and so on. It has set off a wave of neural network research in industry and academia and promoted the development of artificial intelligence. At present, the deep convolution neural network mainly simulates the complex hierarchical cognitive laws of the human brain by increasing the number of layers of the network, using a larger training data set, and improving the network structure or training learning algorithm of the existing neural network, so as to narrow the gap with the visual system of the human brain and enable the machine to acquire the capability of "abstract concepts". Deep convolution neural network has achieved great success in many computer vision tasks such as image classification, target detection, face recognition, pedestrian recognition, etc. Firstly, this paper reviews the development history of convolutional neural networks. Then, the working principle of the deep convolution neural network is analyzed in detail. Then, this paper mainly introduces the representative achievements of convolution neural network from the following two aspects, and shows the improvement effect of various technical methods on image classification accuracy through examples. From the aspect of adding network layers, the structures of classical convolutional neural networks such as AlexNet, ZF-Net, VGG, GoogLeNet and ResNet are discussed and analyzed. From the aspect of increasing the size of data set, the difficulties of manually adding labeled samples and the effect of using data amplification technology on improving the performance of neural network are introduced. This paper focuses on the latest research progress of convolution neural network in image classification and face recognition. Finally, the problems and challenges to be solved in future brain-like intelligence research based on deep convolution neural network are proposed.</p>

scholarly journals Credit Card Fraud Analysis using Robust Space Invariant Artificial Neural Networks (RSIANN)

2019 ◽  
Vol 8 (2) ◽  
pp. 6413-6417
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Credit Card ◽  
Convolution Neural Network ◽  
Support Vector ◽  
Credit Card Fraud ◽  
Tuning Parameters ◽  
Deep Convolution Neural Network ◽  
Artificial Neural

One of the impact factor for any organizations or banks revenue and service quality is credit card fraud activities. Hence, need of efficient approach for detect early potential fraud and/or prevent them. In this paper, we considered pre-processing and used deep convolution neural network called as Space Invariant Artificial Neural Networks for classifying fraudsters. Available Credit card fraud dataset may not have sufficient information hence need pre-processing. The proposed approach has pre-processing phrase to make as robust. This approach used leverage layers and suitable tuning parameters for getting good classification accuracy. In neural network applications, choosing of tuning parameters and model selection has great role in solving the problems. We have done careful analysis and selected leverage layers and corresponding parameter values. The proposed architecture tested with all possible tuning parameters to evaluate the performance on pre-processed credit card fraud records. We found the proposed robust SIANN (RSIANN) is outperformed other state-of-art machine learning (ML) algorithms (Support vector machine (SVM), random forest (RF), Navie bayes and deep convolution neural network (DCNN) in terms of accuracy (85%). Thus, this model analyses the transaction and decide it fraud or not.

An improved deep convolution neural network for predicting the remaining useful life of rolling bearings

2020 ◽  
pp. 1-9
Author(s):  
Yiming Guo ◽  
Hui Zhang ◽  
Zhijie Xia ◽  
Chang Dong ◽  
Zhisheng Zhang ◽  
...  
Keyword(s):  
Neural Network ◽  
Degradation Process ◽  
Rolling Bearing ◽  
Remaining Useful Life ◽  
Convolution Neural Network ◽  
Dual Channel ◽  
Time Domain Data ◽  
Channel Input ◽  
Deep Convolution Neural Network ◽  
Useful Life

The rolling bearing is the crucial component in the rotating machinery. The degradation process monitoring and remaining useful life prediction of the bearing are necessary for the condition-based maintenance. The commonly used deep learning methods use the raw or processed time domain data as the input. However, the feature extracted by these approaches is insufficient and incomprehensive. To tackle this problem, this paper proposed an improved Deep Convolution Neural Network with the dual-channel input from the time and frequency domain in parallel. The proposed methodology consists of two stages: the incipient failure identification and the degradation process fitting. To verify the effectiveness of the method, the IEEE PHM 2012 dataset is adopted to compare the proposed method and other commonly used approaches. The results show that the improved Deep Convolution Neural Network can effectively describe the degradation process for the rolling bearing.

scholarly journals SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks

2021 ◽  
Vol 40 (3) ◽  
pp. 1-13
Author(s):  
Lumin Yang ◽  
Jiajie Zhuang ◽  
Hongbo Fu ◽  
Xiangzhi Wei ◽  
Kun Zhou ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Large Scale ◽  
State Of The Art ◽  
Semantic Segmentation ◽  
Structure Information ◽  
Graph Neural Networks ◽  
Node Labels ◽  
Point Level

We introduce SketchGNN , a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches. We treat an input stroke-based sketch as a graph with nodes representing the sampled points along input strokes and edges encoding the stroke structure information. To predict the per-node labels, our SketchGNN uses graph convolution and a static-dynamic branching network architecture to extract the features at three levels, i.e., point-level, stroke-level, and sketch-level. SketchGNN significantly improves the accuracy of the state-of-the-art methods for semantic sketch segmentation (by 11.2% in the pixel-based metric and 18.2% in the component-based metric over a large-scale challenging SPG dataset) and has magnitudes fewer parameters than both image-based and sequence-based methods.

Sign in / Sign up

Export Citation Format

Share Document