Hysteresis modeling of piezoelectric micro-positioning stage based on convolutional neural network

2020 ◽  
pp. 095965182095084
Author(s):  
Junfeng Hu ◽  
Yuan Zhong ◽  
Mingli Yang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Hysteresis Model ◽  
Convolutional Network ◽  
Network Layer ◽  
Generalization Ability ◽  
Rate Dependent ◽  
Hysteresis Modeling ◽  
Positioning Stage ◽  
Model Layer

The inherent hysteresis nonlinearity of piezoelectric actuator degrades the positioning accuracy of the micro-positioning stage. Prandtl–Ishlinskii model is widely used for piezoelectric hysteresis modeling, yet it is a rate-independent model with weak generalization ability. To overcome this problem, we proposed a convolutional neural network model based on the Prandtl–Ishlinskii model, which consists of a rate-dependent Prandtl–Ishlinskii model layer and convolutional network layer. The rate-dependent Prandtl–Ishlinskii model layer extends the traditional Prandtl–Ishlinskii model to describe the rate-dependent hysteresis behavior. The convolutional network layer with deep learning ability extracts the deep features of the input signal to improve the generalization ability of the hysteresis model. The experiment results indicate that the standard error of the proposed hysteresis model to predict displacement at unmodeled frequencies has been reduced by 18.74%–36.75% in comparison with the Prandtl–Ishlinskii model, which verifies that the proposed hysteresis model has not only higher accuracy but also stronger generalization ability.

scholarly journals Hysteresis Modeling and Compensation of Fast Steering Mirrors with Hysteresis Operator Based Back Propagation Neural Networks

Micromachines ◽  
2021 ◽  
Vol 12 (7) ◽  
pp. 732
Author(s):  
Kairui Cao ◽  
Guanglu Hao ◽  
Qingfeng Liu ◽  
Liying Tan ◽  
Jing Ma
Keyword(s):  
Neural Network ◽  
Back Propagation ◽  
Hysteresis Model ◽  
Cooperative Movement ◽  
Hysteresis Operator ◽  
The Neural Network ◽  
Hysteresis Nonlinearity ◽  
Hysteresis Modeling ◽  
Hysteresis Characteristics ◽  
Inverse Hysteresis

Fast steering mirrors (FSMs), driven by piezoelectric ceramics, are usually used as actuators for high-precision beam control. A FSM generally contains four ceramics that are distributed in a crisscross pattern. The cooperative movement of the two ceramics along one radial direction generates the deflection of the FSM in the same orientation. Unlike the hysteresis nonlinearity of a single piezoelectric ceramic, which is symmetric or asymmetric, the FSM exhibits complex hysteresis characteristics. In this paper, a systematic way of modeling the hysteresis nonlinearity of FSMs is proposed using a Madelung’s rules based symmetric hysteresis operator with a cascaded neural network. The hysteresis operator provides a basic hysteresis motion for the FSM. The neural network modifies the basic hysteresis motion to accurately describe the hysteresis nonlinearity of FSMs. The wiping-out and congruency properties of the proposed method are also analyzed. Moreover, the inverse hysteresis model is constructed to reduce the hysteresis nonlinearity of FSMs. The effectiveness of the presented model is validated by experimental results.

scholarly journals Convolutional Neural Network-Based Artificial Intelligence for Classification of Protein Localization Patterns

Biomolecules ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. 264
Author(s):  
Kaisa Liimatainen ◽  
Riku Huttunen ◽  
Leena Latonen ◽  
Pekka Ruusuvuori
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Convolutional Neural Network ◽  
High Throughput ◽  
Protein Function ◽  
Protein Localization ◽  
Convolutional Network ◽  
High Throughput Analysis ◽  
Fully Convolutional Network

Identifying localization of proteins and their specific subpopulations associated with certain cellular compartments is crucial for understanding protein function and interactions with other macromolecules. Fluorescence microscopy is a powerful method to assess protein localizations, with increasing demand of automated high throughput analysis methods to supplement the technical advancements in high throughput imaging. Here, we study the applicability of deep neural network-based artificial intelligence in classification of protein localization in 13 cellular subcompartments. We use deep learning-based on convolutional neural network and fully convolutional network with similar architectures for the classification task, aiming at achieving accurate classification, but importantly, also comparison of the networks. Our results show that both types of convolutional neural networks perform well in protein localization classification tasks for major cellular organelles. Yet, in this study, the fully convolutional network outperforms the convolutional neural network in classification of images with multiple simultaneous protein localizations. We find that the fully convolutional network, using output visualizing the identified localizations, is a very useful tool for systematic protein localization assessment.

scholarly journals Surface EMG-Based Instantaneous Hand Gesture Recognition Using Convolutional Neural Network with the Transfer Learning Method

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2540
Author(s):  
Zhipeng Yu ◽  
Jianghai Zhao ◽  
Yucheng Wang ◽  
Linglong He ◽  
Shaonan Wang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Gesture Recognition ◽  
Recognition System ◽  
Surface Emg ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Training Time ◽  
Generalization Ability

In recent years, surface electromyography (sEMG)-based human–computer interaction has been developed to improve the quality of life for people. Gesture recognition based on the instantaneous values of sEMG has the advantages of accurate prediction and low latency. However, the low generalization ability of the hand gesture recognition method limits its application to new subjects and new hand gestures, and brings a heavy training burden. For this reason, based on a convolutional neural network, a transfer learning (TL) strategy for instantaneous gesture recognition is proposed to improve the generalization performance of the target network. CapgMyo and NinaPro DB1 are used to evaluate the validity of our proposed strategy. Compared with the non-transfer learning (non-TL) strategy, our proposed strategy improves the average accuracy of new subject and new gesture recognition by 18.7% and 8.74%, respectively, when up to three repeated gestures are employed. The TL strategy reduces the training time by a factor of three. Experiments verify the transferability of spatial features and the validity of the proposed strategy in improving the recognition accuracy of new subjects and new gestures, and reducing the training burden. The proposed TL strategy provides an effective way of improving the generalization ability of the gesture recognition system.

scholarly journals Evaluation of Power Insulator Detection Efficiency with the Use of Limited Training Dataset

2020 ◽  
Vol 10 (6) ◽  
pp. 2104
Author(s):  
Michał Tomaszewski ◽  
Paweł Michalski ◽  
Jakub Osuchowski
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Object Detection ◽  
Convolutional Neural Network ◽  
Deep Neural Networks ◽  
Detection Efficiency ◽  
Training Data ◽  
Training Dataset ◽  
Training Set ◽  
Convolutional Network

This article presents an analysis of the effectiveness of object detection in digital images with the application of a limited quantity of input. The possibility of using a limited set of learning data was achieved by developing a detailed scenario of the task, which strictly defined the conditions of detector operation in the considered case of a convolutional neural network. The described solution utilizes known architectures of deep neural networks in the process of learning and object detection. The article presents comparisons of results from detecting the most popular deep neural networks while maintaining a limited training set composed of a specific number of selected images from diagnostic video. The analyzed input material was recorded during an inspection flight conducted along high-voltage lines. The object detector was built for a power insulator. The main contribution of the presented papier is the evidence that a limited training set (in our case, just 60 training frames) could be used for object detection, assuming an outdoor scenario with low variability of environmental conditions. The decision of which network will generate the best result for such a limited training set is not a trivial task. Conducted research suggests that the deep neural networks will achieve different levels of effectiveness depending on the amount of training data. The most beneficial results were obtained for two convolutional neural networks: the faster region-convolutional neural network (faster R-CNN) and the region-based fully convolutional network (R-FCN). Faster R-CNN reached the highest AP (average precision) at a level of 0.8 for 60 frames. The R-FCN model gained a worse AP result; however, it can be noted that the relationship between the number of input samples and the obtained results has a significantly lower influence than in the case of other CNN models, which, in the authors’ assessment, is a desired feature in the case of a limited training set.

scholarly journals Graph Convolutional Network and Convolutional Neural Network Based Method for Predicting lncRNA-Disease Associations

Cells ◽  
2019 ◽  
Vol 8 (9) ◽  
pp. 1012 ◽  
Author(s):  
Xuan ◽  
Pan ◽  
Zhang ◽  
Liu ◽  
Sun
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Heterogeneous Network ◽  
Heterogeneous Data ◽  
Superior Performance ◽  
Convolutional Network ◽  
Topological Information ◽  
Disease Pair ◽  
Disease Associations ◽  
The Right

Aberrant expressions of long non-coding RNAs (lncRNAs) are often associated with diseases and identification of disease-related lncRNAs is helpful for elucidating complex pathogenesis. Recent methods for predicting associations between lncRNAs and diseases integrate their pertinent heterogeneous data. However, they failed to deeply integrate topological information of heterogeneous network comprising lncRNAs, diseases, and miRNAs. We proposed a novel method based on the graph convolutional network and convolutional neural network, referred to as GCNLDA, to infer disease-related lncRNA candidates. The heterogeneous network containing the lncRNA, disease, and miRNA nodes, is constructed firstly. The embedding matrix of a lncRNA-disease node pair was constructed according to various biological premises about lncRNAs, diseases, and miRNAs. A new framework based on a graph convolutional network and a convolutional neural network was developed to learn network and local representations of the lncRNA-disease pair. On the left side of the framework, the autoencoder based on graph convolution deeply integrated topological information within the heterogeneous lncRNA-disease-miRNA network. Moreover, as different node features have discriminative contributions to the association prediction, an attention mechanism at node feature level is constructed. The left side learnt the network representation of the lncRNA-disease pair. The convolutional neural networks on the right side of the framework learnt the local representation of the lncRNA-disease pair by focusing on the similarities, associations, and interactions that are only related to the pair. Compared to several state-of-the-art prediction methods, GCNLDA had superior performance. Case studies on stomach cancer, osteosarcoma, and lung cancer confirmed that GCNLDA effectively discovers the potential lncRNA-disease associations.

scholarly journals MNCN: A Multilingual Ngram-Based Convolutional Network for Aspect Category Detection in Online Reviews

2019 ◽  
Vol 33 ◽  
pp. 6441-6448 ◽  
Author(s):  
Erfan Ghadery ◽  
Sajad Movahedi ◽  
Heshaam Faili ◽  
Azadeh Shakery
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Sentiment Analysis ◽  
English Language ◽  
Online Reviews ◽  
The Internet ◽  
Word Embeddings ◽  
Convolutional Network ◽  
Significant Growth ◽  
Multiple Languages

The advent of the Internet has caused a significant growth in the number of opinions expressed about products or services on e-commerce websites. Aspect category detection, which is one of the challenging subtasks of aspect-based sentiment analysis, deals with categorizing a given review sentence into a set of predefined categories. Most of the research efforts in this field are devoted to English language reviews, while there are a large number of reviews in other languages that are left unexplored. In this paper, we propose a multilingual method to perform aspect category detection on reviews in different languages, which makes use of a deep convolutional neural network with multilingual word embeddings. To the best of our knowledge, our method is the first attempt at performing aspect category detection on multiple languages simultaneously. Empirical results on the multilingual dataset provided by SemEval workshop demonstrate the effectiveness of the proposed method1.

scholarly journals A Deep Convolutional Neural Network for Oil Spill Detection from Spaceborne SAR Images

2020 ◽  
Vol 12 (6) ◽  
pp. 1015 ◽  
Author(s):  
Kan Zeng ◽  
Yixiao Wang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Oil Spill ◽  
Data Augmentation ◽  
Classification Performance ◽  
Deep Convolutional Neural Network ◽  
Convolutional Network ◽  
Data Set ◽  
Oil Spill Detection ◽  
Processing Framework

Classification algorithms for automatically detecting sea surface oil spills from spaceborne Synthetic Aperture Radars (SARs) can usually be regarded as part of a three-step processing framework, which briefly includes image segmentation, feature extraction, and target classification. A Deep Convolutional Neural Network (DCNN), named the Oil Spill Convolutional Network (OSCNet), is proposed in this paper for SAR oil spill detection, which can do the latter two steps of the three-step processing framework. Based on VGG-16, the OSCNet is obtained by designing the architecture and adjusting hyperparameters with the data set of SAR dark patches. With the help of the big data set containing more than 20,000 SAR dark patches and data augmentation, the OSCNet can have as many as 12 weight layers. It is a relatively deep Deep Learning (DL) network for SAR oil spill detection. It is shown by the experiments based on the same data set that the classification performance of OSCNet has been significantly improved compared to that of traditional machine learning (ML). The accuracy, recall, and precision are improved from 92.50%, 81.40%, and 80.95% to 94.01%, 83.51%, and 85.70%, respectively. An important reason for this improvement is that the distinguishability of the features learned by OSCNet itself from the data set is significantly higher than that of the hand-crafted features needed by traditional ML algorithms. In addition, experiments show that data augmentation plays an important role in avoiding over-fitting and hence improves the classification performance. OSCNet has also been compared with other DL classifiers for SAR oil spill detection. Due to the huge differences in the data sets, only their similarities and differences are discussed at the principle level.

scholarly journals Design of Painting Art Style Rendering System Based on Convolutional Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Xingyu Xie ◽  
Bin Lv
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Generative Adversarial Network ◽  
Convolutional Network ◽  
Data Set ◽  
Adversarial Network ◽  
Paired Samples ◽  
Network Generator ◽  
The Stability ◽  
Art Style

Convolutional Neural Network- (CNN-) based GAN models mainly suffer from problems such as data set limitation and rendering efficiency in the segmentation and rendering of painting art. In order to solve these problems, this paper uses the improved cycle generative adversarial network (CycleGAN) to render the current image style. This method replaces the deep residual network (ResNet) of the original network generator with a dense connected convolutional network (DenseNet) and uses the perceptual loss function for adversarial training. The painting art style rendering system built in this paper is based on perceptual adversarial network (PAN) for the improved CycleGAN that suppresses the limitation of the network model on paired samples. The proposed method also improves the quality of the image generated by the artistic style of painting and further improves the stability and speeds up the network convergence speed. Experiments were conducted on the painting art style rendering system based on the proposed model. Experimental results have shown that the image style rendering method based on the perceptual adversarial error to improve the CycleGAN + PAN model can achieve better results. The PSNR value of the generated image is increased by 6.27% on average, and the SSIM values are all increased by about 10%. Therefore, the improved CycleGAN + PAN image painting art style rendering method produces better painting art style images, which has strong application value.

scholarly journals Severity Estimation of Depression Using Convolutional Neural Network

2021 ◽  
Author(s):  
Attila Zoltán Jenei ◽  
Gábor Kiss
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Early Stage ◽  
Correlation Structure ◽  
Acoustic Features ◽  
Convolutional Network ◽  
Severity Estimation ◽  
Severity Of Depression ◽  
The Individual

In the present study, we attempt to estimate the severity of depression using a Convolutional Neural Network (CNN). The method is special because an auto- and cross-correlation structure has been crafted rather than using an actual image for the input of the network. The importance to investigate the possibility of this research is that depression has become one of the leading mental disorders in the world. With its appearance, it can significantly reduce an individual's quality of life even at an early stage, and in severe cases, it may threaten with suicide. It is therefore important that the disorder be recognized as early as possible. Furthermore, it is also important to determine the disorder severity of the individual, so that a treatment order can be established. During the examination, speech acoustic features were obtained from recordings. Among the features, MFCC coefficients and formant frequencies were used based on preliminary studies. From its subsets, correlation structure was created. We applied this quadratic structure to the input of a convolutional network. Two models were crafted: single and double input versions. Altogether, the lowest RMSE value (10.797) was achieved using the two features, which has a moderate strength correlation of 0.61 (between estimated and original).

Sign in / Sign up

Export Citation Format

Share Document