scholarly journals Domain Adaption Based on ELM Autoencoder

2017 ◽  
Vol 2017 ◽  
pp. 1-8
Author(s):  
Wan-Yu Deng ◽  
Yu-Tao Qu ◽  
Qian Zhang
Keyword(s):  
Nonlinear Approximation ◽  
Feature Representation ◽  
Learning Ability ◽  
Alignment Algorithm ◽  
Target Domain ◽  
Linear Feature ◽  
Cross Domain ◽  
Domain Adaption ◽  
New Space ◽  
Subspace Alignment

We propose a new ELM Autoencoder (ELM-AE) based domain adaption algorithm which describes the subspaces of source and target domain by ELM-AE and then carries out subspace alignment to project different domains into a common new space. By leveraging nonlinear approximation ability and efficient one-pass learning ability of ELM-AE, the proposed domain adaption algorithm can efficiently seek a better cross-domain feature representation than linear feature representation approaches such as PCA to improve domain adaption performance. The widely experimental results on Office/Caltech-256 datasets show that the proposed algorithm can achieve better classification accuracy than PCA subspace alignment algorithm and other state-of-the-art domain adaption algorithms in most cases.

Fusion of part-of-speech vectors and attention mechanisms for cross-domain sentiment analysis

2021 ◽  
pp. 1-9
Author(s):  
Ting Lu ◽  
Yan Xiang ◽  
Junge Liang ◽  
Li Zhang ◽  
Mingfang Zhang
Keyword(s):  
Sentiment Analysis ◽  
Poor Performance ◽  
Feature Representation ◽  
Grand Challenge ◽  
Feature Mapping ◽  
Target Domain ◽  
Specific Domain ◽  
Part Of Speech ◽  
Cross Domain ◽  
Speech Information

The grand challenge of cross-domain sentiment analysis is that classifiers trained in a specific domain are very sensitive to the discrepancy between domains. A sentiment classifier trained in the source domain usually have a poor performance in the target domain. One of the main strategies to solve this problem is the pivot-based strategy, which regards the feature representation as an important component. However, part-of-speech information was not considered to guide the learning of feature representation and feature mapping in previous pivot-based models. Therefore, we present a fused part-of-speech vectors and attention-based model (FAM). In our model, we fuse part-of-speech vectors and feature word embeddings as the representation of features, giving deep semantics to mapping features. And we adopt Multi-Head attention mechanism to train the cross-domain sentiment classifier to obtain the connection between different features. The results of 12 groups comparative experiments on the Amazon dataset demonstrate that our model outperforms all baseline models in this paper.

scholarly journals Strong-Weak Feature Alignment for 3D Object Detection

Electronics ◽  
2021 ◽  
Vol 10 (10) ◽  
pp. 1205
Author(s):  
Zhiyu Wang ◽  
Li Wang ◽  
Bin Dai
Keyword(s):  
Object Detection ◽  
Point Clouds ◽  
Autonomous Driving ◽  
Feature Representation ◽  
Alignment Algorithm ◽  
3D Object ◽  
3D Point Clouds ◽  
Object Feature ◽  
3D Object Detection ◽  
Feature Alignment

Object detection in 3D point clouds is still a challenging task in autonomous driving. Due to the inherent occlusion and density changes of the point cloud, the data distribution of the same object will change dramatically. Especially, the incomplete data with sparsity or occlusion can not represent the complete characteristics of the object. In this paper, we proposed a novel strong–weak feature alignment algorithm between complete and incomplete objects for 3D object detection, which explores the correlations within the data. It is an end-to-end adaptive network that does not require additional data and can be easily applied to other object detection networks. Through a complete object feature extractor, we achieve a robust feature representation of the object. It serves as a guarding feature to help the incomplete object feature generator to generate effective features. The strong–weak feature alignment algorithm reduces the gap between different states of the same object and enhances the ability to represent the incomplete object. The proposed adaptation framework is validated on the KITTI object benchmark and gets about 6% improvement in detection average precision on 3D moderate difficulty compared to the basic model. The results show that our adaptation method improves the detection performance of incomplete 3D objects.

Self-Supervised Pre-training on the Target Domain for Cross-Domain Person Re-identification

2021 ◽  
Author(s):  
Junyin Zhang ◽  
Yongxin Ge ◽  
Xinqian Gu ◽  
Boyu Hua ◽  
Tao Xiang
Keyword(s):  
Target Domain ◽  
Cross Domain

scholarly journals Wheel fault diagnosis model based on multichannel attention and supervised contrastive learning

2021 ◽  
Vol 13 (12) ◽  
pp. 168781402110670
Author(s):  
Yanxiang Chen ◽  
Zuxing Zhao ◽  
Euiyoul Kim ◽  
Haiyang Liu ◽  
Juan Xu ◽  
...  
Keyword(s):  
Network Architecture ◽  
Feature Learning ◽  
Feature Representation ◽  
Diagnostic Methods ◽  
Learning Ability ◽  
Noise Interference ◽  
Backbone Network ◽  
Mechanical Methods ◽  
Wheel Flat ◽  
Wheel Radius

As wheels are important components of train operation, diagnosing and predicting wheel faults are essential to ensure the reliability of rail transit. Currently, the existing studies always separately deal with two main types of wheel faults, namely wheel radius difference and wheel flat, even though they are both reflected by wheel radius changes. Moreover, traditional diagnostic methods, such as mechanical methods or a combination of data analysis methods, have limited abilities to efficiently extract data features. Deep learning models have become useful tools to automatically learn features from raw vibration signals. However, research on improving the feature-learning capabilities of models under noise interference to yield higher wheel diagnostic accuracies has not yet been conducted. In this paper, a unified training framework with the same model architecture and loss function is established for two homologous wheel faults. After selecting deep residual networks (ResNets) as the backbone network to build the model, we add the squeeze and excitation (SE) module based on a multichannel attention mechanism to the backbone network to learn the global relationships among feature channels. Then the influence of noise interference features is reduced while the extraction of useful information features is enhanced, leading to the improved feature-learning ability of ResNet. To further obtain effective feature representation using the model, we introduce supervised contrastive loss (SCL) on the basis of ResNet + SE to enlarge the feature distances of different fault classes through a comparison between positive and negative examples under label supervision to obtain a better class differentiation and higher diagnostic accuracy. We also complete a regression task to predict the fault degrees of wheel radius difference and wheel flat without changing the network architecture. The extensive experimental results show that the proposed model has a high accuracy in diagnosing and predicting two types of wheel faults.

scholarly journals Redundancy Removal Adversarial Active Learning Based on Norm Online Uncertainty Indicator

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Jifeng Guo ◽  
Zhiqi Pang ◽  
Wenbo Sun ◽  
Shi Li ◽  
Yu Chen
Keyword(s):  
Active Learning ◽  
Feature Vector ◽  
State Of The Art ◽  
Representation Learning ◽  
The State ◽  
Feature Representation ◽  
Learning Ability ◽  
Redundancy Removal ◽  
Previous State ◽  
Uncertainty Score

Active learning aims to select the most valuable unlabelled samples for annotation. In this paper, we propose a redundancy removal adversarial active learning (RRAAL) method based on norm online uncertainty indicator, which selects samples based on their distribution, uncertainty, and redundancy. RRAAL includes a representation generator, state discriminator, and redundancy removal module (RRM). The purpose of the representation generator is to learn the feature representation of a sample, and the state discriminator predicts the state of the feature vector after concatenation. We added a sample discriminator to the representation generator to improve the representation learning ability of the generator and designed a norm online uncertainty indicator (Norm-OUI) to provide a more accurate uncertainty score for the state discriminator. In addition, we designed an RRM based on a greedy algorithm to reduce the number of redundant samples in the labelled pool. The experimental results on four datasets show that the state discriminator, Norm-OUI, and RRM can improve the performance of RRAAL, and RRAAL outperforms the previous state-of-the-art active learning methods.

scholarly journals Optimal Transport with Dimensionality Reduction for Domain Adaptation

Symmetry ◽  
2020 ◽  
Vol 12 (12) ◽  
pp. 1994
Author(s):  
Ping Li ◽  
Zhiwei Ni ◽  
Xuhui Zhu ◽  
Juan Song ◽  
Wenying Wu
Keyword(s):  
Dimensionality Reduction ◽  
Optimal Transport ◽  
Domain Adaptation ◽  
Wasserstein Distance ◽  
Local Information ◽  
Target Domain ◽  
Source Domain ◽  
Second Stage ◽  
Cross Domain ◽  
Feature Based

Domain adaptation manages to learn a robust classifier for target domain, using the source domain, but they often follow different distributions. To bridge distribution shift between the two domains, most of previous works aim to align their feature distributions through feature transformation, of which optimal transport for domain adaptation has attract researchers’ interest, as it can exploit the local information of the two domains in the process of mapping the source instances to the target ones by minimizing Wasserstein distance between their feature distributions. However, it may weaken the feature discriminability of source domain, thus degrade domain adaptation performance. To address this problem, this paper proposes a two-stage feature-based adaptation approach, referred to as optimal transport with dimensionality reduction (OTDR). In the first stage, we apply the dimensionality reduction with intradomain variant maximization but source intraclass compactness minimization, to separate data samples as much as possible and enhance the feature discriminability of the source domain. In the second stage, we leverage optimal transport-based technique to preserve the local information of the two domains. Notably, the desirable properties in the first stage can mitigate the degradation of feature discriminability of the source domain in the second stage. Extensive experiments on several cross-domain image datasets validate that OTDR is superior to its competitors in classification accuracy.

scholarly journals Deep Open-Set Domain Adaptation for Cross-Scene Classification based on Adversarial Learning and Pareto Ranking

2020 ◽  
Vol 12 (11) ◽  
pp. 1716
Author(s):  
Reham Adayel ◽  
Yakoub Bazi ◽  
Haikel Alhichri ◽  
Naif Alajlan
Keyword(s):  
High Resolution ◽  
Domain Adaptation ◽  
Target Domain ◽  
Adversarial Learning ◽  
Pareto Ranking ◽  
Cross Domain ◽  
Open Set ◽  
Ranking Scheme ◽  
High Resolution Images ◽  
Alignment Process

Most of the existing domain adaptation (DA) methods proposed in the context of remote sensing imagery assume the presence of the same land-cover classes in the source and target domains. Yet, this assumption is not always realistic in practice as the target domain may contain additional classes unknown to the source leading to the so-called open set DA. Under this challenging setting, the problem turns to reducing the distribution discrepancy between the shared classes in both domains besides the detection of the unknown class samples in the target domain. To deal with the openset problem, we propose an approach based on adversarial learning and pareto-based ranking. In particular, the method leverages the distribution discrepancy between the source and target domains using min-max entropy optimization. During the alignment process, it identifies candidate samples of the unknown class from the target domain through a pareto-based ranking scheme that uses ambiguity criteria based on entropy and the distance to source class prototype. Promising results using two cross-domain datasets that consist of very high resolution and extremely high resolution images, show the effectiveness of the proposed method.

Cross-domain gearbox diagnostics under variable working conditions with deep convolutional transfer learning

2020 ◽  
pp. 107754632093379
Author(s):  
Moslem Azamfar ◽  
Jaskaran Singh ◽  
Xiang Li ◽  
Jay Lee
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
High Performance ◽  
Training Sample ◽  
Training Dataset ◽  
Target Domain ◽  
Training Sample Size ◽  
Vibration Data ◽  
Cross Domain ◽  
Testing Dataset

This study proposes a novel 1D deep convolutional transfer learning method that is able to learn the high-dimensional domain-invariant feature from the labeled training dataset and perform diagnosis tasks on the unlabeled testing dataset subjected to a domain shift. To obtain the domain-invariant features, the cross-entropy loss in the source domain classifier and the maximum mean discrepancies between the source and target domain data are minimized simultaneously. To evaluate the performance of the proposed method, an experimental study is conducted on a gearbox under significant speed variation. Because of inherent limitations of the vibration data, in this research, the effectiveness of torque measurement signals has been explored for gearbox fault diagnosis. Comprehensive studies on network parameters and the training sample size are performed to illustrate the robustness and effectiveness of the proposed method. A comparison study is performed on similar techniques to illustrate the superiority and high performance of the proposed diagnosis method. The achieved results illustrate the effectiveness of torque signal in multiclass cross-domain fault diagnosis of gearboxes.

Sign in / Sign up

Export Citation Format

Share Document