Back-propagation of the Mahalanobis distance through a deep triplet learning model for person Re-Identification

2021 ◽  
pp. 1-18
Author(s):  
María José Gómez-Silva ◽  
sArturo de la Escalera ◽  
José María Armingol
Keyword(s):  
Mahalanobis Distance ◽  
Learning Algorithm ◽  
Back Propagation ◽  
Feature Learning ◽  
Learning Model ◽  
Vast Number ◽  
Significant Challenge ◽  
Similar Appearance ◽  
Model Features ◽  
Identification Model

The automatization of the Re-Identification of an individual across different video-surveillance cameras poses a significant challenge due to the presence of a vast number of potential candidates with a similar appearance. This task requires the learning of discriminative features from person images and a distance metric to properly compare them and decide whether they belong to the same person or not. Nevertheless, the fact of acquiring images of the same person from different, distant and non-overlapping views produces changes in illumination, perspective, background, resolution and scale between the person’s representations, resulting in appearance variations that hamper his/her re-identification. This article focuses the feature learning on automatically finding discriminative descriptors able to reflect the dissimilarities mainly due to the changes in actual people appearance, independently from the variations introduced by the acquisition point. With that purpose, such variations have been implicitly embedded by the Mahalanobis distance. This article presents a learning algorithm to jointly model features and the Mahalanobis distance through a Deep Neural Re-Identification model. The Mahalanobis distance learning has been implemented as a novel neural layer, forming part of a Triplet Learning model that has been evaluated over PRID2011 dataset, providing satisfactory results.

Spatio-Temporal Event Forecasting Using Incremental Multi-Source Feature Learning

2022 ◽  
Vol 16 (2) ◽  
pp. 1-28
Author(s):  
Liang Zhao ◽  
Yuyang Gao ◽  
Jieping Ye ◽  
Feng Chen ◽  
Yanfang Ye ◽  
...  
Keyword(s):  
Real Time ◽  
Missing Values ◽  
Learning Algorithm ◽  
Feature Learning ◽  
Learning Model ◽  
Model Parameters ◽  
Active Set ◽  
Content Type ◽  
Source Data ◽  
Event Forecasting

The forecasting of significant societal events such as civil unrest and economic crisis is an interesting and challenging problem which requires both timeliness, precision, and comprehensiveness. Significant societal events are influenced and indicated jointly by multiple aspects of a society, including its economics, politics, and culture. Traditional forecasting methods based on a single data source find it hard to cover all these aspects comprehensively, thus limiting model performance. Multi-source event forecasting has proven promising but still suffers from several challenges, including (1) geographical hierarchies in multi-source data features, (2) hierarchical missing values, (3) characterization of structured feature sparsity, and (4) difficulty in model’s online update with incomplete multiple sources. This article proposes a novel feature learning model that concurrently addresses all the above challenges. Specifically, given multi-source data from different geographical levels, we design a new forecasting model by characterizing the lower-level features’ dependence on higher-level features. To handle the correlations amidst structured feature sets and deal with missing values among the coupled features, we propose a novel feature learning model based on an N th-order strong hierarchy and fused-overlapping group Lasso. An efficient algorithm is developed to optimize model parameters and ensure global optima. More importantly, to enable the model update in real time, the online learning algorithm is formulated and active set techniques are leveraged to resolve the crucial challenge when new patterns of missing features appear in real time. Extensive experiments on 10 datasets in different domains demonstrate the effectiveness and efficiency of the proposed models.

Construction of a deep sparse filtering network for rotating machinery fault diagnosis

2021 ◽  
pp. 095440702110148
Author(s):  
Chun Cheng ◽  
Wei Zou ◽  
Weiping Wang ◽  
Michael Pecht
Keyword(s):  
Fault Diagnosis ◽  
Back Propagation ◽  
Feature Learning ◽  
Back Propagation Neural Network ◽  
Rotating Machinery ◽  
Fine Tuning ◽  
Local Optimum ◽  
Back Propagation Algorithm ◽  
Intelligent Fault Diagnosis ◽  
Sparse Filtering

Deep neural networks (DNNs) have shown potential in intelligent fault diagnosis of rotating machinery. However, traditional DNNs such as the back-propagation neural network are highly sensitive to the initial weights and easily fall into the local optimum, which restricts the feature learning capability and diagnostic performance. To overcome the above problems, a deep sparse filtering network (DSFN) constructed by stacked sparse filtering is developed in this paper and applied to fault diagnosis. The developed DSFN is pre-trained by sparse filtering in an unsupervised way. The back-propagation algorithm is employed to optimize the DSFN after pre-training. Then, the DSFN-based intelligent fault diagnosis method is validated using two experiments. The results show that pre-training with sparse filtering and fine-tuning can help the DSFN search for the optimal network parameters, and the DSFN can learn discriminative features adaptively from rotating machinery datasets. Compared with classical methods, the developed diagnostic method can diagnose rotating machinery faults with higher accuracy using fewer training samples.

scholarly journals Identification of Pilots’ Fatigue Status Based on Electrocardiogram Signals

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3003
Author(s):  
Ting Pan ◽  
Haibo Wang ◽  
Haiqing Si ◽  
Yao Li ◽  
Lei Shang
Keyword(s):  
Back Propagation ◽  
Principal Component ◽  
Back Propagation Neural Network ◽  
Practical Significance ◽  
Support Vector ◽  
State Identification ◽  
Feature Parameter ◽  
The Time Domain ◽  
Pilot Fatigue ◽  
Identification Model

Fatigue is an important factor affecting modern flight safety. It can easily lead to a decline in pilots’ operational ability, misjudgments, and flight illusions. Moreover, it can even trigger serious flight accidents. In this paper, a wearable wireless physiological device was used to obtain pilots’ electrocardiogram (ECG) data in a simulated flight experiment, and 1440 effective samples were determined. The Friedman test was adopted to select the characteristic indexes that reflect the fatigue state of the pilot from the time domain, frequency domain, and non-linear characteristics of the effective samples. Furthermore, the variation rules of the characteristic indexes were analyzed. Principal component analysis (PCA) was utilized to extract the features of the selected feature indexes, and the feature parameter set representing the fatigue state of the pilot was established. For the study on pilots’ fatigue state identification, the feature parameter set was used as the input of the learning vector quantization (LVQ) algorithm to train the pilots’ fatigue state identification model. Results show that the recognition accuracy of the LVQ model reached 81.94%, which is 12.84% and 9.02% higher than that of traditional back propagation neural network (BPNN) and support vector machine (SVM) model, respectively. The identification model based on the LVQ established in this paper is suitable for identifying pilots’ fatigue states. This is of great practical significance to reduce flight accidents caused by pilot fatigue, thus providing a theoretical foundation for pilot fatigue risk management and the development of intelligent aircraft autopilot systems.

scholarly journals NLM-HS: Navigation Learning Model Based on a Hippocampal–Striatal Circuit for Explaining Navigation Mechanisms in Animal Brains

2021 ◽  
Vol 11 (6) ◽  
pp. 803
Author(s):  
Jie Chai ◽  
Xiaogang Ruan ◽  
Jing Huang
Keyword(s):  
Prefrontal Cortex ◽  
Learning Algorithm ◽  
Learning Model ◽  
Cognitive Map ◽  
Model Based ◽  
Animal Navigation ◽  
Environmental Cognition ◽  
Neurophysiological Studies ◽  
Planning Algorithm ◽  
Two Stages

Neurophysiological studies have shown that the hippocampus, striatum, and prefrontal cortex play different roles in animal navigation, but it is still less clear how these structures work together. In this paper, we establish a navigation learning model based on the hippocampal–striatal circuit (NLM-HS), which provides a possible explanation for the navigation mechanism in the animal brain. The hippocampal model generates a cognitive map of the environment and performs goal-directed navigation by using a place cell sequence planning algorithm. The striatal model performs reward-related habitual navigation by using the classic temporal difference learning algorithm. Since the two models may produce inconsistent behavioral decisions, the prefrontal cortex model chooses the most appropriate strategies by using a strategy arbitration mechanism. The cognitive and learning mechanism of the NLM-HS works in two stages of exploration and navigation. First, the agent uses a hippocampal model to construct the cognitive map of the unknown environment. Then, the agent uses the strategy arbitration mechanism in the prefrontal cortex model to directly decide which strategy to choose. To test the validity of the NLM-HS, the classical Tolman detour experiment was reproduced. The results show that the NLM-HS not only makes agents show environmental cognition and navigation behavior similar to animals, but also makes behavioral decisions faster and achieves better adaptivity than hippocampal or striatal models alone.

scholarly journals Stock Market Prediction Using Artificial Neural Networks

2012 ◽  
Vol 6-7 ◽  
pp. 1055-1060 ◽  
Author(s):  
Yang Bing ◽  
Jian Kun Hao ◽  
Si Chang Zhang
Keyword(s):  
Neural Network ◽  
Prediction Models ◽  
Learning Algorithm ◽  
Stock Exchange ◽  
Back Propagation ◽  
Composite Index ◽  
Network Models ◽  
Back Propagation Neural Network ◽  
Neural Network Models ◽  
The Neural Network

In this study we apply back propagation Neural Network models to predict the daily Shanghai Stock Exchange Composite Index. The learning algorithm and gradient search technique are constructed in the models. We evaluate the prediction models and conclude that the Shanghai Stock Exchange Composite Index is predictable in the short term. Empirical study shows that the Neural Network models is successfully applied to predict the daily highest, lowest, and closing value of the Shanghai Stock Exchange Composite Index, but it can not predict the return rate of the Shanghai Stock Exchange Composite Index in short terms.

The TP Chromatic Aberration Estimation by Using Neural Networks

2011 ◽  
Vol 121-126 ◽  
pp. 4239-4243 ◽  
Author(s):  
Du Jou Huang ◽  
Yu Ju Chen ◽  
Huang Chu Huang ◽  
Yu An Lin ◽  
Rey Chue Hwang
Keyword(s):  
Neural Networks ◽  
Learning Algorithm ◽  
Back Propagation ◽  
Physical Property ◽  
Chromatic Aberration ◽  
Neural Model ◽  
Artificial Intelligent ◽  
Error Back Propagation ◽  
The Neural Networks ◽  
Simulation Results

The chromatic aberration estimations of touch panel (TP) film by using neural networks are presented in this paper. The neural networks with error back-propagation (BP) learning algorithm were used to catch the complex relationship between the chromatic aberration, i.e., L.A.B. values, and the relative parameters of TP decoration film. An artificial intelligent (AI) estimator based on neural model for the estimation of physical property of TP film is expected to be developed. From the simulation results shown, the estimations of chromatic aberration of TP film are very accurate. In other words, such an AI estimator is quite promising and potential in commercial using.

scholarly journals Forecasting Gold Prices Based on Extreme Learning Machine

2016 ◽  
Vol 11 (3) ◽  
pp. 372 ◽  
Author(s):  
Kumar Chandar Sivalingam ◽  
Sumathi Mahendran ◽  
Sivanandam Natarajan
Keyword(s):  
Extreme Learning Machine ◽  
Learning Algorithm ◽  
Back Propagation ◽  
Learning Ability ◽  
Stock Index ◽  
Feed Forward Back Propagation ◽  
Crude Oil Prices ◽  
The Future ◽  
Good Learning ◽  
Learning Machine

<p>In recent years, the investors pay major attention to invest in gold market ecause of huge profits in the future. Gold is the only commodity which maintains ts value even in the economic and financial crisis. Also, the gold prices are closely elated with other commodities. The future gold price prediction becomes the warning ystem for the investors due to unforeseen risk in the market. Hence, an accurate gold rice forecasting is required to foresee the business trends. This paper concentrates on orecasting the future gold prices from four commodities like historical data’s of gold rices, silver prices, Crude oil prices, Standard and Poor’s 500 stock index (S&amp;P500) ndex and foreign exchange rate. The period used for the study is from 1st January 000 to 31st April 2014. In this paper, a learning algorithm for single hidden layered eed forward neural networks called Extreme Learning Machine (ELM) is used which as good learning ability. Also, this study compares the five models namely Feed orward networks without feedback, Feed forward back propagation networks, Radial asis function, ELMAN networks and ELM learning model. The results prove that he ELM learning performs better than the other methods.</p>

Sign in / Sign up

Export Citation Format

Share Document