scholarly journals Image Matching via Loopy RNN

2017 ◽  
Author(s):  
Donghao Luo ◽  
Bingbing Ni ◽  
Yichao Yan ◽  
Xiaokang Yang
Keyword(s):  
Image Matching ◽  
Short Term Memory ◽  
Vision System ◽  
Feature Representation ◽  
Image Feature ◽  
Matching Process ◽  
Head Node ◽  
Long Short Term Memory ◽  
Input Gate ◽  
Matching Score

Most existing matching algorithms are one-off algorithms, i.e., they usually measure the distance between the two image feature representation vectors for only one time. In contrast, human's vision system achieves this task, i.e., image matching, by recursively looking at specific/related parts of both images and then making the final judgement. Towards this end, we propose a novel loopy recurrent neural network (Loopy RNN), which is capable of aggregating relationship information of two input images in a progressive/iterative manner and outputting the consolidated matching score in the final iteration. A Loopy RNN features two uniqueness. First, built on conventional long short-term memory (LSTM) nodes, it links the output gate of the tail node to the input gate of the head node, thus it brings up symmetry property required for matching. Second, a monotonous loss designed for the proposed network guarantees increasing confidence during the recursive matching process. Extensive experiments on several image matching benchmarks demonstrate the great potential of the proposed method.

scholarly journals A new image encryption algorithm based on the OF-LSTMS and chaotic sequences

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Yi He ◽  
Ying-Qian Zhang ◽  
Xin He ◽  
Xing-Yuan Wang
Keyword(s):  
Image Encryption ◽  
Fractional Order ◽  
Chaotic System ◽  
Short Term Memory ◽  
Encryption Algorithm ◽  
Chaotic Sequences ◽  
Long Short Term Memory ◽  
Input Gate ◽  
And Diffusion ◽  
Image Encryption Algorithm

AbstractIn this paper, a novel image encryption algorithm based on the Once Forward Long Short Term Memory Structure (OF-LSTMS) and the Two-Dimensional Coupled Map Lattice (2DCML) fractional-order chaotic system is proposed. The original image is divided into several image blocks, each of which is input into the OF-LSTMS as a pixel sub-sequence. According to the chaotic sequences generated by the 2DCML fractional-order chaotic system, the parameters of the input gate, output gate and memory unit of the OF-LSTMS are initialized, and the pixel positions are changed at the same time of changing the pixel values, achieving the synchronization of permutation and diffusion operations, which greatly improves the efficiency of image encryption and reduces the time consumption. In addition the 2DCML fractional-order chaotic system has better chaotic ergodicity and the values of chaotic sequences are larger than the traditional chaotic system. Therefore, it is very suitable to image encryption. Many simulation results show that the proposed scheme has higher security and efficiency comparing with previous schemes.

Implementation of Verification and Matching E-KTP with Faster R-CNN and ORB

2021 ◽  
Vol 5 (4) ◽  
pp. 783-793
Author(s):  
Muhammad Muttabi Hudaya ◽  
Siti Saadah ◽  
Hendy Irawan
Keyword(s):  
Image Matching ◽  
Nearest Neighbor ◽  
Feature Matching ◽  
Image Feature ◽  
Brute Force ◽  
K Nearest Neighbor ◽  
Matching Method ◽  
Average Precision ◽  
Detection Model ◽  
Matching Process

needs a solid validation that has verification and matching uploaded images. To solve this problem, this paper implementing a detection model using Faster R-CNN and a matching method using ORB (Oriented FAST and Rotated BRIEF) and KNN-BFM (K-Nearest Neighbor Brute Force Matcher). The goal of the implementations is to reach both an 80% mark of accuracy and prove matching using ORB only can be a replaced OCR technique. The implementation accuracy results in the detection model reach mAP (Mean Average Precision) of 94%. But, the matching process only achieves an accuracy of 43,46%. The matching process using only image feature matching underperforms the previous OCR technique but improves processing time from 4510ms to 60m). Image matching accuracy has proven to increase by using a high-quality dan high quantity dataset, extracting features on the important area of EKTP card images.

scholarly journals Predicting remaining useful life of rolling bearings based on deep feature representation and long short-term memory neural network

2018 ◽  
Vol 10 (12) ◽  
pp. 168781401881718 ◽  
Author(s):  
Wentao Mao ◽  
Jianliang He ◽  
Jiamei Tang ◽  
Yuan Li
Keyword(s):  
Neural Network ◽  
Life Prediction ◽  
Short Term Memory ◽  
Degradation Process ◽  
Remaining Useful Life ◽  
Feature Representation ◽  
Short Term ◽  
Term Memory ◽  
Useful Life ◽  
Long Short Term Memory

For bearing remaining useful life prediction problem, the traditional machine-learning-based methods are generally short of feature representation ability and incapable of adaptive feature extraction. Although deep-learning-based remaining useful life prediction methods proposed in recent years can effectively extract discriminative features for bearing fault, these methods tend to less consider temporal information of fault degradation process. To solve this problem, a new remaining useful life prediction approach based on deep feature representation and long short-term memory neural network is proposed in this article. First, a new criterion, named support vector data normalized correlation coefficient, is proposed to automatically divide the whole bearing life as normal state and fast degradation state. Second, deep features of bearing fault with good representation ability can be obtained from convolutional neural network by means of the marginal spectrum in Hilbert–Huang transform of raw vibration signals and health state label. Finally, by considering the temporal information of degradation process, these features are fed into a long short-term memory neural network to construct a remaining useful life prediction model. Experiments are conducted on bearing data sets of IEEE PHM Challenge 2012. The results show the significance of performance improvement of the proposed method in terms of predictive accuracy and numerical stability.

scholarly journals DETECTING AND DISCARDING OF SHADOWS IN IMAGE USING GEOMETRIC CONTOURS AND REGION BASED SEGMENTATION USING THRESHOLDING APPROACH

2015 ◽  
Vol 3 (2) ◽  
pp. 13-19
Author(s):  
Shanthi S ◽  
Vinothini K. R ◽  
Manikandan
Keyword(s):  
Image Matching ◽  
Feature Vector ◽  
Active Contours ◽  
Feature Representation ◽  
Shadow Detection ◽  
Image Feature ◽  
Traditional Model ◽  
Image Feature Extraction ◽  
Segmentation Methods ◽  
Geometric Active Contours

Shadow detection and removal is an important task when dealing with color outdoor images. Shadows are generated by a local and relative absence of light. Most shadow detection and segmentation methods are based on image analysis. However, some factors will affect the detection result due to the complexity of the circumstances.In this paper, a new algorithm for shadow detection and isolation of buildings in high-resolution panchromatic satellite imagery is proposed. This algorithm is based on tailoring the traditional model of the geometric active contours such that the new model of the contours is systematically biased toward segmenting the shadow and the dark regions in the image. Feature extraction a type of dimensionality reduction that efficiently represents interesting parts of an image as a compact feature vector. This approach is useful when image sizes are large and a reduced feature representation is required to quickly complete tasks such as image matching and retrieval.

A novel long short-term memory network for lithium-ion battery health diagnosis using charging curve

2021 ◽  
pp. 014233122110409
Author(s):  
Mingqiang Lin ◽  
Denggao Wu ◽  
Gengfeng Zheng ◽  
Ji Wu
Keyword(s):  
Lithium Ion Batteries ◽  
Short Term Memory ◽  
Lithium Ion ◽  
Short Term ◽  
Data Set ◽  
Term Memory ◽  
Battery Degradation ◽  
Memory Network ◽  
Long Short Term Memory ◽  
Input Gate

Lithium-ion batteries are widely used as the power source in electric vehicles. The state of health (SOH) diagnosis is very important for the safety and storage capacity of lithium-ion batteries. In order to accurately and robustly estimate lithium-ion battery SOH, a novel long short-term memory network (LSTM) based on the charging curve is proposed for SOH estimation in this work. Firstly, aging features that reflect the battery degradation phenomenon are extracted from the charging curves. Then, considering capture the long-term tendency of battery degradation, some improvements are made in the proposed LSTM model. The connection between the input gate and the output gate is added to better control output information of the memory cell. Meanwhile, the forget gate and input gate are coupled into a single update gate for selectively forgetting before the accumulation of information. To achieve more reliability and robustness of the SOH estimation method, the improved LSTM network is adaptively trained online by using a particle filter. Furthermore, to verify the effectiveness of the proposed method, we compare the proposed method with two data-driven methods on the public battery data set and the commercial battery data set. Experimental results demonstrate the proposed method can obtain the highest SOH accuracy.

scholarly journals ROBUST MULTIMODAL IMAGE MATCHING BASED ON MAIN STRUCTURE FEATURE REPRESENTATION

2020 ◽  
Vol XLIII-B3-2020 ◽  
pp. 583-589
Author(s):  
Y. Fu ◽  
Y. Ye ◽  
G. Liu ◽  
B. Zhang ◽  
R. Zhang
Keyword(s):  
Image Matching ◽  
Template Matching ◽  
Feature Representation ◽  
Image Feature ◽  
Feature Descriptor ◽  
Phase Congruency ◽  
Main Structure ◽  
Structure Information ◽  
Remote Sensing Image Processing ◽  
Multimodal Images

Abstract. Image matching is a crucial procedure for multimodal remote sensing image processing. However, the performance of conventional methods is often degraded in matching multimodal images due to significant nonlinear intensity differences. To address this problem, this letter proposes a novel image feature representation named Main Structure with Histogram of Orientated Phase Congruency (M-HOPC). M-HOPC is able to precisely capture similar structure properties between multimodal images by reinforcing the main structure information for the construction of the phase congruency feature description. Specifically, each pixel of an image is assigned an independent weight for feature descriptor according to the main structure such as large contours and edges. Then M-HOPC is integrated as the similarity measure for correspondence detection by a template matching scheme. Three pairs of multimodal images including optical, LiDAR, and SAR data have been used to evaluate the proposed method. The results show that M-HOPC is robust to nonlinear intensity differences and achieves the superior matching performance compared with other state-of-the-art methods.

scholarly journals Forecasting Variation Trends of Stocks via Multiscale Feature Fusion and Long Short-Term Memory Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Yezhen Liu ◽  
Xilong Yu ◽  
Yanhua Wu ◽  
Shuhong Song
Keyword(s):  
Short Term Memory ◽  
Feature Fusion ◽  
Feature Representation ◽  
Data Sets ◽  
Short Term ◽  
Term Memory ◽  
History Data ◽  
Gate Structure ◽  
Validity Indices ◽  
Long Short Term Memory

Forecasting stock price trends accurately appears a huge challenge because the environment of stock markets is extremely stochastic and complicated. This challenge persistently motivates us to seek reliable pathways to guide stock trading. While the Long Short-Term Memory (LSTM) network has the dedicated gate structure quite suitable for the prediction based on contextual features, we propose a novel LSTM-based model. Also, we devise a multiscale convolutional feature fusion mechanism for the model to extensively exploit the contextual relationships hidden in consecutive time steps. The significance of our designed scheme is twofold. (1) Benefiting from the gate structure designed for both long- and short-term memories, our model can use the given stock history data more adaptively than traditional models, which greatly guarantees the prediction performance in financial time series (FTS) scenarios and thus profits the prediction of stock trends. (2) The multiscale convolutional feature fusion mechanism can diversify the feature representation and more extensively capture the FTS feature essence than traditional models, which fairly facilitates the generalizability. Empirical studies conducted on three classic stock history data sets, i.e., S&P 500, DJIA, and VIX, demonstrated the effectiveness and stability superiority of the suggested method against a few state-of-the-art models using multiple validity indices. For example, our method achieved the highest average directional accuracy (around 0.71) on the three employed stock data sets.

scholarly journals Implementasi Deep Learning Menggunakan Arsitektur Long Short Term Memory(LSTM) Untuk Prediksi Curah Hujan Kota Malang

Repositor ◽  
2020 ◽  
Vol 2 (3) ◽  
pp. 331
Author(s):  
Muhammad Rizki ◽  
Setio Basuki ◽  
Yufis Azhar
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Daily Activities ◽  
Learning Method ◽  
Short Term ◽  
Term Memory ◽  
Weather Forecasts ◽  
Long Short Term Memory ◽  
Input Gate ◽  
Gate Input

AbstrakTidak selamanya cuaca di Indonesia berjalan dengan normal atau sesuai dengan musimnya, cuaca sering berubah secara tiba-tiba setiap saat karena ada faktor-faktor yang mempengaruhi penurunan dan peningkatan curah hujan. perkiraan cuaca sangatlah dibutuhkan dan sangat bermanfaat olah berbagai pihak karena bisa menjadi acuan bagi berbagai kalangan untuk menjalani kegiatan mereka sehari-hari. Penelitian dilakukan menggunakan metode Deep Learning karena dari beberapa penelitian sebelumnya yang menggunakan Deep Learning dalam kasus yang berbeda mampu menghasilkan akurasi diatas 85%. Deep learning adalah jaringan yang terdiri dari beberapa layer. Layer-layer tersebut berasal dari kumpulan node-node. Arsitektur yang digunakan yaitu Long Short Term Memory(LSTM) karena pada penelitian-penelitian sebelumnya menggunakan LSTM dalam kasus yang berbeda mendapat hasil yang baik yaitu RME yang dihasilkan kecil. LSTM memiliki struktur seperti rantai dan struktur pada tiap sel terdapat 3 gate yaitu forget gate, input gate, dan output gate. Oleh karena itu, perhitungan yang dilakukan lebih kompleks ditambah lagi dengan Deep Learning diharapkan mendapat hasil yang lebih akurat. Data yang digunakan yaitu data curah hujan kota Malang yang berasal dari BMKG. Abstract The weather in Indonesia does not always run normally or in accordance with the season, the weather often changes suddenly at any time because there are factors that affect the decrease and increase in rainfall. weather forecasts are needed and very useful if the various parties because it can be a reference for various circles to undergo their daily activities. The study was conducted using Deep Learning method because of some previous research using Deep Learning in different cases able to produce accuracy above 85%. Deep learning is a network consisting of several layers. The layers are derived from a collection of nodes. The architecture used is Long Short Term Memory (LSTM) because in previous studies using LSTM in different case got good result that is small generated RME. LSTM has a structure like chains and structures in each cell there are 3 gates of forget gate, input gate, and output gate. Therefore, the calculations performed more complex plus the Deep Learning is expected to get more accurate results. The data used is the rainfall data of Malang city that comes from BMKG. 

Sign in / Sign up

Export Citation Format

Share Document