scholarly journals Matching Pursuit and Sparse Coding for Auditory Representation

IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Dung Kim Tran ◽  
Masashi Unoki
2019 ◽  
Vol 5 (11) ◽  
pp. 85 ◽  
Author(s):  
Ayan Chatterjee ◽  
Peter W. T. Yuen

This paper proposes a simple yet effective method for improving the efficiency of sparse coding dictionary learning (DL) with an implication of enhancing the ultimate usefulness of compressive sensing (CS) technology for practical applications, such as in hyperspectral imaging (HSI) scene reconstruction. CS is the technique which allows sparse signals to be decomposed into a sparse representation “a” of a dictionary D u . The goodness of the learnt dictionary has direct impacts on the quality of the end results, e.g., in the HSI scene reconstructions. This paper proposes the construction of a concise and comprehensive dictionary by using the cluster centres of the input dataset, and then a greedy approach is adopted to learn all elements within this dictionary. The proposed method consists of an unsupervised clustering algorithm (K-Means), and it is then coupled with an advanced sparse coding dictionary (SCD) method such as the basis pursuit algorithm (orthogonal matching pursuit, OMP) for the dictionary learning. The effectiveness of the proposed K-Means Sparse Coding Dictionary (KMSCD) is illustrated through the reconstructions of several publicly available HSI scenes. The results have shown that the proposed KMSCD achieves ~40% greater accuracy, 5 times faster convergence and is twice as robust as that of the classic Spare Coding Dictionary (C-SCD) method that adopts random sampling of data for the dictionary learning. Over the five data sets that have been employed in this study, it is seen that the proposed KMSCD is capable of reconstructing these scenes with mean accuracies of approximately 20–500% better than all competing algorithms adopted in this work. Furthermore, the reconstruction efficiency of trace materials in the scene has been assessed: it is shown that the KMSCD is capable of recovering ~12% better than that of the C-SCD. These results suggest that the proposed DL using a simple clustering method for the construction of the dictionary has been shown to enhance the scene reconstruction substantially. When the proposed KMSCD is incorporated with the Fast non-negative orthogonal matching pursuit (FNNOMP) to constrain the maximum number of materials to coexist in a pixel to four, experiments have shown that it achieves approximately ten times better than that constrained by using the widely employed TMM algorithm. This may suggest that the proposed DL method using KMSCD and together with the FNNOMP will be more suitable to be the material allocation module of HSI scene simulators like the CameoSim package.


2020 ◽  
pp. 92-101
Author(s):  
В’ячеслав Васильович Москаленко ◽  
Микола Олександрович Зарецький ◽  
Альона Сергіївна Москаленко ◽  
Антон Михайлович Кудрявцев ◽  
Віктор Анатолійович Семашко

The model and training method of multilayer feature extractor and decision rules for a malware traffic detector is proposed. The feature extractor model is based on a convolutional sparse coding network whose sparse encoder is approximated by a regression random forest model according to the principles of knowledge distillation. In this case, an algorithm of growing sparse coding neural gas has been developed for unsupervised training the features extractor with automatic determination of the required number of features on each layer. As for feature extractor, at the training phase to implement of sparse coding the greedy L1-regularized method of Orthogonal Matching Pursuit was used, and at the knowledge distillation phase, the L1-regularized method at the least angles (Least regression algorithm) was additionally used. Due to the explaining-away effect, the extracted features are uncorrelated and robust to noise and adversarial attacks. The proposed feature extractor is unsupervised trained to separate the explanatory factors and allows to use the unlabeled training data, which are usually quite large, with the maximum efficiency. As a model of the decision rules proposed to use the binary encoder of input observations based on an ensemble of decision trees and information-extreme closed hyper-surfaces (containers) for class separation, that are recovery in radial-basis of Hemming' binary space. The addition of coding trees is based on the boosting principle, and the radius of class containers is optimized by direct search. The information-extreme classifier is characterized by low computational complexity and high generalization capacity for small sets of labeled training data. The verification results of the trained model on open CTU test data sets confirm the suitability of the proposed algorithms for practical application since the accuracy of malware traffic detection is 96.1 %.


2021 ◽  
Author(s):  
Zhiliang Xing

Sparse Representation is a topic that has been gaining popularity in recent years due to its efficiency, performance and its applications in communication and data extraction fields. A number of algorithms exist that can be used to implement sparse coding techniques in different fields which include K-SVD, ODL, OMP etc. In this project one of the most popular sparse algorithms, the OMP (Orthogonal Matching Pursuit) technique, is investigatedin depth. Since OMP is not capable of finding the global optimum, a Top-Down Search (TDS) algorithm is proposed in this project to achieve much better results by sacrificing the execution time. Another contribution of this project is to investigate the properties of dictionary by modifying the frequency and shifting the phase of a standard Discrete Cosine Transfer (DCT) dictionary. The results of this project show that the performance of sparse coding algorithm still has room for improvement using new techniques.


2021 ◽  
Author(s):  
Zhiliang Xing

Sparse Representation is a topic that has been gaining popularity in recent years due to its efficiency, performance and its applications in communication and data extraction fields. A number of algorithms exist that can be used to implement sparse coding techniques in different fields which include K-SVD, ODL, OMP etc. In this project one of the most popular sparse algorithms, the OMP (Orthogonal Matching Pursuit) technique, is investigatedin depth. Since OMP is not capable of finding the global optimum, a Top-Down Search (TDS) algorithm is proposed in this project to achieve much better results by sacrificing the execution time. Another contribution of this project is to investigate the properties of dictionary by modifying the frequency and shifting the phase of a standard Discrete Cosine Transfer (DCT) dictionary. The results of this project show that the performance of sparse coding algorithm still has room for improvement using new techniques.


2019 ◽  
Vol 7 (1) ◽  
pp. 277-282
Author(s):  
Mohammadi Aiman ◽  
Ruksar Fatima

Sign in / Sign up

Export Citation Format

Share Document