Event-centric multi-modal fusion method for dense video captioning

2021 ◽  
Author(s):  
Zhi Chang ◽  
Dexin Zhao ◽  
Huilin Chen ◽  
Jingdan Li ◽  
Pengfei Liu
Keyword(s):  
Fusion Method ◽  
Video Captioning

Color fusion method for night vision based on YUV space

2011 ◽  
Vol 30 (12) ◽  
pp. 3222-3224
Author(s):  
Xiao-yan QIAN ◽  
Lei HAN ◽  
Bang-feng WANG
Keyword(s):  
Night Vision ◽  
Fusion Method ◽  
Color Fusion

Fault Classification of Hydroelectric Generating Unit Based on Improved Evidence Theory

2014 ◽  
Vol 7 (1) ◽  
pp. 78-83 ◽  
Author(s):  
Jiatang Cheng ◽  
Li Ai ◽  
Zhimei Duan ◽  
Yan Xiong
Keyword(s):  
Fault Diagnosis ◽  
Information Fusion ◽  
Evidence Theory ◽  
Fault Classification ◽  
Fusion Method ◽  
Inconsistent Result ◽  
High Conflict

Aiming at the problem of the conventional vibration fault diagnosis technology with inconsistent result of a hydroelectric generating unit, an information fusion method was proposed based on the improved evidence theory. In this algorithm, the original evidence was amended by the credibility factor, and then the synthesis rule of standard evidence theory was utilized to carry out information fusion. The results show that the proposed method can obtain any definitive conclusion even if there is high conflict evidence in the synthesis evidence process, and may avoid the divergent phenomenon when the consistent evidence is fused, and is suitable for the fault classification of hydroelectric generating unit.

Image Fusion Method Based on Multi-scale Directional Fast Guided Filter and Convolutional Sparse Representation

2019 ◽  
Vol 12 (3) ◽  
pp. 263-269
Author(s):  
Liu Xian-Hong ◽  
Chen Zhi-Bin
Keyword(s):  
Image Fusion ◽  
Sparse Representation ◽  
Filter Bank ◽  
Guided Filter ◽  
Fusion Method ◽  
Edge Preserving ◽  
Directional Information ◽  
Multi Scale ◽  
Directional Filter ◽  
Image Fusion Method

Background: A multi-scale multidirectional image fusion method is proposed, which introduces the Nonsubsampled Directional Filter Bank (NSDFB) into the multi-scale edge-preserving decomposition based on the fast guided filter. Methods: The proposed method has the advantages of preserving edges and extracting directional information simultaneously. In order to get better-fused sub-bands coefficients, a Convolutional Sparse Representation (CSR) based approximation sub-bands fusion rule is introduced and a Pulse Coupled Neural Network (PCNN) based detail sub-bands fusion strategy with New Sum of Modified Laplacian (NSML) to be the external input is also presented simultaneously. Results: Experimental results have demonstrated the superiority of the proposed method over conventional methods in terms of visual effects and objective evaluations. Conclusion: In this paper, combining fast guided filter and nonsubsampled directional filter bank, a multi-scale directional edge-preserving filter image fusion method is proposed. The proposed method has the features of edge-preserving and extracting directional information.

Reinforcement learning based data fusion method for multi-sensors

2020 ◽  
Vol 7 (6) ◽  
pp. 1489-1497
Author(s):  
Tongle Zhou ◽  
Mou Chen ◽  
Jie Zou
Keyword(s):  
Reinforcement Learning ◽  
Data Fusion ◽  
Fusion Method

Understanding temporal structure for video captioning

2019 ◽  
Vol 23 (1) ◽  
pp. 147-159
Author(s):  
Shagan Sah ◽  
Thang Nguyen ◽  
Ray Ptucha
Keyword(s):  
Temporal Structure ◽  
Video Captioning

scholarly journals Correction to: Attention based video captioning framework for Hindi

2021 ◽  
Author(s):  
Alok Singh ◽  
Thoudam Doren Singh ◽  
Sivaji Bandyopadhyay
Keyword(s):  
Video Captioning

SARF: A Simple, Adjustable, and Robust Fusion Method

2021 ◽  
pp. 1-5
Author(s):  
Xiangchao Meng ◽  
Gang Yang ◽  
Feng Shao ◽  
Weiwei Sun ◽  
Huanfeng Shen ◽  
...  
Keyword(s):  
Fusion Method

scholarly journals Relative Total Variation Structure Analysis-Based Fusion Method for Hyperspectral and LiDAR Data Classification

2021 ◽  
Vol 13 (6) ◽  
pp. 1143
Author(s):  
Yinghui Quan ◽  
Yingping Tong ◽  
Wei Feng ◽  
Gabriel Dauphin ◽  
Wenjiang Huang ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Total Variation ◽  
Structure Analysis ◽  
Hyperspectral Image ◽  
Gabor Filter ◽  
Heterogeneous Data ◽  
Lidar Data ◽  
Fusion Method ◽  
Wide Range ◽  
Relative Total Variation

The fusion of the hyperspectral image (HSI) and the light detecting and ranging (LiDAR) data has a wide range of applications. This paper proposes a novel feature fusion method for urban area classification, namely the relative total variation structure analysis (RTVSA), to combine various features derived from HSI and LiDAR data. In the feature extraction stage, a variety of high-performance methods including the extended multi-attribute profile, Gabor filter, and local binary pattern are used to extract the features of the input data. The relative total variation is then applied to remove useless texture information of the processed data. Finally, nonparametric weighted feature extraction is adopted to reduce the dimensions. Random forest and convolutional neural networks are utilized to evaluate the fusion images. Experiments conducted on two urban Houston University datasets (including Houston 2012 and the training portion of Houston 2017) demonstrate that the proposed method can extract the structural correlation from heterogeneous data, withstand a noise well, and improve the land cover classification accuracy.

Sign in / Sign up

Export Citation Format

Share Document