IMAGE CAPTION GENERATION BASED ON SEMANTIC ATTENTION MECHANISM

2021 ◽  
Author(s):  
R. Yao ◽  
X. Wu ◽  
Z. Li ◽  
Y. Tong ◽  
Z. Jiang
Keyword(s):  
Attention Mechanism ◽  
Image Caption Generation ◽  
Image Caption

Spatial Relational Attention Using Fully Convolutional Networks for Image Caption Generation

2020 ◽  
Vol 19 (02) ◽  
pp. 2050011
Author(s):  
Teng Jiang ◽  
Liang Gong ◽  
Yupu Yang
Keyword(s):  
Spatial Relations ◽  
Image Features ◽  
Attention Mechanism ◽  
Convolutional Network ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Benchmark Datasets ◽  
Visual Concepts ◽  
Image Caption Generation ◽  
Image Caption

Attention-based encoder–decoder framework has greatly improved image caption generation tasks. The attention mechanism plays a transitional role by transforming static image features into sequential captions. To generate reasonable captions, it is of great significance to detect spatial characteristics of images. In this paper, we propose a spatial relational attention approach to consider spatial positions and attributes. Image features are firstly weighted by the attention mechanism. Then they are concatenated with contextual features to form a spatial–visual tensor. The tensor is feature extracted by a fully convolutional network to produce visual concepts for the decoder network. The fully convolutional layers maintain spatial topology of images. Experiments conducted on the three benchmark datasets, namely Flickr8k, Flickr30k and MSCOCO, demonstrate the effectiveness of our proposed approach. Captions generated by the spatial relational attention method precisely capture spatial relations of objects.

Image caption generation with dual attention mechanism

2020 ◽  
Vol 57 (2) ◽  
pp. 102178 ◽  
Author(s):  
Maofu Liu ◽  
Lingjun Li ◽  
Huijun Hu ◽  
Weili Guan ◽  
Jing Tian
Keyword(s):  
Attention Mechanism ◽  
Image Caption Generation ◽  
Image Caption

Image caption generation method based on adaptive attention mechanism

2020 ◽  
Author(s):  
Huazhong Jin ◽  
Yu Wu ◽  
Fang Wan ◽  
Man Hu ◽  
Qingqing Li
Keyword(s):  
Attention Mechanism ◽  
Image Caption Generation ◽  
Image Caption

Image Caption Generation using Object Attention Mechanism

2019 ◽  
Vol 46 (4) ◽  
pp. 369-375
Author(s):  
Da-Sol Park ◽  
Jeong-Won Cha
Keyword(s):  
Attention Mechanism ◽  
Object Attention ◽  
Image Caption Generation ◽  
Image Caption

Image Caption Generation Using Deep Learning

2018 ◽  
Vol 06 (10) ◽  
pp. 53-55
Author(s):  
Sailee P. Pawaskar ◽  
J. A. Laxminarayana
Keyword(s):  
Deep Learning ◽  
Image Caption Generation ◽  
Image Caption

Show, Rethink, And Tell: Image Caption Generation With Hierarchical Topic Cues

2021 ◽  
Author(s):  
Feng Chen ◽  
Songxian Xie ◽  
Xinyi Li ◽  
Jintao Tang ◽  
Kunyuan Pang ◽  
...  
Keyword(s):  
Image Caption Generation ◽  
Image Caption

The Accurate Guidance for Image Caption Generation

2018 ◽  
pp. 15-26
Author(s):  
Xinyuan Qi ◽  
Zhiguo Cao ◽  
Yang Xiao ◽  
Jian Wang ◽  
Chao Zhang
Keyword(s):  
Image Caption Generation ◽  
Image Caption

Image Caption Generator Using Attention Mechanism

2021 ◽  
Author(s):  
Vaishnavi Agrawal ◽  
Shariva Dhekane ◽  
Neha Tuniya ◽  
Vibha Vyas
Keyword(s):  
Attention Mechanism ◽  
Image Caption
Sign in / Sign up

Export Citation Format

Share Document