Multimodal Fusion: Combining Visual and Textual Cues for Concept Detection in Video

2015 ◽  
pp. 295-310
Author(s):  
Damianos Galanopoulos ◽  
Milan Dojchinovski ◽  
Krishna Chandramouli ◽  
Tomáš Kliegr ◽  
Vasileios Mezaris
Keyword(s):  
Multimodal Fusion ◽  
Concept Detection ◽  
Textual Cues

A Visual Semantic Concept Detection Algorithm Based on E2LSH-MKL

2012 ◽  
Vol 38 (10) ◽  
pp. 1671
Author(s):  
Rui-Jie ZHANG ◽  
Zhi-Gang GUO ◽  
Bi-Cheng LI ◽  
Hao-Lin GAO
Keyword(s):  
Detection Algorithm ◽  
Semantic Concept ◽  
Concept Detection

scholarly journals A Crossmodal Approach to Multimodal Fusion in Video Hyperlinking

2018 ◽  
Vol 25 (2) ◽  
pp. 11-23 ◽  
Author(s):  
Vedran Vukotic ◽  
Christian Raymond ◽  
Guillaume Gravier
Keyword(s):  
Multimodal Fusion

scholarly journals What People Look at in Multimodal Online Dating Profiles: How Pictorial and Textual Cues Affect Impression Formation

2021 ◽  
pp. 009365022199531
Author(s):  
Tess van der Zanden ◽  
Maria B. J. Mos ◽  
Alexander P. Schouten ◽  
Emiel J. Krahmer
Keyword(s):  
Information Processing ◽  
Eye Tracking ◽  
Impression Formation ◽  
Online Dating ◽  
Information Processing Model ◽  
Secondary Role ◽  
Multimodal Information ◽  
Different Dimensions ◽  
Multimodal Information Processing ◽  
Textual Cues

This study investigates how online dating profiles, consisting of both pictures and texts, are visually processed, and how both components affect impression formation. The attractiveness of the profile picture was varied systematically, and texts either included language errors or not. By collecting eye tracking and perception data, we investigated whether picture attractiveness determines attention to the profile text and if the text plays a secondary role. Eye tracking results revealed that pictures are more likely to attract initial attention and that more attractive pictures receive more attention. Texts received attention regardless of the picture’s attractiveness. Moreover, perception data showed that both the pictorial and textual cues affect impression formation, but that they affect different dimensions of perceived attraction differently. Based on our results, a new multimodal information processing model is proposed, which suggests that pictures and texts are processed independently and lead to separate assessments of cue attractiveness before impression formation.

scholarly journals Multimodal Fusion for Indoor Sound Source Localization

2021 ◽  
pp. 107906
Author(s):  
Jinhui Chen ◽  
Ryoichi Takashima ◽  
Xingchen Guo ◽  
Zhihong Zhang ◽  
Xuexin Xu ◽  
...  
Keyword(s):  
Source Localization ◽  
Sound Source ◽  
Multimodal Fusion ◽  
Sound Source Localization

Ornament Image Retrieval Using Multimodal Fusion

2021 ◽  
Vol 2 (4) ◽  
Author(s):  
Sk Maidul Islam ◽  
Subhankar Joardar ◽  
Debi Prosad Dogra ◽  
Arif Ahmed Sekh
Keyword(s):  
Image Retrieval ◽  
Multimodal Fusion
Sign in / Sign up

Export Citation Format

Share Document