scholarly journals Cross-Modality Semantic Integration With Hypothesis Rescoring for Robust Interpretation of Multimodal User Interactions

2009 ◽  
Vol 17 (3) ◽  
pp. 486-500 ◽  
Author(s):  
Pui-Yu Hui ◽  
Helen M. Meng
Author(s):  
Alan L. V. Guedes ◽  
Sergio Colcher

Multimedia languages traditionally, they focus on synchronizing a multimedia presentation (based on media and time abstractions) and on supporting user interactions for a single user, usually limited to keyboard and mouse input. Recent advances in recognition technologies, however, have given rise to a new class of multimodal user interfaces (MUIs). In short, MUIs process two or more combined user input modalities (e.g. speech, pen, touch, gesture, gaze, and head and body movements) in a coordinated manner with output modalities . An individual input modality corresponds to a specific type of user-generated information captured by input devices (e.g. speech, pen) or sensors (e.g. motion sensor). An individual output modality corresponds to user-consumed information through stimuli captured by human senses. The computer system produces those stimuli through audiovisual or actuation devices (e.g. tactile feedback). In this proposal, we aim at extending the NCL multimedia language to take advantage of multimodal features.


2016 ◽  
Vol 76 (4) ◽  
pp. 5691-5720 ◽  
Author(s):  
Álan Lívio Vasconcelos Guedes ◽  
Roberto Gerson de Albuquerque Azevedo ◽  
Simone Diniz Junqueira Barbosa

2011 ◽  
Author(s):  
Seokchan Yun ◽  
Heungseok Do ◽  
Jinuk Jung ◽  
Song Mina ◽  
Namgoong Hyun ◽  
...  

2020 ◽  
Vol 15 ◽  
Author(s):  
Omer Irshad ◽  
Muhammad Usman Ghani Khan

Aim: To facilitate researchers and practitioners for unveiling the mysterious functional aspects of human cellular system through performing exploratory searching on semantically integrated heterogeneous and geographically dispersed omics annotations. Background: Improving health standards of life is one of the motives which continuously instigates researchers and practitioners to strive for uncovering the mysterious aspects of human cellular system. Inferring new knowledge from known facts always requires reasonably large amount of data in well-structured, integrated and unified form. Due to the advent of especially high throughput and sensor technologies, biological data is growing heterogeneously and geographically at astronomical rate. Several data integration systems have been deployed to cope with the issues of data heterogeneity and global dispersion. Systems based on semantic data integration models are more flexible and expandable than syntax-based ones but still lack aspect-based data integration, persistence and querying. Furthermore, these systems do not fully support to warehouse biological entities in the form of semantic associations as naturally possessed by the human cell. Objective: To develop aspect-oriented formal data integration model for semantically integrating heterogeneous and geographically dispersed omics annotations for providing exploratory querying on integrated data. Method: We propose an aspect-oriented formal data integration model which uses web semantics standards to formally specify its each construct. Proposed model supports aspect-oriented representation of biological entities while addressing the issues of data heterogeneity and global dispersion. It associates and warehouses biological entities in the way they relate with Result: To show the significance of proposed model, we developed a data warehouse and information retrieval system based on proposed model compliant multi-layered and multi-modular software architecture. Results show that our model supports well for gathering, associating, integrating, persisting and querying each entity with respect to its all possible aspects within or across the various associated omics layers. Conclusion: Formal specifications better facilitate for addressing data integration issues by providing formal means for understanding omics data based on meaning instead of syntax


2021 ◽  
Vol 39 (2) ◽  
pp. 1-29
Author(s):  
Qingyao Ai ◽  
Tao Yang ◽  
Huazheng Wang ◽  
Jiaxin Mao

How to obtain an unbiased ranking model by learning to rank with biased user feedback is an important research question for IR. Existing work on unbiased learning to rank (ULTR) can be broadly categorized into two groups—the studies on unbiased learning algorithms with logged data, namely, the offline unbiased learning, and the studies on unbiased parameters estimation with real-time user interactions, namely, the online learning to rank. While their definitions of unbiasness are different, these two types of ULTR algorithms share the same goal—to find the best models that rank documents based on their intrinsic relevance or utility. However, most studies on offline and online unbiased learning to rank are carried in parallel without detailed comparisons on their background theories and empirical performance. In this article, we formalize the task of unbiased learning to rank and show that existing algorithms for offline unbiased learning and online learning to rank are just the two sides of the same coin. We evaluate eight state-of-the-art ULTR algorithms and find that many of them can be used in both offline settings and online environments with or without minor modifications. Further, we analyze how different offline and online learning paradigms would affect the theoretical foundation and empirical effectiveness of each algorithm on both synthetic and real search data. Our findings provide important insights and guidelines for choosing and deploying ULTR algorithms in practice.


Author(s):  
Alexander Bigazzi ◽  
Gurdiljot Gill ◽  
Meghan Winters

Assessments of interactions between road users are crucial to understanding comfort and safety. However, observers may vary in their perceptions and ratings of road user interactions. The objective of this paper is to examine how perceptions of yielding, comfort, and safety for pedestrian interactions vary among observers, ranging from members of the public to road safety experts. Video clips of pedestrian interactions with motor vehicles and bicycles were collected from 11 crosswalks and shown to three groups of participants (traffic safety experts, an engaged citizen advisory group, and members of the general public) along with questions about yielding, comfort, and risk of injury. Experts had similar views of yielding and comfort to the other two groups, but a consistently lower assessment of injury risk for pedestrians in the study. Respondent socio-demographics did not relate to perceptions of yielding, comfort, or risk, but self-reported travel habits did. Respondents who reported walking more frequently rated pedestrian comfort as lower, and respondents who reported cycling more frequently rated risk as lower for pedestrian interactions with both motor vehicles and bicycles. Findings suggest small groups of engaged citizens can provide useful information about public perspectives on safety that likely diverge from expert assessments of risk, and that sample representation should be assessed in relation to travel habits rather than socio-demographics.


2021 ◽  
Vol 9 (6) ◽  
pp. 572
Author(s):  
Luca Di Di Angelo ◽  
Francesco Duronio ◽  
Angelo De De Vita ◽  
Andrea Di Di Mascio

In this paper, an efficient and robust Cartesian Mesh Generation with Local Refinement for an Immersed Boundary Approach is proposed, whose key feature is the capability of high Reynolds number simulations by the use of wall function models, bypassing the need for accurate boundary layer discretization. Starting from the discrete manifold model of the object to be analyzed, the proposed model generates Cartesian adaptive grids for a CFD simulation, with minimal user interactions; the most innovative aspect of this approach is that the automatic generation is based on the segmentation of the surfaces enveloping the object to be analyzed. The aim of this paper is to show that this automatic workflow is robust and enables to get quantitative results on geometrically complex configurations such as marine vehicles. To this purpose, the proposed methodology has been applied to the simulation of the flow past a BB2 submarine, discretized by non-uniform grid density. The obtained results are comparable with those obtained by classical body-fitted approaches but with a significant reduction of the time required for the mesh generation.


Sign in / Sign up

Export Citation Format

Share Document