An Approach for Studying the Effect of High-Level Spatial Properties of 3D Audio in Interactive Systems

2009 ◽  
Author(s):  
Vladimir Ortega-Gonza´lez ◽  
Samir Garbaya ◽  
Fre´de´ric Merienne
Keyword(s):  
Interactive Systems ◽  
Experimental Methodology ◽  
Interactive Applications ◽  
3D Audio ◽  
Spatial Properties ◽  
Computer Interfaces ◽  
Human Computer Interfaces ◽  
Sound Spatialization ◽  
High Level

In this paper we briefly describe an approach for understanding the psychoacoustic and perceptual effects of what we have identified as the high-level spatial properties of 3D audio. The necessity of this study is firstly presented within the context of interactive applications such as Virtual Reality and Human Computer Interfaces. As a result of the bibliographic research in the field we identified the main potential functions of 3D audio spatial stimulation in interactive applications beyond traditional sound spatialization. In the same sense, a classification of the high-level aspects involved in spatial audio stimulation is proposed and explained. Immediately, the case of study, the experimental methodology and the framework are described. Finally, we present the expected results as well as their usefulness within the context of a larger project.

Embodied Conversation

2021 ◽  
pp. 1091-1107
Author(s):  
Andrej Zgank ◽  
Izidor Mlakar ◽  
Uros Berglez ◽  
Danilo Zimsek ◽  
Matej Borko ◽  
...  
Keyword(s):  
Language Processing ◽  
Automatic Speech Recognition ◽  
Speech Synthesis ◽  
Conversational Agents ◽  
Embodied Conversational Agent ◽  
Computer Interfaces ◽  
Human Computer Interfaces ◽  
Text To Speech Synthesis ◽  
High Level

The chapter presents an overview of human-computer interfaces, which are a crucial element of an ambient intelligence solution. The focus is given to the embodied conversational agents, which are needed to communicate with users in a most natural way. Different input and output modalities, with supporting methods, to process the captured information (e.g., automatic speech recognition, gesture recognition, natural language processing, dialog processing, text to speech synthesis, etc.), have the crucial role to provide the high level of quality of experience to the user. As an example, usage of embodied conversational agent for e-Health domain is proposed.

scholarly journals A review-classification of electrooculogram based human computer interfaces

2018 ◽  
Vol 29 (6) ◽  
Author(s):  
S Ramkumar ◽  
K Sathesh Kumar ◽  
T Dhiliphan Rajkumar ◽  
M Ilayaraja ◽  
K Shankar
Keyword(s):  
Computer Interfaces ◽  
Human Computer Interfaces

scholarly journals Computational Interaction

2018 ◽  
Keyword(s):  
Language Processing ◽  
User Interfaces ◽  
Interaction Design ◽  
Interactive Systems ◽  
Economic Modelling ◽  
Model Interaction ◽  
Computer Interfaces ◽  
Human Computer Interfaces ◽  
Wide Range ◽  
Software Engineers

This book presents computational interaction as an approach to explaining and enhancing the interaction between humans and information technology. Computational interaction applies abstraction, automation, and analysis to inform our understanding of the structure of interaction and also to inform the design of the software that drives new and exciting human-computer interfaces. The methods of computational interaction allow, for example, designers to identify user interfaces that are optimal against some objective criteria. They also allow software engineers to build interactive systems that adapt their behaviour to better suit individual capacities and preferences. Embedded in an iterative design process, computational interaction has the potential to complement human strengths and provide methods for generating inspiring and elegant designs. Computational interaction does not exclude the messy and complicated behaviour of humans, rather it embraces it by, for example, using models that are sensitive to uncertainty and that capture subtle variations between individual users. It also promotes the idea that there are many aspects of interaction that can be augmented by algorithms. This book introduces computational interaction design to the reader by exploring a wide range of computational interaction techniques, strategies and methods. It explains how techniques such as optimisation, economic modelling, machine learning, control theory, formal methods, cognitive models and statistical language processing can be used to model interaction and design more expressive, efficient and versatile interaction.

scholarly journals Open Software/Hardware Platform for Human-Computer Interface Based on Electrooculography (EOG) Signal Classification

Sensors ◽  
2020 ◽  
Vol 20 (9) ◽  
pp. 2443
Author(s):  
Jayro Martínez-Cerveró ◽  
Majid Khalili Ardali ◽  
Andres Jaramillo-Gonzalez ◽  
Shizhe Wu ◽  
Alessandro Tonin ◽  
...  
Keyword(s):  
Open Source ◽  
Raspberry Pi ◽  
Support Vector ◽  
Svm Classifier ◽  
Computer Interfaces ◽  
Human Computer Interfaces ◽  
Online Classification ◽  
Acquisition Device ◽  
Maximum Minimum

Electrooculography (EOG) signals have been widely used in Human-Computer Interfaces (HCI). The HCI systems proposed in the literature make use of self-designed or closed environments, which restrict the number of potential users and applications. Here, we present a system for classifying four directions of eye movements employing EOG signals. The system is based on open source ecosystems, the Raspberry Pi single-board computer, the OpenBCI biosignal acquisition device, and an open-source python library. The designed system provides a cheap, compact, and easy to carry system that can be replicated or modified. We used Maximum, Minimum, and Median trial values as features to create a Support Vector Machine (SVM) classifier. A mean of 90% accuracy was obtained from 7 out of 10 subjects for online classification of Up, Down, Left, and Right movements. This classification system can be used as an input for an HCI, i.e., for assisted communication in paralyzed people.

scholarly journals Feature Selection in Classification of Eye Movements Using Electrooculography for Activity Recognition

2014 ◽  
Vol 2014 ◽  
pp. 1-9 ◽  
Author(s):  
S. Mala ◽  
K. Latha
Keyword(s):  
Feature Selection ◽  
Eye Movements ◽  
Differential Evolution ◽  
Activity Recognition ◽  
Human Computer Interactions ◽  
Selection Algorithm ◽  
Computer Interfaces ◽  
Human Computer Interfaces ◽  
Computational Intelligence Methods

Activity recognition is needed in different requisition, for example, reconnaissance system, patient monitoring, and human-computer interfaces. Feature selection plays an important role in activity recognition, data mining, and machine learning. In selecting subset of features, an efficient evolutionary algorithm Differential Evolution (DE), a very efficient optimizer, is used for finding informative features from eye movements using electrooculography (EOG). Many researchers use EOG signals in human-computer interactions with various computational intelligence methods to analyze eye movements. The proposed system involves analysis of EOG signals using clearness based features, minimum redundancy maximum relevance features, and Differential Evolution based features. This work concentrates more on the feature selection algorithm based on DE in order to improve the classification for faultless activity recognition.

scholarly journals Semi-automated classification of colonial Microcystis by FlowCAM imaging flow cytometry in mesocosm experiment reveals high heterogeneity during seasonal bloom

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Yersultan Mirasbekov ◽  
Adina Zhumakhanova ◽  
Almira Zhantuyakova ◽  
Kuanysh Sarkytbayev ◽  
Dmitry V. Malashenkov ◽  
...  
Keyword(s):  
Machine Learning ◽  
Flow Cytometry ◽  
Spatial Resolution ◽  
Mesocosm Experiment ◽  
Imaging Flow Cytometry ◽  
Leibler Divergence ◽  
Temporal And Spatial ◽  
High Level ◽  
Training Sets

AbstractA machine learning approach was employed to detect and quantify Microcystis colonial morphospecies using FlowCAM-based imaging flow cytometry. The system was trained and tested using samples from a long-term mesocosm experiment (LMWE, Central Jutland, Denmark). The statistical validation of the classification approaches was performed using Hellinger distances, Bray–Curtis dissimilarity, and Kullback–Leibler divergence. The semi-automatic classification based on well-balanced training sets from Microcystis seasonal bloom provided a high level of intergeneric accuracy (96–100%) but relatively low intrageneric accuracy (67–78%). Our results provide a proof-of-concept of how machine learning approaches can be applied to analyze the colonial microalgae. This approach allowed to evaluate Microcystis seasonal bloom in individual mesocosms with high level of temporal and spatial resolution. The observation that some Microcystis morphotypes completely disappeared and re-appeared along the mesocosm experiment timeline supports the hypothesis of the main transition pathways of colonial Microcystis morphoforms. We demonstrated that significant changes in the training sets with colonial images required for accurate classification of Microcystis spp. from time points differed by only two weeks due to Microcystis high phenotypic heterogeneity during the bloom. We conclude that automatic methods not only allow a performance level of human taxonomist, and thus be a valuable time-saving tool in the routine-like identification of colonial phytoplankton taxa, but also can be applied to increase temporal and spatial resolution of the study.

scholarly journals Identification of Words and Phrases Through a Phonemic-Based Haptic Display

2021 ◽  
Vol 18 (3) ◽  
pp. 1-22
Author(s):  
Charlotte M. Reed ◽  
Hong Z. Tan ◽  
Yang Jiao ◽  
Zachary D. Perez ◽  
E. Courtenay Wilson
Keyword(s):  
Speech Communication ◽  
Haptic Display ◽  
Communication Aids ◽  
Remote Communication ◽  
Computer Interfaces ◽  
Speech Reception ◽  
Communication Device ◽  
Human Computer Interfaces ◽  
Sensory Impairments ◽  
Effective Transmission

Stand-alone devices for tactile speech reception serve a need as communication aids for persons with profound sensory impairments as well as in applications such as human-computer interfaces and remote communication when the normal auditory and visual channels are compromised or overloaded. The current research is concerned with perceptual evaluations of a phoneme-based tactile speech communication device in which a unique tactile code was assigned to each of the 24 consonants and 15 vowels of English. The tactile phonemic display was conveyed through an array of 24 tactors that stimulated the dorsal and ventral surfaces of the forearm. Experiments examined the recognition of individual words as a function of the inter-phoneme interval (Study 1) and two-word phrases as a function of the inter-word interval (Study 2). Following an average training period of 4.3 hrs on phoneme and word recognition tasks, mean scores for the recognition of individual words in Study 1 ranged from 87.7% correct to 74.3% correct as the inter-phoneme interval decreased from 300 to 0 ms. In Study 2, following an average of 2.5 hours of training on the two-word phrase task, both words in the phrase were identified with an accuracy of 75% correct using an inter-word interval of 1 sec and an inter-phoneme interval of 150 ms. Effective transmission rates achieved on this task were estimated to be on the order of 30 to 35 words/min.

Sign in / Sign up

Export Citation Format

Share Document