A Usability Framework for the Design and Evaluation of Multimodal Interaction

2010 ◽  
pp. 196-216 ◽  
Author(s):  
Jaeseung Chang ◽  
Marie-Luce Bourguet
Keyword(s):  
Mobile Phone ◽  
Finite State Machine ◽  
Multimodal Interaction ◽  
Software Tools ◽  
State Machine ◽  
Multimodal Interfaces ◽  
User Testing ◽  
General Methodology ◽  
Finite State ◽  
Error Robustness

Currently, a lack of reliable methodologies for the design and evaluation of usable multimodal interfaces makes developing multimodal interaction systems a big challenge. In this paper, we present a usability framework to support the design and evaluation of multimodal interaction systems. First, elementary multimodal commands are elicited using traditional usability techniques. Next, based on the CARE (Complementarity, Assignment, Redundancy, and Equivalence) properties and the FSM (Finite State Machine) formalism, the original set of elementary commands is expanded to form a comprehensive set of multimodal commands. Finally, this new set of multimodal commands is evaluated in two ways: user-testing and error-robustness evaluation. This usability framework acts as a structured and general methodology both for the design and for the evaluation of multimodal interaction. We have implemented software tools and applied this methodology to the design of a multimodal mobile phone to illustrate the use and potential of the proposed framework.

scholarly journals APPLICATION OF THE FINITE STATE MACHINE METHOD IN ANDROID-BASED PANDEMIC NIGHTMARE GAME

2021 ◽  
Vol 5 (1) ◽  
pp. 291-298
Author(s):  
Muhammad Khafidh Aulia ◽  
Ali Mahmudi ◽  
Sentot Achmadi
Keyword(s):  
Artificial Intelligence ◽  
Finite State Machine ◽  
State Machine ◽  
Game Engine ◽  
User Testing ◽  
Test Device ◽  
Machine Method ◽  
Unity 3D ◽  
Finite State ◽  
Android Operating System

The Covid-19 pandemic has limited activities outside the home. One of the government's efforts to break the chain of spreading the Covid-19 virus is to urge people to stay at home and carry out all work and study activities online. To get rid of boredom during a pandemic, researchers took the initiative to make a game about teenage nightmares during a pandemic that can be played on Android devices. This research is the creation of an Android-based Pandemic Nightmare game. The method used is FSM (Finite State Machine) as the artificial intelligence of the NPC (Non Playable Character) character in the Pandemic Nightmare game. The need for the thesis product being developed includes Unity 3D as a game engine and Android as a test device. The results of this research are a product in the form of a game that can be run on devices with an Android operating system at least version 5.0 Lollipop. These products have features such as touch controls on the smartphone screen, NPCs that have artificial intelligence, items that can be collected at each level, sound settings, level selection, and fear features that can reduce player visibility. Based on the features contained in the Pandemic Nightmare game, all features can function properly and correctly. Based on user testing, it is known that the majority of users think the games developed are good. Based on the results of the study, it can be concluded that artificial intelligence with the FSM (Finite State Machine) method functions properly, the control buttons and menu buttons function properly. Based on user testing, the Pandemic Nightmare game is good and worth playing.

MARKOV MATHEMATICAL MODEL OF DYNAMIC ADAPTIVE TESTING OF AN ACTIVE AGENT

2018 ◽  
pp. 29-35
Author(s):  
N. V. Brovka ◽  
P. P. Dyachuk ◽  
M. V. Noskov ◽  
I. P. Peregudova
Keyword(s):  
Mathematical Model ◽  
Finite State Machine ◽  
Active Agent ◽  
Adaptive Testing ◽  
State Machine ◽  
Learning Activities ◽  
Independent Learning ◽  
Complex Object ◽  
Total Reward ◽  
Finite State

The problem and the goal.The urgency of the problem of mathematical description of dynamic adaptive testing is due to the need to diagnose the cognitive abilities of students for independent learning activities. The goal of the article is to develop a Markov mathematical model of the interaction of an active agent (AA) with the Liquidator state machine, canceling incorrect actions, which will allow mathematically describe dynamic adaptive testing with an estimated feedback.The research methodologyconsists of an analysis of the results of research by domestic and foreign scientists on dynamic adaptive testing in education, namely: an activity approach that implements AA developmental problem-solving training; organizational and technological approach to managing the actions of AA in terms of evaluative feedback; Markow’s theory of cement and reinforcement learning.Results.On the basis of the theory of Markov processes, a Markov mathematical model of the interaction of an active agent with a finite state machine, canceling incorrect actions, was developed. This allows you to develop a model for diagnosing the procedural characteristics of students ‘learning activities, including: building axiograms of total reward for students’ actions; probability distribution of states of the solution of the problem of identifying elements of the structure of a complex object calculate the number of AA actions required to achieve the target state depending on the number of elements that need to be identified; construct a scatter plot of active agents by target states in space (R, k), where R is the total reward AA, k is the number of actions performed.Conclusion.Markov’s mathematical model of the interaction of an active agent with a finite state machine, canceling wrong actions allows you to design dynamic adaptive tests and diagnostics of changes in the procedural characteristics of educational activities. The results and conclusions allow to formulate the principles of dynamic adaptive testing based on the estimated feedback.

PENERAPAN FINITE STATE MACHINE UNTUK PENGENDALIAN ANIMASI PADA VIDEO GAME RPG NUSANTARA LEGACY

2018 ◽  
Vol 3 (1) ◽  
pp. 1
Author(s):  
Mustofa Mustofa ◽  
Sidiq Sidiq ◽  
Eva Rahmawati
Keyword(s):  
Life Cycle ◽  
Video Game ◽  
Finite State Machine ◽  
Role Playing ◽  
State Machine ◽  
Game Development ◽  
Development Life Cycle ◽  
Finite State ◽  
Role Playing Game

Perkembangan dunia yang dinamis mendorong percepatan perkembangan teknologi dan informasi. Dengan dorongan tersebut komputer yang dulunya dibuat hanya untuk membantu pekerjaan manusia sekarang berkembang menjadi sarana hiburan, permainan, komunikasi dan lain sebagainya. Dalam sektor hiburan salah satu industri yang sedang menjadi pusat perhatian adalah industri video game. Begitu banyaknya produk video game asing yang masuk ke dalam negeri ini memberikan tantangan kepada bangsa ini. Tentunya video game asing yang masuk ke negara ini membawa banyak unsur kebudayaan negara lain. Ini semakin membuat kebudayaan nusantara semakin tergeserkan dengan serangan kebudayaan asing melalui berbagai media. Maka dari itu peneliti mencoba untuk menerapkan Finite State Machine dalam merancang sebuah video game RPG (Role-Playing game) yang memperkenalkan kebudayaan. Dalam perancangan video game ini peneliti menggunakan metode GDLC(Game Development Life Cycle) agar penelitian ini berjalan secara sistematis. Dalam suatu perancangan video game tedapat banyak elemen, pada penelitian ini penulis lebih fokus pada pengendalian animasi karakter yang dimainkan pada video game ini. Dari perancangan yang dilakukan, disimpulkan bahwa Finite State Machine dapat digunakan untuk pengendalian animasi yang baik pada video game RPG. Diharapkan video game ini dapat menjadi salah satu media untuk mengenalkan kebudayaan nusantara

Human action recognition using simple geometric features and a finite state machine

2013 ◽  
Vol 18 (2-3) ◽  
pp. 49-60 ◽  
Author(s):  
Damian Dudzńiski ◽  
Tomasz Kryjak ◽  
Zbigniew Mikrut
Keyword(s):  
Action Recognition ◽  
Finite State Machine ◽  
Recognition Rate ◽  
Human Action Recognition ◽  
Human Action ◽  
Video Stream ◽  
State Machine ◽  
Recognition Algorithm ◽  
Finite State ◽  
Correct Recognition Rate

Abstract In this paper a human action recognition algorithm, which uses background generation with shadow elimination, silhouette description based on simple geometrical features and a finite state machine for recognizing particular actions is described. The performed tests indicate that this approach obtains a 81 % correct recognition rate allowing real-time image processing of a 360 X 288 video stream.

User permission isolation model based on finite state machine

2013 ◽  
Vol 33 (1) ◽  
pp. 149-152
Author(s):  
Jianjun LI ◽  
Yixiang JIANG ◽  
Jie QIAN ◽  
Wei LI ◽  
Yu LI
Keyword(s):  
Finite State Machine ◽  
State Machine ◽  
Model Based ◽  
Finite State

scholarly journals Data Driven Modelling of Nuclear Power Plant Performance Data as Finite State Machines

Modelling ◽  
2021 ◽  
Vol 2 (1) ◽  
pp. 43-62
Author(s):  
Kshirasagar Naik ◽  
Mahesh D. Pandey ◽  
Anannya Panda ◽  
Abdurhman Albasir ◽  
Kunal Taneja
Keyword(s):  
Power Plant ◽  
Nuclear Power Plant ◽  
Nuclear Power ◽  
Finite State Machine ◽  
State Machine ◽  
Plant Performance ◽  
Series Data ◽  
Cyberphysical Systems ◽  
Finite State ◽  
Machine Representation

Accurate modelling and simulation of a nuclear power plant are important factors in the strategic planning and maintenance of the plant. Several nonlinearities and multivariable couplings are associated with real-world plants. Therefore, it is quite challenging to model such cyberphysical systems using conventional mathematical equations. A visual analytics approach which addresses these limitations and models both short term as well as long term behaviour of the system is introduced. Principal Component Analysis (PCA) followed by Linear Discriminant Analysis (LDA) is used to extract features from the data, k-means clustering is applied to label the data instances. Finite state machine representation formulated from the clustered data is then used to model the behaviour of cyberphysical systems using system states and state transitions. In this paper, the indicated methodology is deployed over time-series data collected from a nuclear power plant for nine years. It is observed that this approach of combining the machine learning principles with the finite state machine capabilities facilitates feature exploration, visual analysis, pattern discovery, and effective modelling of nuclear power plant data. In addition, finite state machine representation supports identification of normal and abnormal operation of the plant, thereby suggesting that the given approach captures the anomalous behaviour of the plant.

A finite state machine for Western Swing

1981 ◽  
Vol 16 (4) ◽  
pp. 33-35 ◽  
Author(s):  
Charles Crowley
Keyword(s):  
Finite State Machine ◽  
State Machine ◽  
Finite State
Sign in / Sign up

Export Citation Format

Share Document