scholarly journals Analysis and measurement of internal usability metrics through code annotations

2019 ◽  
Vol 27 (4) ◽  
pp. 1505-1530
Author(s):  
Maximilian Schramme ◽  
José A. Macías
Keyword(s):  
Usability Metrics ◽  
Code Annotations

Correlation Between Gestures’ Qualitative Properties and Usa- bility metrics

2020 ◽  
Vol 64 (1) ◽  
pp. 726-730
Author(s):  
Daniela Chanci ◽  
Naveen Madapana ◽  
Glebys Gonzalez ◽  
Juan Wachs
Keyword(s):  
Linear Regression ◽  
User Satisfaction ◽  
Completion Time ◽  
User Study ◽  
Task Completion ◽  
Time Error ◽  
Qualitative Properties ◽  
Regression Techniques ◽  
Overall Efficiency ◽  
Usability Metrics

The choice of best gestures and commands for touchless interfaces is a critical step that determines the user- satisfaction and overall efficiency of surgeon computer interaction. In this regard, usability metrics such as task completion time, error rate, and memorability have a long-standing as potential entities in determining the best gesture vocabulary. In addition, some previous works concerned with this problem have utilized qualitative measures to identify the best gesture. In this work, we hypothesize that there is a correlation between the qualitative properties of gestures (v) and their usability metrics (u). Therefore, we conducted an experiment with linguists to quantify the properties of the gestures. Next, a user study was conducted with surgeons, and the usability metrics were measured. Lastly, linear and non-linear regression techniques were used to find the correlations between u and v. Results show that usability metrics are correlated with the gestures’ qualitative properties ( R2 = 0.4).

scholarly journals Investigating the Relationship Between Emotion Recognition Software and Usability Metrics

i-com ◽  
2020 ◽  
Vol 19 (2) ◽  
pp. 139-151
Author(s):  
Thomas Schmidt ◽  
Miriam Schlindwein ◽  
Katharina Lichtner ◽  
Christian Wolff
Keyword(s):  
Emotion Recognition ◽  
Regression Models ◽  
Affective Computing ◽  
Large Scale ◽  
General Purpose ◽  
Thinking Aloud ◽  
Continue Research ◽  
Usability Metrics ◽  
Recognition Software ◽  
The Relationship

AbstractDue to progress in affective computing, various forms of general purpose sentiment/emotion recognition software have become available. However, the application of such tools in usability engineering (UE) for measuring the emotional state of participants is rarely employed. We investigate if the application of sentiment/emotion recognition software is beneficial for gathering objective and intuitive data that can predict usability similar to traditional usability metrics. We present the results of a UE project examining this question for the three modalities text, speech and face. We perform a large scale usability test (N = 125) with a counterbalanced within-subject design with two websites of varying usability. We have identified a weak but significant correlation between text-based sentiment analysis on the text acquired via thinking aloud and SUS scores as well as a weak positive correlation between the proportion of neutrality in users’ voice and SUS scores. However, for the majority of the output of emotion recognition software, we could not find any significant results. Emotion metrics could not be used to successfully differentiate between two websites of varying usability. Regression models, either unimodal or multimodal could not predict usability metrics. We discuss reasons for these results and how to continue research with more sophisticated methods.

A Usability Comparison of SMS and IVR as Digital Banking Channels

2011 ◽  
Vol 7 (4) ◽  
pp. 1-16 ◽  
Author(s):  
Gareth Peevers ◽  
Gary Douglas ◽  
Mervyn A. Jack ◽  
Diarmid Marshall
Keyword(s):  
Repeated Measures ◽  
Rank Order ◽  
Consumer Trust ◽  
Mobile Banking ◽  
Completion Rates ◽  
Usability Problems ◽  
Older Users ◽  
Security Concerns ◽  
Usability Metrics ◽  
First Time

In this paper, the authors compare the usability of SMS mobile banking and automated IVR telephone banking. Participants (N = 116) used SMS banking and IVR banking to find their account balance in a repeated-measures experiment. IVR banking scored higher for usability metrics: effectiveness, attitude, and quality. There was no clear difference in rank order of preference between the two channels. Participants gave positive comments regarding speed and efficiency with SMS banking, but had serious doubts over the security of the SMS channel, impacting consumer trust in SMS banking. The authors argue that usability problems and security concerns are a major factor in the low adoption of SMS mobile banking. Older users were less positive in general to SMS banking compared with the more established IVR banking. Older users had lower first time completion rates for SMS banking and gave IVR banking higher attitude and quality scores.

scholarly journals Usability Measures in Mobile-Based Augmented Reality Learning Applications: A Systematic Review

2019 ◽  
Vol 9 (13) ◽  
pp. 2718 ◽  
Author(s):  
Kok Cheng Lim ◽  
Ali Selamat ◽  
Rose Alinda Alias ◽  
Ondrej Krejcar ◽  
Hamido Fujita
Keyword(s):  
Augmented Reality ◽  
Performance Metrics ◽  
Hybrid Technique ◽  
Content Quality ◽  
Boolean Search ◽  
Research Questions ◽  
Usability Metrics ◽  
Usability Data ◽  
Post Synthesis ◽  
Research Types

The implementation of usability in mobile augmented reality (MAR) learning applications has been utilized in a myriad of standards, methodologies, and techniques. The usage and combination of techniques within research approaches are important in determining the quality of usability data collection. The purpose of this study is to identify, study, and analyze existing usability metrics, methods, techniques, and areas in MAR learning. This study adapts systematic literature review techniques by utilizing research questions and Boolean search strings to identify prospective studies from six established databases that are related to the research context area. Seventy-two articles, consisting of 45 journals, 25 conference proceedings, and two book chapters, were selected through a systematic process. All articles underwent a rigorous selection protocol to ensure content quality according to formulated research questions. Post-synthesis and analysis, the output of this article discusses significant factors in usability-based MAR learning applications. This paper presents five identified gaps in the domain of study, modes of contributions, issues within usability metrics, technique approaches, and hybrid technique combinations. This paper concludes five recommendations based on identified gaps concealing potential of usability-based MAR learning research domains, varieties of unexplored research types, validation of emerging usability metrics, potential of performance metrics, and untapped correlational areas to be discovered.

Establishing the Link Between Usability and Student Satisfaction in Adaptive Online Learning

2016 ◽  
Vol 60 (1) ◽  
pp. 1976-1980 ◽  
Author(s):  
Thomas A. Stokes ◽  
Douglas J. Gillan ◽  
Jeffery P. Braden
Keyword(s):  
Student Satisfaction ◽  
Student Performance ◽  
Online Courses ◽  
Learning Experience ◽  
Ease Of Use ◽  
Perceived Usefulness ◽  
Course Delivery ◽  
Web Pages ◽  
Usability Metrics ◽  
Work Done

Online courses present a new element to learners in college courses. Interfaces (web pages) take the place of an instructor as the primary information delivery system. In other words, a student’s learning experience is now tied to the quality of a course’s human- computer interaction. One emerging method of online course delivery is an adaptive course that tailors to individual students needs, abilities, or preferences. There has been much work done on the algorithms that allow the course to adapt to individual students, but there seems to be a lack of research into the usability of these interfaces and how their quality affects student performance and satisfaction. This paper presents some of the data that was collected in a larger, grant-supported project and establishes relationships between usability metrics (ease of use and perceived usefulness) and student satisfaction and outcome measures in adaptive-online courses.

scholarly journals SOCA-DSEM: A well-structured SOCA development systems engineering methodology

2019 ◽  
Vol 16 (1) ◽  
pp. 19-44 ◽  
Author(s):  
Laura Rodriguez-Martinez ◽  
Hector Duran-Limon ◽  
Manuel Mora ◽  
Francisco Rodriguez
Keyword(s):  
Software Engineering ◽  
Systems Engineering ◽  
Preliminary Results ◽  
Service Oriented Computing ◽  
Service Oriented ◽  
Empirical Tests ◽  
Usability Metrics ◽  
Theoretical Foundations

Service-oriented Software Engineering (SOSE) is a software engineering paradigm focused on Service-oriented Computing Applications (SOCAs), for what SOCA development methodologies are required. Recent studies on SOCA development methodologies revealed theoretical and practical deficiencies. Thus, academicians and practitioners must adapt development methodologies from other paradigms or use the available partial SOCA development methodologies. Also, since the high acceptance of agile approaches, we claim new well-structured and balanced agility-rigor methodologies are required. Then, this paper proposes a new SOCA Development Systems Engineering Methodology, including its description, the explanation of its theoretical foundations and the illustration of its use with a prototype of a running example. Two pilot empirical evaluations on usability metrics are also reported. Findings support both theoretical adequacy and positive perceptions from the evaluators. While further empirical tests are required for gaining more conclusive evidences our preliminary results are encouraging.

scholarly journals Quality Improvement in Annotated Code

2010 ◽  
Vol 13 (2) ◽  
Author(s):  
Diego A. A. Correia ◽  
Eduardo M. Guerra ◽  
Fabio F. Silveira ◽  
Clovis T. Fernandes
Keyword(s):  
Quality Improvement ◽  
Open Source ◽  
Quantitative Assessment ◽  
Software Metrics ◽  
Open Source Tool ◽  
Code Annotations

In order to customize their behavior at runtime, a wide sort of modern frameworks do use code annotations at the applications‟ classes as metadata configuration. However, despite its popularity, this type of metadata definition inserts complexity and semantic coupling that is ignored by traditional software metrics. This paper presents identified bad smells in annotated code and defines new metrics that help in their detection by enabling a quantitative assessment of complexity and coupling in this type of code. Moreover, it proposes some strategies to detect those bad smells by using the defined metrics and introduces an open-source tool created to automate the process of bad smell discovery on annotated code.

Sign in / Sign up

Export Citation Format

Share Document