scholarly journals Usability Testing and Feedback Collection in a School Context: Case Poetry Machine

Author(s):  
Anna Kantosalo ◽  
Sirpa Riihiaho

Evaluation methods emphasizing children’s natural interaction help in getting feedback from children for product development. This paper presents a case study with 9- to 10-year-old children in a school context. The evaluated system was an artificial intelligence–based poetry writing system, and the methods used were peer tutoring with paired interviews and group testing with a new Feedback Game. The evaluation criteria included the number of usability problems, usefulness, and fun. The applicability of the methods is discussed along with the resources required. Peer tutoring revealed numerous problems, whereas group testing and the Feedback Game were quick to conduct and analyze.

OPSI ◽  
2021 ◽  
Vol 14 (2) ◽  
pp. 146
Author(s):  
Wakhid Nur Hidayat ◽  
Elly Wuryaningtyas Yunitasari ◽  
Patrisius Edi Prasetyo

In an increasingly competitive industrial environment, every company strives to increase the quality and efficiency of its product development process. PT. Udaka Indonesia, a clothing manufacturer, is experiencing raw material shortages that disrupt the company's production process. The goal of this research is to assess and segment the company's suppliers. The Best Worst Method (BWM) is employed for weighting criteria, and Fuzzy TOPSIS is used to rank alternative providers and subsequently segment them. The dimensions of capabilities (8 criteria with 26 sub-criteria) and willingness (4 criteria with 15 sub-criteria) make up the company's supplier evaluation criteria. The evaluation results suggest that suppliers A2, B2, C2, and D2 are the best in terms of capabilities for label accessories, stickers, paper tags, and polybags, respectively, while A1, B2, C2, and D2 are the best in terms of willingness. Supplier segmentation results show that segmentation 1 includes suppliers C1, B1, B3, and D1, segmentation 2 includes supplier A3, and segmentation 4 includes suppliers A1, A2, B2, B4, C2, and D2. 


2015 ◽  
Vol 43 (1) ◽  
pp. 195-210
Author(s):  
Joanna Rybka ◽  
Małgorzata Plechawska-Wójcik ◽  
Tomasz Tokarek

Abstract The popularity of telemedical applications has been increasing noticeably in recent years. Easy access to a variety of software products makes contemporary users concentrate not only on functionalities but also on the design of the Graphical User Interface (GUI) – its usefulness, ease of use, and intuitiveness. The objective of this study was to evaluate the GUI quality of selected telemedical applications dedicated to depressed patients and doctors providing medical care for this group of patients. Another aim of the paper was to propose and check assessment criteria applied to the evaluation experiment. To achieve this objective, the case study was based on two methods: expert analysis and cognitive walkthrough. The expert analysis study was conducted on three groups of users: user experience specialists, patients, and clinicians. Although the expert analysis method is usually dedicated to GUI design specialists, in this study, we also applied it to patient and physician groups. The results showed that there were no statistical differences between assessments carried out by those three groups of users. Applied testing criteria were revised with Nielsen’s heuristics. The proposed criteria helped to uncover many usability problems in several different areas during user tests. Further studies might be performed in order to strengthen accuracy and for completion of the proposed expert analysis evaluation criteria. However, our results show that the criteria we used seem to be robust enough to apply to both expert and end-user evaluations. Furthermore, multiple evaluation based on two different methods presented with better results, allowing not only problem identification but also verification.


2015 ◽  
Vol 13 (3) ◽  
pp. 350-368
Author(s):  
Mingxing Wu ◽  
Liya Wang ◽  
Ming Li ◽  
Huijun Long

Purpose – This paper aims to propose a novel method to predict and alleviate feature fatigue. Many products now are loaded with an extensive number of features. Adding more features to one product generally makes the product more attractive on the one hand but, on the other hand, may result in increasing difficulty to use the product. This phenomenon is called “feature fatigue”, which will lead to dissatisfaction and negative word-of-mouth (WOM). Feature fatigue will damage the brand’s long-term profit, and ultimately decrease the manufacturer’s customer equity. Thus, a problem of balancing the benefit of increasing “attractiveness” with the cost of decreasing “usability” exists. Design/methodology/approach – A novel method based on the Bass model is proposed to predict and alleviate feature fatigue. Product capability, usability and WOM effects are integrated into the Bass model to predict the impacts of adding features on customer equity in product development, thus helping designers alleviate feature fatigue. A case study of mobile phone development based on survey data is presented to illustrate and validate the proposed method. Findings – The results of the case study demonstrate that adding more features indeed increases initial sales; however, adding too many features ultimately decreases customer equity due to usability problems. There is an optimal feature combination a product should include to balance product capability with usability. The proposed method makes a trade-off between initial sales and long-term profits to maximize customer equity. Originality/value – The proposed method can help designers predict the impacts of adding features on customer equity in the early stages of product development. It can provide decision supports for designers to decide what features should be added to maximize customer equity, thus alleviating feature fatigue.


2017 ◽  
Vol 8 (5) ◽  
pp. 1-17
Author(s):  
Aires Jorge Alberto Sandi ◽  
◽  
Giacaglia Giorgio Eugenio Oscare ◽  

2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Greta Kaluzeviciute

AbstractSystematic case studies are often placed at the low end of evidence-based practice (EBP) due to lack of critical appraisal. This paper seeks to attend to this research gap by introducing a novel Case Study Evaluation-tool (CaSE). First, issues around knowledge generation and validity are assessed in both EBP and practice-based evidence (PBE) paradigms. Although systematic case studies are more aligned with PBE paradigm, the paper argues for a complimentary, third way approach between the two paradigms and their ‘exemplary’ methodologies: case studies and randomised controlled trials (RCTs). Second, the paper argues that all forms of research can produce ‘valid evidence’ but the validity itself needs to be assessed against each specific research method and purpose. Existing appraisal tools for qualitative research (JBI, CASP, ETQS) are shown to have limited relevance for the appraisal of systematic case studies through a comparative tool assessment. Third, the paper develops purpose-oriented evaluation criteria for systematic case studies through CaSE Checklist for Essential Components in Systematic Case Studies and CaSE Purpose-based Evaluative Framework for Systematic Case Studies. The checklist approach aids reviewers in assessing the presence or absence of essential case study components (internal validity). The framework approach aims to assess the effectiveness of each case against its set out research objectives and aims (external validity), based on different systematic case study purposes in psychotherapy. Finally, the paper demonstrates the application of the tool with a case example and notes further research trajectories for the development of CaSE tool.


Sign in / Sign up

Export Citation Format

Share Document