Towards a Taxonomy for Classifying Intuitive Usability Prediction Strategies in Non-Experts

Author(s):  
M.A. Sublette ◽  
C.M. Carswell ◽  
M. Lee ◽  
T. Kent

In order to compare the strategies consumers use to make predictions about the ease-of-use of products, the authors conducted a card sorting exercise with subject-matter experts (SMEs) to refine a coding scheme from current, widely-used usability definitions and measurement tools. Nine SMEs sorted 83 cards containing aspects found in usability definitions, guidelines, measurement tools and descriptions. The resulting fifteen clusters define a coding scheme that is both comprehensive and flexible. The refined taxonomy does not seek to redefine usability, but to provide a mechanism for researchers wanting to use a coding scheme that includes methods for classifying strategies such as usability attribution to system features, metacognitive behaviors (planning and evaluating), and exemplar-based strategies (memory for performing similar tasks).

Author(s):  
Barbara Kuenzle Haake ◽  
Yan Xiao ◽  
Colin Mackenzie ◽  
F. Jacob Seagull ◽  
Thomas Grissom ◽  
...  

Teamwork training is critical for patient safety and has been advocated for widespread application in many settings. A key challenge for evaluating teamwork training is measurement. Despite much effort, the team performance instruments reported thus far suffer from a variety shortcomings that prevent their wide application in assessing teams in real settings. Based on review of video recorded trauma team activities in real patient care, a multi-disciplinary research team developed an instrument based on observable behaviors (UMTOP). A set of video clips were reviewed by 6 subject matter experts who were requested to provide “descriptors” about the observed team activities. The 167 collated descriptors were combined to a reduced list, which was then sent to the subject matter experts for revision. The revised list was then categorized into 5 areas of team performance (task and clinical performance, leadership organization, teamwork organization, social environment, sterile precaution). UMTOP was developed to be a tradeoff among four criteria: ease of use, reliability, usefulness for team performance feedback, and speed of scoring. An initial assessment of reliability was conducted with surgeon and nursing reviewers.


2013 ◽  
Vol 10 (4) ◽  
pp. 252-269 ◽  
Author(s):  
Antigoni Parmaxi ◽  
Panayiotis Zaphiris ◽  
Salomi Papadima-Sophocleous ◽  
Andri Ioannou

Purpose – The purpose of this study is to chart the development in computer-assisted language learning (CALL), by building a map of existing research work in the field. Based on a corpus of 163 manuscripts, published between January 2009 and September 2010 in four major journals devoted to CALL, it sets out to describe the range of topics covered under the umbrella of CALL and provide a holistic view of the field. Design/methodology/approach – The approach adopted in this research includes: development of the 2009-2010 CALL corpus; literature overview and initial coding scheme development; refinement of the initial coding scheme with the help of a focus group and construction of the CALL map version 1.0; refinement of the CALL map version 1.0 following a systematic approach of content analysis and development of the CALL map version 2.0; evaluation of the proposed structure and inclusiveness of all categories in the CALL map version 2.0 using card sorting technique; and finally development of the CALL map version 3.0. Findings – The research trends in the categories of the CALL map are discussed, as well as possible future directions in the field. Originality/value – This paper provides a holistic view of the field of CALL guiding both junior CALL researchers to place themselves in the field, and policy and decision makers who attempt to evaluate the current and future scholar activity in the field. Finally, it caters for more experienced researchers to focus on certain underinvestigated domains.


Author(s):  
Jason Paul Siko

Researchers have examined the use of homemade PowerPoint games as an instructional technique to improve learning outcomes. However, test data have shown no significant difference in performance between high school chemistry students who created games and students who did not (Siko, Barbour, & Toker, 2011). One of the justifications for the use of the games is that students will, with practice, write higher-order questions when constructing the games. Two subject matter experts rated over 2,500 questions from games created by students in an environmental chemistry class through thematic analysis using Bloom’s taxonomy as a coding scheme. The students wrote primarily recall questions, and students who created games on two occasions did not write more questions than students who only created games once. This suggests that changes to the question-writing aspect of the game project may be necessary in order to see improvements in achievement when compared to control groups. Les chercheurs ont étudié l’usage de jeux PowerPoint maison en tant que technique pédagogique visant à améliorer les résultats d'apprentissage. Les données des tests n'ont toutefois révélé aucune différence significative quant au niveau de performance des étudiants du secondaire en chimie ayant créé des jeux et celui des étudiants n’en ayant pas conçus (Siko, Barbour, et Toker, 2011). L’utilisation des jeux est notamment justifiée par l’idée que, pratique aidant, les étudiants écrivent des questions plus complexes lorsqu’ils élaborent des jeux. Au moyen d’une analyse thématique utilisant la taxonomie de Bloom comme système de codification, deux experts chimistes ont évalué plus de 2500 questions provenant de jeux conçus par des étudiants d’une classe de chimie environnementale. Les étudiants ont rédigé principalement des questions faisant appel à la mémoire, et les étudiants ayant créé des jeux à deux reprises n’ont pas produit davantage de questions que ceux qui en étaient à leur première expérience de création de jeux. Il appert que des changements à la rédaction des questions sont requis au projet de jeux pour pouvoir améliorer la performance par rapport aux groupes témoins.


2020 ◽  
Vol 9 (1) ◽  
pp. 1-14
Author(s):  
Nurul Farehah Mohamad Uri ◽  
Mohd Sallehhudin Abd Aziz

The Implementation of CEFR in Malaysia is currently at the second stage whereby the classroom usage of the new CEFR-aligned syllabus and assessment has taken place since 2017 at all stages except for Form 5. Previous studies on CEFR in Malaysia have focused more on teachers’ views and their readiness in accepting the new changes. However, this study focusses more on ascertaining the suitability of the writing syllabus specifications against the CEFR writing scale to find out if the CEFR levels of writing syllabus specifications recommended by the teachers match the CEFR level set by the Ministry of Education, Malaysia. A total of 331 secondary school teachers were asked to respond to the writing syllabus checklist and the Winstep SPSS was used for data analysis. Findings have shown that productive skills of the writing syllabus specifications were found not to be aligned to the target CEFR level set by the Ministry. In conclusion, adjustment and alignment processes should be made accordingly to align and match the non-CEFR aligned English syllabus to the CEFR global scale instead of eradicating it.


2016 ◽  
Vol 5 (1) ◽  
pp. 43 ◽  
Author(s):  
Sri Latifah

This is a research development that aim to produce product such as Student’s Worksheet (LKPD) oriented in values of Islam, through guided inquiry approach on the temperature and heat material for students of class X SMA/MA and to know the response of students toward it. The problem in this study include how to develop Student’s Worksheet (LKPD) oriented in values of Islam through guided inquiry approach on the temperature and heat material and the extent to which the response of students toward it.. This is a development research which apply Research and Development (R&D) method. Products produced is categorized as valid by the validation of subject matter experts with a percentage of 85%, subject matter experts to Islam with a score of 89% and design experts with a score of 91%, as well as products LKPD are very interesting based on the assessment of teachers with a percentage of 84%, and the response of students to the test field trials obtain a percentage score of 90%. Penelitian ini merupakan penelitian pengembangan yang bertujuan untuk menghasilkan produk berupa Lembar Kerja Peserta Didik (LKPD) berorientasi nilai-nilai agama Islam melalui pendekatan inkuiri terbimbing pada materi suhu dan kalor untuk peserta didik kelas X SMA/MA dan untuk mengetahui respon peserta didik terhadap produk LKPD berorientasi nilai-nilai agama Islam melalui pendekatan inkuiri terbimbing pada materi suhu dan kalor untuk peserta didik kelas X SMA/MA . Masalah dalam penelitian ini antara lain bagaimanakah mengembangkan LKPD berorientasi nilai-nilai agama Islam melalui pendekatan inkuiri terbimbing pada materi suhu dan kalor dan sejauh manakah respon peserta didik terhadap LKPD berorientasi nilai-nilai agama Islam melalui pendekatan inkuiri terbimbing pada materi suhu dan kalor untuk peserta didik kelas X SMA/MA. Penelitian ini merupakan penelitian pengembangan menggunakan metode penelitian Research and Development (R&D). Produk yang dihasilkan berkategori valid berdasarkan validasi dari ahli materi dengan persentase 85%, ahli materi agama Islam dengan skor 89% dan ahli desain dengan skor 91%, serta produk LKPD sangat menarik berdasarkan penilaian guru memperoleh persentase 84%, dan respon peserta didik pada uji coba lapangan memperoleh skor persentase 90%.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Mariola Jolanta Marzouk

Purpose This paper aims to provide unique empirical findings exploring the impact of the UK’s post-Brexit Economic Strategy to boost trade with developing countries on the UK banking sector’s ability to manage trade-based money laundering risks. Design/methodology/approach Exploratory research design that used structured literature review, followed by semi-structured interviews with key subject matter experts employed by large UK banks. Findings Both banks and law enforcement struggle to prioritise trade-based money laundering (TBML) intelligence discovery due to deficient skills, resources, technology and lack of strong regulatory stimulus. The regulated sector calls for the UK anti-money laundering (AML) reform that would better incentivise TBML deterrence, yet the Government underestimates the money laundering risks while trading with high-risk jurisdictions post-Brexit. Research limitations/implications The findings are based on a small sample of six semi-structured interviews with difficult to access population of key subject matter experts. Despite the small sample, participants provided well-articulated and informed insights. Practical implications The UK’s post-Brexit Economic Strategy to boost trade with developing countries downplays the TBML risks it carries. The findings should alert UK banks, law enforcement and the Government who will collectively bear the responsibility to effectively manage TBML while enabling smooth trading. Originality/value The research provides unique perceptions of UK banks’ senior subject matter experts on managing TBML threats from opportunistic criminals.


2020 ◽  
Vol 7 (1) ◽  
pp. 1-11
Author(s):  
Izzah Tiari ◽  
Zulkardi Zulkardi ◽  
Sardianto Markos Siahaan

E-learning berbasis Chamilo telah berhasil dikembangkan pada pembelajaran simulasi dan komunikasi digital di SMK Negeri 5 Palembang. Penelitian bertujuan untuk mengetahui kevalidan, kepraktisan, dan efektifitas e-learning terhadap mata pelajaran fitur kolaboratif daring. Tahapan Penelitian pengembangan ini terdiri dari tahap perencanaan, desain, dan pengembangan. E-learning yang telah dikembangkan kemudian diuji kevalidan oleh ahli, diuji kepraktisan oleh peserta didik, dan diuji efektifitas dengan mengimplementasikan e-learning di SMK Negeri 5 Palembang. Pengembangan e-learning menggunakan model Alessi dan Trollip. Dari penelitian ini didapatkan bahwa 1.) E-learning teruji kevalidan dengan penilaian oleh ahli media terhadap e-learning sebesar 89,47%, penilaian oleh ahli materi sebesar 84,62%, dan penilaian ahli desain pembelajaran sebesar 81,82%; 2.) E-learning teruji kepraktisannya dengan penilaian dari 3 peserta didik tingkat rendah, sedang, dan atas dengan rata-rata sebesar 86,10%; dan 3.) E-learning teruji efektifitas meningkatkan hasil belajar peserta didik dilihat dari adanya gain sebesar 0,70 yang termasuk kedalam kategori tinggi.AbstractE-Learning of Chamilo based has been developed for materials simulation and communication digital in SMK Negeri 5 Palembang. The research aims to know validity, practicality, and effectiveness e-learning features on the subject matter of online collaboration features. This research development stage consists of the plan, design, and development phase. E-learning features that have been developed and then tested validity by experts, tested practicality by students, and tested for effectiveness by implementation e-learning in SMK Negeri 5 Palembang. The development of e-learning used the Alessi and Trollip model. From this study, it was found that 1.) The assessment e-learning features have been validity tested by media experts at 89.47%, by subject matter experts of 84,62%, and by learning design experts of 81,82%; 2.) The assessment of e-learning features has been practicality tested by three students’ low level, medium, and high an average by 86,10%; and 3.) E-learning features have been effectively tested to improving students learning outcomes seen from a gain of 0.70 included in the high category.


Sign in / Sign up

Export Citation Format

Share Document