Understanding the “Pathway” Towards a Searcher’s Learning Objective

Search systems are often used to support learning-oriented goals. This trend has given rise to the “search-as-learning” movement, which proposes that search systems should be designed to support learning. To this end, an important research question is: How does a searcher’s type of learning objective (LO) influence their trajectory (or pathway ) toward that objective? We report on a lab study (N = 36) in which participants gathered information to meet a specific type of LO. To characterize LOs and pathways , we leveraged Anderson and Krathwohl’s (A&K’s) taxonomy [ 3 ]. A&K’s taxonomy situates LOs at the intersection of two orthogonal dimensions: (1) cognitive process (CP) (remember, understand, apply, analyze, evaluate, and create) and (2) knowledge type (factual, conceptual, procedural, and metacognitive knowledge). Participants completed learning-oriented search tasks that varied along three CPs (apply, evaluate, and create) and three knowledge types (factual, conceptual, and procedural knowledge). A pathway is defined as a sequence of learning instances (e.g., subgoals) that were also each classified into cells from A&K’s taxonomy. Our study used a think-aloud protocol, and pathways were generated through a qualitative analysis of participants’ think-aloud comments and recorded screen activities. We investigate three research questions. First, in RQ1, we study the impact of the LO on pathway characteristics (e.g., pathway length). Second, in RQ2, we study the impact of the LO on the types of A&K cells traversed along the pathway. Third, in RQ3, we study common and uncommon transitions between A&K cells along pathways conditioned on the knowledge type of the objective. We discuss implications of our results for designing search systems to support learning.

Foundation in Law students’ reading awareness of the case law genre

Background: A text of different genre might pose a different problem to students and different genre requires different approach in understanding and comprehending it. Developing the expertise in reading legal texts at an early stage of learning will be very beneficial to the students of law. This study examines the level of pre-university/foundation in law students’ awareness for the case law genre, and the aim of this study is to investigate the extent of awareness of the case law genre among the foundation in law students. Methods: Five students who were pursuing their study in the foundation/pre-university level were selected as the subjects in this study. Qualitative data were obtained through the think-aloud procedure and questionnaire which was administered after the think-aloud procedure. The transcription of each student’s verbal reports was scrutinised for evidence of genre awareness while the answers given in the questionnaire were used to support the findings of the study. Genre analysis of 4-Move structure was used to identify the students’ level of awareness. Results: The findings indicate that the students were aware of the case law genre. However, they displayed a mixed-level of awareness. Conclusion: It is hoped that this study can provide some insights into the reading behaviour of law students especially when reading case law. Knowing and understanding the case law structure is integral for law students, and analysing students understanding of reading case law can help both the students and English for Academic Purposes (EAP) educators.

Participatory Design of a Medication Module in an Electronic Medical Record for Paediatric Palliative Care: A Think-Aloud Approach with Nurses and Physicians

Background: Electronic medical records (EMRs) play a key role in improving documentation and quality of care in paediatric palliative care (PPC). Inadequate EMR design can cause incorrect prescription and administration of medications. Due to the fact of complex diseases and the resulting high level of medical complexity, patients in PPC are vulnerable to medication errors. Consequently, involving users in the development process is important. Therefore, the aim of this study was to evaluate the acceptance of a medication module from the perspective of potential users in PPC and to involve them in the development process. Methods: A qualitative observational study was conducted with 10 nurses and four physicians using a concurrent think-aloud protocol and semi-structured qualitative interviews. A qualitative content analysis was applied based on a unified theory of acceptance and use of technology. Results: Requirements from the user’s perspective could be identified as possible influences on acceptance and actual use. Requirements were grouped into the categories “performance expectancies” and “effort expectancies”. Conclusions: The results serve as a basis for further development. Attention should be given to the reduction of display fragmentation, as it decreases cognitive load. Further approaches to evaluation should be taken.

Pengembangan Sistem Informasi Geografis Kebun Binatang Berbasis Progressive Web Application (PWA) dengan Metode Prototype (Studi Kasus Kebun Binatang Bandung)

Kebun binatang merupakan tempat yang memiliki peran strategis terhadap aspek konservasi satwa, sosial ekonomi masyarakat, maupun lingkungan. Kebun Binatang Bandung sebagai salah satu kebun binatang di Indonesia sudah seharusnya dapat dikelola dengan baik dengan memberikan fasilitas pelayanan yang mumpuni. Namun pada saat ini Kebun Binatang Bandung masih belum memiliki fasilitas layanan petunjuk arah, peta, dan informasi satwa yang memadai. Hal tersebut melatarbelakangi adanya penelitian pengembangan aplikasi Sistem Informasi Geografis Kebun Binatang Bandung ini. Tujuannya agar pengunjung Kebun Binatang Bandung dapat lebih mudah dan nyaman dalam menjelajahi kebun binatang, serta bisa mendapatkan informasi lebih dalam mengenai satwa yang dilihatnya. Pengembangan aplikasi menggunakan metode pengembangan perangkat lunak Prototype yang dinilai baik untuk pengembangan aplikasi berskala kecil. Metode Prototype terdiri dari lima tahap pengembangan yakni Communication, Quick Plan, Modeling Quick Design, Construction of Prototype, dan Deployment Develivery Feedback. Sementara itu, aplikasi dibuat berbasis Progressive Web Application (PWA) yang mudah diakses namun tetap memberikan fitur-fitur yang menarik layaknya aplikasi native. Hasil pengembangan aplikasi kemudian diujicobakan dengan menggunakan metode System Usability Scale (SUS) dan Retrospective Think Aloud (RTA). Dari hasil pengujian, didapat didapat nilai usabilitas sebesar 81,43 (Skor SUS) yang tergolong ke dalam kategori Acceptable. Dengan demikian dapat disimpulkan bahwa aplikasi ini diterima dan layak untuk digunakan.

Exploring task-based cognitive processes

This paper argues that TBLT researchers should dedicate more effort to investigating the cognitive processes in which L2 learners engage during task work to facilitate theory-construction and to inform pedagogical practices. To help achieve this, a review follows of various subjective (questionnaires, interviews, think-aloud/stimulated recall protocols) and objective (dual-task methodology, keystroke-logging, eye-tracking) methods that are available to TBLT researchers to examine cognitive processes underlying task-based performance. The paper concludes that, to obtain a more valid understanding of task-generated cognitive processes, it is best to combine various methods to overcome the limitations of each. Finally, some methodological recommendations are provided for future cognitively-oriented TBLT research.

Anforderungen sicherheitskritischer Dienste an Augmented Reality-Lösungen – Wassertiefenmessung in einem Seehafen

ZusammenfassungAugmented Reality ist eine zunehmend weiter verbreitete Technologie. Die Potenziale in Bereichen außergewöhnlich hoher kognitiver Anforderungen in sicherheitskritischen Kontexten sind bisher allerdings wenig untersucht. Insbesondere Dienstleistungen, die umfassendes Fachwissen voraussetzen, sicherheitskritisch sind und parallel auszuführende Aufgaben erfordern, können durch den Einsatz von Augmented Reality in ihrer Ausführung unterstützt werden. In solchen Dienstleistungen ermöglicht Augmented Reality eine nahtlose Integration wesentlicher Informationen in das Sichtfeld der Nutzenden. Beim Einsatz von Head-Mounted Displays kann zudem eine freihändige Interaktion erfolgen. Diese Arbeit untersucht die nutzerzentrierten Anforderungen an Augmented Reality-Lösungen in einem sicherheitskritischen Bereich im Betrieb eines großen europäischen Seehafens. Konkret geht es um Wassertiefenmessung des gesamten Hafengebiets zur Instandhaltung der Hafeninfrastruktur. Basierend auf elf Think-Aloud-Sitzungen während der Messfahrten, zwei Experteninterviews und zwei Expertenworkshops, wurden fünf Anforderungen an Augmented Reality bei der Wassertiefenmessung abgeleitet, die eine Lösung zur Unterstützung der Dienstleistung erfüllen sollte. Unseres Wissens nach präsentieren wir damit die erste Studie zur Anwendbarkeit und Umsetzbarkeit von Augmented Reality in der maritimen Industrie und identifizieren Anforderungen, die sich auf die weitere Forschung zum Einsatz von Augmented Reality in sicherheitskritischen Umgebungen übertragen lassen.

Idiolect and Identity: Fourth Grade Students’ Translanguaging, Comprehension, and Self-Identity

The practice of translanguaging offers emergent bilinguals the opportunity to access their full linguistic repertoire. This qualitative study uses the lenses of dynamic bilingualism and idiolect, or one’s own unique language patterns, to explore emergent bilinguals’ translanguaging and reading comprehension strategies during a reading think-aloud, as well as the ways that language factors into the construction of self-identity. Data collected from a think-aloud show that the five fourth-grade students used language flexibly when reading and comprehending the texts that were presented in both Spanish and English. The participants, in follow-up interviews, also explained ways that they use translanguaging strategies when communicating with different audiences and how their identity as bilinguals positions them as mediators of their own language use. These findings support the conclusion that when students’ idiolects are supported and encouraged, they are able to develop positive self-identities.

“Sick or not sick?” A mixed methods study evaluating the rapid determination of illness severity in a pediatric emergency department

Objectives Experienced physicians must rapidly identify ill pediatric patients. We evaluated the ability of an illness rating score (IRS) to predict admission to a pediatric hospital and explored the underlying clinical reasoning of the gestalt assessment of illness. Methods We used mixed-methods to study pediatric emergency medicine physicians at an academic children’s hospital emergency department (ED). Physicians rated patients’ illness severity with the IRS, anchored by 0 (totally well) and 10 (critically ill), and shared their rationale with concurrent think-aloud responses. The association between IRS and need for hospitalization, respiratory support, parenteral antibiotics, and resuscitative intravenous (IV) fluids were analyzed with mixed effects linear regression. Area under the curve (AUC) receiver operator characteristic (ROC) curve and test characteristics at different cut-points were calculated for IRS as a predictor of admission. Think-aloud responses were qualitatively analyzed via inductive process. Results A total of 141 IRS were analyzed (mean 3.56, SD 2.30, range 0–9). Mean IRS were significantly higher for patients requiring admission (4.32 vs. 3.13, p<0.001), respiratory support (6.15 vs. 3.98, p = 0.033), IV fluids (4.53 vs. 3.14, p < 0.001), and parenteral antibiotics (4.68 vs. 3.32, p = 0.009). AUC for IRS as a predictor of admission was 0.635 (95% CI: 0.534–0.737). Analysis of 95 think-aloud responses yielded eight categories that describe the underlying clinical reasoning. Conclusions Rapid assessments as captured by the IRS differentiated pediatric patients who required admission and medical interventions. Think-aloud responses for the rationale for rapid assessments may form the basis for teaching the skill of identifying ill pediatric patients.

Map Evaluation under COVID-19 restrictions: A new visual approach based on think aloud interviews

With the beginning of the COVID-19 pandemic, the execution of eye-tracking user studies in indoor environments was no longer possible, and remote and contactless substitutes are needed. With this paper, we want to introduce an alternative method to eye tracking, completely feasible under COVID-19 restrictions. Our main technique are think aloud interviews, where participants constantly verbalize their thoughts as they move through a test. We record the screen and the mouse movements during the interviews, and analyse both the statements and the mouse positions afterwards. With this information, we can encode the approximate map position of the user’s attention for each second of the interview. This allows us to use the same visual methods as for eye-tracking studies, like attention maps or trajectory maps. We implement our method conducting a user study with 21 participants to identify user behaviour while solving high-level interpretation tasks, and with the results of this study, we can show that or new method provides a useful substitute for eye-tracking user studies.