Characterising users’ task completion process in learning-related tasks:A search pace model

This study investigated users’ searching, reading and writing interactions and their activity transitions during task completion process when users were collecting information for learning-related search tasks. Task completion process was defined as the process users started to search till the time when they have collected enough information to accomplish the search tasks. The data analysis was conducted from a new process perspective through synthesising macro- and micro-process levels. Four evenly distributed stages were divided according to the total task completion time in each search session. Our results demonstrated that users generally experienced three sub-processes during task completion process: exploration, accumulation and composition/reporting. Exploration sub-process is basically the first quarter of the total task completion time, during which users often issue more queries and visit more search engine result pages (SERPs) to collect information, and the dominant activity transition is switching between searching and reading; accumulation sub-process is mainly the second and third quarters of the total task completion time, during which they visit more unique content pages, have more revisits per content page, and they switch between reading and writing activities frequently; the last stage is composition/reporting sub-process, which is dominated by writing, and users often switch between writing and reading, and between writing and searching. Based on these findings, we propose a search pace model to describe how users proceed from the beginning to the end of task completion process in these three sub-processes. The methodology applied has been proved to be effective to examine users’ interaction behaviours from the process perspective on both the micro- and macro-levels. The findings of this article help us understand how users proceed their dynamic searching, reading and writing behaviours for learning-related tasks, and also have implications for the design of search systems that support learning-related tasks.

ONLINE LEARNING AND TIME-ON-TASK: IMPACT OF PROCTORED VS. UN-PROCTORED TESTING

The purpose of this study was to evaluate the impact of proctored versus un-proctored testing on practice time and learning for a self-study, online course in medical terminology. Participants included 120 college students in a pharmacy curriculum. Subjects were randomized to one of three groups utilizing textbook with proctored assessment, online instruction with proctored assessment, or online instruction with un-proctored assessment. A pre-test and post-test was administered to all three groups to evaluate learning. Content page “hits” and practice quiz access was tracked for participants. Learning, as defined by pre/post-test change score, was greatest in the presence of proctored assessment (online and text) (p = 0.027). In addition, use of practice quizzes had a stronger relative correlation with learning (r = 0.401; p<0.001) when compared to content page “hits” (r = 0.257; p = 0.024). Online course content paired with meaningful time-on-task (e.g. practice quizzes) was most effective when paired with proctored assessment.