Using transaction log analysis to assess student search behavior in the library instruction classroom

2014 ◽  
Vol 42 (2) ◽  
pp. 320-335 ◽  
Author(s):  
Susan Avery ◽  
Daniel G. Tracy

Purpose – The purpose of this study is to determine how undergraduate students search in the context of a library instruction session. The results of an assessment of transaction logs are shared to provide evidence of student search behavior within a class setting. Design/methodology/approach – Transaction logs from 29 library instruction sessions using the library’s federated search tool were analyzed. Using a rubric, the authors assessed the logs to discover if students followed the instruction provided to construct more relevant, targeted searches, if they selected recommended resources and if they exhibited persistence in their searching. Findings – The study found most students had difficulty translating instruction on how to use quotation marks into their own searches, were mostly successful when choosing a database and notes varying participation patterns in classes taught at different times. Practical implications – Implications of this study include greater awareness of student search behaviors during library instruction sessions as well as guidance for providing reference services, particularly virtual reference where it is not possible to see how students construct searches. Originality/value – Although there have been studies of student search behaviors, examining behaviors during the context of a library instruction session is unique. This study provides an opportunity to observe student searching in a classroom setting and provides recommendations for more effective library instruction, both in the classroom and at the reference desk.

2019 ◽  
Vol 38 (3) ◽  
pp. 554-562
Author(s):  
Beth Seyala ◽  
Erin Burns ◽  
Shannon Richie ◽  
Amy L. Deuink ◽  
Valerie Lynn

Purpose The purpose of this paper is to evaluate Chromebooks as an alternative to the traditional computer laboratory for library instruction in an academic environment. The results of this study could help inform the creation of a mobile instruction lab that students and librarians quickly construct inside any classroom with minimal effort and no software to manage. Design/methodology/approach An online survey was distributed to student participants. The survey contained two demographic questions followed by seven user experience questions related to the in-classroom use of Chromebooks; most questions were quantitative in nature. Findings The majority of respondents (84 percent) strongly or somewhat agreed that Chromebooks were easy to use, and 15 percent of the respondents reported some difficulty accessing the university’s Wi-Fi system while using the devices. Research limitations/implications This introductory study was limited to a survey population primarily comprised of lower-level undergraduate students in their first two years of study. Additionally, Chromebooks were not tested in an educational environment using G Suite for Education, which could increase the opportunities for use in an academic setting. Practical implications The study’s findings, combined with the portability and long battery life of Chromebooks, make them a candidate for a mobile instruction lab. Originality/value This research seeks to explore the viability of Chromebooks as an affordable and easy to manage alternative to wired instruction rooms, using a light laptop technology that is becoming increasingly familiar to college students.


2019 ◽  
Vol 47 (1) ◽  
pp. 48-59 ◽  
Author(s):  
Christina Riehman-Murphy ◽  
Jennifer Hunter

Purpose The purpose of this paper is to provide evidence of the value of Research Parties, a new model of supplementary reference in a social environment. Design/methodology/approach A survey of multiple choice and open-ended questions was administered to Research Party participants (n = 43) over the course of three semesters to discover the profiles of the undergraduate students who attended and how they heard about the event and to assess the value of the interaction to the student. Findings Respondents unanimously agreed that their interactions with librarians at Research Parties were helpful because their information seeking needs, including finding sources, learning how to search databases, gaining clarity into the assignment, writing and citing, were met. Respondents also mentioned attributes of the librarian’s disposition or attitude such as enthusiastic conversation, encouragement and patience. Several students reflected on their own learning process and noted that they would seek help from a librarian again. Practical implications The results demonstrate that Research Parties are helpful to undergraduate students and a worthwhile model for academic libraries looking to complement their traditional reference services. Originality/value While faculty and administrators have verbally expressed excitement about Research Parties, librarian colleagues have anecdotally reported success instituting this model at their institutions, and students have provided informal positive feedback, this is the first time the model has been evaluated more formally to capture its value.


2011 ◽  
Vol 6 (3) ◽  
pp. 53
Author(s):  
Deena Yanofsky

Objective – To measure students’ perceptions of the ease-of-use and efficacy of a federated search tool versus a single multidisciplinary database. Design – An evaluation worksheet, employing a combination of quantitative and qualitative questions. Setting – A required, first-year English composition course taught at the University of Illinois at Chicago (UIC). Subjects – Thirty-one undergraduate students completed and submitted the worksheet. Methods – Students attended two library instruction sessions. The first session introduced participants to basic Boolean searching (using AND only), selecting appropriate keywords and searching for books in the library catalogue. In the second library session, students were handed an evaluation worksheet and, with no introduction to the process of searching article databases, were asked to find relevant articles on a research topic of their own choosing using both a federated search tool and a single multidisciplinary database. The evaluation worksheet was divided into four sections: step-by-step instructions for accessing the single multidisciplinary database and the federated search tool; space to record search strings in both resources; space to record the titles of up to five relevant articles; and a series of quantitative and qualitative questions regarding ease-of-use, relevancy of results, overall preference (if any) between the two resources, likeliness of future use and other preferred research tools. Half of the participants received a worksheet with instructions to search the federated search tool before the single database; the order was reversed for the other half of the students. The evaluation worksheet was designed to be completed in one hour. Participant responses to qualitative questions were analyzed, codified and grouped into thematic categories. If a student mentioned more than one factor in responding to a question, their response was recorded in multiple categories. Main Results – Participants indicated a slight preference for using a federated search tool over a single multidisciplinary database. Of the 31 students who completed the evaluation worksheet, 16 (51.6%) found that their search results were more relevant in the federated search tool; 10 (32.3%) students reported that the articles they found were more relevant in the single database. Three students stated that both search tools produced equally relevant results and two students responded that neither resource produced relevant results on their topic. When asked to state which resource they would be likely to use in the future, 22 students (71%) indicated that they would use the federated search tool and 21 (67.7%) students answered that they would use the single multidisciplinary database. Of the participants who expressed potential use of the single database to look for articles in the future, 43% referred to the ease of use or efficiency of the search tool in their responses. Similarly, more than half of the students who stated that they would use the federated search tool in the future (54.5%) also cited ease of use or efficiency in their answers. In total, 11 students (35.5%) stated that they would be unlikely to use the federated search tool for future research. In their responses, students referred to the inefficiency or complexity of the research tool. Of the 12 participants (38.7%) who stated that they would be unlikely to use the single multidisciplinary database, 50% cited a lack of relevant results and 42% referred to the overall complexity and inefficiency of the database. Conclusions – The results of this study do not support a significant preference among undergraduate students for either search tool. Though some participants struggled with terminology or various features of each resource, more students expressed confidence and satisfaction with the search process no matter which tool they opted to use. Given student confidence and comfort level in both research environments, the author suggests that librarians should place equal weight on both types of resources in library instruction.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Sandy Hervieux

PurposeThe purpose of this paper is to investigate the impact of the pandemic on the questions received via chat reference at a Canadian university library.Design/methodology/approachA qualitative analysis using coding of chat transcripts and a quantitative analysis of the length of chat interactions were used in this study.FindingsThe author determined that the types of questions received changed slightly during the pandemic due to the new library services offered. The complexity level of questions did not change significantly nor did the presence of instruction. The length of individual chat interactions and the total amount of time spent on chat increased, most likely due to the extended hours of the service and the number of patron questions present in one interaction.Originality/valueThis is the first study to investigate the potential impact of the pandemic on virtual reference services at a university library. The findings could lead to practical implications for libraries who need to close their in-person reference desk or need to respond to building closures.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Hyunjoo Im ◽  
Hae Won Ju ◽  
Kim K.P. Johnson

PurposeLittle research has been done to understand how individual elements (e.g. advertisements) within a webpage are processed and evaluated when visual complexity is increased. Thus, this study aimed to investigate how consumers allocate attention and evaluate products and advertisements on complex webpages when they are casually browsing.Design/methodology/approachThis study conducted two experiments to test the causal effects of different degrees of visual complexity on consumer responses to products and advertisements. An eye-tracking experiment (n = 90) and a follow-up online experiment (n = 121) were conducted using undergraduate students as participants.FindingsParticipants formed a global impression from the overall webpage complexity, which spilled over to evaluation of individual elements on the webpage (e.g. product, advertisement). The inverted U-shaped relationships (vs. linear negative relationships) between webpage visual complexity and attitude toward the webpage, products, and advertisements were observed. The focal product was given a consistent level of attention regardless of the complexity level.Practical implicationsThis study provides implications for website organization and design to maximize positive consumer experiences and marketing effectiveness. The findings provide implications for retailers and advertisement buyers.Originality/valueThis study expanded the knowledge by examining the interplay between individual elements of webpages and the whole webpage complexity when consumers browse visually complex webpages. It is a novel finding that the overall webpage complexity effect spills over to locally attended products or advertisements.


2019 ◽  
Vol 120 (1/2) ◽  
pp. 87-107 ◽  
Author(s):  
Caroline R. Pitt ◽  
Adam Bell ◽  
Rose Strickman ◽  
Katie Davis

Purpose This paper aims to investigate the potential for digital badges to support alternate learning and career pathways in formal and informal learning environments. Stakeholder groups in higher education and industry discussed how digital badges might transform current processes of admitting undergraduate students and hiring young professionals. Design/methodology/approach This research uses a thematic analysis of in-depth interviews with 30 stakeholders in higher education and the technology industry. Findings Interview participants expressed optimism about the potential for digital badges to make learning pathways visible to learners and external audiences and to promote equity in STEM (STEM: science, technology, engineering, and mathematics) education and careers. Participants noted several obstacles, largely focused on issues of credibility and logistics of working with badges across settings. Research limitations/implications Though the research approach is limited in geographic scope, the findings have broad applicability and insight for the use of digital badges in general. Practical implications Education policymakers, employers and scholars will be able to use the insights from this investigation in their efforts to find innovative ways to expand and diversify the STEM workforce, as well as support a wider range of learners than is currently supported by initiatives aligned with the school-to-workforce pipeline metaphor. Originality/value This paper directly confronts issues of real-world applications of digital badges by discussing practical implications with college admissions officers and employers. The current study fills a need for research that investigates the use of digital badges across – as opposed to within – contexts.


SAGE Open ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 215824402110672
Author(s):  
Ruirui Lian ◽  
Wenjing Cai ◽  
Kun Chen ◽  
Hongru Shen ◽  
Xiaopei Gao ◽  
...  

The present research aims to explore the impact of mentoring relationship on college graduates’ job search behavior among Chinese undergraduate students by examining the mediator of job search intention and the moderator of job search self-efficacy. A two-wave survey study was conducted in China ( N = 594). Our findings show a positive indirect relation between mentoring and college graduates’ job search behaviors through job search intention. The graduates’ job search self-efficacy positively moderated the indirect relationship such that when job search self-efficacy was higher, the influence of mentoring on behavior via job search intention was stronger. These findings extend the literature by clarifying how and when mentoring facilitates graduates’ job search behaviors and provide practical implications for facilitating a smooth school-to-work transition in China. As the first study that empirically clarifies why (through job search intention) and when (job search self-efficacy) mentoring function is positively related to job search behavior among Chinese undergraduate students, the present study contributes to the existing mentoring and job search literature. Future research is encouraged to extend the findings by integrating theory of planned behavior (TPB) with self-regulation theory toward deepening current understanding of how and when mentoring can contribute to a student’s success in job search behavior.


2009 ◽  
Vol 4 (4) ◽  
pp. 24 ◽  
Author(s):  
Judith Z. Emde ◽  
Sara E. Morris ◽  
Monica Claassen-Wilson

Objectives - This usability study was developed to observe faculty and graduate students’ reactions to a recent redesign of the University of Kansas (KU) Libraries’ website. The redesign included new navigational features, introduction of a federated search tool, a quick search box on the front page, and research subject pages. The study also provided the opportunity to observe the practices of faculty and graduate students in locating and retrieving information on the Libraries’ website. Methods - Ten participants (five faculty and five graduate students) representing diverse disciplines were solicited for the study. Participants were required to access the Libraries’ website to answer a series of questions regarding new and updated features of the website. Observational analysis using Morae™ software was conducted and interviews with each participant provided details of their opinions on how these new features would influence their research and teaching activities. Results - Most of the participants either did not notice or ignored the major website changes. Links to and locations of commonly used resources (e.g. catalogue; databases; e-journals) had been changed minimally, and the faculty and graduate student participants gravitated to those familiar features to complete tasks. Prior to the study, participants had not accessed the new discovery tools; however, once previewed, responses to the tools’ utility were generally favourable. After using the federated search tool on a familiar topic, several participants noted that, when directed to databases they had not previously considered, they were able to locate citations they had missed in the past. Observers noted pitfalls in navigating the site such as inconsistent underscoring of links, ambiguous terminology, and unclear icons meant to expand subject heading lists. Unexpected searching behaviours were observed, including inconsistent and lack of conceptual understanding in searching for e-journal content. Conclusions - This study provides evidence regarding the usability of a library website with a population already familiar with library resources. It demonstrated that faculty and graduate students are not interested in experimenting with new discovery tools but are amenable to their potential value to undergraduate students. The recent trend toward minimizing content and links on websites satisfies this population, one which is already comfortable with the basic attributes of a library’s website.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Jeremiah Holden Kalir ◽  
Esteban Morales ◽  
Alice Fleerackers ◽  
Juan Pablo Alperin

Purpose Social annotation (SA) is a genre of learning technology that enables the annotation of digital resources for information sharing, social interaction and knowledge production. This study aims to examine the perceived value of SA as contributing to learning in multiple undergraduate courses. Design/methodology/approach In total, 59 students in 3 upper-level undergraduate courses at a Canadian university participated in SA-enabled learning activities during the winter 2019 semester. A survey was administered to measure how SA contributed to students’ perceptions of learning and sense of community. Findings A majority of students reported that SA supported their learning despite differences in course subject, how SA was incorporated and encouraged and how widely SA was used during course activities. While findings of the perceived value of SA as contributing to the course community were mixed, students reported that peer annotations aided comprehension of course content, confirmation of ideas and engagement with diverse perspectives. Research limitations/implications Studies about the relationships among SA, learning and student perception should continue to engage learners from multiple courses and from multiple disciplines, with indicators of perception measured using reliable instrumentation. Practical implications Researchers and faculty should carefully consider how the technical, instructional and social aspects of SA may be used to enable course-specific, personal and peer-supported learning. Originality/value This study found a greater variance in how undergraduate students perceived SA as contributing to the course community. Most students also perceived their own and peer annotations as productively contributing to learning. This study offers a more complete view of social factors that affect how SA is perceived by undergraduate students.


2020 ◽  
Vol 48 (2) ◽  
pp. 243-257
Author(s):  
Rebecca Hill Renirie

Purpose The purpose of this study is to examine teaching intent of information literacy threshold concepts via asynchronous reference transactions. Instructional content in academic librarians’ replies to research requests are analyzed for and mapped to threshold concepts contained in the Association of College and Research Libraries (ACRL) framework. Design/methodology/approach The author mapped the instructional content of a research request reply template to the content of the ACRL framework, then took a random sample of research requests using the template during the calendar year 2016. Additional instructional content provided in the sample replies was also mapped to the framework. Findings In providing written instruction for students to create searches from keywords and search subject-specific databases, every frame is at least partially addressed in the template except Scholarship as Conversation. However, individual librarians adapt the template to teach as needed and there are examples in this case study of teaching aspects of all six frames asynchronously. Practical implications This study provides support for librarians to teach the threshold concepts of the ACRL framework asynchronously at the point of need during virtual reference, and the effective use of a research reply template to accomplish this instruction. Originality/value Few recent studies examine instructional intent in asynchronous/email reference. This study examines teaching the ACRL framework via reference rather than instructional sessions. A portion of this research was presented as a poster at the 2017 ACRL Conference in Baltimore, Maryland.


Sign in / Sign up

Export Citation Format

Share Document