Institutions collaborating on an information literacy assessment tool

2014 ◽  
Vol 35 (8/9) ◽  
pp. 538-546 ◽  
Author(s):  
Sara Sharun ◽  
Michelle Edwards Thomson ◽  
Nancy Goebel ◽  
Jessica Knoch

Purpose – The purpose of this paper is to create an information literacy (IL) instruction assessment tool that responds to the unique needs of individual institutions and provides a strategic and relevant model for assessing IL skills among undergraduate students. Design/methodology/approach – The research team designed a post-test questionnaire comprised of two demographic questions, two open-ended questions and a pool of skill-based multiple-choice questions mapped to Association of College and Research Libraries Information Literacy (ACRL IL) Competency Standards for Higher Education. Participating librarians used a customized questionnaire to assess student learning at the end of their one-shot instruction sessions. Findings – In their responses to the multiple-choice questions, students demonstrated a clear understanding of ethical use of information and a strong ability to select appropriate tools for accessing information sources. Student responses to the open-ended questions revealed a wide range of confidence and ability levels, and provided insight into the frequency, depth and breadth with which various ACRL Standards are being addressed in library sessions. Research limitations/implications – This paper reports on student responses to questions that have subsequently been identified as problematic; therefore, strong inferences cannot be made about student learning from these responses. Questions have since been improved with further revision. In addition, the sample sizes for individual questions were too small to be generalizable. Practical implications – The intentional and strategic approach to the development of the assessment tool and its implementation is that it be practical and easy to implement for partner libraries. It is intended to make assessment of IL in the undergraduate context be assessable to all academic librarians who desire to participate. Originality/value – This paper describes a unique assessment tool that is designed to be responsive to local needs and provide a cost-free assessment option for academic libraries.

2016 ◽  
Vol 7 (2) ◽  
pp. 159-177 ◽  
Author(s):  
Pauline Kneale ◽  
Andrew Edwards-Jones ◽  
Helen Walkington ◽  
Jennifer Hill

Purpose This paper aims to focus on the undergraduate research conference as its sphere of study and investigate the impact of significance of participation and socialisation in such activities on student attitudes and professional development. Using situated learning to theoretically position the undergraduate research conference as an authentic learning context, connection is also made with the concept of graduate attributes. Design/methodology/approach The Vitae (2014) Researcher Development Framework (RDF) is used to provide a template for charting the experiences and development of undergraduate students as researchers. This can be applied to short-term activities and programmes and to long-term career plans. The insights from 90 undergraduate students participating in three national undergraduate research conferences were obtained through interviews, and thematically analysed to map the students’ skills development against the RDF criteria. Findings Three main aspects of undergraduate research conference participation were considered particularly important by the students: the value of paper presentations, the value of poster presentations and the value of the overall conference experience. Within these themes, participants identified a wide range of skills and attributes they felt they had developed as a result of either preparing for or participating in the conferences. The majority of these skills and attributes could be mapped against the different domains of the RDF, using a public engagement lens for comparing actual with expected developmental areas. Research limitations/implications This research helps undergraduate research conference organisers construct programme content and form it in such a way that students’ skill development can be maximised prior to, and during, the course of an event. Learning developers can also use these findings to help understand the support needs of students preparing to deliver papers at such conferences. So far, little empirical research has examined students’ skills development within the undergraduate research conference arena. Originality/value The outcomes of this study show the diversity of the skills that students developed and the value of the conference format for offering networking practice and enhancing the communication skills which employers value.


Author(s):  
Eva Ratihwulan

<p>This research is aimed to improve students' motivation and learning outcomes. The action used in improving the two things is the learning process with STAD technique. This study uses three stages: Pre Cycle, Cycle I, and Cycle II, each cycle using two meetings. Research data were obtained from a student questionnaire and test with multiple choice questions. Questionnaire to know the development of learning motivation, while the test with multiple choice questions to know the development of learning outcomes. The research data is analyzed descriptively-qualitative. The results of the study explain that the implementation of learning with STAD techniques can improve student's motivation and achievement. Learning motivation in Pre Cycle obtained an average of 23.47 (medium category). While in Cycle I the average learning motivation increased to 26.57 (medium category). Percentage of students achieved high category score of 4 students (13%). Furthermore, in cycle II the average learning motivation of 33.87 (high category). Percentage of students obtained a great and very high category score of 22 students (73.3%). Thus until the end of Cycle II, learning motivation has increased. While the results of learning on the Precycle obtained an average of 61.93 (enough category), in the first cycle increased to 69.53 (enough class), in Cycle II obtained an average of 78.77 (right type). Furthermore, it is known that the percentage of learning mastery in the Pre Cycle of 3%, Cycle I of 31%, then in cycle II the rate of learning mastery increased to 86.66%. Thus until the end of Cycle II, student learning outcomes have increased. Based on the above data can be concluded that the implementation of learning STAD technique can improve learning motivation and student learning outcomes.</p>


2021 ◽  

Abstract This 229-paged book discussed the role of zoos in a modern, environmentally conscious society. It does this by offering the reader the opportunity to answer 600 multiple-choice questions on a wide range of topics including zoo history, enclosure design, aquarium management, animal behaviour and welfare, zoo research, conservation breeding, zoo visitor behaviour, conservation medicine, zoo legislation and many more.


2017 ◽  
Vol 12 (2) ◽  
pp. 178 ◽  
Author(s):  
Stephanie Krueger

A Review of: Carroll, A. J., Corlett-Rivera, K., Hackman, T., & Zou, J. (2016). E-book perceptions and use in STEM and non-STEM disciplines: A comparative follow-up study. portal: Libraries and the Academy, 16(1), 131-162. https://doi.org/10.1353/pla.2016.0002 Abstract Objective – To compile a set of usability and collection development suggestions and to examine a possible statistical correlation between visiting the physical library, online resource use, and e-book use. Design – Online questionnaire survey. Setting – Major public research university in Maryland, United States of America. Subjects – 47,209 faculty, students, and staff. Methods – This survey is a follow-up to a similar 2012 study at the same institution. Survey respondents completed 14 multiple-choice and up to 8 open-ended questions about academic e-book discovery, perception, and usage patterns for both STEM and non-STEM respondents using the Qualtrics online research platform. Seven of eight open-ended questions were conditional (i.e., dependent on answers to multiple-choice questions), thus the number of questions answered by respondents could vary. The survey was available from October 1 to November 22, 2014, and promoted across a variety of communication channels (email, library website, social media, print flyers and handouts). Incentives for completing the survey included one iPad Mini and eight U.S. $25 Amazon gift cards. Main Results – 1,911 (820 STEM and 1,091 non-STEM) self-selected students, faculty, and staff from a total campus population of 47,209 faculty, students, and staff (4.2% response rate) participated in the survey, excluding 277 additional responses representing library personnel (70) and individuals not affiliated with the institution (207). 64% of respondents indicated more e-book use than three years before, with only 21.9% of respondents noting they never use e-books for academic purposes compared to 31% in 2012. 32.5% of respondents noted daily or weekly use of e-books for scholarly pursuits, with undergraduates reporting the most frequent use: 38.6% daily/weekly use versus 37.2% for graduate students, 16.2% for faculty, and 14.2% for staff. 38% of respondents reporting daily/weekly use were from STEM disciplines; 31.3% were from non-STEM fields. Computers, not e-readers, were the primary devices used for accessing e-books: 72.5% of respondents reported using laptops or desktops to this end versus tablets, 37.9%; mobile phones, 36.7%; Kindles, 25.6%; Nooks, 5.9%; and other e-readers, 3.3%. Top “mixed device access” responses were tablet/mobile phone/computer (98 responses); mobile phone/computer (93 responses); and tablet/computer (81 responses). The top three discovery tools respondents reported using for finding e-books were commercial sites (35.9%), free websites (26.8%), and the library website (26.2%). A weak-positive Spearman’s rho rank correlation of 0.25 provides some evidence that respondents who visit the library often are likely to use online resources and e-books. 35% of respondents reported they use e-books online “most of the time,” and 67% of respondents indicated they print out e-book content for use. Responses to the question “What, if anything, would make you more likely to use e-books for academic purposes?” included easier access via the library website (48% of respondents), better functionality for highlighting/annotating (44%), reduced cost (43.2%), easier downloading (38.5%), more e-books in area of research interest (37.3%), more textbooks (37.2%), and ownership of a dedicated e-reader (35.6%). In 2012, 52% of respondents reported never having downloaded an e-book for offline use. This percentage dropped notably in this study, with only 11.5% of respondents indicating they had never downloaded for later use. Conclusion – While this study indicates both STEM and non-STEM respondents at this institution are increasingly using e-books, preferences for electronic versus print format varied according to content type and type of user (e.g., STEM or non-STEM, undergraduate or graduate, student/faculty/staff). Key recommendations for usability and collection development include: improving discovery and awareness mechanisms, purchasing some content (e.g., references works, style guides) in e-format while ensuring multiple simultaneous use, taking advantage of print plus electronic options to serve users with different format preferences, and encouraging vendors to allow digital rights management free downloading and printing.


2019 ◽  
Vol 5 (1) ◽  
pp. e000495
Author(s):  
Danielle L Cummings ◽  
Matthew Smith ◽  
Brian Merrigan ◽  
Jeffrey Leggit

BackgroundMusculoskeletal (MSK) complaints comprise a large proportion of outpatient visits. However, multiple studies show that medical school curriculum often fails to adequately prepare graduates to diagnose and manage common MSK problems. Current standardised exams inadequately assess trainees’ MSK knowledge and other MSK-specific exams such as Freedman and Bernstein’s (1998) exam have limitations in implementation. We propose a new 30-question multiple choice exam for graduating medical students and primary care residents. Results highlight individual deficiencies and identify areas for curriculum improvement.Methods/ResultsWe developed a bank of multiple choice questions based on 10 critical topics in MSK medicine. The questions were validated with subject-matter experts (SMEs) using a modified Delphi method to obtain consensus on the importance of each question. Based on the SME input, we compiled 30 questions in the assessment. Results of the large-scale pilot test (167 post-clerkship medical students) were an average score of 74 % (range 53% – 90 %, SD 7.8%). In addition, the tool contains detailed explanations and references were created for each question to allow an individual or group to review and enhance learning.SummaryThe proposed MSK30 exam evaluates clinically important topics and offers an assessment tool for clinical MSK knowledge of medical students and residents. It fills a gap in current curriculum and improves on previous MSK-specific assessments through better clinical relevance and consistent grading. Educators can use the results of the exam to guide curriculum development and individual education.


2020 ◽  
pp. postgradmedj-2020-138822
Author(s):  
Prakrit Raj Kumar ◽  
Thomas Stubley ◽  
Yousuf Hashmi ◽  
Usman Ahmed

IntroductionThere is a huge variation in the depth and breadth of content taught regarding orthopaedic examinations. Undergraduate students are often confused by the variability in examination teaching, therefore increasing concerns for upcoming objectively structured clinical examinations (OSCEs). Doctors, despite being expected to teach, rarely receive formal preparation, with only a handful of institutions providing necessary training. The Clinical Orthopaedic Teaching programme for Students (COTS) was designed to equip medical students with the knowledge to perform orthopaedic examinations and to synergistically provide senior students with the necessary experience for the future teaching required of them.MethodsSix fortnightly sessions were delivered, each focusing on a specific joint examination. Student and tutor recruitment were voluntary. Pre-session and post-session multiple-choice questions (MCQs) were provided to students to assess improvement in knowledge. Anonymous feedback forms were provided to both students and tutors.ResultsFrom 61 student responses, 98.4% of students stated that COTS met the learning outcomes, with content relevant for their medical curriculum. 96.7% supported COTS’ near-peer teaching (NPT) style for OSCE preparation. Based on a five-point Likert scale, students displayed a mean improvement in confidence (1.7±1.2, p<0.001) and MCQ scores (1.3±1.2, p<0.001). All 10 tutors perceived an improvement of their teaching skills and confidence to teach (1.0±0.9, p=0.016).ConclusionCOTS shows that an NPT style can be used to effectively teach orthopaedic examinations, with benefits for students and tutors. With our aim to refine and upscale this programme, we publish our pilot study findings to encourage similar teaching programmes to be adopted at other universities.


2010 ◽  
Vol 9 (4) ◽  
pp. 453-461 ◽  
Author(s):  
Jia Shi ◽  
William B. Wood ◽  
Jennifer M. Martin ◽  
Nancy A. Guild ◽  
Quentin Vicens ◽  
...  

We have developed and validated a tool for assessing understanding of a selection of fundamental concepts and basic knowledge in undergraduate introductory molecular and cell biology, focusing on areas in which students often have misconceptions. This multiple-choice Introductory Molecular and Cell Biology Assessment (IMCA) instrument is designed for use as a pre- and posttest to measure student learning gains. To develop the assessment, we first worked with faculty to create a set of learning goals that targeted important concepts in the field and seemed likely to be emphasized by most instructors teaching these subjects. We interviewed students using open-ended questions to identify commonly held misconceptions, formulated multiple-choice questions that included these ideas as distracters, and reinterviewed students to establish validity of the instrument. The assessment was then evaluated by 25 biology experts and modified based on their suggestions. The complete revised assessment was administered to more than 1300 students at three institutions. Analysis of statistical parameters including item difficulty, item discrimination, and reliability provides evidence that the IMCA is a valid and reliable instrument with several potential uses in gauging student learning of key concepts in molecular and cell biology.


2019 ◽  
Vol 16 (1) ◽  
pp. 59-73 ◽  
Author(s):  
Peter McKenna

PurposeThis paper aims to examine whether multiple choice questions (MCQs) can be answered correctly without knowing the answer and whether constructed response questions (CRQs) offer more reliable assessment.Design/methodology/approachThe paper presents a critical review of existing research on MCQs, then reports on an experimental study where two objective tests (using MCQs and CRQs) were set for an introductory undergraduate course. To maximise completion, tests were kept short; consequently, differences between individuals’ scores across both tests are examined rather than overall averages and pass rates.FindingsMost students who excelled in the MCQ test did not do so in the CRQ test. Students could do well without necessarily understanding the principles being tested.Research limitations/implicationsConclusions are limited by the small number of questions in each test and by delivery of the tests at different times. This meant that statistical average data would be too coarse to use, and that some students took one test but not the other. Conclusions concerning CRQs are limited to disciplines where numerical answers or short and constrained text answers are appropriate.Practical implicationsMCQs, while useful in formative assessment, are best avoided for summative assessments. Where appropriate, CRQs should be used instead.Social implicationsMCQs are commonplace as summative assessments in education and training. Increasing the use of CRQs in place of MCQs should increase the reliability of tests, including those administered in safety-critical areas.Originality/valueWhile others have recommended that MCQs should not be used (Hinchliffe 2014, Srivastavaet al., 2004) because they are vulnerable to guessing, this paper presents an experimental study designed to demonstrate whether this hypothesis is correct.


2014 ◽  
Vol 63 (6/7) ◽  
pp. 422-435 ◽  
Author(s):  
Georgios A. Giannakopoulos ◽  
Ioannis Koumantakis

Purpose – The purpose of this paper is to present a survey carried out on a sample of Greek university students (including students of library and archival science) that aimed to map and clarify perceptions of the archive among the students as well as their understanding of the nature of archival science. Moreover, it intends to investigate the information regarding student’s opinions and expectations about their archival studies. Design/methodology/approach – Two separate groups took part in this research and were asked to answer a questionnaire with 16 closed-type multiple-choice questions. The first group included 244 individuals, all of them Higher-Educational Institutions students from almost all academic fields. The second group contained 130 students from the three Information Departments of Greece. Findings – The conclusions verify Greek society’s view of archives. Even though no consistent definition of the archive seems to exist among the sample of students on which this survey drew, there is a clear understanding of the archive as a source of information emerging from the questionnaires as a shared undisputed fact. Practical implications – The research indicates that archival science is an important part of the information studies. The survey results were taken into account during the revamping of the curriculum of the Department of Library Science and Information Systems, Technological Educational Institute (TEI) of Athens. Originality/value – The study has advanced the understanding of archival science as an informational discipline which has to contribute a great part in the integrated field of information.


2014 ◽  
Vol 22 (3) ◽  
pp. 212-225 ◽  
Author(s):  
Valerie Priscilla Goby ◽  
Catherine Nickerson

Purpose – This paper aims to focus on the successful efforts made at a university business school in the Gulf region to develop an assessment tool to evaluate the communication skills of undergraduate students as part of satisfying the Association to Advance Collegiate Schools of Business (AACSB) accreditation requirements. We do not consider the validity of establishing learning outcomes or meeting these according to AACSB criteria. Rather, we address ourselves solely to the design of a testing instrument that can measure the degree of student learning within the parameters of university-established learning outcomes. Design/methodology/approach – The testing of communication skills, as opposed to language, is notoriously complex, and we describe our identification of constituent items that make up the corpus of knowledge that business students need to attain. We discuss our development of a testing instrument which reflects the learning process of knowledge, comprehension and application. Findings – Our work acted as a valid indicator of the effectiveness of teaching and learning as well as a component of accreditation requirements. Originality/value – The challenge to obtain accreditation, supported by appropriate assessment procedures, is now a high priority for more and more universities in emerging, as well as in developed, economies. For business schools, the accreditation provided by AACSB remains perhaps the most sought after global quality assurance program, and our work illustrates how the required plotting and assessment of learning objectives can be accomplished.


Sign in / Sign up

Export Citation Format

Share Document