Meta-Assessment: The ARL Library Assessment Ecosystem Modified for Montana State University

2019 ◽  
Author(s):  
Scott W. H. Young ◽  
David Swedman ◽  
Martha Kyrillidou
Keyword(s):  
Comparative Analysis ◽  
User Experience ◽  
Gap Analysis ◽  
Task Force ◽  
Strategic Plan ◽  
Second Phase ◽  
State University ◽  
Montana State University ◽  
Assessment Program

How can we apply an assessment lens to our own assessment practices? To answer this question, we follow a mixed-methods approach by applying the assessment ecosystem design described in the recent ARL Assessment Program Visioning Task Force Recommendations (December 17, 2017). Our research synthesizes the evidence and insights gathered through three methods: a case study analysis, a comparative analysis, and a gap analysis.First, we examine a case study of a UX and Assessment (UX&A) program recently developed at Montana State University (MSU). The vision of the UX&A program at MSU is to build and sustain a library that is useful, usable, and desirable for our diverse community of users. UX&A personnel work collaboratively with other Library departments to continually measure, assess, and improve users' experience of Library services and instruction, both physical and online. This new UX&A program was developed in tandem with a new library strategic plan, which is based on the Balanced Scorecard framework.With the new assessment program and strategic plan in place, we conducted a second phase of research: a comparative analysis of the MSU UX&A program vis-à-vis the assessment landscape described in the ARL Recommendations. In this analysis, we highlight which ecosystem elements are currently in place, which elements are in development, and which still need to be developed at MSU.Next, we conducted a gap analysis comparing the ARL recommendations with established and emerging user experience and assessment programs in place at other research libraries to determine if there are additional elements outside of these recommendations that may be useful for describing, assessing, and improving a library’s assessment framework.Finally, we synthesized the insights gathered from our meta-assessment to create an enhanced version of the ARL ecosystem as applied to the MSU library. In terms of practical impact, this enhanced meta-assessment ecosystem can be applied to comprehensively evaluate and improve a library’s user experience and assessment program. Our research ultimately demonstrates and models an approach for meta-assessment that can help inform the development of more effective and sustainable library UX and assessment programs, for the ultimate benefit of our users.

scholarly journals Analysis of The User Experience of a Mobile Application System : A Case Study of Xyz

2017 ◽  
Vol 4 (2) ◽  
pp. 47-61
Author(s):  
Panjinagara Vandy Firstama ◽  
Maulahikmah Galinium ◽  
James Purnama
Keyword(s):  
User Experience ◽  
Mobile Application ◽  
Gap Analysis ◽  
Application System ◽  
System A ◽  
Experience Questionnaire ◽  
New System

This research intention is to comparing user experience value of mobile applic ation using User experience(UX) result from new and old sys tem, then doing gap analysis to determine how much improvement of user experience in the new system compared to old system. By using User Experience Questionnaire (UEQ), this research is to evaluat e which aspect of mobile application is looked for by its u ser. Survey is conducted to 60 people to answer what experience they have on old application, new application and user expectation for application and compare them. The result shows that there s mu ch improvement from old application to new application, and for expectation user towards new and old application, the gap between new app to expectation become closer if compare with old app to expectation

scholarly journals Engineers Without Borders-Montana State University: A Case Study in Student-Directed Engagement in Community Service

2016 ◽  
Author(s):  
Kathryn Plymesser ◽  
Damon Sheumaker ◽  
Christopher Allen
Keyword(s):  
Community Service ◽  
State University ◽  
Montana State University ◽  
Engineers Without Borders

Implementation of Resource Discovery

2012 ◽  
pp. 598-607 ◽  
Author(s):  
Elizabeth P. Babbitt ◽  
Amy Foster ◽  
Doralyn Rossmann
Keyword(s):  
Academic Libraries ◽  
Resource Discovery ◽  
Lessons Learned ◽  
Collection Development ◽  
State University ◽  
Montana State University ◽  
Daunting Task ◽  
Library Resources ◽  
The Impact

Academic libraries have a myriad of information sources for their communities, yet meeting users at their point of need can be a daunting task. Web-scale discovery tools offer a way to pull together many library resources for retrieval through a single search interface. The lessons learned in this case study at Montana State University include challenges with implementation, troubleshooting, collection development, and user education. Strategies and solutions to problems such as “full-text red herrings” (broken links to articles from aggregated databases) as well as techniques for prioritizing search results are described. Incorporating locally digitized collections in the discovery tool is also explained. The impact of discovery on collection development can take many forms and this case study details three issues that this implementation caused to emerge. The examples described in this chapter serve as helpful considerations for other academic libraries in their Web-scale discovery product exploration, implementation, and analysis.

scholarly journals Usability Testing: A Case Study

1999 ◽  
Vol 60 (6) ◽  
pp. 552-569 ◽  
Author(s):  
Janet Chisman ◽  
Karen Diller ◽  
Sharon Walbridge
Keyword(s):  
Full Text ◽  
Task Force ◽  
Usability Testing ◽  
Washington State ◽  
Public Access ◽  
State University ◽  
Education Department ◽  
Washington State University ◽  
Usability Tests

Usability testing is a technique for identifying difficulty that individuals may have using a product. Usability tests of the Washington State University (WSU) Libraries’ online public access catalog (OPAC), Article Indexes, Full Text, More, and Other Library Catalogs sections revealed problem areas. A task force used test findings to recommend solutions that led to the participation of the working group involved in designing search screens, the libraries’ User Education Department, and Innovative Interfaces Inc., the OPAC vendor. Solutions are currently being implemented.

Understanding user experience in bring your own device spaces in the library

2019 ◽  
Vol 20 (3) ◽  
pp. 201-212
Author(s):  
Zoe Chao ◽  
Steve Borrelli ◽  
Bikalpa Neupane ◽  
Joseph Fennewald
Keyword(s):  
User Experience ◽  
Social Needs ◽  
Mixed Methods Study ◽  
Bring Your Own Device ◽  
State University ◽  
Content Type ◽  
User Behaviors ◽  
Flip Chart ◽  
Penn State

Purpose The purpose of this paper is to triangulate qualitative and quantitative data with existing data to inform on the function and user experience of a newly created the “News Library,” and, further, to inform on the viability of “bring your own device spaces” (BYOD) in meeting the computing needs of Penn State University Park students through a multi-dimensional study. Design/methodology/approach This study leverages several methodologies for data collection, including observation, survey, flip chart prompts, interviews and focus groups. Findings Findings suggest that the News Library accommodates users’ social needs. However, it does not accommodate their communal needs well. The majority of students at the Penn State University Park campus, own laptops and bring them to the library when they intend to study. Personal device usage is preferable to library-provided computers per a familiarity with their personal device, access to personal files and independence of workspace. Research limitations/implications As this is a case study, the findings are not generalizable. This study was conducted in one library, on one campus at a 24-campus institution with over 30 libraries. Originality/value The mixed-methods study provides multiple views into user behaviors and expectations. The authors propose guidelines for informing the design of BYOD spaces.

Assurance of Learning (AOL): Case Study in a Capstone Finance Course at Indiana University South Bend Comparative Analysis of Classes O ver the Years 2017 and 2018

2019 ◽  
Vol 10 (8) ◽  
pp. 691-703
Author(s):  
Raj K. Kohli ◽  
◽  
Anurag Pant
Keyword(s):  
Comparative Analysis ◽  
Classroom Environment ◽  
Poor Performance ◽  
Assessment Process ◽  
State University ◽  
Indiana University ◽  
Assurance Of Learning ◽  
The Mean ◽  
The Impact

Assurance of Learning (AOL) has become an increasingly important dimension in Association to Advance Collegiate Schools of Business (AACSB) evaluation standards. In this case study, the authors developed and used a distinct AOL model to measure the impact on students learning in a capstone finance course at a state university in Indiana. Direct assessment of students learning is tested in closely controlled classroom environment through exam. A comparative analysis is completed using AOL developed model for the years 2017 and 2018. The findings suggest the mean non-AOL grade (85.67%) is significantly higher than the mean AOL grade (58.60%) in the year 2017. The same was observed in 2018, the mean non-AOL (85.53%) was significantly greater than the mean AOL grade (70.96). A poor performance in AOL model category indicates that the AOL model developed for this study successfully measures Assessment Process.

scholarly journals NATURAL TREATMENT SYSTEMS FROM THE POINT OF DIDACTICS

2016 ◽  
Vol 13 (26) ◽  
pp. 69-77 ◽  
Author(s):  
Ketevan KUPATADZE ◽  
Burak KIZILOZ
Keyword(s):  
Comparative Analysis ◽  
Environmental Pollution ◽  
21St Century ◽  
Chemical Processes ◽  
Motivation To Learn ◽  
State University ◽  
Ecological Chemistry ◽  
Natural Treatment Systems ◽  
Natural Treatment

All the issues related to environmental ecology, and, among them, Natural Treatment systems, obtain particular importance now, in the 21st century. It is very important to start delivering classes on NTS, the natural chemical processes, and pollution agents, at schools and universities. As a case study, the article discusses the methodology of teaching NTS at University and school levels. The methodology is orientated on the realization of some important didactic principles in the teaching process which is a very effective tool for increasing students’ motivation to learn. For comparative analysis, there will be used the experience of two neighboring countries - Greece and Turkey, to better understand the NTS applications in reality. The article has described the scenario of lectures and laboratory work which is taking place at Ilia State University, within the scopes of the courses: Ecological Chemistry and Eco-tourism. To increase the level of the popularity of NTS, it will be a good experience to organize on-site lectures at the places where NTS is functioning. The outcome of the pedagogical experiment has made it clear, that such a method of teaching of NTS affects positively students motivation and changes their attitude towards the environmental pollution

scholarly journals Textual evaluation vs. User testing: a comparative analysis

2019 ◽  
Author(s):  
Thiago Hellen O. da Silva ◽  
Lavínia Matoso Freitas ◽  
Marília Soares Mendes ◽  
Elizabeth Sucupira Furtado
Keyword(s):  
Comparative Analysis ◽  
User Experience ◽  
User Testing

One of the ways to evaluate a system is from Textual Evaluation. This type of evaluation consider the textual user’s opinions to infer aspects of the interaction with the system. Although this method covers many texts and consi- ders spontaneous narratives of the users, it takes a lot of time and effort. Some authors have reported on the need to compare evaluations techniques in order to investigate their effectiveness in revealing issue or to supplement the results of a systems assessment. This study presents a comparative analysis between the textual evaluation and user testing. A case study was performed evaluating the usability and user experience of a health app. As a result, the techniques were analyzed based on aspects that involved describing the results, resources needed and description of problems and users.

scholarly journals Strategic Planning for the Chinese American Library Association

2021 ◽  
Vol 6 (1) ◽  
pp. 55-72
Author(s):  
Wenli Gao ◽  
Raymond Pun ◽  
Lian Ruan
Keyword(s):  
Strategic Planning ◽  
Planning Process ◽  
Mission Statement ◽  
Task Force ◽  
Strategic Plan ◽  
Chinese American ◽  
American Library Association ◽  
Strategic Planning Process ◽  
Planning Task

This report explored the Chinese American Librarians Association (CALA)’s strategic planning process for 2020-2025 during COVID-19. The paper introduced CALA’s mission statement, values, and discussed the importance of the strategic plan. A strategic planning task force was formed to create an opportunity for membership input in virtual town hall meetings and surveys. The authors presented a case study on the process of revising a strategic plan and discussed the implementation phases. The authors also shared the challenges and recommendations in organizing strategic planning for a library association.

scholarly journals An Investigation into the Effect of Smartphones Back Button Location on Users' Experience: A Case Study Comparing Apple iPhone and Android UI

2018 ◽  
pp. 1-7
Author(s):  
Ahmad Rufai ◽  
Umar Sani
Keyword(s):  
User Experience ◽  
User Interfaces ◽  
Structured Interview ◽  
User Preferences ◽  
State University ◽  
Input Method ◽  
The Difference ◽  
Study Participants ◽  
Point Of Reference

The use of touchscreens as an input method on Smartphones has become the norm in the mobile phone industry. This has changed the way keys are traditionally arranged on Smartphones devices. One of these changes is on the location of “back button”. Few studies, However, have been conducted to investigate the effect of key locations on users performance and experience. Aims: In this paper, we investigate the effect of back button location on users’ experience of using Smartphones. We made a  comparison between Android Samsung Galaxy S3 and iPhone 5s. Place and Duration of Study: Participants: Sokoto State University, Sokoto, Nigeria.  between May 2017 and July 2017. Methodology: A total of 40 participants all Students of Sokoto State University participated in the study. 26 were males and 14 females. 30 owned Android Smartphones while the remaining  10 owned Apple iPhone. We used observation to observe how users navigate through Facebook and Gmail app on both iPhone and Android while paying attention to their use of the back button, the time it takes to locate these buttons and first point of reference. A semi-structured interview was also conducted on users, requesting them to compare how the difference in the location of the back button on iPhone and Android has affected their experience of navigating through both  Facebook and Gmail app. Results: The study reveals that back button key location affects the user experience of using Smartphones, keys located at the bottom edges are easier to locate and those located at top edges are harder to locate and press. Conclusion: Based on the results, the study concludes that designers of Smartphones user interfaces should strongly consider user preferences when deciding the location for back buttons and on Smartphones.  

Sign in / Sign up

Export Citation Format

Share Document