The development of performance measures through an activity based benchmarking project across an international network of academic libraries

2014 ◽  
Vol 15 (1/2) ◽  
pp. 58-66 ◽  
Author(s):  
Simon Hart ◽  
Howard Amos
Keyword(s):  
Performance Measures ◽  
Academic Libraries ◽  
Teaching And Learning ◽  
Assessment Practices ◽  
Maturity Model ◽  
International Network ◽  
Content Type ◽  
Capability Maturity ◽  
Library Assessment ◽  
University Life

Purpose – The purpose of this paper is to outline the findings from the initial stages of an activity-based benchmarking project developed across an international network of academic libraries. Through working on a shared response to the question: “if we enable and support the academic endeavour how do we measure our effectiveness?” the network of libraries is using the formal mechanism of benchmarking as a means of continuous improvement. Design/methodology/approach – Actual improvements as a result of benchmarking are known to arise from considering and looking at processes, tools and techniques rather than from simply comparing and reviewing measurements of activity. The establishment of the Matariki Network of Universities provided the opportunity to begin work on international benchmarking amongst the member libraries. The project is a collaborative exercise involving comparisons across the libraries on a selected number of services and activities that are similar across the institutions and are representative of overall library service provision. In this first stage of the project the focus is on support for teaching and learning, specifically activities and programmes that support the transition of first-year students into university life. To simplify the process the libraries have shared details in relation to specific cohorts of students. In order to achieve this, participating libraries used an online collaborative workspace to respond to a series of questions. These responses were analysed to identify common themes, highlight exemplars and select further topics for discussion. Findings – Acknowledging the challenge of international collaboration, processes and mechanisms were developed. It was important to establish a shared language with a set of agreed terms and definitions. Similarly, taking time for each partner to contribute to the project has been valuable. Consideration of each of the libraries responses to the survey questions reveals a diverse number of activities and practices that represent a strong commitment to the needs of students. Drawing on institutional strategic direction and policy, each library allocates substantial resourcing to these activities and practices. The exercise within the benchmarking project produced a valuable set of data for each library to review and learn from. In terms of managing the project, findings are consistent with those reported in the administration of other benchmarking projects. The libraries are in the early stages of developing a series of common international performance measures. It is evident that learning more detail about assessment processes used across each library is necessary to advance the project aims. Further work with the project partners on measuring the effectiveness of their activities will allow the testing of the application of a maturity model for quality improvement of library assessment practices. Research limitations/implications – The project provides the opportunity to develop a series of performance measures that can be verified across an international network of libraries. Sharing information on activities and practices that impact upon the wider institution provides a means to review and improve library assessment practices. Originality/value – This paper outlines the first benchmarking activity in the development of a review of performance measures through an activity-based benchmarking project. The activity included an international network of academic libraries. This work will lead to benchmarking effectiveness measures and the development of a library assessment capability maturity model. This will offer a development path, and a better understanding of progress, to demonstrate value and provide evidence of successful outcomes.

A capability maturity model for assessment of active learning in higher education

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Fernanda Gobbi de Boer Garbin ◽  
Carla Schwengber ten Caten ◽  
Diego Augusto de Jesus Pacheco
Keyword(s):  
Higher Education ◽  
Active Learning ◽  
Stem Education ◽  
Teaching And Learning ◽  
Learning Processes ◽  
Capability Maturity Model ◽  
Maturity Model ◽  
Content Type ◽  
Capability Maturity ◽  
Traditional Pedagogy

PurposeAlthough active learning methodologies are recognized as an effective means to achieve expected educational demands, in practice, the teaching and learning processes are still widely characterized by traditional pedagogy aspects. As a result, teaching innovations in science, technology, engineering and math (STEM) education are carried out in isolation in specific disciplines, programs or departments. To addresses these challenges and to stimulate useful teaching innovations, this study aims to propose the capability maturity model to active learning (CMMAL) for assessing the maturity level of active learning methodologies in higher education institutions (HEIs).Design/methodology/approachThe CMMAL provides inputs for planning and decision-making, identifying variables such as the current state of teaching and learning processes, project management, team development, allocation of resources and infrastructure and the choice of evaluation and assessment methods. From the relevant literature, the primary aspects that impact on active learning were identified and incorporated into the structure of the model. Next, a survey was performed with 295 STEM professors and experts validating the scope of the model proposed.FindingsThe findings demonstrated the contribution of the CMMAL mainly to (1) assess the maturity levels of active methodologies in higher education and (2) stimulate the institutionalization of active learning practices in HEIs to minimize some problems related to the dissemination of new teaching practices.Practical implicationsThe primary practical and academic contribution of our study is the proposition of an artifact with a scope compatible with the need of the HEIs for the implementation of active learning methodologies. This paper presents a different perspective of current literature in active learning in STEM education, introducing a model that contributes to open the dialogue with HEIs interested in better understand and improve the performance in student-centered pedagogy.Originality/valueThe model also informs and leads to specific recommendations for HEIs seeking to enhance the performance of and alter the culture around active learning methodologies.

Assessment committees: good practices from ARL libraries

2016 ◽  
Vol 17 (3) ◽  
pp. 224-240 ◽  
Author(s):  
Michelle H. Brannen ◽  
Sojourna J. Cunningham ◽  
Regina Mays
Keyword(s):  
Academic Libraries ◽  
Academic Library ◽  
Content Type ◽  
Good Practices ◽  
Research Libraries ◽  
Association Of Research Libraries ◽  
Library Assessment ◽  
Current State ◽  
Survey Results ◽  
Assessment Activities

Purpose Assessment activities in academic libraries continue to grow as libraries explore assessment endeavors. Ranging from basic stats gathering and reporting to surveys, focus groups, and usability studies and beyond. Many practitioners are finding it necessary to create new processes and programs, with little guidance. The purpose of this paper is to paint a broad picture of assessment activities in Association of Research Libraries (ARL) university libraries with the goal of creating a resource for libraries developing or improving their assessment programs. Design/methodology/approach A survey was developed that asked questions about assessment personnel, activities, mission, and website. A total of 113 surveys were sent to academic library members of ARL. Survey results were analyzed to compile a list of recommended good practices for assessment and working with assessment committees in academic libraries. Findings The investigators had a response rate of 43 percent. The open-ended nature of the survey questions allowed for the respondents to specifically narrow down the problems and opportunities inherent in library assessment committees. Originality/value This study takes the temperature of the current state of assessment programs in ARL libraries, demonstrating the growth of assessment programs. It begins to document the practices of these libraries, particularly in regards to the sometimes informal and hard to track use of committees and other in-house collaborations, as a first step toward developing best practices for the field. The results illuminate productive areas for further study, including investigating how to measure a culture of assessment and maximizing impact of assessment information presented on assessment websites.

Principles and practice in impact assessment for academic libraries

2018 ◽  
Vol 119 (1/2) ◽  
pp. 121-134 ◽  
Author(s):  
Christine Urquhart
Keyword(s):  
Performance Evaluation ◽  
Impact Assessment ◽  
Academic Libraries ◽  
Data Analytics ◽  
Open Data ◽  
Library Services ◽  
Content Type ◽  
Qualitative And Quantitative ◽  
Library Assessment ◽  
And Performance

Purpose This paper aims to examine the principles that underpin library assessment, methods used for impact and performance evaluation and how academic libraries should use the findings, and it discusses how value frameworks help. Design/methodology/approach This is a literature review covering aspects of value (value propositions, value co-creation), value frameworks (including the 2015 ACRL framework, Holbrook typology with worked example), data analytics and collaborative projects including LibQUAL+ initiatives and the use of balanced scorecard principles (including a values scorecard). Findings The use of data analytics in library assessment requires collaboration among library services to develop reliable data sets. Scorecards help ongoing impact and performance evaluation. Queries that arise may require a framework, or logic model, to formulate suitable questions and assemble evidence (qualitative and quantitative) to answer new questions about the value of library services. The perceived value framework of Holbrook’s typology, the values scorecard and the ACRL framework all support the deeper level of inquiry required. Research limitations/implications Includes examples of possible application of frameworks. Practical implications A value framework might help data analytic approaches in combining qualitative and quantitative data. Social implications Impact assessment may require assessing how value is co-created with library users in use of e-resources and open data. Originality/value The study contrasts the varying approaches to impact evaluation and library assessment in academic libraries, and it examines more in-depth value frameworks.

scholarly journals Systems thinking and CMM for continuous improvement in the construction industry

2019 ◽  
Vol 69 (2) ◽  
pp. 271-296 ◽  
Author(s):  
Temitope Seun Omotayo ◽  
Prince Boateng ◽  
Oluyomi Osobajo ◽  
Adekunle Oke ◽  
Loveline Ifeoma Obi
Keyword(s):  
Continuous Improvement ◽  
Financial Risk ◽  
System Thinking ◽  
Management Policy ◽  
Maturity Model ◽  
Structured Interviews ◽  
Content Type ◽  
Performance Culture ◽  
Construction Companies ◽  
Capability Maturity

Purpose The purpose of this paper is to present a capability maturity model (CMM) developed to implement continuous improvement in small and medium scale construction companies (SMSCC) in Nigeria. Design/methodology/approach A multi-strategy approach involving qualitative studies of SMSCC in Nigeria was conducted. Semi-structured interviews were conducted with purposively selected construction experts in Nigeria to identify variables essential for continuous improvement in SMSCC. Data collected were thematically analysed using NVIVO. Subsequently, a system thinking approach is employed to design and develop the CMM for implementing continuous improvement SMSCC, by exploring possible relationships between the variables established. Findings CMM provided a five-level approach for the inclusion of investigated variables such as team performance; culture; structure; post-project reviews, financial risk management, waste management policy and cost control. These variables are factors leading to continuous improvement in SMSCC, implementable within a six to seven and a half years’ timeline. Practical implications The system thinking model revealed cogent archetypes in the form of reinforcing loops that can be applied in developing the performance of SMSCC. Continuous improvement is feasible. However, it takes time to implement. Further longitudinal studies on the cost of implementing continuous improvement through CMM a knowledge transfer project can be initiated. Originality/value A methodical strategy for enhancing the effectiveness and operations of SMSCC in developing countries can be extracted from the causal loop diagram and the CMM.

scholarly journals The assessment of quality maturity levels in Nigerian university libraries

2017 ◽  
Vol 66 (6/7) ◽  
pp. 399-414 ◽  
Author(s):  
Halima Egberongbe ◽  
Barbara Sen ◽  
Peter Willett
Keyword(s):  
Academic Libraries ◽  
Academic Library ◽  
Value Added ◽  
Basic Knowledge ◽  
Maturity Model ◽  
University Libraries ◽  
Framework Analysis ◽  
Content Type ◽  
Maturity Assessment ◽  
Nigerian University

Purpose Organizations constantly evaluate their activities to ensure that they are attaining their management goals. Maturity assessment enables organizations to examine their capabilities, support innovation and evaluate development. The aim of this paper is to evaluate the maturity statuses of a selection of Nigerian university libraries in a study to investigate their quality management (QM) approaches. The study provides recommendations for means to attain the required statuses in academic library development. Design/methodology/approach The study involved a multisite case study in which interviews were conducted with 15 university librarians (or their representatives) and ten focus groups were conducted with non-management library staff. The resulting qualitative data were analyzed using an aspect of framework analysis – charting, while a maturity model from the field of project management (Prince 2 Maturity Model, P2MM) was used to assess maturity in QM of the libraries. Findings The results of the maturity assessment indicate a basic knowledge of the concept of QM implementation among the libraries. The scores obtained on the P2MM capability scale placed the libraries studied mainly on Level 1 (awareness level) of the model. Practical implications This paper demonstrates that the culture of QM in academic libraries in Nigeria is at a low level with considerable potential for development. It is suggested that future adoption of quality maturity models to assess performance and organizational effectiveness would aid improvements for value-added services. Originality/value This is the first study to attempt the assessment of quality maturity levels in Nigerian academic libraries for identification of the organization’s positioning in QM and strategy.

Mining reference chat transcripts to analyze noise complaints

2018 ◽  
Vol 46 (4) ◽  
pp. 578-586
Author(s):  
Jason M. Vance
Keyword(s):  
Academic Libraries ◽  
Hot Spots ◽  
Design Methodology ◽  
Public University ◽  
Time Of Day ◽  
Virtual Reference ◽  
Content Type ◽  
Library Assessment ◽  
Preliminary Study

Purpose This case study provides a new methodology for examining patron-initiated noise complaints in academic libraries by mining virtual reference chat transcript logs. The purpose of this study is to illustrate how noise complaints can be identified, analyzed and mapped to create a visual representation of the library’s soundscape. Design/methodology/approach This study reviewed 4,494 reference chat logs taken over four semesters at a large public university between August 2015 and May 2017. From these transcripts, the author identified 330 unique noise complaints and analyzed them by content, time of day, day of week, week of semester and floor of library. Complaints were also plotted on a library map to determine noise complaint hot spots. Findings Analysis of the noise complaints showed that 82 per cent of the reported incidents originated in designated quiet study zones and 55 per cent of the complaints occurred in the evenings when the library was more lightly staffed. Mapping the noise complaints revealed that most infractions were reported in areas where public computing areas and group study rooms were situated directly adjacent to designated quiet study areas. Originality/value Although there are numerous studies on noise in libraries and many published analyses of reference chat transcripts, this paper is the first to analyze chat transcripts for the purpose of studying noise complaints in the library. This paper is an expansion of a preliminary study presented at the 2016 Library Assessment Conference in Arlington, VA.

scholarly journals The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness

2018 ◽  
Vol 13 (4) ◽  
pp. 31-49
Author(s):  
Simon Hart ◽  
Howard Amos
Keyword(s):  
Ad Hoc ◽  
Design Science ◽  
Science Research ◽  
Assessment Process ◽  
Capability Maturity Model ◽  
Maturity Model ◽  
Maturity Level ◽  
Activity Data ◽  
Capability Maturity ◽  
Library Assessment

Abstract Objective – This paper presents a Library Assessment Capability Maturity Model (LACMM) that can assist library managers to improve assessment. The process of developing the LACMM is detailed to provide an evidence trail to foster confidence in its utility and value. Methods – The LACMM was developed during a series of library benchmarking activities across an international network of universities. The utility and value of the LACMM was tested by the benchmarking libraries and other practitioners; feedback from this testing was applied to improve it. Guidance was taken from a procedures model for developing maturity models that draws on design science research methodology where an iterative and reflective approach is taken.  Results – The activities decision making junctures and the LACMM as an artifact make up the results of this research. The LACMM has five levels. Each level represents a measure of the effectiveness of any assessment process or program, from ad-hoc processes to mature and continuously improving processes. At each level there are criteria and characteristics that need to be fulfilled in order to reach a particular maturity level. Corresponding to each level of maturity, four stages of the assessment cycle were identified as further elements of the LACMM template. These included (1) Objectives, (2) Methods and data collection, (3) Analysis and interpretation, and (4) Use of results. Several attempts were needed to determine the criteria for each maturity level corresponding to the stages of the assessment cycle. Three versions of the LACMM were developed to introduce managers to using it. Each version corresponded to a different kind of assessment activity: data, discussion, and comparison. A generic version was developed for those who have become more familiar with using it. Through a process of review, capability maturity levels can be identified for each stage in the assessment cycle; so too can plans to improve processes toward continuous improvement. Conclusion – The LACMM will add to the plethora of resources already available. However, it is hoped that the simplicity of the tool as a means of assessing assessment and identifying an improvement path will be its strength. It can act as a quick aide-mémoire or form the basis of a comprehensive self-review or an inter-institutional benchmarking project. It is expected that the tool will be adapted and improved upon as library managers apply it.

Influence of organizational life cycle on performance management design in the software industry

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Salete Verginia Fontana Baiochi ◽  
Guilherme Corredato Guerino ◽  
Gislaine Camila Lapasini Leal ◽  
Renato Balancieri ◽  
Syntia Lemos Cotrim ◽  
...  
Keyword(s):  
Life Cycle ◽  
Software Development ◽  
Performance Management ◽  
Project Performance ◽  
Structural Equations ◽  
Maturity Model ◽  
Organizational Life ◽  
Organizational Life Cycle ◽  
Content Type ◽  
Capability Maturity

PurposeThis work investigates the influence of the organizational life cycle (OLC) on the performance management system (PMS) design and the performance of projects in Brazilian industries of software development.Design/methodology/approachThe study employed descriptive statistics and structural equations modeling on the data and information obtained from 115 Brazilian industries of software development with maturity in project management. Data collection was carried out through a survey applied to managers of the organizations mapped and certified by management maturity models Brazilian software process improvement (MPS-BR) or capability maturity model integration (CMMI).FindingsResults revealed that OLC influences the PMS design dimensions (scope, aggregation and opportunity) and project performance. Regarding effects observed on the performance of projects, only the scope dimension's influence was validated by the analyses, and the other dimensions were not significant considering the investigated sample.Originality/valueThe paper shows evidence of how OLC can influence PMS design and project performance. The analyses can help managers to improve their actions in the PMS design, increasing confidence and generating more robust and sustainable results in the business model.

The development of the data science capability maturity model: a survey-based research

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Mert Onuralp Gökalp ◽  
Ebru Gökalp ◽  
Kerem Kayabay ◽  
Altan Koçyiğit ◽  
P. Erhan Eren
Keyword(s):  
Data Science ◽  
Gap Analysis ◽  
Process Capability ◽  
Capability Maturity Model ◽  
International Electrotechnical Commission ◽  
Maturity Model ◽  
Data Governance ◽  
Content Type ◽  
Capability Maturity ◽  
Development Framework

PurposeThe purpose of this paper is to investigate social and technical drivers of data science practices and develop a standard model for assisting organizations in their digital transformation by providing data science capability/maturity level assessment, deriving a gap analysis, and creating a comprehensive roadmap for improvement in a standardized way.Design/methodology/approachThis paper systematically reviews and synthesizes the existing literature-related to data science and 183 practitioners' considerations by employing a survey-based research method. By blending the findings of this research with a well-established process capability maturity model standard, International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 330xx, and following a methodological maturity development framework, a theoretically grounded model, entitled as the data science capability maturity model (DSCMM) was developed.FindingsIt was found that organizations seek a capability/maturity model standard to evaluate and improve their current data science capabilities. To close this research gap, the DSCMM is developed. It consists of six capability maturity levels and twenty-seven processes categorized under five process areas: organization, strategy management, data analytics, data governance and technology management.Originality/valueThis paper validates the need for a process capability maturity model for the data science domain and develops the DSCMM by integrating literature findings and practitioners' considerations into a well-accepted process capability maturity model standard to continuously assess and improve the maturity of data science capabilities of organizations.

A leadership maturity model for implementing Six Sigma in academic institutions – using case studies to build theory

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Stephen Graham Anthony ◽  
Jiju Antony
Keyword(s):  
Case Studies ◽  
Continuous Improvement ◽  
Six Sigma ◽  
Lean Six Sigma ◽  
Leadership Teams ◽  
Academic Leadership ◽  
Maturity Model ◽  
Academic Institutions ◽  
Content Type ◽  
Capability Maturity

Purpose The purpose of this paper is to present a maturity model for academic leadership teams to benchmark their ability to deliver a culture of continuous improvement through the use of Lean Six Sigma. Teams will also be able to use this model to develop strategic action plans to improve the culture of continuous improvement within their institution. In addition, this paper explains the journey the authors have taken in creating this model by using a mixture of literature review, questionnaires and case studies to build the model and the use of test cases to refine and improve the model. Design/methodology/approach This paper uses a structured approach, focussing first on assessing the state of UK Lean Six Sigma(LSS) implementation and the, through the use of the case study method, the authors have designed a maturity model based on the classic capability maturity matrix approach. The final model has then been tested to refine the model into an improved version. Findings Key findings from interviewing the academic institutions that make up this paper highlight the current best practice in the UK and how far they still have to travel to become truly continuous improving organisations. Research limitations/implications This paper is limited to only focussing on UK institutions in the design and development of the maturity model. Future research should benchmark UK institutions more formally with international universities from North America and the Far East. Practical implications This paper present a final maturity model which can be used by academic leadership teams to both map their maturity at delivering continuous improvement projects and to act as an action plan to move the culture towards a quality-based, continuously improving institution. Originality/value To the best of the authors’ knowledge, this is the first such model to be produced focussing on the leadership and sustainability of deploying LSS in academic institutions.

Sign in / Sign up

Export Citation Format

Share Document