scholarly journals Understanding and evaluating teaching effectiveness in the UK higher education sector using experimental design

2019 ◽  
Vol 36 (2) ◽  
pp. 202-216 ◽  
Author(s):  
Jiju Antony ◽  
Stavros Karamperidis ◽  
Frenie Antony ◽  
Elizabeth A. Cudney

PurposeThe purpose of this paper is to demonstrate the power of experimental design as a technique to understand and evaluate the most important factors which influence teaching effectiveness for a postgraduate course in a higher education (HE) context.Design/methodology/approachThe methodology involves the execution of a case study in the form of an experiment in a business school setting. The experiment was carried out with the assistance of over 100 postgraduate students from 26 countries. The data were collected over a two year period (2015 and 2016) from a postgraduate course offered by the same tutor for repeatability reasons.FindingsThe key findings of the experiment have clearly indicated that students’ perceptions of teaching effectiveness based on intuition and guesswork are not identical to the outcomes from a simple designed experiment. Moreover, the results of the experiment provided a greater stimulus for the wider applications of the technique to other processes across the case study HE sector.Research limitations/implicationsOne of the limitations of the study is that the experiment was conducted for a popular postgraduate course. It would be beneficial to understand the results of the experiment for less popular postgraduate courses in the university in order to drive improvements. Moreover, this research was conducted only for postgraduate courses and the results may vary for undergraduate courses. This would be an interesting study to understand the differences in the factors between undergraduate and postgraduate teaching effectiveness.Practical implicationsThe outcome of this experiment would help everyone who is involved in teaching to understand the factors and their influences to improve students’ satisfaction scores during the delivery of teaching.Originality/valueThis paper shows how experimental design as a pure manufacturing technique can be extended to a HE setting.

Author(s):  
Jiju Antony ◽  
Laxman Sivanathan ◽  
E.V. Gijo

Purpose – The purpose of this paper is to explore the use of Design of Experiments (DoE) in a higher education setting and to remove the misconception that it is only applied to a manufacturing environment. The authors demonstrate a simple case study here to illustrate its application in a typical non-manufacturing context. Design/methodology/approach – The methodology involves the execution of a simple study in the form of an experiment in the Faculty of Engineering, University of Strathclyde. The experiment was performed with the assistance of both undergraduate and postgraduate students in one department in the Faculty of Engineering. Findings – It was found from the experiment that postgraduate students prefer a case study approach of teaching with multiple speakers and prefer their classes in the morning. As for undergraduate students, similar results were obtained but would prefer their classes in the afternoon. Moreover further analysis shows that the postgraduate students prefer a 30 minutes introduction to the topic in a one hour lecture. Moreover the students prefer more time to be spent on the exercises and less time on the discussion. Research limitations/implications – The sample size of the experiment was considered small in the study although this was a pilot study to investigate the use of DoE in a higher education setting. The authors will continue to collect more data for further validity of results obtained from the pilot study. The authors will also explore the use of different designs as part of the future investigations. Practical implications – The outcome of this experiment would help everyone who is involved in teaching to understand the factors and their influences to improve students’ satisfaction scores during the delivery of teaching. Originality/value – This paper shows how DoE as a pure manufacturing technique can be extended to a higher education setting. The results of this study were quite an eye opener for the authors in terms of understanding the key factors which influence any process irrespective of the sector.


2015 ◽  
Vol 23 (3) ◽  
pp. 233-249 ◽  
Author(s):  
Michelle Morgan

Purpose – The purpose of this paper is to report the notable findings of students with different domiciled status. There is a lack of research and understanding of how prior study experiences and the expectations of new students that are due to embark on an MSc by coursework level (also known as postgraduate-taught [PGT]) can impact on their study and ability to persist and succeed. The research available has mainly been confined to post-experience surveys. By identifying prior study experiences and study expectations, education providers in higher education institutions can use these insights not only to attract more students but to improve retention rates and the overall student experience. The research undertaken in the Faculty of Science, Engineering and Computing at a London-based, post-1992 institution aims to provide valuable data and insights into this nationally and internationally neglected area. Design/methodology/approach – New taught postgraduate students provided data on their previous study experiences, study expectations, opinions of postgraduate-level study and demographic data via a hard copy questionnaire which was distributed and completed during the orientation period in September 2012. It was entered into the Statistical Package for the Social Sciences (SPSS), and a range of tests were run on the data. Findings – The findings in this paper and the project in general will be further explored and investigated as a result of the Higher Education Funding Council for England (HEFCE) awarding a major grant to the post-1992 university to undertake research into these areas amongst nine similar English universities. Research limitations/implications – As the research was conducted over a one-year period, the findings are based on the limitations that such a time and financially limited project can offer. The institution at which the research was undertaken is a post-1992 institution that has high concentration towards teaching functions. The findings in this paper and the project in general will be further explored and investigated as a result of the HEFCE awarding a major grant to the post-1992 university to undertake research into these areas among nine similar English universities. Originality/value – The research highlights the similarities and differences in prior study experiences and expectations of studying at PGT level between the UK-, the European Union- (EU) and Non-EU-domiciled respondents. The research offers potentially important findings for similar institutions that are currently looking to develop and expand their PGT provision.


2018 ◽  
Vol 10 (2) ◽  
pp. 118-129
Author(s):  
Linda Carol Algozzini ◽  
Valencia Lavon Gabay ◽  
Shannon D. Voyles ◽  
Kimberly Bessolo ◽  
Grady Batchelor

Purpose This case study reviews a group coaching and mentoring (GCM) change model and its significance in dissolving barriers and promoting equity in virtual learning environments. The purpose of this paper is to examine the model’s approach to shifting instructor mindsets to align with institutional core values and initiatives that best serve a twenty-first century adult learner. Design/methodology/approach The change model, grounded in GCM, metacognition, self-regulated learning, and community of practice theory, incorporates participatory action research design focusing on cycles of action, reflection, and evaluation. Findings This study illustrates the change model’s success in moving educators toward deeper understanding of self and individual student differences. It further showcases how professionals adapt and improve practices using self-regulated learning and metacognition to better serve the population they teach. Practical implications The GCM framework improved engagement. The design, while implemented in a higher education arena, is applicable to other entities seeking to bridge gaps using metacognition and self-regulated learning to become adaptable and inclusive. Originality/value The change model, recipient of one of this year’s Effective Practice Awards from the Online Learning Consortium (2017), is recognized for innovation and replicability in and beyond higher education.


2014 ◽  
Vol 15 (1/2) ◽  
pp. 32-40 ◽  
Author(s):  
Ian Hall ◽  
Jessica Stephens ◽  
Sarah Kennedy

Purpose – The University of York Library, part of its Information Directorate, has successfully run an annual user survey using LibQUAL+ since 2008. The tool has proven invaluable in understanding user needs and measuring improvements. The ability to benchmark performance has been well received by university senior managers. Following this positive experience, the Directorate piloted the TechQual+ survey to assess its technology services. TechQual+ is a total market-survey tool developed on the same principles as LibQUAL+. York was the first university in the UK to do this. The purpose of this paper is to reflect upon the experience and its relevance to information services. Design/methodology/approach – A team was established to co-ordinate the distribution of the survey, which was e-mailed to all university members. The survey was conducted over a period of three weeks in December 2011 using their web-based tool. The team worked with the survey providers to make amendments in order to comply with UK Data Protection legislation. Findings – The TechQual+ tool provided a rich set of data on the IT needs of University of York students and staff, including a wealth of comments. As the first use of the tool in the UK, a number of outcomes arose from the pilot: methods for running the survey in order to meet UK data protection requirements; feedback on the tool itself, with some questions not understood from a UK context; a rich set of results data, with some similarities (and several differences) to those available through LibQUAL+. Originality/value – The paper presents the first application of the TechQual+ survey in UK and discusses the issues faced when implementing it in a UK context. The case study will be of interest to libraries or converged services interested in assessing their IT provision.


2016 ◽  
Vol 37 (6/7) ◽  
pp. 385-395 ◽  
Author(s):  
Gareth Wyn Owen

Purpose A case study of the Wales Higher Education Libraries Forum (WHELF) project to procure and implement a shared library management system (LMS) for all universities in Wales, together with the National Health Service Libraries in Wales and the National Library of Wales. In particular, the purpose of this paper is to explore the drivers to this collaboration, outline the benefits achieved and the framework to realise further benefits. Design/methodology/approach Case study review of the process, together with a review of literature on consortia and LMSs. Findings WHELF has developed into a more mature consortium through procuring and implementing a shared LMS. The process has delivered tangible benefits and is driving more work to realise further benefits. Research limitations/implications As the WHELF Shared LMS project is only nearing the end of the implementation phase, many of the anticipated operational benefits cannot be reported. Practical implications Useful case study for other consortia or potential consortia. Originality/value WHELF is in vanguard of consortia developments in the UK, and this is the first case study of the project.


2017 ◽  
Vol 18 (7) ◽  
pp. 1018-1038 ◽  
Author(s):  
Issa Ibrahim Berchin ◽  
Vanessa dos Santos Grando ◽  
Gabriela Almeida Marcon ◽  
Louise Corseuil ◽  
José Baltazar Salgueirinho Osório de Andrade Guerra

Purpose This paper aims to analyze strategies that promote sustainability in higher education institutions (HEIs), focusing on the case study of a federal institute of higher education in Brazil. Design/methodology/approach The research was based on a scientific literature review on sustainability in HEIs, to identify the recurrent actions for sustainability in these institutions; and a case study of a federal institute of higher education in Brazil, to illustrate how these actions are being implemented by HEIs. Findings Concerns about sustainability, prompted by the Brazilian federal legislature, led federal HEI to change its internal processes, infrastructure and organizational culture toward sustainability. Practical implications The findings presented in this study, more specifically the sustainability plan of the Federal Institute for Education, Science and Technology of Santa Catarina, aligned with the recommendations proposed, can be used and replicated in other HEIs. Originality/value Scientific literature about organizational changes led by sustainability concerns, in HEIs specifically, still needs more attention in the academia. By addressing the case of a Brazilian public institution of higher education, this paper contributes to the literature on sustainability in higher education by reporting the process of implementation of a sustainability plan.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Liane Dalla Gasperina ◽  
Janaina Mazutti ◽  
Luciana Londero Brandli ◽  
Roberto dos Santos Rabello

Purpose Smart campuses can be seen as the future of higher education efforts, especially for their contributions to sustainability and to encourage innovation. This paper aims to present the benefits of smart practices in a Higher Education Institutions and highlights its connections to the sustainable development goals (SDGs). Design/methodology/approach The methodology is divided into three steps: first, an international search and assessment of smart practices at universities; second, the identification of smart practices in a university campus in southern Brazil; and third, the presentation of the benefits of smart practices and their relationship with the SDGs. Findings The results showed that globally, the area most covered by smart practices in universities is the environment and, specifically, focused on waste reduction. in the context of this case study, the benefits of implementing smart practices mainly reach SDGs 4 and SDG 9, especially due to aspects of teaching technologies for the new classroom models and the optimization of campus infrastructure management. Practical implications The study encourages other universities to implement smart practices in their campuses, to becoming smart campuses while they also collaborate in achieving the SDGs while raising the discussion on the importance of committed actions taken on a university campus with the UN SDGs, to leverage synergies on campus operations at universities. Originality/value This paper presents a set of smart practices that universities are applying both globally and locally (in southern Brazil). In addition, it contributes to sustainability research by showing how smart practices have the potential to promote SDGs in universities, especially through campus operations.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Jonas Johannisson ◽  
Michael Hiete

Purpose This study aims to share experiences of an easy to adapt service-learning approach in a graduate course on life cycle assessment (LCA). Specifically, it reports on how students helped the university’s cafeteria to assess meals by conducting an LCA for 25 meals and identifying environmental hotspots. Design/methodology/approach A descriptive case study of a graduate course at Ulm University is presented. The course included lectures and problem-based exercises, both theoretical and software assisted. A course evaluation was conducted during the course and one year after completion to poll improvement potentials, as well as its impacts on students’ everyday life. Findings It was found that although it was the first LCA for all students, the resulting LCA information of 25 different meals were homogeneous, comparable to the scientific literature and beneficial to the cafeteria’s sustainable development strategy. The concept of service-learning had a higher impact on students’ motivation than a good grade and active-learning is explicitly requested by students. The course design sensitized students to the real-life problems of LCA and made their consumption patterns more elaborate and ecological. Furthermore, this digitization of higher education could be carried out with only minor changes in the present COVID-19 pandemic situation. Originality/value As the subject of service-learning in natural sciences is still expandable, this study presents an easy to adapt case study on how to integrate such an approach into university curricula dominated by traditional learning. To the best of the authors’ knowledge, this case study presents the first published LCA university course explicitly describing and evaluating a service-learning approach. The topic touches the everyday lives of students, allows comparisons between different student groups, is easily scalable to different group sizes and credits, and supports learning both how to study in small groups and cooperation between groups to ensure comparability of LCA results.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Suzanna Elmassah ◽  
Marwa Biltagy ◽  
Doaa Gamal

Purpose Higher education institutions (HEIs) should play a fundamental role in achieving the international 2030 sustainable development (SD) agenda. Quality education is the fourth of the sustainable development goals (SDGs), and one of the targets related to this is to ensure that by 2030 all learners acquire the knowledge and skills needed to promote SD. Therefore, the SDGs provide a motive for HEIs to integrate SD concepts into their day-to-day practices. This study aims to introduce a framework for HEIs’ sustainable development assessment. Such a framework guides HEIs and educational leaders to support their countries’ commitments to achieving the SDGs. Design/methodology/approach This paper presents the results of a case study analysis of the role and successful techniques of HEIs in achieving SD in three countries, namely, Germany, Japan and Egypt. Primary data was collected by semi-structured interviews with three Cairo University officials, while secondary data was collected by reviewing the universities' official websites, reports, publications and related papers. This study introduces a novel framework for HEIs' SD analysis and assessment, which guides HEIs and educational leaders to support SD to fulfill their countries' commitments to achieving the SDGs. This framework is based on the following five categories: strategic direction and institutional working practices, supporting students, supporting university staff competencies, supporting society's stakeholders and networking and sustainable campus. Consideration is given to the potential role of HEIs to support SD in each of these areas. Findings Cairo University could learn from the novel and pioneer practices of the Leuphana University of Lüneburg, and the University of Tokyo to fill in the gaps it has in different roles. It can also put more effort into adopting the suggested higher education programs of Egypt's Vision 2030. Research limitations/implications This paper is limited to a case analysis comparing three countries, Germany, Japan and Egypt. Second, this study has not considered school education, which is equally essential in countries' SD. Practical implications HEIs can use the framework and the findings in this paper to evaluate their current roles in supporting SD, identify the gaps and take actions accordingly to address their weaknesses. Originality/value The paper compares three universities, one in each of the case study countries. It draws conclusions that identify ways in which the paper's framework and findings can guide SD practice in HEIs internationally, especially those in the developing world.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Harry Barton Essel ◽  
Dimitrios Vlachopoulos ◽  
Dickson Adom ◽  
Akosua Tachie-Menson

Purpose The purpose of this study is to explore the characteristics and potential effects of teaching and learning through audio teleconferencing (dial-in) with a cell phone. In addition, the study aims to identify the associations between the audio teleconferencing and video teleconferencing in a 12-week postgraduate course. Design/methodology/approach The study is a cross-sectional survey conducted at the Department of Educational Innovations at the Kwame Nkrumah University of Science and Technology from March to June 2020. The purposive sampling technique was used to sample 100 postgraduate students who registered for a course in the department. The data for the study were collected using the System Usability Scale (SUS) and 17-item self-administered eQuestionnaire. Multiple Linear Regression analysis, ANOVA, Independent sample T-test and Mann–Whitney U-test were used to estimate the differences in course achievements of students who experienced education through audio teleconferencing and those who experienced education through video teleconferencing. Findings In total, 59% of the participating postgraduate students chose to attend the synchronous online lectures via audio teleconferencing (dial-in). The participants gave a high SUS score (SUS > 80.3; Grade A; Excellent) for audio conferencing service. Among the students in the audio teleconferencing cohort, the results evidenced a strong positive linear correlation, (r (57) = 0.79, p < 0.05), between the individual adjective ratings and the SUS scores. There was marginal significance among demography of students in the audio teleconference (AT) cohort with regards to their perception about the dial-in lecture. There was no statistically significant difference, (t (98) = 1.88, p = 0.063), in the achievement test for AT students and video teleconference (VT) students. The instructors and the students were satisfied with the AT. Practical implications Based on the students’ preference, AT offers equal benefit as VT with regards to system satisfaction and perceived quality of online teaching. AT, as teaching modality, should be an option for students who reside in communities with high latency internet connectivity. It is recommended that instructors are trained on how to engage and motivate students via AT. Originality/value Higher education institutions in Ghana are facing decisions about how to continue learning and teaching through flexible pedagogy, while keeping their faculty members and students protected from the COVID-19 pandemic. Many of these institutions have canceled the brick-and-mortar education and other conventional learning practices and have instructed faculty to adopt online teaching through synchronous video teleconferencing platforms. However, the learning experience is not the same for students who reside in remote or rural communities with low bandwidth. There is very little research in this topic, especially in developing countries like Ghana, and the present study aims to bridge the gap in the literature by exploring the characteristics and potential effects of teaching and learning through audio teleconferencing (dial-in) with a cell phone, in the context of a 12-week postgraduate course.


Sign in / Sign up

Export Citation Format

Share Document