scholarly journals The Online Evaluation of Courses: Impact on Participation Rates and Evaluation Scores

2017 ◽  
Vol 47 (2) ◽  
pp. 106-120
Author(s):  
Jovan F Groen ◽  
Yves Herry

At one of Ontario’s largest universities, the University of Ottawa, course evaluations involve about 6,000 course sections and over 43,000 students every year. This paper-based format requires over 1,000,000 sheets of paper, 20,000 envelopes, and the support of dozens of administrative staff members. To examine the impact of a shift to an online system for the evaluation of courses, the following study sought to compare participation rates and evaluation scores of an online and paper-based course evaluation system. Results from a pilot group of 10,417 students registered in 318 courses suggest an average decrease in participation rate of 12–15% when using an online system. No significant differences in evaluation scores were observed. Instructors and students alike shared positive reviews about the online system; however, they suggested that an in-class period be maintained for the electronic completion of course evaluations.  

Author(s):  
Jesper Hessius ◽  
Jakob Johansson

Purpose: Web-based questionnaires are currently the standard method for course evaluations. The high rate of smartphone adoption in Sweden makes possible a range of new uses, including course evaluation. This study examines the potential advantages and disadvantages of using a smartphone app as a complement to web-based course evaluationsystems.Methods: An iPhone app for course evaluations was developed and interfaced to an existing web-based tool. Evaluations submitted using the app were compared with those submitted using the web between August 2012 and June 2013, at the Faculty of Medicine at Uppsala University, Sweden. Results: At the time of the study, 49% of the students were judged to own iPhones. Over the course of the study, 3,340 evaluations were submitted, of which 22.8% were submitted using the app. The median of mean scores in the submitted evaluations was 4.50 for the app (with an interquartile range of 3.70-5.20) and 4.60 (3.70-5.20) for the web (P= 0.24). The proportion of evaluations that included a free-text comment was 50.5% for the app and 49.9% for the web (P= 0.80).Conclusion: An app introduced as a complement to a web-based course evaluation system met with rapid adoption. We found no difference in the frequency of free-text comments or in the evaluation scores. Apps appear to be promising tools for course evaluations. web-based course evaluation system met with rapid adoption. We found no difference in the frequency of free-text comments or in the evaluation scores. Apps appear to be promising tools for course evaluations.


2020 ◽  
Vol 2 (1) ◽  
pp. 32-37
Author(s):  
Nooradelena Mohd Ruslim ◽  
Ng Loo Ee ◽  
Norhusna Saharun ◽  
Nurhusna Baharuddin ◽  
Nurul Ain Abu Bakar ◽  
...  

The purpose of the study is to explore the relationship between teaching evaluation and lecturers’ performances. To achieve this purpose, the study analysed the correlations between teaching evaluation scores by student and evaluation on lecturers’ performances by dean, and between teaching evaluation scores by student and students’ final examination results. Census study was applied to collect all data, which involved 124 lecturers and eight deans. The study used data from the online system, which involved evaluation made for 246 courses by all active students in semester June – November 2018. Descriptive and inferential statistics were applied in this study and analysed using SPSS version 21.0. The result showed that there is no significant relationship between teaching evaluation scores by student and evaluation on lecturers’ performances by dean. This study also found that there is no significant relationship between teaching evaluation scores by student and students’ final examination results. Based on the findings, the study inferred there is bias in the evaluation instruments and there are external factors contributed to the outcome of insignificant correlations in both analyses, thus the effect or impact of the evaluation system to academic division is not significant


1980 ◽  
Vol 10 (1) ◽  
pp. 37-56
Author(s):  
A. L. Darling

In the period from 1960 to 1976 the participation rate in university education increased dramatically and has since fallen. During this same period the size of the university age group doubled, so there was a period of great expansion in university enrolment. Popula- tion projections show a decline of the order of 20% in the size of the university age group between 1982 and 1996, and many believe that university enrolments must inevitably drop too, although the participation rate will be a major determinant of what happens. The factors which influence participation rates using the period 1960 to 1978, and the way in which participation rates are measured are examined. This is then applied to a discussion of the level of undergraduate enrolment in the period to 1996.


2019 ◽  
Vol 10 (4) ◽  
pp. 975-991 ◽  
Author(s):  
Ingo Kregel

PurposeThe current evaluation standards in German higher education institutions (HEIs) do not often lead to measurable quality improvement. The purpose of this paper is to critically evaluate whether Kaizen can improve the quality of teaching. The presented concept illustrates the evaluation of each course unit to continuously encourage quality feedback from the learners and intensify the exchange with lecturers.Design/methodology/approachAction research is used to combine the continuous improvement philosophy of Kaizen with student course evaluations. A pilot study of the concept provides data from four course cycles to analyze learnings and setbacks.FindingsLearners in the pilot courses welcomed the intense participation and allowed improvements to elements such as course concept, course material, presentation style and content or detail selection. The participation rate declined during each term and was highly influenced by triggers like exam and grade relevance. Kaizen could successfully improve course quality, especially in the first two years of newly developed courses.Research limitations/implicationsThe presented results have been collected from one course over four years in one institution. The next stage of research would be the application of the approach in other institutions to validate results and make potential adjustments to the concept, for example, toward continuous learning.Originality/valueAlthough course evaluation has become standard in German HEIs, most institutions only implement it once per term or year. This paper discusses a new approach to expedite the evaluation of teaching quality at the point of action (Gemba) to facilitate the short-term reactions of lecturers.


2018 ◽  
Author(s):  
Andi Sessu

Export trade balance, oil and non-oil imports, Indonesia is in an active state or economy to prosper, while the results of multiple regression analysis showed that the export of non oil/gas, non oil/gas import, oil and gas imports and economic growth positive effect on the labor force participation rate, which means every increased four variables also increased labor force participation rate, while oil and gas exports have negative effect means that any increased export of oil and gas resulting in a decline in labor force participation rates and significant effect of all the variables of the labor force participation rate in Indonesia. Multiple correlation coefficients obtained r = 0.998 shows the effect of variable export of non oil/gas, non oil/gas import, export of oil and gas, oil and gas imports, economic growth together very strong and the coefficient of determination together the five variables can be R = 0.996 shows the percentage contribution of influence together of 99% means that only 0.01% contribution of other variables influence the level of labor force participation in Indonesia. It can be concluded that the development of oil and gas trade and non-oil and gas in Indonesia still need cooperation between individual communities, private sector, civil society and government in an effort to increase trade in Indonesia, because it is very big influence on the labor force participation rate that could lower the unemployment rate and can automatically reducing poverty, because unemployment and poverty in Indonesia is still high when compared with some other countries in the world


2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
S Barre ◽  
H Leleu ◽  
S Taleb ◽  
A Vimont

Abstract Introduction Colorectal cancer (CRC) is the third most common cancer and the second most deadly in France. A CRC national organized screening (OS) program was set up in France in 2009. It targets asymptomatic people aged 50 to 74 year with medium risk of CRC. OS program is based on fecal immunochemical test (FIT) followed by colonoscopy. Participation rate over the last period showed a participation rate of 34%, far from the European standards and the 45% target objective of the French cancer plan. Methods The epidemiological impact of the DO-CCR was estimated from the results of an individual simulation model adapted from the MISCAN-Colon model, calibrated and transposed to the French context. The model simulates the natural history of CRC in a cohort of 5,000,000 individuals from birth to death. The simulated population reproduced the age and sex structure of the French population. Current screening strategy was simulated for the entire population. A first analysis was conducted to estimate the individual impact of screening by sex and by age of screening initiation and cessation. A second analysis was carried out to estimate the global impact of the based on various participation rates. Results FIT every 2 years, from the age of 50, is associated with a reduction in the CRC incidence of 21% for women and 24% for men and a reduction in CRC mortality of 43% for women and 51% for men. At the current level of participation, the OS reduces incidence by 5% and mortality by 14% (2,200 CCR and 2,600 deaths per year) compared to no OS. The impact would be reduced by an additional 3% and 8% for participation rates of 45% and 65% respectively, a decrease of 1,300 and 3,500 cases per additional year. Similarly, mortality would decrease by an additional 8% and 22% for participation rates of 45% and 65%, respectively additional decreases of 1,400 and 4,000 deaths per year. Key messages These results confirm that in a population at medium risk for CRC, the OS is an effective strategy for reducing incidence of CRC. Increasing participation rate to reach the Cancer Plan’s objectives remains a key issue in France.


2022 ◽  
Author(s):  
Heidi Lyshol ◽  
Ana Paula Gil ◽  
Hanna Tolonen ◽  
Sónia Namorado ◽  
Irina Kislaya ◽  
...  

Abstract BackgroundParticipation rates in health surveys, recognized as an important quality dimension, have been declining over the years, which may affect representativeness and confidence in results. The Portuguese national health examination survey INSEF (2015) achieved a participation rate of 43.9%, which is in line with participation rates from other similar health examination surveys. The objective of this article is to describe strategies used by the local teams to increase participation rates and to solve practical survey problems.MethodsAfter a literature search, informal interviews were conducted with 14 public health officials from local health examination teams, regional and central authorities. 41 of the local staff members also filled in a short questionnaire anonymously. The interviews and self-administered questionnaires were analysed using mixed methods, informed by thematic analysis.ResultsThe local teams believed that the detailed manual, described as a "cookbook for making a health examination survey", made it possible to maintain high scientific standards while allowing for improvising solutions to problems in the local context. The quality of the manual, supported by a series of training workshops with the central research and support team, gave the teams the confidence and knowledge to implement local solutions. Motivation and cohesion within the local teams were among the goals of the training process. Local teams felt empowered by being given large responsibilities and worked hard to incite people to attend the examination through a close and persuasive approach.Local teams praised their INSA contacts for being available for assistance throughout the survey, and said they were inspired to try harder to reach participants to please their contacts for interpersonal reasons.ConclusionsThe theory of organizational improvisation or bricolage, which means using limited resources to solve problems, was useful to discuss and understand what took place during INSEF.A detailed manual covering standard procedures, continuous monitoring of the data collection and face-to-face workshops, including role-play, were vital to assure high scientific standards and high participation rates in this health examination survey. Close contacts between the central team and local focal points in all regions and all survey sites were key to accommodating unexpected challenges and innovative solutions.


2013 ◽  
Vol 6 (3) ◽  
pp. 333-338 ◽  
Author(s):  
Faruk Guder ◽  
Mary Malliaris

This paper studies the reasons for low response rates in online evaluations. Survey data are collected from the students to understand factors that might affect student participation in the course evaluation process. When course evaluations were opened to the student body, an email announcement was sent to all students, and a reminder email was sent a week later. Our study showed that participation rates increased not only when emails were sent, but also when faculty used in-class time to emphasize the importance of completing the evaluations.


2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
C Padilla ◽  
P Soler Michel ◽  
V Vieira

Abstract Introduction Mammography screening can reduce breast cancer mortality among women aged 50 years and older. Small geographic areas with lower breast cancer screening uptake may reflect gaps in screening efforts. Our objective was to identify the geographic variations of breast cancer screening uptake among women aged 50-74 years in the Lyon Metropole area, France. Methods We used spatial regression models within a generalized additive framework to determine the clusters of census blocks with significantly lower risk of breast cancer screening uptake. Census block-level data on breast cancer screening participation rates were calculated for women aged 50-74 years who did a mammography between 2015-2016 after being invited with a letter by the cancer screening organization. Using smoothed risk maps adjusting for covariates, we estimated the impact of the spatial distribution of deprivation index, part of opportunistic screening on breast cancer screening participation. Results Between 2015 and 2016, the participation rate of organized breast cancer screening was 49.9%. As hypothesized, women living in highly deprived census blocks had lower participation rates compared to less deprived. However, women living in rural areas with fewer certified mammography services than in urban areas had the highest participation rate. Spatial analyses identified four clusters, one located in an urban area and three in suburban areas. Conclusions Our analysis indicates that depending on the location of the cluster, the influence came from different variables. Knowing the impact of site-specific risk factors is important for implementing an appropriate prevention intervention. Key messages Spatial analysis for cancer screening can help to improve health initiatives. This study contributes to a better understanding of the cluster-specific factors that explain geographic disparities.


2021 ◽  
Author(s):  
Heidi Lyshol ◽  
Ana P. Gil ◽  
Hanna Tolonen ◽  
Sónia Namorado ◽  
Irina Kislaya ◽  
...  

Abstract Background Participation rates in health surveys, recognized as an important quality dimension, have been declining over the years, which may affect representativeness and confidence in results. The Portuguese national health examination survey INSEF (2015) achieved a participation rate of 43.9%, which is in line with participation rates from other similar health examination surveys. The objective of this article is to describe strategies used by the local teams to increase participation rates and to solve practical survey problems.Methods After a literature search, informal interviews were conducted with 14 public health officials from local health examination teams, regional and central authorities. 41 of the local staff members also filled in a short questionnaire anonymously. The interviews and self-administered questionnaires were analysed using mixed methods, informed by thematic analysis.Results The local teams believed that the detailed manual, described as a "cookbook for making a health examination survey", made it possible to maintain high scientific standards while allowing for improvising solutions to problems in the local context. The quality of the manual, supported by a series of training workshops with the central research and support team, gave the teams the confidence and knowledge to implement local solutions. Motivation and cohesion within the local teams were among the goals of the training process. Local teams felt empowered by being given large responsibilities and worked hard to incite people to attend the examination through a close and persuasive approach.Local teams praised their INSA contacts for being available for assistance throughout the survey, and said they were inspired to try harder to reach participants to please their contacts for interpersonal reasons.Conclusions The theory of organizational improvisation or bricolage, which means using limited resources to solve problems, was useful to discuss and understand what took place during INSEF.A detailed manual covering standard procedures and face-to-face workshops, including role-play, were vital to assure high scientific standards and high participation rates in this health examination survey. Close contacts between the central team and local focal points in all regions and all survey sites were key to accommodating unexpected challenges and innovative solutions.


Sign in / Sign up

Export Citation Format

Share Document