scholarly journals Remote versus on-site proctored exam: comparing student results in a cross-sectional study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Vasiliki Andreou ◽  
Sanne Peters ◽  
Jan Eggermont ◽  
Johan Wens ◽  
Birgitte Schoenmakers

Abstract Background The COVID-19 pandemic has profoundly affected assessment practices in medical education necessitating distancing from the traditional classroom. However, safeguarding academic integrity is of particular importance for high-stakes medical exams. We utilised remote proctoring to administer safely and reliably a proficiency-test for admission to the Advanced Master of General Practice (AMGP). We compared exam results of the remote proctored exam group to those of the on-site proctored exam group. Methods A cross-sectional design was adopted with candidates applying for admission to the AMGP. We developed and applied a proctoring software operating on three levels to register suspicious events: recording actions, analysing behaviour, and live supervision. We performed a Mann-Whitney U test to compare exam results from the remote proctored to the on-site proctored group. To get more insight into candidates’ perceptions about proctoring, a post-test questionnaire was administered. An exploratory factor analysis was performed to explore quantitative data, while qualitative data were thematically analysed. Results In total, 472 (79%) candidates took the proficiency-test using the proctoring software, while 121 (20%) were on-site with live supervision. The results indicated that the proctoring type does not influence exam results. Out of 472 candidates, 304 filled in the post-test questionnaire. Two factors were extracted from the analysis and identified as candidates’ appreciation of proctoring and as emotional distress because of proctoring. Four themes were identified in the thematic analysis providing more insight on candidates’ emotional well-being. Conclusions A comparison of exam results revealed that remote proctoring could be a viable solution for administering high-stakes medical exams. With regards to candidates’ educational experience, remote proctoring was met with mixed feelings. Potential privacy issues and increased test anxiety should be taken into consideration when choosing a proctoring protocol. Future research should explore generalizability of these results utilising other proctoring systems in medical education and in other educational settings.

2021 ◽  
Author(s):  
Vasiliki Andreou ◽  
Sanne Peters ◽  
Jan Eggermont ◽  
Johan Wens ◽  
Birgitte Schoenmakers

Abstract Background: The COVID-19 pandemic has profoundly affected assessment practice in higher education including a complex planning of supervision. To organise safely and reliably a remote proficiency-test for admission to the Advanced Master of General Practice (AMGP), we developed a supervisor app tracking and tracing candidates’ behaviour. Methods: A cross-sectional design was adopted with candidates applying for admission to the AMGP. The supervisor app operated on three levels to register events: recording actions, analysing behaviour, and live supervision. Each suspicious event was given a score. The outcome measures were the number of suspicious events and the exam outcome compared to the past year. To get more insight into candidates’ perceptions about the app, a post-test questionnaire was administered. An exploratory factor analysis was performed to explore quantitative data, while qualitative data were thematically analysed. Results: In total, 472 (79%) candidates used the app in an off campus setting and 121 (20%) were on campus with live supervision. Test results of both groups were comparable. The app detected 22 candidates with a suspicious level >1, mainly due to background noise. All events occurred without fraud purpose. Out of 472 candidates, 304 filled in the post-test questionnaire. Two factors were extracted from the analysis and identified as candidates’ appreciation of the app and as emotional distress because of the app. Four themes were identified in the thematic analysis providing more insight on candidates’ emotional well-being. Conclusions: A supervisor app registering and recording behaviour to prevent fraud during off-campus exams is efficient without influencing the exam outcome. Although candidates’ perceptions were mixed, increased anxiety was due to the lack of clear guidelines about the app. Future research should compare in a controlled design the cost-benefit balance between the supervisor app and candidates’ awareness of being monitored combined with a safe exam browsing plug in.


Author(s):  
Allison Brown ◽  
Aliya Kassam ◽  
Mike Paget ◽  
Kenneth Blades ◽  
Megan Mercia ◽  
...  

Background: The evidence surrounding the impact of COVID-19 on medical learners remains anecdotal and highly speculative despite the anticipated impact and potential consequences of the current pandemic on medical training. The purpose of this study was to explore the extent that COVID-19 initially impacted medical learners around the world and examine global trends and patterns across geographic regions and levels of training. Methods: A cross-sectional survey of medical learners was conducted between March 25–June 14, 2020, shortly after the World Health Organization declared COVID-19 a pandemic. Results: 6492 learners completed the survey from 140 countries. Most medical schools removed learners from the clinical environment and adopted online learning, but students reported concerns about the quality of their learning, training progression, and milestone fulfillment. Residents reported they could be better utilized and expressed concerns about their career timeline. Trainees generally felt under-utilized and wanted to be engaged clinically in meaningful ways; however, some felt that contributing to healthcare during a pandemic was beyond the scope of a learner. Significant differences were detected between levels of training and geographic regions for satisfaction with organizational responses as well as the impact of COVID-19 learner wellness and state-trait anxiety. Conclusions: The disruption to the status quo of medical education is perceived by learners across all levels and geographic regions to have negatively affected their training and well-being, particularly amongst postgraduate trainees. These results provide initial empirical insights into the areas that warrant future research as well as consideration for current and future policy planning.


2021 ◽  
Vol 8 (3) ◽  
pp. 49-55
Author(s):  
Shiv Kumar R ◽  
Puli SK ◽  
P. Kishan ◽  
Sanjay ND ◽  
Pusukuri Sphurthi ◽  
...  

Background: The development of an ideal doctor-patient relationship requires empathy. Empathetic conversation aids in the formation of an open and trusting equation between doctor and patient. Furthermore, this leads to accurate diagnoses and more compliance to the advised treatment. In this manner, empathy helps in overall recovery of the patient and improves global functioning and generalised well-being. This study aims to make note of the fluctuation in empathy levels during medical education. Studies done in various countries have found factors such as curriculum, clinical rotations timing and gender to progressively influences empathy levels in students throughout their medical training. The recent trend of violence against healthcare professionals in India calls for an urgent action into the gap between doctors and patients communication. Empathy towards patients and attendants will reduce such untoward events. In this current context, we should improve empathy levels among the training doctors. As a first step, we should assess various factors affecting empathy among health care professionals. Method: This cross sectional study was done among undergraduates of a rural medical college in Northern Telangana during the time period of October to December 2019. Their empathy levels were assessed using Jefferson’s Scale for Empathy- Student version (JSE-S). Result: Of the 470 students surveyed, 227 were males and 243 females. Female students were having higher empathy among first year and second years (p<0.001). Empathy levels seem to decline from first year to second year following which the mean empathy remains similar throughout the remaining years in students of both sexes. There is no significant relation between mean empathy scores and choice of future speciality (p>0.05). Conclusion: Female undergraduate students are found to be more empathetic than their male counterparts. A fall in empathy scores from the first to second year of MBBS is seen, which is when students enter their clinical rotations. Targeted intervention at this time may go a long way in the creation of a new generation of more empathetic physicians. Hence, there is a need for evaluation of teaching and learning techniques in medical education. Further, there is a call for more research into the determinants of decline in empathy amongst medical professionals.


Author(s):  
Latha S. Davda ◽  
David R. Radford ◽  
Jennifer E. Gallagher

Medical education and training of health professionals are linked with their recruitment and retention. Practising as a competent health professional requires life-long continuous training and therefore training structures in health systems appear to influence doctors job satisfaction, their well-being and their intentions to remain in that health system. The commentary critiques aspects of the paper on doctors retention in Ireland, while drawing some parallels with the United Kingdom. There appears to be an emerging type of health professional migrants ‘education tourists’ who travel to other countries to obtain medical education creating new routes of migration and this presents new challenges to source and destination countries. The global shortage of doctors and other health professionals further exacerbates health inequalities as seen in the present pandemic and therefore the increased need for research into health professionals’ migration and their integration.


2020 ◽  
Vol 33 (1) ◽  
pp. 38-44
Author(s):  
Renata Lamenha-Lins ◽  
Maria Cavalcanti-Campêlo ◽  
Cláudia Cavalcante-Silva ◽  
Kelly Rodrigues-Mota ◽  
Carlos Leão-Oliveira ◽  
...  

The aim of this study is to assess the prevalence of odontogenic infection in low-income Brazilian schoolchildren and evaluate its association with the subjective variables of oral health-related quality of life and dental pain. In this cross-sectional study, 230 schoolchildren aged eight to ten years old underwent a clinical oral survey in which the DMFT/dmft and PUFA/pufa indexes were measured. Afterward, children responded individually to the Child Perceptions Questionnaire (CPQ8-10) and self-reports of dental pain were collected. Data were statistically analyzed using MannWhitney or Kruskal-Wallis test with a post-test by Dunn's and Pearson correlation. Of the children evaluated, 42.6% had odontogenic infection and 80% reported experiencing dental pain. Children's age (p = 0.034) and past experience of dental pain (p < 0.002) were associated with odontogenic sepsis, in addition to impairment of their emotional well-being (p = 0.008), social welfare (p = 0.009) and overall impact on quality of life (p = 0.019). Toothache intensity (p < 0.001), frequency (p < 0.001) and duration (p < 0.001) were correlated to the overall impact on children's quality of life. The prevalence of odontogenic infection remains high among low-income Brazilian schoolchildren. Pediatric infection and its related pain induce not only various biological disorders but also impair children's self-perception of quality of life.


2017 ◽  
Vol 15 (6) ◽  
pp. 693-703 ◽  
Author(s):  
Kristin Litzelman ◽  
Danielle Blanch-Hartigan ◽  
Chun Cheih Lin ◽  
Xuesong Han

ABSTRACTObjective:Experiencing a life-threatening illness such as cancer can elicit both negative (e.g., distress) and positive (e.g., growth) psychological responses. The present study sought to determine the correlates of four positive psychological byproducts in cancer survivors: becoming a stronger person, coping better with life's challenges, making positive changes in life, and adopting healthier habits.Method:Data for this cross-sectional study were taken from the Medical Expenditures Panel Survey (MEPS) Experiences with Cancer Survivorship Supplement (Yabroff et al., 2012). Cancer survivors (N = 785) reported their sociodemographic and cancer-related characteristics. Descriptive statistics were utilized to summarize cancer survivor characteristics, including demographic factors, cancer factors, and stressors and resources related to cancer. Multivariable logistic regressions were employed to assess the independent association of the stressors and resources with each psychological response, controlling for covariates. All analyses were weighted to account for the complex sampling design of the MEPS.Results:In multivariable analyses, those with a family caregiver were 50% more likely to report better coping with challenges, and around 70% were more likely to report making positive changes in life or adopting healthier habits because of their cancer. Receiving informational support from healthcare providers was also consistently associated with positive byproducts (odds ratios ranging from 1.6 to 2.0). Few of the stressors were associated with positive byproducts: having insurance problems due to cancer was positively associated with becoming a stronger person, and work limitations were associated with making positive changes in life; those who reported high perceived chances of recurrence were less likely to report becoming a stronger person.Significance of Results:Having a family caregiver and receiving detailed informational support from healthcare providers were associated with reporting positive experiences with cancer. The hypotheses and future research stimulated by these findings may improve our understanding of the process by which positive byproducts develop and may ultimately help improve psychological well-being among cancer survivors.


Author(s):  
Tide Garnow ◽  
Eva-Lena Einberg ◽  
Anna-Karin Edberg ◽  
Pernilla Garmy

Health complaints are increasing among adolescents and are recognized as a global public health issue. Health complaints are an indicator for subjective ill-being, but little is known about the relationship between sadness and other health complaints. The aim of this study was to investigate sadness and other health complaints among Swedish adolescents. A survey with a cross-sectional design was completed by adolescents (n = 1489, 15–17 years old) in the south of Sweden. A logistic regression analysis was used to analyze the relationship between sadness and other health complaints. The result show that sadness and other health complaints were common among adolescents, and sadness was related to health complaints (headache (OR: 1.58), sleeping difficulties (OR: 2.00), reduced appetite (OR: 1.43), tension (OR: 2.44), and concentration difficulties (OR: 2.75)). When adolescents express sadness or other health complaints it is important to reflect on what these complaints are an expression of, and take into account the body as physical and psychological intertwined. This might entail person-centered support that hopefully leads to an improvement in adolescents’ well-being. Future research that profoundly highlights adolescents’ existential health is needed.


2020 ◽  
Author(s):  
Allison Brown ◽  
Aliya Kassam ◽  
Mike Paget ◽  
Kenneth Blades ◽  
Megan Mercia ◽  
...  

To broadly explore the extent that COVID-19 has initially impacted medical learners around the world and examine global trends and patterns across geographic regions and levels of training, a cross-sectional survey of medical learners was conducted between March 25-June 14th, 2020, shortly after the World Health Organization declared concurrent COVID-19 a pandemic. 6492 medical learners completed the survey from 140 countries, Students were concerned about the quality of their learning, training progression, and milestone fulfillment. Most trainees felt under-utilized and wanted to be engaged clinically in meaningful ways; however, some trainees felt that contributing to healthcare during a pandemic was beyond the scope of a medical learner. Statistically significant differences were detected between levels of training and geographic regions for satisfaction with organizational responses, the impact of COVID-19 on wellness, and state-trait anxiety. Overall, the initial disruption to medical training has been perceived by learners across all levels and geographic regions to have negatively affected their training and well-being, particularly amongst postgraduate trainees. These results provide initial insights into the areas that warrant future research as well as consideration for current and future policy planning, such as the policies for clinical utilization of medical learners during public health emergencies.


BMJ Open ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. e047368
Author(s):  
Victoria Egli ◽  
Sandra Mandic ◽  
Tessa Pocock ◽  
Anantha Narayanan ◽  
Lisa Williams ◽  
...  

IntroductionNeighbourhood environments can have significant and enduring impacts on children’s physical, psychological and social health. Environments can impact health through promoting or hindering physical activity, active travel, and healthy eating in addition to opportunities for social interaction, cognitive development, rest and relaxation. There is a paucity of research that has examined neighbourhood and health priorities, strengths and needs from the perspectives of the community, and even less that has focused on the perspectives of children within communities. The aim of this article is to describe the research protocol for a project to gather child-identified needs and strengths-based solutions for promoting child health and well-being in urban neighbourhood environments.Methods and analysisThis participatory research project is designed to partner with children in school settings in Tāmaki Makaurau Auckland and Ōtepoti Dunedin, Aotearoa New Zealand. An abundant communities approach will be used with children to identify needs and strengths related to neighbourhoods and health. Specific methods including collaborative, creative, play-based methods such as concept-mapping activities and co-creation of final dissemination material on the key messages are described. Plans for researcher reflections, data analysis and dissemination are also detailed.Ethics and disseminationThis research has been approved by the University of Auckland Human Participants Ethics Committee. Results will be disseminated through child and researcher co-created output, a technical report and academic journal articles. By using evidence-based child-centred approaches to knowledge generation, we anticipate the research will generate new localised insights about children’s preferences and needs for healthy neighbourhoods which will be shared with stakeholders in planning and practice. The detailed session protocol including critical researcher reflections is shared in this manuscript for application, development and refinement in future research.


2021 ◽  
Vol 37 (4) ◽  
Author(s):  
Syeda Sadia Fatima ◽  
Romana Idress ◽  
Kausar Jabeed ◽  
Saniya Sabzwari ◽  
Sadaf Khan

Background and Objectives: The Covid-19 pandemic has caused large-scale disruption in almost all educational programs across the world. Planning and rapid implementation of assessment through an online format presents the next set of novel challenges that must be addressed by academic administrations across the globe. Methods: This cross-sectional study was conducted between March to August 2020 at the Aga Khan University Medical College. Two hundred medical students of year 1 and 2 participated in the study. We describe the planning, processes, and outcomes of online assessments using video communication platforms conducted at a private university in Pakistan. Standardized protocols were written and piloted, extensive training of student, proctors and staff for preparation and conduct of online assessments were developed. Feedback was recorded after each session and suggestions were incorporated in subsequent high-stakes assessments. Results: A total of three pilot assessments were conducted to identify issues and process refinement. Commercially available lockdown browser and ZOOM were used in the first pilot; 80% of the class was unable to launch lockdown browser and laptops required repeated reload/reboot. For the second pilot assessment, University’s VLE page & MS Teams was trailed. Issues with internet connectivity, VLE page slowdown, and suboptimal recording feature in MS Teams were identified. For the final pilot assessment, phased launching of VLE page with single test item per page was implemented with success. The students reported that attempting the online exam on VLE with ZOOM support was user friendly. Ninety percent of the class was supportive of the continuing with the online assessments. Conclusion: In order to device an effective protocol for e-assessments conducting multiple trial runs, and incorporating feedback from all stakeholders is a necessity. doi: https://doi.org/10.12669/pjms.37.4.3948 How to cite this:Fatima SS, Idrees R, Jabeen K, Sabzwari S, Khan S. Online assessment in undergraduate medical education: Challenges and solutions from a LMIC university. Pak J Med Sci. 2021;37(4):---------. doi: https://doi.org/10.12669/pjms.37.4.3948 This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


Sign in / Sign up

Export Citation Format

Share Document