A cross-cultural study of students’ perceptions of assessment practices in higher education

Author(s):  
Mahmoud F. Alquraan

Purpose – This study aims to utilized the item response theory (IRT) rating scale model to analyze students’ perceptions of assessment practices in two universities: one in Jordan and the other in the USA. The sample of the study consisted of 506 university students selected from both universities. Results show that the two universities still focus on paper-pencil testing to assess students’ learning outcomes. The study recommends that higher education institutes should encourage their teachers to use different assessment methods to assess students’ learning outcomes. Design/methodology/approach – The convenience sample consisted of 506 selected university students from the USA and Jordan, and participants were distributed according to their educational levels, thus: 83 freshmen, 139 sophomores, 157 juniors and 59 seniors. (Note: some students from both universities did not report their gender and/or their educational level). The USA university sample consisted of 219 students from three colleges at a major university in the southeast of the USA studying for arts and sciences, education and commerce and business qualifications, of whom 43 were males and 173 were females. The study used the Students Perception of Assessment Practices Inventory developed by Alquraan (2007), and for the purpose of this study, the RUMM2020 program was used for its rating scale model. Findings – Both universities, in Jordan and the USA, still focus more on the developmental (construction of assessment tasks), organizational and planning aspects of assessment processes than they do on assessments of learning and assessment methods (traditional and new assessment methods). The assessment practices that are used frequently in both universities based on the teachers sampled are: “(I27) I know what to study for the test in this class”, “(I6) Teacher provides a good environment during test administration” and “(I21) My teacher avoids interrupting students as they are taking tests”. This indicates that teachers in the selected universities have a tendency to focus on the administrative and communicative aspects of assessment (e.g. providing a good environment during test administration) more than on using different assessment methods (e.g. portfolios, new technology, computers, peer and self-assessment) or even using assessment practices that help students learn in different ways (e.g. assessing students’ prior knowledge and providing written feedback on the graded tests). Originality/value – This is a cross-cultural study focus assessment of students learning in higher education.

1995 ◽  
Vol 11 (1) ◽  
pp. 14-20 ◽  
Author(s):  
Sean M. Hammond

This paper presents an IRT analysis of the Beck Depression Inventory which was carried out to assess the assumption of an underlying latent trait common to non-clinical and patient samples. A one parameter rating scale model was fitted to data drawn from a patient and non-patient sample. Findings suggest that while the BDI fits the model reasonably well for the two samples separately there is sufficient differential item functioning to raise serious duobts of the viability of using it analogously with patient and non-patient groups.


2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Evandro Morais Peixoto ◽  
Daniela Sacramento Zanini ◽  
Josemberg Moura de Andrade

Abstract Background The Kessler Distress Scale (K10) is a self-report scale for the assessment of non-specific psychological distress in the general and clinical population. Because of its ease of application and good psychometric properties, the K10 has been adapted to several cultures. The present study seeks to adapt the K10 to Brazilian Portuguese and estimate its validity evidence and reliability. Methods A total of 1914 individuals from the general population participated in the study (age = 34.88, SD = 13.61, 77.7% female). The adjustment indices were compared among three different measurement models proposed for the K10 through confirmatory factor analysis (CFA). The items’ properties were analyzed by Andrich’s Rating Scale Model (RSM). Furthermore, evidence based on relations to other variables (depression, stress, anxiety, positive and negative affects, and satisfaction with life) was estimated. Results CFA indicated the adequacy of the bifactor model (CFI= 0.985; TLI= 0.973; SMR= 0.019; RMSEA= 0.050), composed of two specific factors (depression and anxiety) and one general factor (psychological distress), corresponding to the theoretical hypothesis. Additionally, it was observed multiple-group invariance by gender and age range. The RSM provided an understanding of the organization of the continuum represented by the psychological distress construct (items difficulty), which varied from −0.89 to 1.00; good adjustment indexes; infit between 0.67 and 1.32; outfit between 0.68 and 1.34; and desirable reliability, α= 0.87. Lastly, theoretically coherent associations with the external variables were observed. Conclusions It is concluded that the Brazilian version of the K10 is a suitable measure of psychological distress for the Brazilian population.


2011 ◽  
Vol 48 (4) ◽  
pp. 441-456 ◽  
Author(s):  
Wen-Chung Wang ◽  
Shiu-Lien Wu

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Kerry Shephard ◽  
Qudsia Kalsoom ◽  
Ritika Gupta ◽  
Lorenz Probst ◽  
Paul Gannon ◽  
...  

Purpose Higher education is uncertain which sustainability-related education targets should be sought and monitored. Accepting that something needs to be measurable to be systematically improved, the authors explored how measures relate to potential targets. This paper aims to focus on dispositions to think critically (active open-minded thinking and fair-minded thinking in appraising reasoning) as measures and explored how they related to sustainability concern as an indicative educational target. Design/methodology/approach This research included the development and testing of research instruments (scales) that explored dispositions to critical thinking and sustainability concern. Authors researched these instruments within their own correspondence groups and tested them with university students and staff in Pakistan, the USA, Austria, India and New Zealand. The authors also asked a range of contextualising questions. Findings Respondents’ disposition to aspects of active, open-minded thinking and fair-minded thinking do predict their concern about facets of sustainability but their strength of religious belief was an important factor in these relationships and in their measurement. Practical implications This research demonstrates the complexity of monitoring dispositions to think critically and sustainability concern in educational systems, particularly in circumstances where the roles of religious beliefs are of interest; and suggests ways to address this complexity. Originality/value This research integrates and expands discourses on ESD and on critical thinking in diverse disciplines and cultures. It investigates measurement approaches and targets that could help higher education institutions to educate for sustainable development and to monitor their progress, in ways that are compatible with their culture and values.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Michael T. Miller

Purpose This study was designed to address the problem of how higher education institutions, as organizations designed to promote learning, responded to the COVID pandemic and the suspension of in-person instruction. The purpose of this paper was specifically to explore how institutions go about learning from the pandemic to better prepare themselves for the future that they will face. Design/methodology/approach A researcher-developed survey instrument was distributed electronically to 300 faculty leaders at randomly selected universities in the USA. With three follow-up e-mail requests, the survey had a 31% usable response rate. Findings Survey results indicated that institutional leadership did not make strong use of shared governance in responding to the COVID pandemic in creating operational response strategies. Further, institutions did not alter their policies or make structural changes to be more adept in facing the challenges of a global pandemic and its impact on the financial well-being of the institutions. Although institutions did make changes to their attitudes about students, these were not developmental changes but rather behavioral modification expectations. Originality/value This study drew upon data collected after the first three months of the global COVID pandemic, providing an important first-look at organizational behavior in response to a largely unplanned global event.


Author(s):  
Sydney Freeman Jr ◽  
Frances Kochan

Purpose The purpose of this paper is to examine a long-term mentoring relationship between a White female from the Traditional Generation and an African American male from the Xennial Generation, as engaged in a mentoring relationship within higher education institutions in the USA. The study investigated if, how and to what degree the differences and similarities between them influenced their mentoring relationship. Design/methodology/approach The authors used an autoethnographic approach involving extensive questioning, dialoguing, note keeping and analysis over eight months. Findings The analysis suggested that race had the greatest influence on the relationship. The primary reasons for mentoring success were similarities in family backgrounds and commonly held values. Research limitations/implications This study may not be generalizable to mentoring relationships that do not involve cultural differences in race, age or gender. Practical implications The paper offers a model for the types of strategies individuals can use in cross-racial mentoring endeavors to help build and sustain these relationships. It also includes suggestions for individuals engaged in mentoring relationships, which include gender, race or age differences, and organizations seeking to enhance diversity within their institutions. Originality/value There is not an extensive body of research on individual cross-racial, gender and generational mentoring that provides an analysis of the experience of those involved. Additionally, the model presented for examining cross-racial mentoring relationships is unique.


Sign in / Sign up

Export Citation Format

Share Document