scholarly journals Accuracy and Reliability of Peer Assessment of Athletic Training Psychomotor Laboratory Skills

2010 ◽  
Vol 45 (6) ◽  
pp. 609-614 ◽  
Author(s):  
Melissa C. Marty ◽  
Jolene M. Henning ◽  
John T. Willse
Keyword(s):  
Athletic Training ◽  
Assessment Tool ◽  
Peer Assessment ◽  
Generalizability Theory ◽  
Athletic Training Education ◽  
Cross Sectional Study ◽  
Psychomotor Skills ◽  
Athletic Training Students ◽  
Manual Muscle Test ◽  
Cross Sectional

Abstract Context: Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. Objective: To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Design: Cross-sectional study. Setting: Entry-level master's athletic training education program. Patients or Other Participants: First-year (n  =  5) and second-year (n  =  8) students. Main Outcome Measure(s): Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Results: Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the ϕ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (ϕ  =  0.79) for the Faber test, with 1 participant on 2 occasions (ϕ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (ϕ  =  0.72). Conclusions: Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was less reliable than having more than 1 student assess those skills on more than 1 occasion. Peer assessment of psychomotor skills could be an important part of the learning process and a tool to supplement instructor assessment.

scholarly journals Perceived Frequency of Peer-Assisted Learning in the Laboratory and Collegiate Clinical Settings

2012 ◽  
Vol 47 (2) ◽  
pp. 212-220 ◽  
Author(s):  
Jolene M. Henning ◽  
Thomas G. Weidner ◽  
Melissa Snyder ◽  
William N. Dudley
Keyword(s):  
Athletic Training ◽  
Skill Acquisition ◽  
Peer Mentoring ◽  
Peer Assessment ◽  
Athletic Training Education ◽  
Cross Sectional Study ◽  
Clinical Settings ◽  
Peer Assisted Learning ◽  
Cross Sectional ◽  
Peer Modeling

Context: Peer-assisted learning (PAL) has been recommended as an educational strategy to improve students' skill acquisition and supplement the role of the clinical instructor (CI). How frequently students actually engage in PAL in different settings is unknown. Objective: To determine the perceived frequency of planned and unplanned PAL (peer modeling, peer feedback and assessment, peer mentoring) in different settings. Design: Cross-sectional study. Setting: Laboratory and collegiate clinical settings. Patients or Other Participants: A total of 933 students, 84 administrators, and 208 CIs representing 52 (15%) accredited athletic training education programs. Intervention(s): Three versions (student, CI, administrator) of the Athletic Training Peer Assisted Learning Survey (AT-PALS) were administered. Cronbach α values ranged from .80 to .90. Main Outcome Measure(s): Administrators' and CIs' perceived frequency of 3 PAL categories under 2 conditions (planned, unplanned) and in 2 settings (instructional laboratory, collegiate clinical). Self-reported frequency of students' engagement in 3 categories of PAL in 2 settings. Results: Administrators and CIs perceived that unplanned PAL (0.39 ± 0.22) occurred more frequently than planned PAL (0.29 ± 0.19) regardless of category or setting (F1,282 = 83.48, P < .001). They perceived that PAL occurred more frequently in the collegiate clinical (0.46 ± 0.22) than laboratory (0.21 ± 0.24) setting regardless of condition or category (F1,282 = 217.17, P < .001). Students reported engaging in PAL more frequently in the collegiate clinical (3.31 ± 0.56) than laboratory (3.26 ± 0.62) setting regardless of category (F1,860 = 13.40, P < .001). We found a main effect for category (F2,859 = 1318.02, P < .001), with students reporting they engaged in peer modeling (4.01 ± 0.60) more frequently than peer mentoring (2.99 ± 0.88) (P < .001) and peer assessment and feedback (2.86 ± 0.64) (P < .001). Conclusions: Participants perceived that students engage in unplanned PAL in the collegiate clinical setting with a stronger inclination toward engagement in peer modeling. Educators should develop planned PAL activities to capitalize on the inherent desire of the students to collaborate with their peers.

scholarly journals Perceived Levels of Frustration During Clinical Situations in Athletic Training Students

2014 ◽  
Vol 49 (1) ◽  
pp. 68-74 ◽  
Author(s):  
Scott Heinerichs ◽  
Neil Curtis ◽  
Alison Gardiner-Shires
Keyword(s):  
Athletic Training ◽  
Clinical Experience ◽  
Clinical Education ◽  
Training Programs ◽  
Athletic Training Education ◽  
Cross Sectional Study ◽  
Athletic Training Students ◽  
Cross Sectional ◽  
Athletic Training Student ◽  
Education Experience

Context: Athletic training students (ATSs) are involved in various situations during the clinical experience that may cause them to express levels of frustration. Understanding levels of frustration in ATSs is important because frustration can affect student learning, and the clinical experience is critical to their development as professionals. Objective:  To explore perceived levels of frustration in ATSs during clinical situations and to determine if those perceptions differ based on sex. Design:  Cross-sectional study with a survey instrument. Setting:  A total of 14 of 19 professional, undergraduate athletic training programs accredited by the Commission on Accreditation of Athletic Training Education in Pennsylvania. Patients or Other Participants:  Of a possible 438 athletic training students, 318 (72.6%) completed the survey. Main Outcomes Measure(s):  The Athletic Training Student Frustration Inventory was developed and administered. The survey gathered demographic information and included 24 Likert-scale items centering on situations associated with the clinical experience. Descriptive statistics were computed on all items. The Mann-Whitney U was used to evaluate differences between male and female students. Results:  A higher level of frustration was perceived during the following clinical situations: lack of respect by student-athletes and coaching staffs, the demands of the clinical experience, inability of ATSs to perform or remember skills, and ATSs not having the opportunity to apply their skills daily. Higher levels of frustration were perceived in female than male ATSs in several areas. Conclusions:  Understanding student frustration during clinical situations is important to better appreciate the clinical education experience. Low levels of this emotion are expected; however, when higher levels exist, learning can be affected. Whereas we cannot eliminate student frustrations, athletic training programs and preceptors need to be aware of this emotion in order to create an environment that is more conducive to learning.

scholarly journals Prevalence and Predictors of Burnout in Athletic Training Students: A Comparison of Undergraduate and Graduate Students

2021 ◽  
Vol 16 (2) ◽  
pp. 101-111
Author(s):  
Ashlyne Paige Vineyard ◽  
Andrew Gallucci ◽  
Kathleen Adair ◽  
Leslie Oglesby ◽  
Kristina White ◽  
...  
Keyword(s):  
Graduate Students ◽  
Athletic Training ◽  
Social Stress ◽  
Maslach Burnout Inventory ◽  
Cross Sectional Study ◽  
Personal Accomplishment ◽  
Athletic Training Students ◽  
Cross Sectional ◽  
Web Based ◽  
Survey Responses

Context Burnout is a psychological syndrome consisting of increased emotional exhaustion (EE), depersonalization (DP), and decreased personal accomplishment (PA). To date, examinations of burnout among athletic training students (ATS) is limited. Objective To determine prevalence and antecedents of burnout among ATS. Design Cross-sectional study. Setting Web-based survey. Patients or Other Participants Students enrolled in athletic training programs (ATP). Intervention(s) A survey assessed demographics, stressors, and burnout measured by the Maslach Burnout Inventory–Human Services Survey. Main Outcome Measure(s) Multiple regression analyses were used to determine relationships between variables. Results A total of 725 students participated. Most respondents were undergraduates (n = 582, 80%), female (n = 518, 71%), Caucasian (n = 564, 78%), and single (n = 422, 58%). Mean burnout scores for EE, DP, and PA were 33 ± 10, 17 ± 4.5, and 39 ± 5.8, respectively. Survey responses showed that 70.8% of undergraduate and 62.9% of graduate students reported high EE. All the students (100%) in both samples reported high DP. Undergraduates pursuing internships or residencies (b = −7.69, P < .001) and who were currently enrolled in non–Division I institutions (b = −2.90, P < .01) had decreased EE. Increased stress revealed increased EE (overall stress: b = 3.11, P < .001; social stress: b = 1.32, P < .05; class stress: b = 1.45, P < .05). Increases in clinical hours also related to increased EE (b = 1.49, P < .001). Those pursuing internships or residencies (b = −2.10, P < .05) and who were female (b = −2.10, P < .05) reported decreased DP. Being married (b = 2.87, P < .01), increased clinical hours (b = 0.77, P < .001), and social stress (b = 0.59, P < .05) resulted in increased DP. Increased PA was seen in students intending to pursue graduate education (b = 1.76, P < .05) and female students (b = 1.17, P < .05). Graduate students' stress levels revealed increased EE (b = 6.57, P < .01) and DP (b = 0.98, P < .05). Conclusions Differences exist between undergraduate and graduate burnout scores and associated predictors. Further research is needed to identify student responses to burnout.

scholarly journals Peer Assessment of Clinical Skills and Professional Behaviors Among Undergraduate Athletic Training Students

2016 ◽  
Vol 11 (2) ◽  
pp. 95-102 ◽  
Author(s):  
Jeanine M. Engelmann
Keyword(s):  
Medical Education ◽  
Athletic Training ◽  
Compression Test ◽  
Clinical Skills ◽  
Peer Assessment ◽  
Athletic Training Education ◽  
Athletic Training Students ◽  
Professional Behaviors ◽  
Senior Student ◽  
Lachman Test

Context: Peer assessment is widely used in medical education as a formative evaluation and preparatory tool for students. Athletic training students learn similar knowledge, skills, and affective traits as medical students. Peer assessment has been widely studied with beneficial results in medical education, yet athletic training education has thus far produced only 2 studies that address the use of peer assessment with athletic training students. Objective: To identify whether undergraduate athletic training students accurately and reliably assess their peers on clinical skills and professional behaviors. Design: Quasi-experimental between-groups and within-group. Setting: Medical exam office. Patients or Other Participants: Junior and senior athletic training students, classroom faculty and clinical preceptors (instructors) from the same Commission on Accreditation of Athletic Training Education athletic training program. Intervention(s): One instructor and 2 students concurrently performed an assessment in real-time of 5 clinical skills performed by a junior or senior student. Clinical skills demonstrated were the Biceps Femoris Manual Muscle Test (BFMMT), Lachman Test, Kleiger Test, Noble's Compression Test, and Thompson Test. Main Outcome Measure(s): Each student group's scores were compared with instructor group scores to determine the accuracy of the assessment. Each student group's scores were compared within-group to determine reliability of student scores. Accuracy and reliability of clinical skills were measured using the Cohen κ coefficient. A weighted Cohen κ coefficient was used for professional behavior measures. Results: Senior students were accurate (P < .05) for all clinical skills and professional behaviors and reliable (P < .05) for the BFMMT, Thompson Test, and professional behaviors. Junior students were accurate (P < .05) for all clinical skills except the Lachman Test and reliable (P < .05) for the BFMMT and Noble's Compression Test. Conclusions: Students are able to assess the clinical skills of their peers with the same consistency as instructors during a live skills demonstration. Year in school may affect ability to assess professional behaviors.

scholarly journals Examining the Relationship Between Social Support Satisfaction and Perceived Stress and Depression in Athletic Training Students

2018 ◽  
Vol 13 (2) ◽  
pp. 168-174 ◽  
Author(s):  
Bryan Crutcher ◽  
Ryan N. Moran ◽  
Tracey Covassin
Keyword(s):  
Social Support ◽  
Athletic Training ◽  
Perceived Stress ◽  
Training Programs ◽  
Athletic Trainers ◽  
Depression Scale ◽  
Athletic Training Education ◽  
Epidemiologic Studies ◽  
Athletic Training Students ◽  
Cross Sectional

Context: Although social support has been reported to be a factor that increases retention of athletic trainers in their profession, there is a lack of literature examining the specific relationship of social support satisfaction and its predictive influence on stress and depression among athletic training students. Objective: To determine which sources of social support were perceived to be the most salient and ascertain whether social support satisfaction can predict stress and depression among athletic training students. Design: Cross-sectional study. Setting: Nine Commission on Accreditation of Athletic Training Education–accredited professional athletic training programs. Patients or Other Participants: A total of 204 athletic training students from Commission on Accreditation of Athletic Training Education–accredited athletic training programs were included in this study. Main Outcome Measure(s): Participants completed the Perceived Stress Scale, Center for Epidemiologic Studies Depression Scale, and the Social Support Questionnaire. Results: Social Support Satisfaction significantly predicted overall perceived stress (P = .010) and depression (P < .001). Satisfaction of support from family (P = .043) and other athletic trainers (P = .011) were significant predictors of perceived stress, whereas satisfaction of support from family (P = .003), other athletic trainers (P = .002), and athletes (P = .038) significantly predicted depression. Conclusions: The current study suggests that having an increased satisfaction of social support may reduce stress perceptions and depression in athletic training students.

Effectiveness of Mobile Learning on Athletic Training Psychomotor Skill Acquisition

2015 ◽  
Vol 10 (4) ◽  
pp. 287-295 ◽  
Author(s):  
Emily Davie ◽  
Malissa Martin ◽  
Micki Cuppett ◽  
Denise Lebsack
Keyword(s):  
Athletic Training ◽  
Skill Acquisition ◽  
Stress Test ◽  
Athletic Training Education ◽  
Knee Valgus ◽  
Athletic Training Students ◽  
Manual Muscle Test ◽  
Valgus Stress ◽  
Video Instruction ◽  
Exam Scores

Context Instruction of psychomotor skills is an important component of athletic training education. Accommodating the varied learning abilities and preferences of athletic training students can be challenging for an instructor initiating skill acquisition in a traditional face-to-face (F2F) environment. Video instruction available on mobile devices may offer an alternative teaching tool, allowing for student-initiated learning. Objective To compare outcomes of Quick Clips (QC) instruction with F2F instruction as measured by skill-examination scores. Design Quasi-experimental. Setting Five higher learning institutions with Commission on Accreditation of Athletic Training Education (CAATE) accredited athletic training education programs. Patients or Other Participants Seventy-four pre-athletic training students, average age 18.86 ± 1.0 years (49 women, 25 men), volunteered for this study. Participants were randomly assigned to 1 of 2 instructional groups (F2F or QC). Intervention(s) The principal investigator provided F2F instruction to 38 participants in 3 skills (knee valgus stress test, middle trapezius manual muscle test, and goniometric measurement of active ankle dorsiflexion). The remaining 36 participants watched 3 QC videos demonstrating the same skills. Main Outcome Measure(s) Three individual skill exam scores and the total score. Results A 1-way multivariate analysis of variance indicated a significant effect (P < .0001) of instructional method on exam scores. Follow-up univariate analysis of variance indicated knee valgus stress test exam scores were significantly higher after F2F instruction (P < .0001). Neither manual muscle test nor goniometric measurement exam scores were affected by instructional method. Conclusions The findings support the use of QC as an alternative to F2F instruction for 2 of the 3 skills. This finding is similar to studies reported in the nursing literature on computer-assisted learning, which found inconclusive evidence to support the superiority of one method over another. Mobile video instruction is an effective teaching strategy. It may be best utilized to supplement traditional F2F instruction.

Predictors of Commitment to Athletic Training Education

2013 ◽  
Vol 8 (1-2) ◽  
pp. 3-9 ◽  
Author(s):  
Windee M. Weiss ◽  
Peter J. Neibert
Keyword(s):  
Athletic Training ◽  
Analysis Of Variance ◽  
Athletic Training Education ◽  
Social Constraints ◽  
Athletic Training Students ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Sport Commitment ◽  
Second Year ◽  
Current Sample

Context In order for athletic training students to be successful in any athletic training education program (ATEP), a certain level of commitment to the program and profession is required. Objective The purpose of this study was to explore the applicability of the sport commitment model (SCM) to an ATEP by applying the SCM in an academic setting to predict ATEP students' commitment to an ATEP. Design Cross-sectional, survey. Setting Commission on Accreditation of Athletic Training Education–accredited ATEP. Patients or Other Participants A total of 99 male and female athletic training students participated. Participants ranged in age from 18 to 24 years of age (mean = 20.10 ± 1.28). Intervention(s) Previously validated measures were used to assess students' perceptions of enjoyment, attractive alternatives, investments, social constraints and support, benefits and costs, and commitment to the ATEP. All measures demonstrated adequate reliability for the current sample (Cronbach α = 0.71–0.93). Main Outcome Measure(s) A simultaneous multiple regression was conducted to determine which of the SCM determinants predicted ATEP commitment. An analysis of variance and a multivariate analysis of variance were conducted to compare preservice and first-, second-, and third-year ATEP students on SCM constructs. Results Perceived enjoyment and investments emerged as the significant predictors for ATEP commitment, with higher perceptions of enjoyment and investments predicting higher ATEP commitment. Students of varying academic years differed on their perceptions of ATEP enjoyment, with preservice students reporting higher enjoyment than first- or third-year students, and second-year students reporting higher enjoyment than third-year students. Additionally, preservice students reported significantly higher commitment and benefits, and lower costs and attractive alternatives, than first- and third-year students. Second-year students reported lower perceived costs than first- and third-year students. Conclusions The SCM may provide a theoretical framework in which to predict ATEP students' commitment to the program, as well as behavioral commitment (eg, stay/leave behavior).

scholarly journals Students Provide Accurate, But Not Always Detailed, Feedback to a Peer Performing an Orthopedic Assessment Skill

2011 ◽  
Author(s):  
Melissa Marty ◽  
Jolene Henning ◽  
John Willse
Keyword(s):  
Training Program ◽  
Athletic Training ◽  
Repeated Measures ◽  
Peer Assessment ◽  
First Year ◽  
Psychomotor Skills ◽  
Athletic Training Students ◽  
Percent Correct ◽  
Entry Level

Athletic training students often practice psychomotor skills with their peers when learning skills and often assess one another and provide feedback. There is limited research examining the accuracy of the assessment and quality of the feedback athletic training students provide. Purpose: To examine the accuracy of the assessments and the quality of the feedback students provide to a peer performing an orthopedic special test (i.e., psychomotor skill). Design: Non-experimental repeated measures. Setting: Entry-level master’s athletic training program. Participants: First year (n = 6) and second-year (n = 5) graduate students. Main Outcome Measures: During two separate sessions, subjects evaluated ten videos of a peer performing the FABER test for hip pathology. Accuracy of the assessments was examined through percent correct scores. The feedback was categorized as either comments provided on items performed incorrectly or items performed correctly. Quality of feedback was categorized as detailed or general. Results: Subjects assessed videos of a peer performing the FABER test with 97.83% accuracy. The subjects provided a total of 451 comments; 297 comments for items performed incorrectly and 154 comments for items performed correctly. The subjects provided detailed feedback 54.32% of the time and provided general feedback 45.68% of the time. Conclusions: Students can accurately assess a peer performing an orthopedic assessment skill and they also provide accurate feedback. However, the feedback is not always detailed. A peer assessment/feedback training program may improve the quality of feedback students provide.

scholarly journals Portability of United States Athletic Training Education in an International Setting

2018 ◽  
Vol 13 (1) ◽  
pp. 33-41 ◽  
Author(s):  
Hideyuki Izumi ◽  
Masaaki Tsuruike
Keyword(s):  
United States ◽  
Athletic Training ◽  
Mutual Recognition ◽  
Correlation Coefficients ◽  
Athletic Training Education ◽  
The United States ◽  
Cross Sectional Study ◽  
Average Score ◽  
Cross Sectional ◽  
International Environment

Context: United States-educated athletic trainers (ATs) are expected to have more opportunities in the international environment as the number of mutual recognition agreements grows. However, no information is available from existing studies regarding the portability of current US athletic training education in an international environment. Objective: To determine if there are differences in the practices and perceptions of ATs' tasks between US-educated Japanese ATs and Japan-educated Japanese ATs. Design: Cross-sectional study. Setting: Analysis of secondary datasets from the Global Practice Analysis Survey. Patients or Other Participants: Two hundred seventeen Japanese ATs in Japan, of whom 34 were educated in the United States and 183 completed the required coursework to be certified by Japan Sports Association. Main Outcome Measure(s): Fisher exact tests were used (P < .05) to determine the difference in each of 24 task ratings in terms of the criticality, importance, and frequency dimensions between the 2 groups. Further, Spearman's ranked correlation, in which rankings were based on the average score of 4-point Likert scales (P < .05), were used to compare priorities regarding the 24 tasks between the 2 groups. Results: Differences were identified for only 2 tasks among 72 (24 tasks for 3 dimensions) in task-level evaluations. The correlation coefficients were as follows: criticality = 0.92 (P < .01), importance = 0.93 (P < .01), and frequency = 0.92 (P < .01). Conclusions: There were negligible differences in the practice patterns and perceptions between those trained in Japan and those who were US trained, indicating that US athletic training education prepares Japanese students well to work in Japan and may be portable internationally.

scholarly journals Beijing Friendship Hospital Osteoporosis Self-Assessment Tool for Elderly Male (BFH-OSTM) vs Fracture Risk Assessment Tool (FRAX) for identifying painful new osteoporotic vertebral fractures in older Chinese men: a cross-sectional study

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Ning An ◽  
Ji Sheng Lin ◽  
Qi Fei
Keyword(s):  
Assessment Tool ◽  
Roc Curves ◽  
Cross Sectional Study ◽  
Self Assessment ◽  
Cross Sectional ◽  
Fracture Group ◽  
Friendship Hospital ◽  
Fracture Risk Assessment Tool ◽  
Older Chinese ◽  
Sensitivity Specificity

Abstract Background To compare the validation of four tools for identifying painful new osteoporotic vertebral compression fractures (PNOVCFs) in older Chinese men: bone mineral density (BMD), Asian osteoporosis self-assessment tool (OSTA), World Health Organization fracture risk assessment tool (FRAX) (without BMD) and Beijing Friendship Hospital Osteoporosis Self-Assessment Tool (BFH-OSTM). Methods A cross sectional study was conducted from 2013 to 2019. A total of 846 men aged ≥50 were included and were divided into two groups: Fracture Group (patients with PNOVCFs underwent percutaneous vertebroplasty surgery) and Non-Fracture Group (community dwelled subjects for healthy examination). All subjects accepted a dual-energy X-ray BMD test and a structured questionnaire. The results of BMD, OSTA, FRAX and BFH-OSTM scores were assessed and receiver-operating characteristic (ROC) curves were generated to compare the validity of four tools for identifying PNOVCFs. Optimal cutoff points, sensitivity, specificity, and areas under the ROC curves (AUCs) were determined. Results There were significant differences including BMD T score (femoral neck, total hip and L1-L4), OSTA, FRAX and BFH-OSTM scores between Fracture group and Non-fracture group. Compared to BMD and OSTA, BFH-OSTM and FRAX had better predictive value, the sensitivity, specificity and AUC value are 0.841, 81.29%, 70.67% and 0.796, 74.85%, 78.52%, respectively. Compared with FRAX, the BFH-OSTM has a better AUC value. Conclusions Both BFH-OSTM and FRAX can be used to identify POVCFs, However, BFH-OSTM model may be a more simple and effective tool to identify the risk of POVCFs in Chinese elderly men.

Sign in / Sign up

Export Citation Format

Share Document