scholarly journals Peer Assessment of Clinical Skills and Professional Behaviors Among Undergraduate Athletic Training Students

2016 ◽  
Vol 11 (2) ◽  
pp. 95-102 ◽  
Author(s):  
Jeanine M. Engelmann

Context: Peer assessment is widely used in medical education as a formative evaluation and preparatory tool for students. Athletic training students learn similar knowledge, skills, and affective traits as medical students. Peer assessment has been widely studied with beneficial results in medical education, yet athletic training education has thus far produced only 2 studies that address the use of peer assessment with athletic training students. Objective: To identify whether undergraduate athletic training students accurately and reliably assess their peers on clinical skills and professional behaviors. Design: Quasi-experimental between-groups and within-group. Setting: Medical exam office. Patients or Other Participants: Junior and senior athletic training students, classroom faculty and clinical preceptors (instructors) from the same Commission on Accreditation of Athletic Training Education athletic training program. Intervention(s): One instructor and 2 students concurrently performed an assessment in real-time of 5 clinical skills performed by a junior or senior student. Clinical skills demonstrated were the Biceps Femoris Manual Muscle Test (BFMMT), Lachman Test, Kleiger Test, Noble's Compression Test, and Thompson Test. Main Outcome Measure(s): Each student group's scores were compared with instructor group scores to determine the accuracy of the assessment. Each student group's scores were compared within-group to determine reliability of student scores. Accuracy and reliability of clinical skills were measured using the Cohen κ coefficient. A weighted Cohen κ coefficient was used for professional behavior measures. Results: Senior students were accurate (P < .05) for all clinical skills and professional behaviors and reliable (P < .05) for the BFMMT, Thompson Test, and professional behaviors. Junior students were accurate (P < .05) for all clinical skills except the Lachman Test and reliable (P < .05) for the BFMMT and Noble's Compression Test. Conclusions: Students are able to assess the clinical skills of their peers with the same consistency as instructors during a live skills demonstration. Year in school may affect ability to assess professional behaviors.

2006 ◽  
Vol 1 (1) ◽  
pp. 8-11 ◽  
Author(s):  
Debbie I. Craig

Objective: Student learning of professionalism in athletic training education programs (ATEPs) can be varied and even elusive. The purpose of this article is to define professionalism and discuss its development in athletic training students. Background: Medical professions have studied extensively how students learn professionalism. However, with some studies reporting up to 90 different associated characteristics, no set definition of professionalism has been adopted. Students may learn professional behaviors in the classroom and the clinic. Research in medical education reports that a majority of this learning occurs in the clinical environment. Description: There are numerous ways to promote the learning of professionalism in athletic training students. After engaging each student personally in this pursuit, techniques such as communicating the mission and code of ethics of the National Athletic Trainers ' Association (NATA), clearly stating expectations the ATEP holds of students ' professional behavior, providing a variety of learning opportunities in different clinical settings, carefully selecting approved clinical instructors (ACIs), and using self-assessment and reflection are a few of the techniques recommended. The importance of the role of ACIs in the development of professional behaviors in athletic training students is stressed. Advantages: Without purposefully including the learning of professionalism in ATEP curriculums (the classroom and clinical experiences), students are at risk of not being prepared to represent and promote athletic training at the highest levels within the allied health professions.


2010 ◽  
Vol 5 (2) ◽  
pp. 87-89 ◽  
Author(s):  
Stacy E. Walker ◽  
Thomas G. Weidner

Context: Standardized patients are widely used in health care programs to both teach and evaluate the communication and clinical skills of students. Although athletic training education programs (ATEPs) commonly use simulations, little information exists related to the use and implementation of standardized patients (SPs). Objective: To provide strategies to use SPs with athletic training students and limited resources. Background: Standardized patient encounters differ from simulations. Simulations require students to perform clinical skills on a mock patient or athlete who has no training to consistently portray a particular injury or illness. SP encounters are consistent, carefully crafted portrayals of injuries or illnesses by trained individuals. Synthesis: A feasible way to use SPs in an ATEP is the time-in-time-out method which allows students to not only examine a SP, but also interact with and obtain immediate feedback from their instructor. Research with athletic training students has revealed that SP encounters are both realistic and worthwhile. Many resources exist to initiate the use of standardized patients in ATEPs, including various research publications, and online resources such as MedEd Portal and the Association of Standardized Patient Educators. Results: The use of SPs enhances learning opportunities for students and provides a format for real-time evaluation for instructors. Recommendation(s): Educators should consider using athletic training students and/or theater students to serve as SPs. Also, a local hospital or other SP programs at a local university may offer the use of their facilities or resources to initiate the use of SPs in your ATEP. Conclusion(s): Many resources are needed to implement the use of standardized patients into an ATEP, but the experience can be well worth the expense to provide a realistic and worthwhile learning experience for students.


2015 ◽  
Vol 10 (2) ◽  
pp. 138-145 ◽  
Author(s):  
Stephanie M. Mazerolle ◽  
Thomas Dodge

Context Limited evidence exists on the role clinical education can play in the development of athletic training student commitment for the profession. Objective Investigating the role clinical education experiences play on the development of passion for athletic training. Design Exploratory qualitative study. Setting Athletic training education programs. Patients or Other Participants Seventeen students (8 males, 9 females) volunteered. Students represented both junior (13) and senior (4) levels, were engaged in 23 ± 5 hours per week of clinical education, and were 20 ± 2 years old. Main Outcome Measure(s) One-on-one, in-person interviews following a semistructured format. Multiple analyst triangulation and member checks were included as steps to establish data credibility. Results A positive clinical education experience as described by this cohort of students was inclusive of strong mentorship, realism, professional commitment of the preceptor, and clinical skill integration. In combination, these attributes appear to help students develop their professional commitment for athletic training. Preceptors who provided mentorship by modeling appropriate professional behaviors, providing a realistic perspective to their role, and showing enthusiasm allowed the students in this study to gain an accurate understanding of the profession. Opportunities to develop clinical skills with feedback for improvement demonstrated the preceptors' commitment to the profession and the student and was valued as contributing to the overall experience. Conclusions The development of the athletic training student's commitment to the profession is directly related to a positive clinical education experience facilitated by a preceptor who is also passionate about the job. Preceptors are encouraged to provide the athletic training student with a realistic impression of the clinical setting in which they are gaining experiences in order for them to fully understand their future role and responsibilities. Maintaining an optimistic but pragmatic attitude is also valued by the athletic training student.


2010 ◽  
Vol 45 (6) ◽  
pp. 609-614 ◽  
Author(s):  
Melissa C. Marty ◽  
Jolene M. Henning ◽  
John T. Willse

Abstract Context: Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. Objective: To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Design: Cross-sectional study. Setting: Entry-level master's athletic training education program. Patients or Other Participants: First-year (n  =  5) and second-year (n  =  8) students. Main Outcome Measure(s): Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Results: Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the ϕ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (ϕ  =  0.79) for the Faber test, with 1 participant on 2 occasions (ϕ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (ϕ  =  0.72). Conclusions: Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was less reliable than having more than 1 student assess those skills on more than 1 occasion. Peer assessment of psychomotor skills could be an important part of the learning process and a tool to supplement instructor assessment.


2015 ◽  
Vol 10 (3) ◽  
pp. 219-226 ◽  
Author(s):  
Patricia A. Aronson ◽  
Thomas G. Bowman ◽  
Stephanie M. Mazerolle

Context The perceptions of athletic training students (ATSs) regarding their clinical education experiences are not fully understood. It is important to investigate ATS perceptions of clinical education to allow athletic training educators to provide educational experiences that will maximize learning. Objective To determine what ATSs value during their clinical education experiences. Design Qualitative study. Setting Participants completed an electronic preceptor evaluation. Patients or Other Participants Nineteen (14 female, 5 male; average age = 22 ± 1 years) senior ATSs over 2 years enrolled in a Commission on Accreditation of Athletic Training Education–accredited athletic training program participated in our study. Participants came from 1 Commission on Accreditation of Athletic Training Education–accredited athletic training program in the Mid-Atlantic region. Data Collection and Analysis We asked seniors to evaluate their final clinical education experience by completing an open-ended questionnaire. We analyzed the data following the principles of grounded theory. We negotiated over the coding scheme until we reached full agreement, performed a peer review, and conducted member checks to ensure trustworthiness of the results. Results Three major themes emerged from the data. Athletic training students enjoy interacting with preceptors who act as appropriate professional role models. Our participants also found value in being able to develop their clinical skills with appropriate situational supervision. Finally, ATSs appreciate when preceptors teach them new information by stimulating their critical thinking skills. Conclusions To help provide positive learning environments for senior ATSs, athletic training education administrators should select preceptors who can successfully model professional responsibilities, present ATSs with authentic learning experiences, and promote higher-level thinking. We believe providing ATSs with exposure to preceptors who can meet these criteria may better prepare students for professional practice, alter persistence decisions, and should be a goal of clinical experiences for the benefit of ATSs.


2014 ◽  
Vol 9 (3) ◽  
pp. 104-112 ◽  
Author(s):  
Sarah S. Benes ◽  
Stephanie M. Mazerolle

Context Successful athletic training programs should help students develop a desire to work within the athletic training profession while providing adequate preparation for them to enter the workforce. Understanding athletic training students' perceptions of the profession as they leave programs and the factors that influence these perceptions is critical in ensuring retention of graduating students in the field. Objective To examine senior athletic training students' [SATSs] attitudes, opinions, and perceptions of the athletic training profession and to gain insight into the factors that influence their career choice. Design Qualitative study. Setting Commission on Accreditation of Athletic Training Education–accredited athletic training education programs. Patients or Other Participants A total of 26 SATSs (7 men, 19 women) who graduated in 2011. Main Outcome Measure(s) We collected data using semistructured phone interviews and implemented a grounded theory approach to analyze the data. We used member checks and multiple-analyst triangulation strategies to establish the trustworthiness of the data. Results The SATSs reported positive and negative perceptions about the profession within 2 major categories: (1) aspects of the profession and (2) public understanding of the profession. “Aspects of the profession” was described by long hours/schedule, low salary, family conflict issues, future of the profession, dynamism of the profession, and profession people enjoy. The “Public understanding of the profession” was articulated by public misconception and a lack of respect for the profession. Factors that influence their perceptions are related to prior experience with athletic training/sports, clinical experiences, and interaction with athletic training professionals. Conclusions The SATSs have developed positive and negative perceptions about the profession through their professional preparations. These are influenced by their progression through the program wherein they develop confidence and feel prepared to enter the workforce with a better understanding of and passion for the profession.


2008 ◽  
Vol 43 (4) ◽  
pp. 386-395 ◽  
Author(s):  
Stacy E. Walker ◽  
Thomas G. Weidner ◽  
Kirk J. Armstrong

Abstract Context: Appropriate methods for evaluating clinical proficiencies are essential in ensuring entry-level competence. Objective: To investigate the common methods athletic training education programs use to evaluate student performance of clinical proficiencies. Design: Cross-sectional design. Setting: Public and private institutions nationwide. Patients or Other Participants: All program directors of athletic training education programs accredited by the Commission on Accreditation of Allied Health Education Programs as of January 2006 (n  =  337); 201 (59.6%) program directors responded. Data Collection and Analysis: The institutional survey consisted of 11 items regarding institutional and program demographics. The 14-item Methods of Clinical Proficiency Evaluation in Athletic Training survey consisted of respondents' demographic characteristics and Likert-scale items regarding clinical proficiency evaluation methods and barriers, educational content areas, and clinical experience settings. We used analyses of variance and independent t tests to assess differences among athletic training education program characteristics and the barriers, methods, content areas, and settings regarding clinical proficiency evaluation. Results: Of the 3 methods investigated, simulations (n  =  191, 95.0%) were the most prevalent method of clinical proficiency evaluation. An independent-samples t test revealed that more opportunities existed for real-time evaluations in the college or high school athletic training room (t189  =  2.866, P  =  .037) than in other settings. Orthopaedic clinical examination and diagnosis (4.37 ± 0.826) and therapeutic modalities (4.36 ± 0.738) content areas were scored the highest in sufficient opportunities for real-time clinical proficiency evaluations. An inadequate volume of injuries or conditions (3.99 ± 1.033) and injury/condition occurrence not coinciding with the clinical proficiency assessment timetable (4.06 ± 0.995) were barriers to real-time evaluation. One-way analyses of variance revealed no difference between athletic training education program characteristics and the opportunities for and barriers to real-time evaluations among the various clinical experience settings. Conclusions: No one primary barrier hindered real-time clinical proficiency evaluation. To determine athletic training students' clinical proficiency for entry-level employment, athletic training education programs must incorporate standardized patients or take a disciplined approach to using simulation for instruction and evaluation.


2016 ◽  
Vol 11 (2) ◽  
pp. 72-81 ◽  
Author(s):  
Stephanie M. Mazerolle ◽  
Christianne M. Eason ◽  
Sara Nottingham ◽  
Jessica L. Barrett

Context: Mentorship is a developmental process whereby a novice individual, as he/she becomes inducted into his/her area of expertise, is guided by a more experienced person. Speculation exists that years of experience can impact this relationship. Objective: To determine the impact mentoring can have on athletic training student development and evaluate if experience as a preceptor is viewed as influential on the mentor experience. Design: Mixed-methods study. Setting: Commission on Accreditation of Athletic Training Education accredited programs. Patients or Other Participants: We recruited 17 (14 females, 3 males) athletic training students to participate in our study. On average, our participants were 21 ± 1 years old and represented varying levels of academic standing (1 sophomore, 9 juniors, 7 seniors). All participants indicated they currently had a mentor when asked directly. Main Outcome Measure(s): Participants responded to the Athletic Training Perceptions of Effective Mentoring survey and 14 open-ended interview questions regarding their perceptions of mentoring. An inductive approach was used to identify themes and supporting categories. Trustworthiness was established by using multiple-analyst triangulation, peer review and piloting of the instruments, and triangulation of data using a mixed-methods approach. Results: Athletic training students perceive their mentoring experiences as those that provide support and understanding, advance their clinical practice, and allow for the development of career goals. Age and experience did not appear to impact the overall experience of the student but rather facilitates the type of mentoring relationship developed. Conclusions: Mentoring was perceived to be an advantageous aspect of the socialization process for the athletic training student. It provided support and understanding during times of increased stress, allowed for the development of clinical skills, and provided the chance to cultivate a professional identity.


2014 ◽  
Vol 9 (4) ◽  
pp. 182-189 ◽  
Author(s):  
Stephanie M. Mazerolle ◽  
Thomas G. Bowman ◽  
Sarah S. Benes

Context Clinical experiences are an integral part of athletic training education and are where students gain the hands-on, practical knowledge and skills necessary to provide quality patient care in the field. However, some clinical education experiences may not allow athletic training students to become clinically integrated. Objective To explore athletic training students' perspectives on their clinical learning experiences, specifically as they relate to an engaging learning environment. Design Qualitative study. Setting Commission on Accreditation of Athletic Training Education accredited undergraduate programs. Patients or Other Participants Twenty-one athletic training students (6 juniors; 15 seniors) with an average age of 22 years (20–23 years) from 4 National Athletic Trainers' Association districts volunteered to participate in our study. Data Collection and Analysis Participants responded to a series of open-ended questions by journaling their thoughts and opinions through the secure website QuestionPro. Data were analyzed using open coding that was guided by a general inductive procedure. Data credibility was established through peer review, interpretative member checks, and multiple analyst triangulation. Results Our cohort identified an engaging learning environment as one that allowed active learning and participation as an athletic trainer and included communication between the student and preceptor, patient interactions, and instructor feedback regarding development and application of skills and knowledge. Conclusions Athletic training students prefer a more active learning style and value observing their preceptor engage in patient care, but they also want the opportunity to practice their athletic training skills to gain competence and confidence.


2020 ◽  
Vol 15 (2) ◽  
pp. 85-92
Author(s):  
Kristin Ann Paloncy

Context Simulation is commonly incorporated into medical and health programs as a method of skill practice and evaluation and can be effective at improving athletic training student learning outcomes when purposefully designed. Objective The purpose of this study was to determine what level of impact participation in supervised practice after debriefing within a simulation-based cardiovascular emergency scenario using the Laerdal SimMan in a university simulation center in the United States had on athletic training students' clinical performance. Design Quantitative quasi-experimental cohort design with repeated measures study. Patients or Other Participants Convenience sample of undergraduate athletic training students (n = 46) enrolled in a professional program at a university in the Midwest. Intervention(s) Participation in supervised practice of cardiopulmonary resuscitation skills after debriefing in a simulation. Main Outcome Measure(s) Clinical competency with associated cardiopulmonary resuscitation skills using the Laerdal Learning Application software program that interfaces with the simulation hardware. Results There was a statistically significant interaction between groups (F1,10 = 18.70, P < .05, η = 652) indicating participants in the supervised practice after debriefing group were significantly higher (mean = 0.72, SD = 0.05) than those that did not have supervised practice after the debriefing (mean = 0.17, SD = 0.05). Conclusions The design and development of a simulation experience is optimized when there is deliberate consideration of what components and exposure to these learning components will lead to certain outcomes. Even though supervised practice after debriefing has been identified as optional for skill-based simulations, the current study demonstrates that the supervised practice of clinical skills component is vital within emergency cardiovascular simulation encounters for participants to increase clinical competency.


Sign in / Sign up

Export Citation Format

Share Document