Evaluating the Profile of Psychological Strategies: An Applied Profile for Assessing the Perceived Effectiveness of Athletes’ Psychological Strategies in Sport

2021 ◽  
Vol 5 (1) ◽  
pp. 30-41
Author(s):  
Umut Doğan
Keyword(s):  
Sport Psychology ◽  
Alternative Assessment ◽  
Assessment Tool ◽  
Psychological Outcomes ◽  
Assessment Tools ◽  
Validity And Reliability ◽  
Competitive Athletes ◽  
Applied Assessment ◽  
Test Retest Reliability

An alternative assessment tool called the Profile of Psychological Strategies (ProPS) was recently developed to measure athletes’ perceptions of (a) which strategies they use, (b) to pursue which psychological outcomes, and (c) how effective their strategies are in pursuing those psychological outcomes. This case study explains the process of evaluating this new, flexible, and highly applied tool’s theoretical validity/coherence, reliability, and immediate utility with 101 competitive athletes. This study showed that the theoretical validity and reliability of even nonstandardized, highly applied assessment tools can be evaluated. The ProPS was found to have good preliminary levels of divergent validity and immediate utility. The ProPS was also preliminarily found to have acceptable levels of known-group, concurrent, and convergent evidence, as well as test–retest reliability. Athletes in higher resilience and/or lower concentration disruption groups tended to report higher levels of effectiveness in selected psychological strategies. This case study can be useful for sport experts, especially sport psychology practitioners, wishing to use the ProPS to measure athletes’ psychological strategies and for those aiming to evaluate their own applied assessment tool.

Developing an Applied Profile for Assessing the Perceived Effectiveness of Athletes’ Psychological Strategies: A Case Study at the Australian Institute of Sport

2021 ◽  
Vol 5 (1) ◽  
pp. 1-9
Author(s):  
Umut Doğan
Keyword(s):  
Instrument Development ◽  
Alternative Assessment ◽  
Assessment Tool ◽  
Psychological Resilience ◽  
Perceived Effectiveness ◽  
Australian Institute ◽  
Applied Assessment ◽  
Present Case Study

Existing tools measuring athletes’ psychological strategies have various practical limitations including (a) not capturing the perceived effectiveness of psychological strategies in pursuing desirable outcomes; (b) overlooking stages of competitive involvement, such as before training or the night before competition; (c) and being predominantly paper-based. In the present case study, the author explains the process of developing an alternative assessment tool called the Profile of Psychological Strategies (ProPS). This new profile aims to measure athletes’ perceptions of which strategies they use, to pursue which desirable outcomes, and how effectively. The ProPS has its theoretical roots in Fletcher and Sarkar’s approach to developing psychological resilience and was developed based on an adapted version of Radhakrishna’s Sequence for Instrument Development. This case study can be useful both for sport experts looking for a practical and flexible way to measure athletes’ psychological strategies and for those aiming to develop their own applied assessment tool.

scholarly journals An Approach for the Development and Implementation of an Assessment Tool for Interprofessional Education Learning Activities

2017 ◽  
Vol 8 (4) ◽  
pp. 4 ◽  
Author(s):  
Lisa Salvati ◽  
David Bright ◽  
Margaret De Voest ◽  
Lisa Meny ◽  
Kali VanLangen ◽  
...  
Keyword(s):  
Interprofessional Education ◽  
Assessment Tool ◽  
Patient Care Team ◽  
Pharmacy Education ◽  
Assessment Tools ◽  
Longitudinal Assessment ◽  
Validity And Reliability ◽  
Assessment Approach ◽  
Case Study Report

The Accreditation Council for Pharmacy Education Standards 2016 state that colleges of pharmacy must assess student achievement and readiness to contribute as a member of an interprofessional collaborative patient care team. There are a limited number of assessment tools available to achieve this part of the Standards. The purpose of this Case Study Report is to describe the process that one college of pharmacy took to develop an interprofessional education (IPE) assessment tool to be used for their longitudinal assessment approach for IPE in the didactic portion of the curriculum. Strategies for the development of an assessment tool are provided through three themes: continuous refinement, collaboration and streamlining. Next steps for the implementation of the assessment tool, as well as evaluating its validity and reliability, are discussed.   Type: Case Study

scholarly journals Flexibility during the COVID-19 Pandemic Response: Healthcare Facility Assessment Tools for Resilient Evaluation

2021 ◽  
Vol 18 (21) ◽  
pp. 11478
Author(s):  
Andrea Brambilla ◽  
Tian-zhi Sun ◽  
Waleed Elshazly ◽  
Ahmed Ghazy ◽  
Paul Barach ◽  
...  
Keyword(s):  
Case Studies ◽  
Assessment Tool ◽  
Healthcare Facility ◽  
Health Impact ◽  
Design Guidelines ◽  
Assessment Tools ◽  
Validity And Reliability ◽  
Evaluation Tool ◽  
Healthcare Operations ◽  
Healthcare Facilities

Healthcare facilities are facing huge challenges due to the outbreak of COVID-19. Around the world, national healthcare contingency plans have struggled to cope with the population health impact of COVID-19, with healthcare facilities and critical care systems buckling under the extraordinary pressures. COVID-19 has starkly highlighted the lack of reliable operational tools for assessing the level sof flexibility of a hospital building to support strategic and agile decision making. The aim of this study was to modify, improve and test an existing assessment tool for evaluating hospital facilities flexibility and resilience. We followed a five-step process for collecting data by (i) doing a literature review about flexibility principles and strategies, (ii) reviewing healthcare design guidelines, (iii) examining international healthcare facilities case studies, (iv) conducting a critical review and optimization of the existing tool, and (v) assessing the usability of the evaluation tool. The new version of the OFAT framework (Optimized Flexibility Assessment Tool) is composed of nine evaluation parameters and subdivided into measurable variables with scores ranging from 0 to 10. The pilot testing of case studies enabled the assessment and verification the OFAT validity and reliability in support of decision makers in addressing flexibility of hospital design and/or operations. Healthcare buildings need to be designed and built based on principles of flexibility to accommodate current healthcare operations, adapting to time-sensitive physical transformations and responding to contemporary and future public health emergencies.

A Novel Tool for the Assessment of Sport Climbers’ Movement Performance

2020 ◽  
Vol 15 (6) ◽  
pp. 795-800 ◽  
Author(s):  
Nicola Taylor ◽  
David Giles ◽  
Micha Panáčková ◽  
James Mitchell ◽  
Joel Chidley ◽  
...  
Keyword(s):  
Performance Assessment ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Consultation Process ◽  
Retest Reliability ◽  
Performance Factors ◽  
Sport Climbing ◽  
Movement Performance ◽  
Test Retest Reliability

Purpose: To assess the validity and reliability of a novel movement-performance assessment tool for climbing/sport climbing. Methods: First, salient climbing movement-performance factors were identified through an iterative consultation process with 10 expert climbing coaches; the resulting Climber’s Movement Performance Assessment Tool (CM-PAT) contained 14 items in 5 categories. Second, 61 intermediate to advanced climbers ascended a single route, which was video recorded. Subsequently, 4 experienced (>10 y coaching) coaches used the CM-PAT to observe and score the climbers’ performance. Interrater reliability and comparisons with existing measures of climbing performance (6-mo self-reported ability, success and failure, climbing pace [m·min−1], and geometric entropy) were made. Results: Intraclass correlation coefficient (2,k) for the 4 raters demonstrated excellent reliability (>.81) between observers and good to excellent test–retest reliability (.71–.91). Pearson correlations between self-reported ability and CM-PAT scores explained 61% of the variance in self-reported climbing performance compared with 16% for geometric entropy and 52% for climbing pace. Considering differences in successful and unsuccessful climbers, the CM-PAT (P < .0005; d = 2.14), geometric entropy (P = .014; d = 0.67), and pace (P < .0005; d = 1.88) were able to differentiate between groups. Conclusions: The CM-PAT is the first sport climbing performance observational instrument to be developed through a thorough iterative process with expert coaches. Excellent interrater and test–retest reliability and excellent agreement with self-reported ability and with existing quantitative measures of performance support its recommendation for use in coaching and research contexts. Notably, a key advantage over existing measures is the identification of coachable elements of performance.

scholarly journals Automated Assessment in Programming Courses: A Case Study during the COVID-19 Era

2020 ◽  
Vol 12 (18) ◽  
pp. 7451
Author(s):  
Enrique Barra ◽  
Sonsoles López-Pernas ◽  
Álvaro Alonso ◽  
Juan Fernando Sánchez-Rada ◽  
Aldo Gordillo ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Great Difficulty ◽  
Assessment Method ◽  
Assessment Tools ◽  
Final Exam ◽  
Student Centered ◽  
Face To Face ◽  
Face To Face Learning ◽  
Online Format

The COVID-19 pandemic imposed in many countries, in the short term, the interruption of face-to-face teaching activities and, in the medium term, the existence of a ‘new normal’, in which teaching methods should be able to switch from face-to-face to remote overnight. However, this flexibility can pose a great difficulty, especially in the assessment of practical courses with a high student–teacher ratio, in which the assessment tools or methods used in face-to-face learning are not ready to be adopted within a fully online environment. This article presents a case study describing the transformation of the assessment method of a programming course in higher education to a fully online format during the COVID-19 pandemic, by means of an automated student-centered assessment tool. To evaluate the new assessment method, we studied students’ interactions with the tool, as well as students’ perceptions, which were measured with two different surveys: one for the programming assignments and one for the final exam. The results show that the students’ perceptions of the assessment tool were highly positive: if using the tool had been optional, the majority of them would have chosen to use it without a doubt, and they would like other courses to involve a tool like the one presented in this article. A discussion about the use of this tool in subsequent years in the same and related courses is also presented, analyzing the sustainability of this new assessment method.

scholarly journals Psychometric evaluation of the Chinese version of the Person-Centred Care Assessment Tool

BMJ Open ◽  
2020 ◽  
Vol 10 (7) ◽  
pp. e031580
Author(s):  
Cai Le ◽  
Ke Ma ◽  
Pingfen Tang ◽  
David Edvardsson ◽  
Lina Behm ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Intraclass Correlation ◽  
Psychometric Evaluation ◽  
Quality Of Healthcare ◽  
Hospital Staff ◽  
Chinese Version ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Care Assessment ◽  
Test Retest Reliability

ObjectiveThis study aims to test a Chinese cross-cultural adaptation of the English version of the Person-Centred Care Assessment Tool (P-CAT) and evaluate its psychometric properties.DesignP-CAT was translated/back-translated using established procedures before the psychometric evaluation of the Chinese version was made.SettingTwo hospitals covering urban and suburban areas of Kunming in the Yunnan province of China.Participants152 female hospital staff completed the survey.Main outcome measure(s)Construct validity and reliability, including internal consistency and test–retest reliability, were assessed among a sample of hospital staff.ResultsThe factor analysis resulted in a two-component solution that consisted of two subscales. The corrected item-total correlations for all of the items ranged from 0.14 to 0.44, with six items not meeting the cut-off level for item-total correlation (>0.3). The Chinese P-CAT demonstrated strong reliability, with a Cronbach’s alpha of 0.91–0.94 for the scales and a test–retest reliability coefficient of 0.88 for the overall scale scores. The intraclass correlation was 0.92 (95% CI 0.90 to 0.95).ConclusionP-CAT appears to be a promising measure for evaluating staff perceptions of person-centredness in Chinese hospital environments. The results show that P-CAT can be a useful tool for improving the quality of healthcare in terms of person-centred care in the Chinese context.

scholarly journals Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa

2013 ◽  
Vol 5 (1) ◽  
Author(s):  
Louis Jenkins ◽  
Bob Mash ◽  
Anselme Derese
Keyword(s):  
South Africa ◽  
Family Medicine ◽  
Assessment Tool ◽  
Portfolio Assessment ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Competency Based ◽  
The Difference ◽  
Test Retest Reliability

Background: Competency-based education and the validity and reliability of workplace-based assessment of postgraduate trainees have received increasing attention worldwide.Family medicine was recognised as a speciality in South Africa six years ago and a satisfactory portfolio of learning is a prerequisite to sit the national exit exam. A massive scaling up of the number of family physicians is needed in order to meet the health needs of the country.Aim: The aim of this study was to develop a reliable, robust and feasible portfolio assessment tool (PAT) for South Africa.Methods: Six raters each rated nine portfolios from the Stellenbosch University programme, using the PAT, to test for inter-rater reliability. This rating was repeated three months later to determine test–retest reliability. Following initial analysis and feedback the PAT was modified and the inter-rater reliability again assessed on nine new portfolios. An acceptable intra-classcorrelation was considered to be > 0.80.Results: The total score was found to be reliable, with a coefficient of 0.92. For test–retest reliability, the difference in mean total score was 1.7%, which was not statistically significant. Amongst the subsections, only assessment of the educational meetings and the logbook showed reliability coefficients > 0.80.Conclusion: This was the first attempt to develop a reliable, robust and feasible national portfolio assessment tool to assess postgraduate family medicine training in the South African context. The tool was reliable for the total score, but the low reliability of several sections in the PAT helped us to develop 12 recommendations regarding the use of the portfolio, the design of the PAT and the training of raters.

scholarly journals The Patchwork Text as Assessment Tool for Postgraduate Law Teaching in South Africa

Obiter ◽  
2020 ◽  
Vol 41 (2) ◽  
pp. 292-308
Author(s):  
JG Horn ◽  
L Van Niekerk
Keyword(s):  
Deep Learning ◽  
Alternative Assessment ◽  
Assessment Tool ◽  
Assessment Tools ◽  
Postgraduate Students ◽  
Traditional Assessment ◽  
Academic Knowledge ◽  
Assessment Approach ◽  
Problem Solvers ◽  
The Right

In the increasingly competitive higher education sphere, delivering graduates with a sound academic grounding in their discipline is no longer enough. Institutions of higher learning must yield lifelong learners who are employable and equipped with the practical skills required by the profession. To ensure this, the right assessment approach is key. While assessment has always been a crucial component of instruction, traditional assessment tools run the risk of being mere tools for certification, facilitating surface learning instead of deep learning. Assessment approaches need to be re-evaluated to strike a balance between encouraging deep learning and instilling proper academic knowledge in graduates. To contribute to such a re-evaluation of traditional assessment methods, this article reports on the introduction of the patchwork text (PWT) as an alternative assessment tool in postgraduate law teaching at the University of the Free State (UFS). After making the case for the move towards more authentic, alternative assessment techniques, the authors embark on a discussion of the main features of the PWT, as well as guidelines for drafting a PWT assessment. The focus then shifts to an overview of PWT implementation in other postgraduate modules, ending with a discussion of the authors’ experience introducing the PWT in their own teaching. Useful information about the authors’ approach is shared, including examples of formative assessment exercises used as part of the PWT, specifics regarding the portfolio of evidence of learning to be handed in, and an outline of the four “patches” making up the assessment. It is concluded that the PWT has proven to be a viable tool for assessing postgraduate students in certain law modules at the UFS. It has managed to promote deep learning, develop students into critical thinkers and problem-solvers, and compel them to continuously engage with the study material – all while achieving the intended learning outcomes. The PWT is therefore recommended to lecturers who seek to equip students with a macro-vision of their field of study, the ability to integrate and contextualise different areas of the discipline, and the skill to reflect critically on new, emerging developments in the field.

scholarly journals Development of Preverbal Communication Skills Scale for Children with Multiple Disabilities and Visual Impairment

2016 ◽  
Vol 13 (2) ◽  
pp. 2668
Author(s):  
Emine Ayyıldız ◽  
Nur Akçin ◽  
Yıldız Güven
Keyword(s):  
Visual Impairment ◽  
Communication Skills ◽  
Assessment Tool ◽  
Multiple Disabilities ◽  
Assessment Tools ◽  
Validity And Reliability ◽  
Communication Behaviors ◽  
Turkish Children ◽  
Quantitative Phase ◽  
Qualitative Phase

Communication is crucial for any human being and the children with disabilities are no exception. Due to the number and combination of their disabilities and/or conditions, children with multiple disabilities and visual impairment (MDVI) have especially limitations of the ability to communicate the meaningful and functional way with their environment. In order to improve the communication skills of children with MDVI, it is very important to identify unique, individual communication behaviors of these children. Thus, the aim of this study was to develop a valid and reliable developmental assessment tool to evaluate preverbal communication skills of Turkish children with MDVI.Sequential explanatory mixed methods were used in the study. In the qualitative phase, semi-structured interviews were conducted with the mothers of 34 children suffering from MDVI to explore the preverbal communication behaviors of the children based on the daily observances of their mothers’ with a descriptive analysis being performed on the data. From the findings of the interviews and the literature review, Preverbal Communication Skills Scale for Children with Multiple Disabilities and Visual Impairment (PCSS-MDVI) and the scoring guide were developed. During the quantitative phase, 65 mothers of children with MDVI were given this scale in order to determine the validity and reliability of the scale. For the reliability analysis, 34 mothers of typically developing (TD) children age between 1 to 24 months old also were given the scale.The findings of the qualitative phase indicated that children with MDVI were communicating mostly with preverbal behaviors and the analysis on data from the quantitative phase with respect to item analysis, reliability and validity revealed that the scale is valid and reliable. The scale has 17 items and three subscales, which are; regulating behaviors, social interaction and joint attention. The majority of children with MDVI cannot communicate verbally and there is lack of studies and assessment tools for the purpose of effectively evaluate these children’s preverbal communicative behaviors in our country. Based on the analysis, the PCSS-MDVI has been demonstrated good preliminary psychometric properties and it can be used as an instrument to evaluate preverbal communication behaviors of children with MDVI. It is the preliminary study of the development of the scale. Thus, validation of the scale should be repeated with more participants and the data of the video observations of preverbal communication behaviors of children with MDVI should be added to the analysis.            

scholarly journals Assessment, Allocation, And Management Of Home And Community Care Services For Medically Complex Children : A Case Study

2021 ◽  
Author(s):  
David Salib
Keyword(s):  
Community Care ◽  
Assessment Tool ◽  
Assessment Tools ◽  
Local Health ◽  
Health Human Resource ◽  
Care Needs ◽  
Care Services ◽  
Home And Community Care ◽  
Care Coordinators

This study examines the experiences of CCAC Care Coordinators when assessing, allocating, and managing medically complex children who require home and community care services. A case-study design was implemented, employing a focus group with seven Care Coordinators and an analysis of the 14 Local Health Integration Networks (LHINs) Integrated Health Service Plans (IHSPs) across Ontario. Three major findings arose from the study. First, families are experiencing increased levels of burden related to the child's care responsibilities. Second, there remains a health human resource shortage of individuals with a specialization in paediatrics in the home and community sector. Third, Care Coordinators function as street-level bureaucrats when allocating publicly funded services without the use of a standardized assessment tool. Ultimately, a model of care needs to be implemented supporting a balanced approach to assessment, utilizing standard assessment tools while providing a means for Care Coordinators to utilize their expertise in allocating services.

Sign in / Sign up

Export Citation Format

Share Document