scholarly journals Inter-Rater Agreement and Test-Retest Reliability of the Performance and Fitness (PERF-FIT) Test Battery for Children: A Test for Motor Skill Related Fitness.

2020 ◽  
Author(s):  
Bouwien Smits-Engelsman ◽  
Eline Smit ◽  
Rosemary Xorlanyo Doe-Asinyo ◽  
Stella Elikplim Lawerteh ◽  
Wendy Aertssen ◽  
...  
Keyword(s):  
Low Income ◽  
Motor Skill ◽  
Assessment Tool ◽  
Test Battery ◽  
Rater Agreement ◽  
Good Test ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Reliability Indices ◽  
Test Retest Reliability

Abstract Background: The Performance and Fitness (PERF-FIT) test battery for children is a recently developed, valid assessment tool for measuring motor skill-related physical fitness in 5 to 12-year-old children living in low-income settings. The aim of this study was to determine: (1) inter-rater agreement and (2) test-retest reliability of the PERF-FIT in children from 3 different countries (Ghana, South Africa and the Netherlands). Method: For inter-rater reliability 29 children, (16 boys and 13 girls, 6-10 years) were scored by 2 raters simultaneously. For test–retest reliability 72 children, (33 boys and 39 girls, 5-12 years) performed the test twice, minimally one week and maximally two weeks apart. Relative and absolute reliability indices were calculated. ANOVA was used to examine differences between the three assessor teams in the three countries.Results: The PERF-FIT demonstrated excellent inter-rater reliability (ICC, 0.99) and good test-retest reliability (ICC, ≥ 0.80) for 11 of the 12 tasks. a poor ICC was found for the Jumping item only, due to low spread in values. Overall, measurement error, Limits of Agreement and Coefficient of Variation had acceptable levels to support clinical use. No systematic differences were found between first and second measurement between the three countries but for one item (Overhead throw). Conclusions: The PERF-FIT can reliably measure motor skill related fitness in 5 to 12-year-old children in different settings and help clinicians monitor levels of power and agility, and fundamental motor skills (throwing, bouncing, catching, jumping, hopping and balance).

scholarly journals Inter-rater reliability and test-retest reliability of the Performance and Fitness (PERF-FIT) test battery for children: a test for motor skill related fitness

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Bouwien C. M. Smits-Engelsman ◽  
Eline Smit ◽  
Rosemary Xorlanyo Doe-Asinyo ◽  
Stella Elikplim Lawerteh ◽  
Wendy Aertssen ◽  
...  
Keyword(s):  
Low Income ◽  
Motor Skill ◽  
Assessment Tool ◽  
Test Battery ◽  
Good Test ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Reliability Indices ◽  
Significant Difference ◽  
Test Retest Reliability

Abstract Background The Performance and Fitness (PERF-FIT) test battery for children is a recently developed, valid assessment tool for measuring motor skill-related physical fitness in 5 to 12-year-old children living in low-income settings. The aim of this study was to determine: (1) inter-rater reliability and (2) test-retest reliability of the PERF-FIT in children from 3 different countries (Ghana, South Africa and the Netherlands). Method For inter-rater reliability 29 children, (16 boys and 13 girls, 6–10 years) were scored by 2 raters simultaneously. For test–retest reliability 72 children, (33 boys and 39 girls, 5–12 years) performed the test twice, minimally 1 week and maximally 2 weeks apart. Relative and absolute reliability indices were calculated. ANOVA was used to examine differences between the three assessor teams in the three countries. Results The PERF-FIT demonstrated excellent inter-rater reliability (ICC, 0.99) and good test-retest reliability (ICC, ≥ 0.80) for 11 of the 12 tasks, with a poor ICC for the Jumping item, due to low spread in values. A significant difference between first and second test occasion was present on half of the items, but the differences were small (Cohen’s d 0.01–0.17), except for Stepping, Side jump and Bouncing and Catching (Cohen’s d 0.34, 0.41 and 0.33, respectively). Overall, measurement error, Limits of Agreement and Coefficient of Variation had acceptable levels to support clinical use. No systematic dissimilarities in error were found between first and second measurement between the three countries but for one item (Overhead throw). Conclusions The PERF-FIT can reliably measure motor skill related fitness in 5 to 12-year-old children in different settings and help clinicians monitor levels of fundamental motor skills (throwing, bouncing, catching, jumping, hopping and balance), power and agility.

Validation of a Hidradenitis Suppurativa Self-Assessment Tool

2019 ◽  
Vol 23 (4) ◽  
pp. 388-390 ◽  
Author(s):  
Aditi Senthilnathan ◽  
Sree S. Kolli ◽  
Leah A. Cardwell ◽  
Irma Richardson ◽  
Steven R. Feldman ◽  
...  
Keyword(s):  
Hidradenitis Suppurativa ◽  
Assessment Tool ◽  
Multiple Scales ◽  
Weighted Kappa ◽  
Self Administration ◽  
Self Assessment ◽  
Good Test ◽  
Retest Reliability ◽  
Dermatology Clinic ◽  
Test Retest Reliability

Background: Hidradenitis suppurativa (HS) is a debilitating dermatologic condition presenting with recurrent abscesses. While there are multiple scales to determine HS severity, none are designed for self-administration. A validated severity self-assessment tool may facilitate survey research and improve communication by allowing patients to objectively report their HS severity between clinic visits. Objectives: The purpose of this study was to assess a self-administered HS measure. Methods: An HS self-assessment tool (HSSA) with 10 photographs of different Hurley stages was developed. The tool was administered to patients diagnosed with HS who visited the Wake Forest Baptist Health dermatology clinic over a span of 2 months. Physician-administered Hurley stage was recorded to determine criterion validity. To assess test-retest reliability of the measure, patients completed the HSSA again at least 30 minutes after the first completion. Results: Twenty-four patients completed the measure, and 20 of these patients completed it twice. Agreement between physician-determined Hurley stage and self-determined Hurley stage was 66.7% with a weighted kappa of 0.57 (95% confidence interval [CI]: 0.30-0.84). The weighted kappa for agreement between patients’ initial and second completion of the HSSA was 0.81 (95% CI: 0.64-0.99). Conclusions: The self-administered measure provides moderate agreement with physician-determined Hurley stage and good test-retest reliability.

scholarly journals Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa

2013 ◽  
Vol 5 (1) ◽  
Author(s):  
Louis Jenkins ◽  
Bob Mash ◽  
Anselme Derese
Keyword(s):  
South Africa ◽  
Family Medicine ◽  
Assessment Tool ◽  
Portfolio Assessment ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Competency Based ◽  
The Difference ◽  
Test Retest Reliability

Background: Competency-based education and the validity and reliability of workplace-based assessment of postgraduate trainees have received increasing attention worldwide.Family medicine was recognised as a speciality in South Africa six years ago and a satisfactory portfolio of learning is a prerequisite to sit the national exit exam. A massive scaling up of the number of family physicians is needed in order to meet the health needs of the country.Aim: The aim of this study was to develop a reliable, robust and feasible portfolio assessment tool (PAT) for South Africa.Methods: Six raters each rated nine portfolios from the Stellenbosch University programme, using the PAT, to test for inter-rater reliability. This rating was repeated three months later to determine test–retest reliability. Following initial analysis and feedback the PAT was modified and the inter-rater reliability again assessed on nine new portfolios. An acceptable intra-classcorrelation was considered to be > 0.80.Results: The total score was found to be reliable, with a coefficient of 0.92. For test–retest reliability, the difference in mean total score was 1.7%, which was not statistically significant. Amongst the subsections, only assessment of the educational meetings and the logbook showed reliability coefficients > 0.80.Conclusion: This was the first attempt to develop a reliable, robust and feasible national portfolio assessment tool to assess postgraduate family medicine training in the South African context. The tool was reliable for the total score, but the low reliability of several sections in the PAT helped us to develop 12 recommendations regarding the use of the portfolio, the design of the PAT and the training of raters.

scholarly journals Reliability of the performance-based measure of executive functions in people with schizophrenia

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
En-Chi Chiu ◽  
Ya-Chen Lee ◽  
Shu-Chun Lee ◽  
I-Ping Hsueh
Keyword(s):  
Executive Functions ◽  
Intraclass Correlation ◽  
Minimal Detectable Change ◽  
Rater Agreement ◽  
Good Test ◽  
Retest Reliability ◽  
Purposive Action ◽  
And Performance ◽  
Agreement Study ◽  
Test Retest Reliability

Abstract Background The Performance-based measure of Executive Functions (PEF) with four domains is designed to assess executive functions in people with schizophrenia. The purpose of this study was to examine the test-retest reliability of the PEF administered by the same rater (intra-rater agreement) and by different raters (inter-rater agreement) in people with schizophrenia and to estimate the values of minimal detectable change (MDC) and MDC%. Methods Two convenience samples (each sample, n = 60) with schizophrenia were conducted two assessments (two weeks apart). The intraclass correlation coefficient (ICC) was analyzed to examine intra-rater and inter-rater agreements of the test-retest reliability of the PEF. The MDC was calculated through standard error of measurement. Results For the intra-rater agreement study, the ICC values of the four domains were 0.88–0.92. The MDC (MDC%) of the four domains (volition, planning, purposive action, and perfromance effective) were 13.0 (13.0%), 12.2 (16.4%), 16.2 (16.2%), and 16.3 (18.8%), respectively. For the inter-rater agreement study, the ICC values of the four domains were 0.82–0.89. The MDC (MDC%) were 15.8 (15.8%), 17.4 (20.0%), 20.9 (20.9%), and 18.6 (18.6%) for the volition, planning, purposive action, and performance effective domains, respectively. Conclusions The PEF has good test-retest reliability, including intra-rater and inter-rater agreements, for people with schizophrenia. Clinicians and researchers can use the MDC values to verify whether an individual with schizophrenia shows any real change (improvement or deterioration) between repeated PEF assessments by the same or different raters.

scholarly journals Development and reliability of the Korean version of the Feeding Abilities Assessment

2019 ◽  
Vol 32 (1) ◽  
pp. 69-74
Author(s):  
Seul Gi Koo ◽  
Hae Yean Park ◽  
Jongbae Kim ◽  
Areum Han
Keyword(s):  
Correlation Coefficient ◽  
Internal Consistency ◽  
Content Validity ◽  
Assessment Tool ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Korean Version ◽  
Test Retest Reliability

Objective The purpose of this study is to introduce a standardised assessment tool by verifying the reliability of the translated Korean version of the Feeding Abilities Assessment (K-FAA), which was developed to suit Korean culture. Methods The research subjects were 65 patients with dementia living in nursing homes. The K-FAA was completed by verifying the suitability of translation and reverse translation. The validity of the K-FAA was established through content validity, while its reliability was analysed based on internal consistency reliability for the items, test–retest reliability and inter-rater reliability. Results The content validity index determined, based on the assessment of professors, occupational therapists, and nurses, was more than .70. Cronbach’s α was more than .929, showing good internal consistency. A test–retest reliability of .884 was derived using Pearson’s correlation coefficient (p < .01), and an inter-rater reliability of .800 was derived using the kappa coefficients; intraclass correlation coefficient was .897, which also indicated good reliability. Conclusion The K-FAA was modified to fit the Korean domestic situation, and this assessment had high reliability. Therefore, K-FAA can evaluate the feeding ability of patients with dementia. Future studies should focus on providing evidence-based data to maintain or supplement the feeding ability of patients with dementia in Korea.

scholarly journals The Psychometric Properties of the Arabic Preschool Activity Card Sort

2017 ◽  
Vol 2017 ◽  
pp. 1-6 ◽  
Author(s):  
Somaya H. Malkawi ◽  
Sana M. N. Abu-Dahab ◽  
Ahmad F. Amro ◽  
Nihad A. Almasri
Keyword(s):  
Preschool Children ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Assessment Tool ◽  
Age Groups ◽  
Good Test ◽  
Card Sort ◽  
Retest Reliability ◽  
Test Retest Reliability

Background. The Preschool Activity Card Sort (PACS) is an interview-based assessment tool to measure participation of preschool children with age range from 3 to 6 years. Objective of Study. The purpose of this study was to establish the psychometric properties of the recently translated Arabic PACS (A-PACS). Methods. One hundred fifty-one Jordanian parents participated in the study representing different geographical areas. Children were almost equally distributed between males and females and into three age groups. Construct and concurrent validity were examined as well as the internal consistency of the scale and the test-retest reliability. Findings. The A-PACS was able to differentiate between the participation level of young and old children in the domains of education, community mobility, and low demand leisure of the A-PACS giving evidence to its construct validity and it significantly correlated with some aspects of the Vineland Adaptive Behavior Scale (VABS) giving evidence to its concurrent validity. The A-PACS showed excellent overall internal consistency (α=.859) for all domains and good test-retest reliability (r=.976, p<.001). Conclusion. The A-PACS can be considered as a valid and reliable tool to measure participation of preschool children with normal development from Arabic cultures. Future studies should focus on the validity of the A-PACS for use with children with disabilities.

Reliability of Autism-Tics, AD/HD, and other Comorbidities (A–TAC) Inventory in a Test-Retest Design

2014 ◽  
Vol 114 (1) ◽  
pp. 93-103 ◽  
Author(s):  
Tomas Larson ◽  
Eva Norén Selinus ◽  
Clara Hellner Gumpert ◽  
Thomas Nilsson ◽  
Nóra Kerekes ◽  
...  
Keyword(s):  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Population Based ◽  
Autism Spectrum ◽  
Good Test ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Intraclass Correlation Coefficients ◽  
Intraclass Correlations ◽  
Test Retest Reliability

The Autism-Tics, AD/HD, and other Comorbidities (A–TAC) inventory is used in epidemiological research to assess neurodevelopmental problems and coexisting conditions. Although the A–TAC has been applied in various populations, data on retest reliability are limited. The objective of the present study was to present additional reliability data. The A–TAC was administered by lay assessors and was completed on two occasions by parents of 400 individual twins, with an average interval of 70 days between test sessions. Intra- and inter-rater reliability were analysed with intraclass correlations and Cohen's κ. A–TAC showed excellent test-retest intraclass correlations for both autism spectrum disorder and attention deficit hyperactivity disorder (each at .84). Most modules in the A–TAC had intra- and inter-rater reliability intraclass correlation coefficients of ≥ .60. Cohen's κ indicated acceptable reliability. The current study provides statistical evidence that the A–TAC yields good test-retest reliability in a population-based cohort of children.

Measuring “Language Access Profiles” in Deaf and Hard-of-Hearing Children With the DHH Language Exposure Assessment Tool

2020 ◽  
pp. 1-25
Author(s):  
Matthew L. Hall ◽  
Stephanie De Anda
Keyword(s):  
Cluster Analysis ◽  
Exposure Assessment ◽  
Hard Of Hearing ◽  
Assessment Tool ◽  
Communication Mode ◽  
Developmental Potential ◽  
Language Access ◽  
Retest Reliability ◽  
Language Exposure ◽  
Test Retest Reliability

Purpose The purposes of this study were (a) to introduce “language access profiles” as a viable alternative construct to “communication mode” for describing experience with language input during early childhood for deaf and hard-of-hearing (DHH) children; (b) to describe the development of a new tool for measuring DHH children's language access profiles during infancy and toddlerhood; and (c) to evaluate the novelty, reliability, and validity of this tool. Method We adapted an existing retrospective parent report measure of early language experience (the Language Exposure Assessment Tool) to make it suitable for use with DHH populations. We administered the adapted instrument (DHH Language Exposure Assessment Tool [D-LEAT]) to the caregivers of 105 DHH children aged 12 years and younger. To measure convergent validity, we also administered another novel instrument: the Language Access Profile Tool. To measure test–retest reliability, half of the participants were interviewed again after 1 month. We identified groups of children with similar language access profiles by using hierarchical cluster analysis. Results The D-LEAT revealed DHH children's diverse experiences with access to language during infancy and toddlerhood. Cluster analysis groupings were markedly different from those derived from more traditional grouping rules (e.g., communication modes). Test–retest reliability was good, especially for the same-interviewer condition. Content, convergent, and face validity were strong. Conclusions To optimize DHH children's developmental potential, stakeholders who work at the individual and population levels would benefit from replacing communication mode with language access profiles. The D-LEAT is the first tool that aims to measure this novel construct. Despite limitations that future work aims to address, the present results demonstrate that the D-LEAT represents progress over the status quo.

Test–Retest Reliability of Social Cognition Screening Questionnaire–Taiwan Version in People With Schizophrenia

2021 ◽  
Vol 75 (Supplement_2) ◽  
pp. 7512500023p1-7512500023p1
Author(s):  
Shu-Chun Lee ◽  
Yi-Ching Wu ◽  
David Leland Roberts ◽  
Kuang-Pei Tseng ◽  
Wen-Yin Chen
Keyword(s):  
Social Cognition ◽  
Random Measurement Error ◽  
Good Test ◽  
Retest Reliability ◽  
Screening Questionnaire ◽  
The Core ◽  
Random Measurement ◽  
The Social ◽  
Test Retest Reliability ◽  
Multiple Domains

Abstract Date Presented 04/19/21 The Social Cognition Screening Questionnaire–Taiwan version (SCSQT) was designed to assess multiple domains of social cognition in people with schizophrenia in Taiwan. The SCSQT contains five subscales and provides estimates of the core domains of mentalizing and social perception and an overall social cognition score. Our validation of SCSQT indicated that the SCSQT had good test–retest reliability, acceptable random measurement error, and negligible practice effects. Primary Author and Speaker: Shu-Chun Lee Additional Authors and Speakers: Trudy Mallinson Contributing Authors: Alison M. Cogan, Ann Guernon, Katherine O'Brien, and Piper Hansen

Sign in / Sign up

Export Citation Format

Share Document