PandAcuity in paediatrics: a novel clinical measure of visual function based on the panda illusion

Background/aimsTo evaluate the PandAcuity test for visual function testing in a paediatric cohort and to examine its agreement with conventional visual acuity (VA) testing.MethodsPandAcuity scores were determined in 152 children (77 males) aged between 3 and 15 years after VA testing (LEATM-test, E-chart, Landolt-C-rings or numbers). The PandAcuity test consisted of illusions made up from silhouettes of animals ‘hidden’ within zig-zag-patterns of decreasing spatial frequencies. Correlation analyses between PandAcuity score and VA were performed.Results150 children completed the test in at least one eye, 148 in both eyes. The PandAcuity test demonstrated good test–retest reliability (intraclass correlation coefficient=0.89) between two runs. VA and PandAcuity score showed a medium to large correlation (Spearman’s ρ=0.52, p<0.0001). 93% of the children’s visual impairment was classified in the same range by both test types. Receiver operating characteristic analysis of predicted visual impairment showed an excellent agreement with the classification based on VA testing (AUC=0.84).ConclusionThe PandAcuity test is rapid, simple and well accepted, rendering it a suitable supplement for the clinical assessment of VA in children. Because of its counterintuitive application (a higher number of correctly identified images means worse VA), it can be used to cross-validate conventional acuity tests to assure children’s compliance.

Download Full-text

Reliability and Validity of Turkish Myasthenia Gravis-Activities of Daily Living Scale

OTJR Occupation Participation and Health ◽

10.1177/1539449220961077 ◽

2020 ◽

pp. 153944922096107

Author(s):

Ecem Karanfil ◽

Yeliz Salcı ◽

Ayla Fil-Balkan ◽

Can Ebru Bekircan-Kurt ◽

Sevim Erdem Özdamar ◽

...

Keyword(s):

Construct Validity ◽

Myasthenia Gravis ◽

Activities Of Daily Living ◽

Daily Living ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Life Questionnaire ◽

Good Test ◽

Retest Reliability ◽

Test Retest Reliability

Linguistic, reliable, and valid secondary efficacy measures are important in clinical settings and studies. The aim of the study is to report test–retest reliability and construct validity of Turkish version of Myasthenia Gravis-Activities of Daily Living Scale (MG-ADL-T) in Myasthenia Gravis (MG) patients. Fifty-two ocular and generalized individuals with MG, applying to rehabilitation center, were included in the study. MG-ADL-T, MG quality-of-life questionnaire (MG-QoL), MG composite (MGC), quantitative MG score (QMGS), and pulmonary function test were administered. Reliability was assessed with intraclass correlation coefficient (ICC) and Cronbach’s alpha. Spearman correlation test and receiver operating characteristic (ROC) analysis were performed for construct validity. MG-ADL-T had fair internal consistency (Cronbach’s α = .67), excellent test–retest reliability (ICC = 0.96) and moderate construct validity (MG-QoL, r = 0.59; QMGS, r = .58; MGC, r = .68). MG-ADL, a unique scale that evaluates activities of daily living (ADL), has good test–retest reliability and construct validity in Turkish MG patients.

Download Full-text

Reliability of the Polar Vantage M Sports Watch when Measuring Heart Rate at Different Treadmill Exercise Intensities

Sports ◽

10.3390/sports8090117 ◽

2020 ◽

Vol 8 (9) ◽

pp. 117

Author(s):

Mike Climstein ◽

Jessica L. Alder ◽

Alyce M. Brooker ◽

Elissa J. Cartwright ◽

Kevin Kemp-Smith ◽

...

Keyword(s):

Heart Rate ◽

Treadmill Exercise ◽

Intraclass Correlation ◽

Good Test ◽

Good Reliability ◽

Measurement Variability ◽

Retest Reliability ◽

Activity Monitors ◽

Test Retest Reliability ◽

Standard Error Of Measurement

Background: Usage of wrist-worn activity monitors has rapidly increased in recent years, and these devices are being used by both fitness enthusiasts and in clinical populations. We, therefore, assessed the test–retest reliability of the Polar Vantage M (PVM) watch when measuring heart rate (HR) during various treadmill exercise intensities. Methods: HR was measured every 30 s (simultaneous electrocardiography (ECG) and PVM). Test–retest reliability was determined using an intraclass correlation coefficient (ICC) with 95% confidence intervals (CIs). Standard error of measurement (SEM) and smallest real difference (SRD) were used to determine measurement variability. Results: A total of 29 participants completed the trials. ICC values for PVM during stages 1, 2 and 5 demonstrated good to excellent test–retest reliability (0.78, 0.78 and 0.92; 95% CI (0.54–0.90, 0.54–0.9, 0.79–0.97)). For PVM during stages 0 (rest), 3 and 4, the ICC values indicated poor to good reliability (0.42, 0.68 and 0.58; 95% CI (−0.27–0.73, 0.32–0.85, 0.14–0.80)). Conclusion: This study identified that the test–retest reliability of the PVM was comparable at low and high exercise intensities; however, it revealed a poor to good test–retest reliability at moderate intensities. The PVM should not be used in a clinical setting where monitoring of an accurate HR is crucial to the patients’ safety.

Download Full-text

Test-Retest Reliability of the StepWatch Activity Monitor Outputs in Healthy Adults

Journal of Physical Activity and Health ◽

10.1123/jpah.7.5.671 ◽

2010 ◽

Vol 7 (5) ◽

pp. 671-676 ◽

Cited By ~ 27

Author(s):

Suzie Mudge ◽

Denise Taylor ◽

Oliver Chang ◽

Rosita Wong

Keyword(s):

Activity Index ◽

Intraclass Correlation ◽

Objective Measure ◽

Activity Monitor ◽

Healthy Adults ◽

Peak Activity ◽

Good Test ◽

Retest Reliability ◽

Step Rate ◽

Test Retest Reliability

Background:Activity Monitors give an objective measure of usual walking performance. This study aimed to examine the test-retest reliability of the StepWatch Activity Monitor outputs (mean steps/day; peak activity index; sustained activity indices of 1, 5, 20, 30, 60 minutes; steps at high, medium, and low stepping rates).Methods:Thirty healthy adults age 18 to 49 years wore the StepWatch for 2 3-day periods at least 1 week apart.Results:The intraclass correlation coefficients of the StepWatch outputs ranged from 0.44 to 0.91 over 3 days. The coefficient of variation ranged from 3.0% to 51.3% over the monitoring periods, with higher variation shown for shorter monitoring periods. The most reliable 5 outputs had 95% limits of agreement between 3-day periods that were less than 40%. These were mean steps/day (±39.1%), highest step rate in 1 (±17.3%) and 5 (±37.4%) minutes, peak activity index (±25.6%), and percentage of inactive time (±9.52%).Conclusions:Mean steps/day, highest step rate in 1 and 5 minutes, peak activity index, and percentage of inactive time have good test-retest reliability over a 3-day monitoring period, with lower reliability shown by the other StepWatch outputs. Monitoring over 1 or 2 days is less reliable.

Download Full-text

Reliability of Subjective Pain Ratings and Nociceptive Flexion Reflex Responses as Measures of Conditioned Pain Modulation

Pain Research and Management ◽

10.1155/2014/698246 ◽

2014 ◽

Vol 19 (2) ◽

pp. 93-96 ◽

Cited By ~ 22

Author(s):

Carlo Jurth ◽

Benno Rehberg ◽

Falk von Dincklage

Keyword(s):

Intraclass Correlation ◽

Pain Modulation ◽

Hot Water ◽

Conditioned Pain Modulation ◽

Good Test ◽

Retest Reliability ◽

Reflex Responses ◽

Pain Ratings ◽

Subjective Pain ◽

Test Retest Reliability

BACKGROUND: The endogenous modulation of pain can be assessed through conditioned pain modulation (CPM), which can be quantified using subjective pain ratings or nociceptive flexion reflexes. However, to date, the test-retest reliability has only been investigated for subjective pain ratings.OBJECTIVE: To compare the test-retest reliability of CPM-induced changes, measured using subjective pain ratings and nociceptive flexion reflexes, to provide a reliable scoring parameter for future studies.METHOD: A total of 40 healthy volunteers each received painful electrical stimuli to the sural nerve to elicit nociceptive flexion reflexes. Reflex sizes and subjective pain ratings were recorded before and during the immersion of the contralateral hand in hot water to induce CPM as well as innocuous water as control. Measurements were repeated in a retest 28 days later.RESULTS: Intraclass correlation coefficients showed good test-retest reliabilities of CPM during the hot water stimulus for both scoring parameters. Subjective pain ratings also correlated between test and retest during the control stimulus.CONCLUSIONS: Subjective pain ratings and nociceptive flexion reflexes show comparable test-retest reliabilities, but they reflect different components of CPM. While subjective pain ratings appear to incorporate cognitive influences to a larger degree, reflex responses appear to reflect spinal nociception more purely.

Download Full-text

Test-Retest and Interrater Reliability of the Functional Movement Screen

Journal of Athletic Training ◽

10.4085/1062-6050-48.2.11 ◽

2013 ◽

Vol 48 (3) ◽

pp. 331-336 ◽

Cited By ~ 51

Author(s):

Rebecca Shultz ◽

Scott C. Anderson ◽

Gordon O. Matheson ◽

Brandon Marcello ◽

Thor Besier

Keyword(s):

Interrater Reliability ◽

Intraclass Correlation ◽

Video Recording ◽

Functional Movement Screen ◽

Good Test ◽

Good Reliability ◽

Functional Movement ◽

Retest Reliability ◽

Test Retest Reliability ◽

First Session

Context: The Functional Movement Screen (FMS) is a popular test to evaluate the degree of painful, dysfunctional, and asymmetric movement patterns. Despite great interest in the FMS, test-retest reliability data have not been published. Objective: To assess the test-retest and interrater reliability of the FMS and to compare the scoring by 1 rater during a live session and the same session on video. Design: Cross-sectional study. Setting: Human performance laboratory in the sports medicine center. Patients or Other Participants: A total of 21 female (age = 19.6 ± 1.5 years, height = 1.7 ± 0.1 m, mass = 64.4 ± 5.1 kg) and 18 male (age = 19.7 ± 1.0 years, height = 1.9 ± 0.1 m, mass = 80.1 ± 9.9 kg) National Collegiate Athletic Association Division IA varsity athletes volunteered. Intervention(s): Each athlete was tested and retested 1 week later by the same rater who also scored the athlete's first session from a video recording. Five other raters scored the video from the first session. Main Outcome Measure(s): The Krippendorff α (K α) was used to assess the interrater reliability, whereas intraclass correlation coefficients (ICCs) were used to assess the test-retest reliability and reliability of live-versus-video scoring. Results: Good reliability was found for the test-retest (ICC = 0.6), and excellent reliability was found for the live-versus-video sessions (ICC = 0.92). Poor reliability was found for the interrater reliability (K α = .38). Conclusions: The good test-retest and high live-versus-video session reliability show that the FMS is a usable tool within 1 rater. However, the low interrater K α values suggest that the FMS within the limits of generalization should not be used indiscriminately to detect deficiencies that place the athlete at greater risk for injury. The FMS interrater reliability may be improved with better training for the rater.

Download Full-text

A reliable and valid measure of COVID-19 patient-reported symptoms in outpatients: the Symptoms Evolution of COVID-19 (SE-C19) instrument

10.1101/2021.12.16.21267708 ◽

2021 ◽

Author(s):

Diana Rofail ◽

Pip Griffiths ◽

Giulio Flore ◽

Mohamed Hussein ◽

Sumathi Sivapalasingam ◽

...

Keyword(s):

Intraclass Correlation ◽

Good Test ◽

Symptom Resolution ◽

Patient Global Impression ◽

New Instrument ◽

Patient Reported ◽

Item Scores ◽

Definition Of ◽

Test Retest Reliability ◽

Low Prevalence

Background: There is no valid and reliable patient self-reported measure assessing symptomology among outpatients with COVID-19. The Symptoms Evolution of COVID-19 (SE-C19) is a self-administered new instrument that includes 23 symptoms, each rated for severity at their worst moment within the last 24 hours. We studied the psychometric properties of SE-C19. Methods: Reliability, validity, and sensitivity to change of the SE-C19 were assessed in 657 outpatients with confirmed COVID-19 enrolled in NCT04425629. SE-C19 and Patient Global Impression of Severity (PGIS) were administered daily from baseline (predose at Day 1) to end of study (Day 29). Findings: Most patients (70.0%) were aged ≤50 years and white (85.5%). At baseline, patients reported an average (SD) of 6.6 (3.9) symptoms (ie, rated as at least Mild) with 3.8 (3.3) of these symptoms being rated as Moderate or Severe. By Day 29, most symptoms had resolved; 74.4% of patients reported no symptoms and on average, only 0.6 (SD 1.5) were reported as at least Mild. Stable patients according to the PGIS showed scores with intraclass correlation values indicating moderate-to-good test-retest reliability (ie, 0.50-0.90). At baseline, 20 item scores (87%) varied significantly across PGIS defined groups supporting the validity of SE-C19. A symptom resolution endpoint was defined after excluding the item 'Sneezing', due to its low ability to discriminate severity levels, and 'Confusion', 'Rash', and 'Vomiting', due to their low prevalence in this population. Symptoms resolution required complete absence of all remaining items, except 'Cough', 'Fatigue', and 'Headache', which could be Mild or Moderate in severity. Interpretation: We identified 19 items that are valid and reliable to measure disease-related symptoms in COVID-19 outpatients and propose a definition of symptom resolution that could be used in future clinical trials and potentially, also in clinical practice.

Download Full-text

Reliability of the performance-based measure of executive functions in people with schizophrenia

BMC Psychiatry ◽

10.1186/s12888-021-03562-y ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

En-Chi Chiu ◽

Ya-Chen Lee ◽

Shu-Chun Lee ◽

I-Ping Hsueh

Keyword(s):

Executive Functions ◽

Intraclass Correlation ◽

Minimal Detectable Change ◽

Rater Agreement ◽

Good Test ◽

Retest Reliability ◽

Purposive Action ◽

And Performance ◽

Agreement Study ◽

Test Retest Reliability

Abstract Background The Performance-based measure of Executive Functions (PEF) with four domains is designed to assess executive functions in people with schizophrenia. The purpose of this study was to examine the test-retest reliability of the PEF administered by the same rater (intra-rater agreement) and by different raters (inter-rater agreement) in people with schizophrenia and to estimate the values of minimal detectable change (MDC) and MDC%. Methods Two convenience samples (each sample, n = 60) with schizophrenia were conducted two assessments (two weeks apart). The intraclass correlation coefficient (ICC) was analyzed to examine intra-rater and inter-rater agreements of the test-retest reliability of the PEF. The MDC was calculated through standard error of measurement. Results For the intra-rater agreement study, the ICC values of the four domains were 0.88–0.92. The MDC (MDC%) of the four domains (volition, planning, purposive action, and perfromance effective) were 13.0 (13.0%), 12.2 (16.4%), 16.2 (16.2%), and 16.3 (18.8%), respectively. For the inter-rater agreement study, the ICC values of the four domains were 0.82–0.89. The MDC (MDC%) were 15.8 (15.8%), 17.4 (20.0%), 20.9 (20.9%), and 18.6 (18.6%) for the volition, planning, purposive action, and performance effective domains, respectively. Conclusions The PEF has good test-retest reliability, including intra-rater and inter-rater agreements, for people with schizophrenia. Clinicians and researchers can use the MDC values to verify whether an individual with schizophrenia shows any real change (improvement or deterioration) between repeated PEF assessments by the same or different raters.

Download Full-text

The Mandarin Voice Handicap Index for Laryngectomees With Pneumatic Artificial Laryngeal and Esophageal Speech

American Journal of Speech-Language Pathology ◽

10.1044/2021_ajslp-20-00241 ◽

2021 ◽

pp. 1-12

Author(s):

Chen-Chi Wang ◽

Jia-Shiou Liao ◽

Hsiu-Chin Lai ◽

Yi-Hsuan Lo

Keyword(s):

Internal Consistency ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Voice Handicap Index ◽

Good Test ◽

Retest Reliability ◽

Related Quality ◽

Valid Instrument ◽

Test Retest Reliability ◽

The Impact

Purpose The Voice Handicap Index (VHI) questionnaire assesses the impact of total laryngectomy on voice-related quality of life. This study evaluates the Mandarin VHI, including its internal consistency, test–retest reliability, content validity, and differences in scores for Mandarin alaryngeal patients with pneumatic artificial laryngeal (PA) and esophageal (ES) speech. Method Translation and validation of the VHI questionnaire was performed through the forward–backward translation technique. This study used a sample of 78 PA and 23 ES participants from Taiwan who completed the Mandarin VHI. Forty-two of the alaryngeal participants completed the Mandarin VHI twice over a period of 7–63 days. Results The measurement of the internal consistency of the Mandarin VHI showed a high Cronbach's alpha coefficient for the total score (.975) and the functional (.930), physical (.939), and emotional (.938) subscales. Based on the results of the intraclass correlation coefficients, good test–retest reliability for the total and domain scores was found (intraclass correlation coefficient = .827–.863). Conclusion The Mandarin VHI was validated as an instrument with proper internal consistency and reliability, which supports the Mandarin VHI as a valid instrument for the self-evaluation of handicaps related to voice problems in PA and ES speakers.

Download Full-text

Portuguese-language version of the COPD Assessment Test: validation for use in Brazil

Jornal Brasileiro de Pneumologia ◽

10.1590/s1806-37132013000400002 ◽

2013 ◽

Vol 39 (4) ◽

pp. 402-408 ◽

Cited By ~ 24

Author(s):

Guilherme Pinheiro Ferreira da Silva ◽

Maria Tereza Aguiar Pessoa Morano ◽

Cyntia Maria Sampaio Viana ◽

Clarissa Bentes de Araujo Magalhaes ◽

Eanes Delgado Barros Pereira

Keyword(s):

Intraclass Correlation ◽

Depression Scale ◽

Teaching Hospitals ◽

Good Test ◽

Language Version ◽

Copd Assessment Test ◽

6Mwt Distance ◽

Scale Scores ◽

Test Retest Reliability ◽

The City

OBJECTIVE: To validate a Portuguese-language version of the COPD assessment test (CAT) for use in Brazil and to assess the reproducibility of this version. METHODS: This was multicenter study involving patients with stable COPD at two teaching hospitals in the city of Fortaleza, Brazil. Two independent observers (twice in one day) administered the Portuguese-language version of the CAT to 50 patients with COPD. One of those observers again administered the scale to the same patients one week later. At baseline, the patients were submitted to pulmonary function testing and the six-minute walk test (6MWT), as well as completing the previously validated Portuguese-language versions of the Saint George's Respiratory Questionnaire (SGRQ), modified Medical Research Council (MMRC) dyspnea scale, and hospital anxiety and depression scale (HADS). RESULTS: Inter-rater and intra-rater reliability was excellent (intraclass correlation coefficient [ICC] = 0.96; 95% CI: 0.93-0.97; p < 0.001; and ICC = 0.98; 95% CI: 0.96-0.98; p < 0.001, respectively). Bland Altman plots showed good test-retest reliability. The CAT total score correlated significantly with spirometry results, 6MWT distance, SGRQ scores, MMRC dyspnea scale scores, and HADS-depression scores. CONCLUSIONS: The Portuguese-language version of the CAT is a valid, reproducible, and reliable instrument for evaluating patients with COPD in Brazil.

Download Full-text

Reliability of Autism-Tics, AD/HD, and other Comorbidities (A–TAC) Inventory in a Test-Retest Design

Psychological Reports ◽

10.2466/03.15.pr0.114k10w1 ◽

2014 ◽

Vol 114 (1) ◽

pp. 93-103 ◽

Cited By ~ 15

Author(s):

Tomas Larson ◽

Eva Norén Selinus ◽

Clara Hellner Gumpert ◽

Thomas Nilsson ◽

Nóra Kerekes ◽

...

Keyword(s):

Intraclass Correlation ◽

Correlation Coefficients ◽

Population Based ◽

Autism Spectrum ◽

Good Test ◽

Rater Reliability ◽

Retest Reliability ◽

Intraclass Correlation Coefficients ◽

Intraclass Correlations ◽

Test Retest Reliability

The Autism-Tics, AD/HD, and other Comorbidities (A–TAC) inventory is used in epidemiological research to assess neurodevelopmental problems and coexisting conditions. Although the A–TAC has been applied in various populations, data on retest reliability are limited. The objective of the present study was to present additional reliability data. The A–TAC was administered by lay assessors and was completed on two occasions by parents of 400 individual twins, with an average interval of 70 days between test sessions. Intra- and inter-rater reliability were analysed with intraclass correlations and Cohen's κ. A–TAC showed excellent test-retest intraclass correlations for both autism spectrum disorder and attention deficit hyperactivity disorder (each at .84). Most modules in the A–TAC had intra- and inter-rater reliability intraclass correlation coefficients of ≥ .60. Cohen's κ indicated acceptable reliability. The current study provides statistical evidence that the A–TAC yields good test-retest reliability in a population-based cohort of children.

Download Full-text