scholarly journals Test–retest reliability and practice effect of the Leuven Perceptual Organisation Screening Test

2022 ◽  
Author(s):  
Xiaotong Ding ◽  
Kathleen Vancleef
Keyword(s):  
Screening Test ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Multilevel Modelling ◽  
Practice Effect ◽  
Systematic Evaluation ◽  
Retest Reliability ◽  
Repeat Administration ◽  
Test Retest Reliability ◽  
Adequate Reliability

AbstractVisual diagnostic tests must have a high degree of consistency in their measurements (high reliability) to ensure accurate assessment of perceptual abilities. The current study assessed test–retest reliability and practice effects in the Leuven Perceptual Organisation Screening Test (L-POST) in 144 healthy volunteers, with time intervals between 0 and 756 days. We used Pearson's and intraclass correlation analysis, Bland–Altman analysis and multilevel modelling. Results from our analyses converged and supported an adequate reliability of the L-POST. Multilevel modelling demonstrated an absence of practice effect, suggesting that the L-POST is suitable for repeat administration. This study suggests that the L-POST has adequate reliability and is suitable for repeat administration even at short intervals. This study provides the basis for a more systematic evaluation for neuropsychological assessments, which can lead to the development of more reliable assessment batteries.

scholarly journals Test-retest reliability and Practice Effect of the Leuven Perceptual Organisation Screening Test

2020 ◽  
Author(s):  
Xiaotong Ding ◽  
Kathleen Vancleef
Keyword(s):  
Screening Test ◽  
High Reliability ◽  
Practice Effect ◽  
Retest Reliability ◽  
Repeat Administration ◽  
Multi Level ◽  
Perceptual Abilities ◽  
Test Retest Reliability ◽  
High Degree ◽  
Adequate Reliability

Visual diagnostic tests must have a high degree of consistency in its measurements (high reliability) to ensure accurate assessment of perceptual abilities. The current study assessed test-retest reliability and practice effects in Leuven Perceptual Organisation Screening Test (L-POST) in 144 healthy volunteers using correlation analysis, Bland-Altman analysis, and multi-level modelling. Results from three analyses converged and supported an adequate reliability of L-POST. Additionally, multi-level modelling demonstrated an absence of practice effect, suggesting that the L-POST is suitable for repeat administration.

scholarly journals Development and reliability of the Korean version of the Feeding Abilities Assessment

2019 ◽  
Vol 32 (1) ◽  
pp. 69-74
Author(s):  
Seul Gi Koo ◽  
Hae Yean Park ◽  
Jongbae Kim ◽  
Areum Han
Keyword(s):  
Correlation Coefficient ◽  
Internal Consistency ◽  
Content Validity ◽  
Assessment Tool ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Korean Version ◽  
Test Retest Reliability

Objective The purpose of this study is to introduce a standardised assessment tool by verifying the reliability of the translated Korean version of the Feeding Abilities Assessment (K-FAA), which was developed to suit Korean culture. Methods The research subjects were 65 patients with dementia living in nursing homes. The K-FAA was completed by verifying the suitability of translation and reverse translation. The validity of the K-FAA was established through content validity, while its reliability was analysed based on internal consistency reliability for the items, test–retest reliability and inter-rater reliability. Results The content validity index determined, based on the assessment of professors, occupational therapists, and nurses, was more than .70. Cronbach’s α was more than .929, showing good internal consistency. A test–retest reliability of .884 was derived using Pearson’s correlation coefficient (p < .01), and an inter-rater reliability of .800 was derived using the kappa coefficients; intraclass correlation coefficient was .897, which also indicated good reliability. Conclusion The K-FAA was modified to fit the Korean domestic situation, and this assessment had high reliability. Therefore, K-FAA can evaluate the feeding ability of patients with dementia. Future studies should focus on providing evidence-based data to maintain or supplement the feeding ability of patients with dementia in Korea.

Test-retest Reliability of Navigated Transcranial Magnetic Stimulation of the Motor Cortex

2013 ◽  
Vol 10 (1) ◽  
pp. 51-56 ◽  
Author(s):  
Marie-Thérèse Forster ◽  
Moritz Limbart ◽  
Volker Seifert ◽  
Christian Senft
Keyword(s):  
Transcranial Magnetic Stimulation ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Magnetic Stimulation ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Navigated Transcranial Magnetic Stimulation ◽  
Abductor Hallucis ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract BACKGROUND: Because navigated transcranial magnetic stimulation (nTMS) is increasingly used in neurosurgical research, interpretation of its results is of utmost importance. OBJECTIVE: To evaluate the test-retest reliability of nTMS. METHODS: Twelve healthy participants underwent nTMS at 2 different sessions separated by 10.3 ± 9.6 days. Investigated parameters included resting motor thresholds, hotspots, and centers of gravity calculated for the first dorsal interosseous, abductor pollicis brevis, extensor digitorum, tibial anterior, and abductor hallucis muscles. RESULTS: Excellent reliability of resting motor thresholds was observed. Hotspots and centers of gravity showed moderate to excellent repeatability along the anteroposterior axis (intraclass correlation coefficient, 0.54-0.89), whereas the x coordinate presented mainly poor to moderate stability (intraclass correlation coefficient, 0.11-0.89). Movement of centers of gravity over sessions was 0.57 ± 0.32 cm, and hotspots laid 0.79 ± 0.47 cm apart. Calculation of coefficient of variation revealed high reliability of investigated parameters in upper extremities; in lower extremity muscles, high variation across sessions was observed. CONCLUSION: nTMS can be considered a reliable tool, thus opening new fields of noninvasive investigations in neurosurgery. The results presented here should be considered in the interpretation of individual nTMS results.

scholarly journals Measurement properties of the Dynavision D2 one-minute drill task in active adolescents

Neurology ◽  
2018 ◽  
Vol 91 (23 Supplement 1) ◽  
pp. S4.2-S4
Author(s):  
Tamara McLeod ◽  
R. Curtis Bay ◽  
Hannah Gray ◽  
Richelle Marie Williams
Keyword(s):  
Repeated Measures ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Practice Effect ◽  
Practice Effects ◽  
Measurement Properties ◽  
Post Injury ◽  
Retest Reliability ◽  
The One ◽  
Test Retest Reliability

ObjectiveThe purpose of this study was to evaluate test-retest reliability and practice effects of the Dynavision D2 in active adolescents.BackgroundFollowing sport-related concussion, assessment of oculomotor function and vision is important. While clinical tests are recommended, computerized devices, such as the Dynavision D2, are emerging as viable tools for vision assessment. As with all concussion assessments, understanding test-retest reliability and susceptibility to practice effects is important for appropriate interpretation of serial assessments post-injury.Design/methodsParticipants included 20 female adolescents (age = 16.6 ± 1.10 years, mass = 62.0 ± 5.9 kg, height = 169.2 ± 5.1 cm). Participants completed 2 test sessions 1 week apart using the Dynavision D2. The Dynavision D2 includes a one-minute drill task where a single light illuminates, and participants hit the light as quickly as possible, completing 3 drills per trial. Participants completed 3 trials during the first session and 2 during the second. Independent variables were day (day 1, day 2) and drills (15 drills). Dependent variables were the number of hits per minute (Hits/min) and average reaction time (AvgRT). Within-day and between-day test-retest reliabilities were analyzed using two-way random effects intraclass correlation coefficients for consistency. Practice effects were analyzed with repeated measures analysis of variance and Helmert contrasts (p = 0=.05).ResultsModerate-to-strong reliability was demonstrated for Hits/min (within-day 1 [ICC = 0.74; 95% CI: 0.53, 0.87]; within-day 2 [ICC = 0.91; 95% CI. 77.97]; between-days [ICC = 0.86; 95% CI. 65.95]). Moderate-to-strong reliability was demonstrated for AvgRT (within-day 1 [ICC = 0.70, 95% CI. 48.86], within-day 2 [ICC = 0.92; 95% CI. 78.97]; between-days [ICC = 0.85; 95% CI: 0.64.94]). Practice effects were noted for Hits/Min (p = 0.001) and AvgRT (p < 0.001). Helmert contrasts suggested that the practice effect plateaued at drill 11 for Hits/min and drill 12 for AvgRT.ConclusionsModerate-to-excellent test-retest reliability was found for the one-minute task drill with better reliability noted on day 2 and between days, compared to day 1. This task is susceptible to practice effects, highlighting the need for familiarization or practice trials prior to documenting patient scores.

A New Measurement of Activities of Daily Living for Thai Elderly With Dementia

2003 ◽  
Vol 15 (2) ◽  
pp. 135-148 ◽  
Author(s):  
Vorapun Senanarong ◽  
Kamolthip Harnphadungkit ◽  
Naraporn Prayoonwiwat ◽  
Niphon Poungvarin ◽  
Nopwan Sivasariyanonds ◽  
...  
Keyword(s):  
Activities Of Daily Living ◽  
Barthel Index ◽  
Concurrent Validity ◽  
Daily Living ◽  
Discriminant Validity ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Retest Reliability ◽  
Medicine Physician ◽  
Test Retest Reliability

Background: Activities of daily living (ADL) vary across cultures, and measure of ADL needs to be specific to the population under study. We developed an ADL measure for Thai elderly with dementia and investigated the reliability and validity of this instrument. Materials and Methods: Item construction was accomplished with a panel of neurologists and a rehabilitation medicine physician. One hundred eighty-one subjects were interviewed using the Thai ADL measure. Of this sample, one hundred fifty-nine had dementia according to the Diagnosic and Statistical Manual of Mental Disorders, fourth edition criteria. These data were analyzed for internal consistency; concurrent validity was determined by comparison with the Barthel Index, Functional Assessment Questionnaire (FAQ), Thai Mental State Exam (TMSE), and Clinical Dementia Rating (CDR) scale; and discriminant validity was determined by comparison with the Neuropsychiatric Inventory (NPI). Thirty subjects were tested to determine interrater and test-retest reliability. Results: Thai ADL measure was composed of six basic ADL and seven instrumental ADL. It had high correlation with TMSE scores (r = −.69), CDR scores (r = .81), Barthel Index scores (r = −.08), and FAQ scores (r = .88), and moderate correlation with NPI scores (r = .46). The instrument had high test-retest reliability (intraclass correlation coefficient [ICC] = .92, .89) and high interrater reliability (ICC = .96, .93). Conclusion: The Thai ADL scale is easy to use and it has high reliability. It had high concurrent validity with previously published ADL scales. The methodology used to develop the Thai ADL scale can provide a model for creating culturally competent ADL scales.

Normative data and test-retest reliability of the sinusoidal harmonic acceleration test, pseudorandom rotation test and velocity step test

2008 ◽  
Vol 18 (4) ◽  
pp. 197-208
Author(s):  
Leen Maes ◽  
Ingeborg Dhooge ◽  
Eddy De Vel ◽  
Wendy D'haenens ◽  
Annelies Bockstael ◽  
...  
Keyword(s):  
Normative Data ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Step Test ◽  
Method Error ◽  
Retest Reliability ◽  
Rotation Test ◽  
Test Retest Reliability ◽  
Sinusoidal Harmonic Acceleration ◽  
Acceleration Test

Rotational testing has been used in clinical practice to explore vestibular function. Frequently used stimulus algorithms include: sinusoidal harmonic acceleration test (SHAT), pseudorandom rotation test (PRRT), and velocity step test (VST). The aim of this study was to construct normative data as well as to evaluate the test-retest reliability of those rotational paradigms. One hundred and fifty subjects without vestibular history participated in the normative study. The SHAT was presented at 5 frequencies (0.01, 0.02, 0.05, 0.1, 0.2 Hz), whereas for the PRRT those frequencies were summed. The VST consisted of a rotation to the right and left and was administered twice. Thirty-two volunteers were retested to assess the test-retest reliability. Separate normative data were needed according to sex, stimulus type, and frequency for the SHAT and PRRT, and according to stimulus and direction for the VST. High reliability by means of the intraclass correlation coefficient (ICC) and the method error (ME) was obtained for the SHAT, PRRT, and VST gain, SHAT phase and asymmetry, and VST time constant parameters. The availability of data on the minimal detectable test-retest differences supports the evaluation of rotational responses on a retest session.

scholarly journals King-Devick Test Reliability in National Collegiate Athletic Association Athletes: A National Collegiate Athletic Association–Department of Defense Concussion Assessment, Research and Education Report

2019 ◽  
Vol 54 (12) ◽  
pp. 1241-1246 ◽  
Author(s):  
Katherine M. Breedlove ◽  
Justus D. Ortega ◽  
Thomas W. Kaminski ◽  
Kimberly G. Harmon ◽  
Julianne D. Schmidt ◽  
...  
Keyword(s):  
Athletic Training ◽  
Large Scale ◽  
National Collegiate Athletic Association ◽  
Intraclass Correlation ◽  
Cross Sectional Study ◽  
Practice Effect ◽  
Test Reliability ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Test Retest Reliability

Context The King-Devick (KD) test has received considerable attention in the literature as an emerging concussion assessment. However, important test psychometric properties remain to be addressed in large-scale independent studies. Objective To assess (1) test-retest reliability between trials, (2) test-retest reliability between years 1 and 2, and (3) reliability of the 2 administration modes. Design Cross-sectional study. Setting Collegiate athletic training facilities. Patients or Other Participants A total of 3248 intercollegiate student-athletes participated in year 1 (male = 55.3%, age = 20.2 ± 2.3 years, height = 1.78 ± 0.11 m, weight = 80.7 ± 21.0 kg) and 833 participated in both years. Main Outcome Measure(s) Time, in seconds, to complete the KD error free. The KD test reliability was assessed between trials and between annual tests over 2 years and stratified by test modality (spiral-bound cards [n = 566] and tablet [n = 264]). Results The KD test was reliable between trials (trial 1 = 43.2 ± 8.3 seconds, trial 2 = 40.8 ± 7.8 seconds; intraclass correlation coefficient [ICC] (2,1) = 0.888, P &lt; .001), between years (year 1 = 40.8 ± 7.4 seconds, year 2 = 38.7 ± 7.7 seconds; ICC [2,1] = 0.827, P &lt; .001), and for both spiral-bound cards (ICC [2,1] = 0.834, P &lt; .001) and tablets (ICC [2,1] = 0.827, P &lt; .001). The mean change between trials for a single test was −2.4 ± 3.8 seconds. Although most athletes improved from year 1 to year 2, 27.1% (226 of 883) of participants demonstrated worse (slower) KD times (3.2 ± 3.9 seconds) in year 2. Conclusions The KD test was reliable between trials and years and when stratified by modality. A small improvement of 2 seconds was identified with annual retesting, likely due to a practice effect; however, 27% of athletes displayed slowed performance from year 1 to year 2. These results suggest that the KD assessment was a reliable test with modest learning effects over time and that the assessment modality did not adversely affect baseline reliability.

scholarly journals Comprehensive Assessment of Spatial Ability in Children: A Computerized Tasks Battery

2021 ◽  
Vol 17 (1) ◽  
pp. 38-49
Author(s):  
Solmaz Soluki ◽  
Samira Yazdani ◽  
Ali Akbar Arjmandnia ◽  
Jalil Fathabadi ◽  
Saeid Hassanzadeh ◽  
...  
Keyword(s):  
Spatial Ability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Internal Consistency Reliability ◽  
Retest Reliability ◽  
Intraclass Correlation Coefficients ◽  
Spatial Performance ◽  
Iranian Children ◽  
Test Retest Reliability ◽  
Adequate Reliability

Spatial ability is known to have an important role in learning different skills in childhood and achieving success in specific professions. A vast majority of the studies on this topic have focused on adults, and few on in children. In this study, eight tasks were selected to assess eight factors of spatial ability and were modified to be suitable for children. Computerized versions of the tasks were designed and their reliability was measured. One-hundred and ten Iranian children aged 9 to 12 years old participated in the study. In order to assess the test-retest reliability, half of the participants were tested twice. Internal consistency reliability was calculated for some of the tasks. Intraclass correlation coefficients were obtained by test-retest reliability analysis for all tasks ranging from 0.689 to 0.997. The range of Cronbach's α coefficient was found to be between 0.335 and 0.784. The range of the ω coefficient was from 0.428 to 0.798. Each modified task had adequate reliability for assessing the respective spatial ability factors. This battery can help to identify the level of spatial performance in children.

The Reliability of the Occupational Therapy Adult Perceptual Screening Test (OT-APST)

2005 ◽  
Vol 68 (11) ◽  
pp. 509-517 ◽  
Author(s):  
Deirdre M Cooke ◽  
Kryss McKenna ◽  
Jennifer Fleming ◽  
Ross Darnell
Keyword(s):  
Occupational Therapy ◽  
Screening Test ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Occupational Therapists ◽  
Intrarater Reliability ◽  
Reliability Study ◽  
Retest Reliability ◽  
One Year ◽  
Test Retest Reliability

The Occupational Therapy Adult Perceptual Screening Test (OT-APST) is designed to screen for impairments in visual perception and apraxia in adults following stroke. The OT-APST is a comprehensive battery that contains 25 items in the following seven subscale areas: agnosia (5 items); visuospatial relations covering elements of body scheme (4 items) and unilateral neglect (5 items); constructional skills (3 items); apraxia (6 items); acalculia (1 item); and functional skills (5 items). Several OT-APST items contribute to more than one subscale, hence there is a difference in the number of items in each subscale and the overall number of items. This study reports three aspects of the reliability of the OT-APST: interrater, intrarater and test-retest reliability. The participants in the interrater and intrarater reliability study were 15 people following stroke. Videotaped OT-APST performance was scored by nine occupational therapists and the results compared with the scores of the first author as the gold-standard rater. The participants in the test-retest reliability study were 10 people who were neurologically stable one year after stroke and were assessed 2 weeks apart on the OT-APST. The results obtained for each of the 25 OT-APST items included intraclass correlation coefficients (Type 3,1) for interrater reliability ranging from 0.66 to 1.0, for intrarater reliability ranging from 0.64 to 1.0, and for test-retest reliability ranging from 0.76 to 0.95. These results indicate that the OT-APST has good interrater, intrarater and test-retest reliability and offers a reliable screening tool for use by occupational therapists working in the area of stroke.

Test-Retest-Reliability of Computer-Based Metamorphopsia Measurement in Macular Diseases

2020 ◽  
Author(s):  
Daniela Claessens ◽  
Alexander K. Schuster ◽  
Ronald V. Krüger ◽  
Marian Liegl ◽  
Laila Singh ◽  
...  
Keyword(s):  
Macular Edema ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Measuring Method ◽  
Repeated Measurements ◽  
Retest Reliability ◽  
Macular Diseases ◽  
Computer Based ◽  
Test Retest Reliability

AbstractIn this study, the test-retest-reliability as one aspect of reliability of metamorphopsia measurements using a computer-based measuring method was determined in patients with macular diseases. Metamorphopsia amplitude, position, and area were quantified using AMD – A Metamorphopsia Detector software (app4eyes GmbH & Co. KG, Germany) in patients with diabetic, myopic, or uveitic macular edema, intermediate or neovascular age-associated macular degeneration, epiretinal membrane, vitelliform maculopathy, Irvine-Gass syndrome, or macular edema due to venous retinal occlusion. The intraclass correlation coefficient (ICC) was calculated in order to determine the repeatability of two repeated measurements and was used as an indicator of the reliability of the measurements. In this study, metamorphopsia measurements were conducted on 36 eyes with macular diseases. Metamorphopsia measurements made using AMD – A Metamorphopsia Detector software were highly reliable and repeatable in patients with maculopathies. The intraclass correlation coefficient of all indices was excellent (0.95 – 0.97). For diseases of the vitreoretinal interface or macular diseases with intra- or subretinal edema, this metamorphopsia measurement represents a supplement for visual function testing in the clinic, as well as in clinical studies.

Sign in / Sign up

Export Citation Format

Share Document