Comparing Performance Across In-person and Videoconference-Based Administrations of Common Neuropsychological Measures in Community-Based Survivors of Stroke

2020 ◽  
pp. 1-14
Author(s):  
Jodie E. Chapman ◽  
Betina Gardner ◽  
Jennie Ponsford ◽  
Dominique A. Cadilhac ◽  
Renerus J. Stolwyk
Keyword(s):  
Neuropsychological Assessment ◽  
Language Impairment ◽  
Repeated Measures ◽  
Verbal Learning ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Preliminary Evidence ◽  
Service Access ◽  
Community Based ◽  
Neuropsychological Measures

Abstract Objective: Neuropsychological assessment via videoconference could assist in bridging service access gaps due to geographical, mobility, or infection control barriers. We aimed to compare performances on neuropsychological measures across in-person and videoconference-based administrations in community-based survivors of stroke. Method: Participants were recruited through a stroke-specific database and community advertising. Stroke survivors were eligible if they had no upcoming neuropsychological assessment, concurrent neurological and/or major psychiatric diagnoses, and/or sensory, motor, or language impairment that would preclude standardised assessment. Thirteen neuropsychological measures were administered in-person and via videoconference in a randomised crossover design (2-week interval). Videoconference calls were established between two laptop computers, facilitated by Zoom. Repeated-measures t tests, intraclass correlation coefficients (ICCs), and Bland–Altman plots were used to compare performance across conditions. Results: Forty-eight participants (26 men; M age = 64.6, SD = 10.1; M time since stroke = 5.2 years, SD = 4.0) completed both sessions on average 15.8 (SD = 9.7) days apart. For most measures, the participants did not perform systematically better in a particular condition, indicating agreement between administration methods. However, on the Hopkins Verbal Learning Test – Revised, participants performed poorer in the videoconference condition (Total Recall Mdifference = −2.11). ICC estimates ranged from .40 to .96 across measures. Conclusions: This study provides preliminary evidence that in-person and videoconference assessment result in comparable scores for most neuropsychological tests evaluated in mildly impaired community-based survivors of stroke. This preliminary evidence supports teleneuropsychological assessment to address service gaps in stroke rehabilitation; however, further research is needed in more diverse stroke samples.

scholarly journals Automatic 3D dense phenotyping provides reliable and accurate shape quantification of the human mandible

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Pieter-Jan Verhelst ◽  
H. Matthews ◽  
L. Verstraete ◽  
F. Van der Cruyssen ◽  
D. Mulier ◽  
...  
Keyword(s):  
Repeated Measures ◽  
Intraclass Correlation ◽  
Three Dimensional ◽  
Correlation Coefficients ◽  
Surface Registration ◽  
Anatomical Landmarks ◽  
Centroid Size ◽  
Intraclass Correlation Coefficients ◽  
Total Variability ◽  
Automatic Phenotyping

AbstractAutomatic craniomaxillofacial (CMF) three dimensional (3D) dense phenotyping promises quantification of the complete CMF shape compared to the limiting use of sparse landmarks in classical phenotyping. This study assesses the accuracy and reliability of this new approach on the human mandible. Classic and automatic phenotyping techniques were applied on 30 unaltered and 20 operated human mandibles. Seven observers indicated 26 anatomical landmarks on each mandible three times. All mandibles were subjected to three rounds of automatic phenotyping using Meshmonk. The toolbox performed non-rigid surface registration of a template mandibular mesh consisting of 17,415 quasi landmarks on each target mandible and the quasi landmarks corresponding to the 26 anatomical locations of interest were identified. Repeated-measures reliability was assessed using root mean square (RMS) distances of repeated landmark indications to their centroid. Automatic phenotyping showed very low RMS distances confirming excellent repeated-measures reliability. The average Euclidean distance between manual and corresponding automatic landmarks was 1.40 mm for the unaltered and 1.76 mm for the operated sample. Centroid sizes from the automatic and manual shape configurations were highly similar with intraclass correlation coefficients (ICC) of > 0.99. Reproducibility coefficients for centroid size were < 2 mm, accounting for < 1% of the total variability of the centroid size of the mandibles in this sample. ICC’s for the multivariate set of 325 interlandmark distances were all > 0.90 indicating again high similarity between shapes quantified by classic or automatic phenotyping. Combined, these findings established high accuracy and repeated-measures reliability of the automatic approach. 3D dense CMF phenotyping of the human mandible using the Meshmonk toolbox introduces a novel improvement in quantifying CMF shape.

Comparing Counts of Park Users With a Wearable Video Device and an Unmanned Aerial System

2021 ◽  
pp. 1-8
Author(s):  
Richard R. Suminski ◽  
Gregory M. Dominick ◽  
Matthew Saponaro
Keyword(s):  
Repeated Measures ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Future Research ◽  
Unmanned Aerial Systems ◽  
Park Use ◽  
Intraclass Correlation Coefficients ◽  
Potential Benefits ◽  
Absolute Agreement ◽  
Aerial Systems

Evidence suggests that video captured with a wearable video device (WVD) may augment or supplant traditional methods for assessing park use. Unmanned aerial systems (UASs) are used to assess human activity, but research employing them for park assessments is sparse. Therefore, this study compared park user counts between a WVD and UAS. A diverse set of 33 amenities (e.g., playground) in three parks were videoed simultaneously by one researcher wearing a WVD and another operating the UAS. Assessments were done at 12 p.m. and 7 p.m. on weekends, with one park evaluated on two occasions 7 days apart. Two investigators independently reviewed videos and reached consensus on the counts of individuals at each amenity. Intraclass correlation coefficients (ICCs) were used to determine intra- and interrater reliabilities. A total of 404 (M = 4.7; SD = 9.6) and 389 (M = 4.5; SD = 9.0) individuals were counted in the UAS and WVD videos, respectively. Absolute agreement was 86% (74/86) and 100% when no individuals were using the amenity. Whether using all 86 videos or only videos having people (48 videos), ICCs indicated excellent reliability (ICC = .99; p < .001). The totals seen for the repeated measures were UAS = 146 and WVD = 136 for Day 1 and UAS = 169 and WVD = 161 for Day 2. Intrarater reliability was excellent for the UAS (ICC = .92; p < .001) and good for the WVD (ICC = .89; p < .001). Disagreement was mainly due to obstructions—people behind or under structures. This study provides support for the use of UASs for counting park users and future research examining the potential benefits of video analysis for assessing park use.

scholarly journals Standardising the measurement of physical activity in people receiving haemodialysis: considerations for research and practice

2019 ◽  
Vol 20 (1) ◽  
Author(s):  
Hannah M. L. Young ◽  
Mark W. Orme ◽  
Yan Song ◽  
Maurice Dungey ◽  
James O. Burton ◽  
...  
Keyword(s):  
Physical Activity ◽  
Sample Size ◽  
Repeated Measures ◽  
A Priori ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Future Research ◽  
Wear Time ◽  
Minimum Number ◽  
The Uk

Abstract Background Physical activity (PA) is exceptionally low amongst the haemodialysis (HD) population, and physical inactivity is a powerful predictor of mortality, making it a prime focus for intervention. Objective measurement of PA using accelerometers is increasing, but standard reporting guidelines essential to effectively evaluate, compare and synthesise the effects of PA interventions are lacking. This study aims to (i) determine the measurement and processing guidance required to ensure representative PA data amongst a diverse HD population, and; (ii) to assess adherence to PA monitor wear amongst HD patients. Methods Clinically stable HD patients from the UK and China wore a SenseWear Armband accelerometer for 7 days. Step count between days (HD, Weekday, Weekend) were compared using repeated measures ANCOVA. Intraclass correlation coefficients (ICCs) determined reliability (≥0.80 acceptable). Spearman-Brown prophecy formula, in conjunction with a priori ≥  80% sample size retention, identified the minimum number of days required for representative PA data. Results Seventy-seven patients (64% men, mean ± SD age 56 ± 14 years, median (interquartile range) time on HD 40 (19–72) months, 40% Chinese, 60% British) participated. Participants took fewer steps on HD days compared with non-HD weekdays and weekend days (3402 [95% CI 2665–4140], 4914 [95% CI 3940–5887], 4633 [95% CI 3558–5707] steps/day, respectively, p < 0.001). PA on HD days were less variable than non-HD days, (ICC 0.723–0.839 versus 0.559–0.611) with ≥ 1 HD day and ≥  3 non-HD days required to provide representative data. Using these criteria, the most stringent wear-time retaining ≥ 80% of the sample was ≥7 h. Conclusions At group level, a wear-time of ≥7 h on ≥1HD day and ≥ 3 non-HD days is required to provide reliable PA data whilst retaining an acceptable sample size. PA is low across both HD and non- HD days and future research should focus on interventions designed to increase physical activity in both the intra and interdialytic period.

scholarly journals Reliability of Safe Maximum Lifting Determinations of a Functional Capacity Evaluation

2002 ◽  
Vol 82 (4) ◽  
pp. 364-371 ◽  
Author(s):  
Douglas P Gross ◽  
Michele C Battié
Keyword(s):  
Functional Capacity ◽  
Repeated Measures ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Functional Capacity Evaluation ◽  
Measurement Variability ◽  
Retest Reliability ◽  
Repeated Measures Design ◽  
Test Retest Reliability

Abstract Background and Purpose. Functional capacity evaluations (FCEs) are measurement tools used in predicting readiness to return to work following injury. The interrater and test-retest reliability of determinations of maximal safe lifting during kinesiophysical FCEs were examined in a sample of people who were off work and receiving workers' compensation. Subjects. Twenty-eight subjects with low back pain who had plateaued with treatment were enrolled. Five occupational therapists, trained and experienced in kinesiophysical methods, conducted testing. Methods. A repeated-measures design was used, with raters testing subjects simultaneously, yet independently. Subjects were rated on 2 occasions, separated by 2 to 4 days. Analyses included intraclass correlation coefficients (ICCs) and 95% confidence intervals. Results. The ICC values for interrater reliability ranged from .95 to .98. Test-retest values ranged from .78 to .94. Discussion and Conclusion. Inconsistencies in subjects' performance across sessions were the greatest source of FCE measurement variability. Overall, however, test-retest reliability was good and interrater reliability was excellent.

Dynamic Footprint Measurement Collection Technique and Intrarater Reliability

2012 ◽  
Vol 102 (2) ◽  
pp. 130-138 ◽  
Author(s):  
Jeanna M. Fascione ◽  
Ryan T. Crews ◽  
James S. Wrobel
Keyword(s):  
Repeated Measures ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Healthy Population ◽  
Intrarater Reliability ◽  
Intraclass Correlation Coefficients ◽  
Foot Posture ◽  
Arch Index ◽  
Post Hoc ◽  
Dynamic Footprint

Background: Identifying the variability of footprint measurement collection techniques and the reliability of footprint measurements would assist with appropriate clinical foot posture appraisal. We sought to identify relationships between these measures in a healthy population. Methods: On 30 healthy participants, midgait dynamic footprint measurements were collected using an ink mat, paper pedography, and electronic pedography. The footprints were then digitized, and the following footprint indices were calculated with photo digital planimetry software: footprint index, arch index, truncated arch index, Chippaux-Smirak Index, and Staheli Index. Differences between techniques were identified with repeated-measures analysis of variance with post hoc test of Scheffe. In addition, to assess practical similarities between the different methods, intraclass correlation coefficients (ICCs) were calculated. To assess intrarater reliability, footprint indices were calculated twice on 10 randomly selected ink mat footprint measurements, and the ICC was calculated. Results: Dynamic footprint measurements collected with an ink mat significantly differed from those collected with paper pedography (ICC, 0.85–0.96) and electronic pedography (ICC, 0.29–0.79), regardless of the practical similarities noted with ICC values (P = .00). Intrarater reliability for dynamic ink mat footprint measurements was high for the footprint index, arch index, truncated arch index, Chippaux-Smirak Index, and Staheli Index (ICC, 0.74–0.99). Conclusions: Footprint measurements collected with various techniques demonstrate differences. Interchangeable use of exact values without adjustment is not advised. Intrarater reliability of a single method (ink mat) was found to be high. (J Am Podiatr Med Assoc 102(2): 130–138, 2012)

The Reliability and Convergent Validity of Field Tests of Body Composition in Young Adolescents

2006 ◽  
Vol 3 (s2) ◽  
pp. S67-S77 ◽  
Author(s):  
Michelle Ihmels ◽  
Gregory J. Welk ◽  
James J. McClain ◽  
Jodee Schaben
Keyword(s):  
Body Composition ◽  
Body Fat ◽  
Repeated Measures ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Field Tests ◽  
Correlation Coefficients ◽  
Young Adolescents ◽  
Intraclass Correlation Coefficients ◽  
Classification Agreement

Background:Advances in BIA offer practical alternative approaches to assessing body composition in young adolescents and have not been studied for comparability.Methods:This study compared reliability and convergent validity of three field tests (2-site skinfold, Omron and Tanita BIA devices) on young adolescents. Reliability was determined using intraclass correlation coefficients, convergent validity was examined by computing correlations among the three estimates, differences in estimated body fat values were evaluated using repeated-measures ANOVA, and classification agreement was computed for achieving FITNESSGRAM® Healthy Fitness Zone.Results:ICC values of all three measures exceeded .97. Correlations ranged from .74 to .81 for males and .79 to .91 for females. Classification agreement values ranged from 82.8% to 92.6%.Conclusions:Results suggest general agreement among the selected methods of body composition assessments in both boys and girls with the exception that percent body fat in boys by Tanita BIA is significantly lower than skinfold estimation.

Biomechanical Response to Acute Stretching in Dancers and Non-Dancers

2020 ◽  
Vol 24 (1) ◽  
pp. 12-18
Author(s):  
Bárbara Pessali-Marques ◽  
Gustavo H.C. Peixoto ◽  
Christian E.T. Cabido ◽  
André Gustavo P. Andrade ◽  
Sara A. Rodrigues ◽  
...  
Keyword(s):  
Undergraduate Students ◽  
Repeated Measures ◽  
Mechanical Response ◽  
Physical Therapists ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Knee Extension ◽  
Young Males ◽  
Resistance Torque ◽  
Post Test

This study aimed to investigate the bio- mechanical response of the hamstring muscles to acute stretching in dancers (D) compared to non-dancers (ND). Maximal range of motion (ROMMax) and stiffness of the hamstrings were assessed in 46 young males, 23 undergraduate students (ND) and 23 professional dancers (D). Ages of the two groups were D 21.5 ± 0.60 years; ND 27.5 ± 0.98 years). Testing was performed in two sessions, familiarization with procedures in the first session and the tests themselves (pre- and post-test and intervention) in the second, with a 24- to 48-hour interval between. The pre-test consisted of three trials of passive knee extension to the point of increased tension in the hamstrings, defined as ROMMax. The resistance torque recorded at ROMMax was defined as torqueMax. Six 30-second constant torque stretches were performed at 100% of the torqueMaxreached in the pre-test in one lower limb only (intervention), with the contralateral limb used as control. The torque measured at an identical ROM before (pre-test) and after (post-test) the intervention was defined as torqueROM, and represented stiffness in this study. Reliability of the ROMMax, torqueMax, and torqueROMwas assessed via intraclass correlation coefficients (ICC3, k) and standard error of the measurements (SEM). Comparison between dancers and non-dancers, control, and intervention conditions for all dependent variables was performed using ANOVA repeated measures followed by Tukey post hoc comparisons to highlight any interaction. The submaximal stretch intensity applied caused torqueROM to decrease in both D and ND groups (p < 0.01), indicating a decrease in stiffness, but no difference between the groups was found. A significantly greater increase in ROMMax was found for the D group compared to the ND group (p < 0.01), suggesting that other aspects in addition to MTU biomechanical adaptations may have played a role in the ROMMax increase, especially for the D group. Further research is needed to explore what those other adaptations are. Meanwhile, coaches and physical therapists should be aware that dancers may require different stretch training protocols than non-dancers.

scholarly journals Assessing Fidelity to Family-Based Treatment: An Exploratory Examination of Expert, Therapist, Parent, and Peer Ratings

2021 ◽  
Author(s):  
Jennifer Couturier ◽  
Melissa Kimber ◽  
Melanie Barwick ◽  
Gail McVey ◽  
Sheri Findlay ◽  
...  
Keyword(s):  
Repeated Measures ◽  
Phase 1 ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
The Other ◽  
Peer Ratings ◽  
Fidelity Assessment ◽  
Scale Scores ◽  
Family Based Treatment ◽  
Family Based

Abstract Introduction: Fidelity is an essential component for evaluating the clinical and implementation outcomes related to delivery of evidence-based practices (EBPs). Effective measurement of fidelity requires clinical buy-in, and as such, requires a process that is not burdensome for clinicians and managers. As part of a larger implementation study, we examined fidelity to Family-Based Treatment (FBT) measured by several different raters including an expert, a peer, therapists themselves, and parents, with a goal of determining a pragmatic, reliable and efficient method to capture treatment fidelity to FBT. Methods: Each therapist audio-recorded at least one FBT case and submitted recordings from session 1, 2, and 3 from phase 1, plus one additional session from phase 1, two sessions from phase 2, and one session from phase 3. These submitted files were rated by an expert and a peer rater using a validated FBT fidelity measure. As well, therapists and parents rated fidelity immediately following each session and submitted ratings to the research team. Inter-observer reliability was calculated for each item using the intraclass correlation coefficient (ICC), comparing the expert ratings to ratings from each of the other raters (parents, therapists, and peer). Mean scale scores were compared using repeated measures ANOVA.Results: Intraclass correlation coefficients revealed that agreement was the best between expert and peer, with excellent, good, or fair agreement in 7 of 13 items from session 1, 2 and 3. There were only four such values when comparing expert to parent agreement, and two such values comparing expert to therapist ratings. The rest of the ICC values indicated poor agreement. Scale level analysis indicated that expert fidelity ratings for phase 1 treatment sessions scores were significantly higher than the peer ratings and, that parent fidelity ratings tended to be significantly higher than the other raters across all three treatment phases. There were no significant differences between expert and therapist mean scores.Conclusions: There may be challenges inherent in parents rating fidelity accurately. Peer rating or therapist self-rating may be considered pragmatic, efficient, and reliable approaches to fidelity assessment for real-world clinical settings.

scholarly journals Development of a Fitness Test Battery for Special Weapons and Tactics (SWAT) Operators—A Pilot Study

2021 ◽  
Vol 18 (15) ◽  
pp. 7992
Author(s):  
Megan Sax van der Weyden ◽  
Christopher D. Black ◽  
Daniel Larson ◽  
Brian Rollberg ◽  
Jason A. Campbell
Keyword(s):  
Repeated Measures ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Police Departments ◽  
Fitness Test ◽  
Intraclass Correlation Coefficients ◽  
Body Drag ◽  
Testing Measure ◽  
Coefficients Of Variation ◽  
Reliable Testing

This investigation examined relationships between a Special Weapons and Tactics-specific fitness test (SORT) and an obstacle course (OC) used for qualification in fourteen male SWAT members from three local, regional police departments. The SORT included: squat, pushup, and lunge in 60 s; pullup hold; sled drag; and Yo-Yo Intermittent Recovery Test L1. The obstacle course included: 25 m sprint (repeated); window ascent; scale under a wall; 25 m serpentine run (repeated), body drag (20 m, repeated). Pearson coefficients examined SORT and OC relationships (p ≤ 0.05); intraclass correlation coefficients (ICC2,1) assessed agreement of SORT trials. Repeated measures ANOVA evaluated differences in SORT metrics across time. Coefficients of variation (COV) examined SORT scoring consistency. The YoYo test was related to all SORT assessments (r = −0.803–0.894), except sled drag. The remaining SORT metrics were related to ≥two tests. SORT COVs ranged from 0.77–13.26% for trials 1–2 but decreased between trials 2–3 (0.95–8.97%). The OC was associated with YoYo, lunges, squats and sled drag (r = −0.790, −0.730, −0.766, and 0.802, respectively). No differences (p > 0.05) existed across SORT trials for event scores. The SORT battery appears to be a valid and reliable testing measure to assess SWAT occupational specific fitness.

scholarly journals How Important Is Randomization of Swallows During Kinematic Analyses of Swallow Function?

2020 ◽  
Vol 29 (3) ◽  
pp. 1650-1654
Author(s):  
Cara Donohue ◽  
James L. Coyle
Keyword(s):  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Random Order ◽  
Preliminary Evidence ◽  
Intrarater Reliability ◽  
Kinematic Data ◽  
Intraclass Correlation Coefficients ◽  
Exact Agreement ◽  
Kinematic Analyses ◽  
Swallow Function

Purpose In dysphagia research involving kinematic analyses on individual swallow parameters, randomization is used to ensure judges are not influenced by judgments made for other parameters within the same swallow or by judgments made for other swallows from the same participant. Yet, the necessity of randomizing swallows to avoid bias during kinematic analyses is largely assumed and untested. This study investigated whether randomization of the order of swallows presented to judges impacts analyses of temporal kinematic events from videofluoroscopic swallow studies. Method One hundred twenty-seven swallows were analyzed from 18 healthy adults who underwent standardized videofluoroscopic swallow studies. Swallows were first analyzed by two trained raters sequentially, analyzing all kinematic events within each swallow, and then a second time in random order, measuring one kinematic event at a time. Intrarater reliability measurements were calculated between random and sequential swallow judgments for all kinematic events using intraclass correlation coefficient and percent exact agreement within a three-frame tolerance. Results Intraclass correlation coefficients (1.00) and percent exact agreement (89%) were excellent for all kinematic events between analyses methods, indicating there were no significant differences in measurements performed in random or sequential order. Conclusions This study provides preliminary evidence that randomization may be unnecessary during temporal swallow kinematic data analyses for research, which may lead to more efficient analyses and dissemination of findings, and alignment of findings with clinical interpretations. Replication of this design with swallows from people with dysphagia would strengthen the generalizability of the results.

Sign in / Sign up

Export Citation Format

Share Document