scholarly journals Evaluating test-retest reliability and sex/age-related effects on temporal clustering coefficient of dynamic functional brain networks

2021 ◽  
Author(s):  
Yicheng Long ◽  
Chaogan Yan ◽  
Zhipeng Wu ◽  
Xiaojun Huang ◽  
Hengyi Cao ◽  
...  
Keyword(s):  
Intraclass Correlation ◽  
Brain Networks ◽  
Clustering Coefficient ◽  
Retest Reliability ◽  
Brain Functions ◽  
Temporal Clustering ◽  
Age Related ◽  
Human Connectome Project ◽  
Wide Range ◽  
Test Retest Reliability

The multilayer dynamic network model has been proposed as an effective method to understand how the brain functions dynamically. Specially, derived from the definition of clustering coefficient in static networks, the temporal clustering coefficient provides a direct measure of topological stability of dynamic brain networks and shows potential in predicting altered brain functions in both normal and pathological conditions. However, test-retest reliability and demographic-related effects on this measure remain to be evaluated. Using a publicly available dataset from the Human Connectome Project consisting of 337 young healthy adults (157 males/180 females; 22 to 37 years old), the present study investigated: (1) the test-retest reliability of temporal clustering coefficient across four repeated resting-state functional magnetic resonance imaging scans as measured by intraclass correlation coefficient (ICC); and (2) sex- and age-related effects on temporal clustering coefficient. The results showed that (1) the temporal clustering coefficient had overall moderate test-retest reliability (ICC > 0.40 over a wide range of densities) at both global and subnetwork levels; (2) female subjects showed significantly higher temporal clustering coefficient than males at both global and subnetwork levels, in particular within the default-mode and subcortical regions; (3) temporal clustering coefficient of the subcortical subnetwork was negatively correlated with age in young adults. Our findings suggest that temporal clustering coefficient is a reliable and reproducible approach for the identification of individual differences in brain function, and provide evidence for sex and age effects on human brain dynamic connectome.

scholarly journals Countermovement Jump Analysis Using Different Portable Devices: Implications for Field Testing

Sports ◽  
2018 ◽  
Vol 6 (3) ◽  
pp. 91 ◽  
Author(s):  
Vincenzo Rago ◽  
João Brito ◽  
Pedro Figueiredo ◽  
Thiago Carvalho ◽  
Tiago Fernandes ◽  
...  
Keyword(s):  
Gold Standard ◽  
Concurrent Validity ◽  
Intraclass Correlation ◽  
Force Platform ◽  
Portable Devices ◽  
Countermovement Jump ◽  
Good Test ◽  
Retest Reliability ◽  
Wide Range ◽  
Test Retest Reliability

The aim of this study was to analyze the concurrent validity, test–retest reliability, and capacity to detect changes of four different portable devices used to measure a wide range of neuromuscular parameters derived from countermovement jump (CMJ). An accelerometric device (Myotest), a jump mat (Ergojump), an optical device (Optojump), and a smartphone app (MyJump) were simultaneously examined for concurrent validity against gold-standard measures (motion-capture system and a force platform). Twenty-two CMJ-derived variables were collected from 15 healthy male subjects (n = 60 CMJs). Contraction time (CT) and eccentric duration (EccD) measurements obtained from the Myotest were moderately to largely associated with and not different from force platform measurements (r = 0.31 to 0.64, ES = 0.11 to 0.18) and showed moderate test-retest reliability (intraclass correlation coefficient (ICC) = 0.92 to 0.97, coefficient of variation (CV) = 3.8 to 8.0%). Flight time (FT) and jump height (JH) from Ergojump, Optojump, and MyJump showed moderate to strong associations with gold-standard measurements (r = 0.57 to 0.98) and good test–retest reliability (ICC = 0.54 to 0.97, CV = 1.8 to 4.2). However, all portable devices underestimated JH (ES = 1.25 to 2.75). Independent of the instrument used, the analyzed CMJ variables showed good capacity to detect changes (standard error of measurement (SEM) < smallest worthwhile change (SWC)), with the exception of rate of force and rate of power development parameters, which showed marginal capacity (SEM > SWC). The Myotest is preferable to measure temporal parameters during ground contact, whereas Ergojump, Optojump, and MyJump devices may be preferable to measure FT and JH, with the Optojump being the most accurate.

scholarly journals Validity and Reliability of Limits-of-Stability Testing: A Comparison of 2 Postural Stability Evaluation Devices

2011 ◽  
Vol 46 (6) ◽  
pp. 600-606 ◽  
Author(s):  
Marie L. Pickerill ◽  
Rod A. Harter
Keyword(s):  
Construct Validity ◽  
Postural Stability ◽  
Intraclass Correlation ◽  
Retest Reliability ◽  
Limits Of Stability ◽  
Directional Control ◽  
Computerized Posturography ◽  
Wide Range ◽  
Test Retest Reliability ◽  
Healthy Participants

Context: A lack of published comparisons between measures from commercially available computerized posturography devices and the outcome measures used to define the limits of stability (LOS) makes meaningful interpretation of dynamic postural stability measures difficult. Objectives: To compare postural stability measures between and within devices to establish concurrent and construct validity and to determine test-retest reliability for LOS measures generated by the NeuroCom Smart Balance Master and the Biodex Balance System. Design: Cross-sectional study. Setting: Controlled research laboratory. Patients or Other Participants: A total of 23 healthy participants with no vestibular or visual disabilities or lower limb impairments. Intervention(s): The LOS were assessed during 2 laboratory test sessions 1 week apart. Main Outcome Measure(s): Three NeuroCom LOS variables (directional control, endpoint excursion, and movement velocity) and 2 Biodex LOS variables (directional control, test duration). Results: Test-retest reliability ranged from high to low across the 5 LOS measures (intraclass correlation coefficient [2,k] = 0.82 to 0.48). Pearson correlations revealed 4 significant relationships (P &lt; .05) between and within the 2 computerized posturography devices (r = 0.42 to −0.65). Conclusions: Based on the wide range of intraclass correlation values we observed for the NeuroCom measures, clinicians and researchers alike should establish the reliability of LOS testing for their own clinics and laboratories. The low to moderate reliability outcomes observed for the Biodex measures were not of sufficient magnitude for us to recommend using the LOS measures from this system as the gold standard. The moderate Pearson interclass correlations we observed suggest that the Biodex and NeuroCom postural stability systems provided unique information. In this study of healthy participants, the concurrent and construct validity of the Biodex and NeuroCom LOS tests were not definitively established. We recommend that this study be repeated with a clinical population to further explore the matter.

Test-Retest-Reliability of Computer-Based Metamorphopsia Measurement in Macular Diseases

2020 ◽  
Author(s):  
Daniela Claessens ◽  
Alexander K. Schuster ◽  
Ronald V. Krüger ◽  
Marian Liegl ◽  
Laila Singh ◽  
...  
Keyword(s):  
Macular Edema ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Measuring Method ◽  
Repeated Measurements ◽  
Retest Reliability ◽  
Macular Diseases ◽  
Computer Based ◽  
Test Retest Reliability

AbstractIn this study, the test-retest-reliability as one aspect of reliability of metamorphopsia measurements using a computer-based measuring method was determined in patients with macular diseases. Metamorphopsia amplitude, position, and area were quantified using AMD – A Metamorphopsia Detector software (app4eyes GmbH & Co. KG, Germany) in patients with diabetic, myopic, or uveitic macular edema, intermediate or neovascular age-associated macular degeneration, epiretinal membrane, vitelliform maculopathy, Irvine-Gass syndrome, or macular edema due to venous retinal occlusion. The intraclass correlation coefficient (ICC) was calculated in order to determine the repeatability of two repeated measurements and was used as an indicator of the reliability of the measurements. In this study, metamorphopsia measurements were conducted on 36 eyes with macular diseases. Metamorphopsia measurements made using AMD – A Metamorphopsia Detector software were highly reliable and repeatable in patients with maculopathies. The intraclass correlation coefficient of all indices was excellent (0.95 – 0.97). For diseases of the vitreoretinal interface or macular diseases with intra- or subretinal edema, this metamorphopsia measurement represents a supplement for visual function testing in the clinic, as well as in clinical studies.

scholarly journals Validation of a menstrual pictogram and a daily bleeding diary for assessment of uterine fibroid treatment efficacy in clinical studies

2020 ◽  
Vol 4 (1) ◽  
Author(s):  
Claudia Haberland ◽  
Anna Filonenko ◽  
Christian Seitz ◽  
Matthias Börner ◽  
Christoph Gerlinger ◽  
...  
Keyword(s):  
Uterine Fibroid ◽  
Full Range ◽  
Intraclass Correlation ◽  
Phase Iii ◽  
Measurement Properties ◽  
Retest Reliability ◽  
Response Options ◽  
Patient Global Impression ◽  
Patient Reported ◽  
Test Retest Reliability

Abstract Background To evaluate the psychometric and measurement properties of two patient-reported outcome instruments, the menstrual pictogram superabsorbent polymer-containing version 3 (MP SAP-c v3) and Uterine Fibroid Daily Bleeding Diary (UF-DBD). Test-retest reliability, criterion, construct validity, responsiveness, missingness and comparability of the MP SAP-c v3 and UF-DBD versus the alkaline hematin (AH) method and a patient global impression of severity (PGI-S) were analyzed in post hoc trial analyses. Results Analyses were based on data from up to 756 patients. The full range of MP SAP-c v3 and UF-DBD response options were used, with score distributions reflecting the cyclic character of the disease. Test-retest reliability of MP SAP-c v3 and UF-DBD scores was supported by acceptable intraclass correlation coefficients when stability was defined by the AH method and Patient Global Impression of Severity (PGI-S) scores (0.80–0.96 and 0.42–0.94, respectively). MP SAP-c v3 and UF-DBD scores demonstrated strong and moderate-to-strong correlations with menstrual blood loss assessed by the AH method. Scores increased in monotonic fashion, with greater disease severities, defined by the AH method and PGI-S scores; differences between groups were mostly statistically significant (P < 0.05). MP SAP-c v3 and UF-DBD were sensitive to changes in disease severity, defined by the AH method and PGI-S. MP SAP-c v3 and UF-DBD showed a lower frequency of missing patient data versus the AH method, and good agreement with the AH method. Conclusions This evidence supports the use of the MP SAP-c v3 and UF-DBD to assess clinical efficacy endpoints in UF phase III studies replacing the AH method.

scholarly journals Cross-cultural translation and validation of the Spanish version of the patellofemoral pain and osteoarthritis subscale of the KOOS (KOOS-PF)

2021 ◽  
Vol 14 (1) ◽  
Author(s):  
Juan Pablo Martinez-Cano ◽  
Daniel Vernaza-Obando ◽  
Julián Chica ◽  
Andrés Mauricio Castro
Keyword(s):  
Intraclass Correlation ◽  
Patellofemoral Pain ◽  
Spanish Version ◽  
Minimal Detectable Change ◽  
Global Rating ◽  
Minimal Important Change ◽  
Specific Patient ◽  
Retest Reliability ◽  
Patient Reported ◽  
Test Retest Reliability

Abstract Objective The aim of this study was to translate to Spanish the patellofemoral pain and osteoarthritis subscale of the knee injury and osteoarthritis outcome score (KOOS-PF) and validate this Spanish version of a disease-specific patient-reported outcome measure (PROM) for patellofemoral pain. Results The KOOS-PF was translated to Spanish and sixty patients with patellofemoral pain and/or osteoarthritis accepted to complete the questionnaire. 1-week later 58 patients answered the questions again for the test–retest reliability validation and finally 55 patients completed 1-month later for the responsiveness assessment. The Spanish version showed very good internal consistency (Cronbach’s alpha: 0.93) and test–retest reliability (intraclass correlation coefficient: 0.82). Responsiveness was confirmed, showing a strong correlation with the global rating of change (GROC) score (r 0.64). The minimal detectable change was 11.1 points, the minimal important change was 17.2 points, and there were no floor or ceiling effects for the score.

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Therapeutic Interventions ◽  
Treatment Burden ◽  
Validity And Reliability ◽  
Stroke Patients ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Validity and reliability of the Turkish version of the Patient Dignity Inventory

2021 ◽  
pp. 1-8
Author(s):  
Yasemin Eskigülek ◽  
Sultan Kav
Keyword(s):  
Palliative Care ◽  
Factor Analysis ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Turkish Version ◽  
Retest Reliability ◽  
Significant Difference ◽  
Test Retest Reliability ◽  
Fit Index ◽  
Turkish Society

Abstract Objective The aim of this study was to investigate the validity and reliability of the Patient Dignity Inventory (PDI) in the Turkish society, which was developed to evaluate dignity-related distress in palliative care patients. Methods One hundred and twenty-seven adults with advanced cancer hospitalized in several clinics of two university hospitals were included in the study. The patients whose Palliative Performance Scale score was at least 40% were recruited to study. The data were collected with a patient demographic form, the Turkish version of Hospital Anxiety and Depression Scale (HADS-TR), and the Turkish version of the PDI (PDI-TR). The PDI-TR was finalized and back-translated after translating into Turkish and obtaining 10 expert opinions. Exploratory and confirmatory factor analysis, internal consistency, concurrent validity, and test–retest reliability analysis were performed. Results The Cronbach's α coefficient of PDI-TR was 0.94. Factor analysis resulted in a five-factor solution, and all items were loaded on factors. Factors were labeled as symptom distress, existential distress, self-confidence, dependency, and supportive care needs and accounted for 68.70% of the overall variance. The model's normed fit index, comparative fit index, and X2/SD were found between acceptable range (0.90, 0.93, and 2.64, respectively). A positive and strong correlation was found between subdimension scores of HADS-TR and the total score of PDI-TR (r = 0.70 for anxiety subdimension; r = 0.73 for depression subdimension). The test–retest reliability was conducted with 32 patients within the sample two weeks after the first application, and no significant difference was found between the two application scores as the result of paired-sample t-test (p > 0.05). An intraclass correlation coefficient of test–retest reliability was r = 0.855. Significance of results PDI-TR was found to be a valid and reliable tool in palliative care patients in Turkish society.

scholarly journals Test–retest reliability of laser evoked pain perception and fMRI BOLD responses

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Yanzhi Bi ◽  
Xin Hou ◽  
Jiahui Zhong ◽  
Li Hu
Keyword(s):  
Resting State ◽  
Repeated Measures ◽  
Subjective Experience ◽  
Pain Perception ◽  
Primary Motor Cortex ◽  
Intraclass Correlation ◽  
Retest Reliability ◽  
Repeated Measures Design ◽  
Brain Responses ◽  
Test Retest Reliability

AbstractPain perception is a subjective experience and highly variable across time. Brain responses evoked by nociceptive stimuli are highly associated with pain perception and also showed considerable variability. To date, the test–retest reliability of laser-evoked pain perception and its associated brain responses across sessions remain unclear. Here, an experiment with a within-subject repeated-measures design was performed in 22 healthy volunteers. Radiant-heat laser stimuli were delivered on subjects’ left-hand dorsum in two sessions separated by 1–5 days. We observed that laser-evoked pain perception was significantly declined across sessions, coupled with decreased brain responses in the bilateral primary somatosensory cortex (S1), right primary motor cortex, supplementary motor area, and middle cingulate cortex. Intraclass correlation coefficients between the two sessions showed “fair” to “moderate” test–retest reliability for pain perception and brain responses. Additionally, we observed lower resting-state brain activity in the right S1 and lower resting-state functional connectivity between right S1 and dorsolateral prefrontal cortex in the second session than the first session. Altogether, being possibly influenced by changes of baseline mental state, laser-evoked pain perception and brain responses showed considerable across-session variability. This phenomenon should be considered when designing experiments for laboratory studies and evaluating pain abnormalities in clinical practice.

A new visual feedback-based system for the assessment of pinch force, endurance, accuracy and precision. A test-retest reliability study

Hand Therapy ◽  
2021 ◽  
pp. 175899832110025
Author(s):  
Alberto Dottor ◽  
Eleonora Camerone ◽  
Mirko Job ◽  
Diletta Barbiani ◽  
Elisa Frisaldi ◽  
...  
Keyword(s):  
Visual Feedback ◽  
Intraclass Correlation ◽  
Precision Grip ◽  
Voluntary Contraction ◽  
Good Reliability ◽  
Retest Reliability ◽  
Relative Reliability ◽  
Time Accuracy ◽  
In The Beginning ◽  
Test Retest Reliability

Introduction Given that pinch is a precision grip involved in sustained submaximal activities, a Sustained Contraction (SC) task could be associated to Maximal Voluntary Contraction (MVC). To better evaluate the thumb-index system, the test-retest reliability of pinch MVC and SC, measured by a visual feedback-based pinch gauge was assessed. Methods 26 healthy participants performed MVC and SC in two separate sessions. SC required to maintain 40%MVC as long as possible and it was evaluated in terms of time, accuracy (Mean Distance between force trace and target force, MD), precision (Coefficient of Variability of force trace, CV). MD and CV analyses were conducted dividing the SC task into three equivalent time stages (beginning, middle, exhaustion). Relative Reliability (RR) was measured by Intraclass Correlation Coefficient, and Absolute Reliability (AR) was measured by Standard Error of Measurement and by Bland-Altman plot. Results MVC and Time showed high RR and AR in both hands. RR of MD and CV in right hand was excellent in the beginning and middle stages, and fair in the exhaustion one, showing decreasing reliability as fatigue increases. In the left hand RR of MD and CV was generally lower. MD showed excellent reliability in the beginning stage and good reliability in the other stages. CV showed fair relative reliability at both beginning and middle stages, excellent in the last one. Conversely, it was observed high AR of MD and CV in all stages in both hands. Conclusions All indices are reliable to assess motor control of thumb-index pinch in both hands.

Test–Retest Reliability of the Mini-BESTest in People With Mild to Moderate Multiple Sclerosis

2021 ◽  
Author(s):  
A Wallin ◽  
M Kierkegaard ◽  
E Franzén ◽  
S Johansson
Keyword(s):  
Multiple Sclerosis ◽  
Measurement Errors ◽  
Balance Control ◽  
Intraclass Correlation ◽  
Repeated Measurements ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Limits Of Agreement ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objective The mini-BESTest is a balance measure for assessment of the underlying physiological systems for balance control in adults. Evaluations of test–retest reliability of the mini-BESTest in larger samples of people with multiple sclerosis (MS) are lacking. The purpose of this study was to investigate test–retest reliability of the mini-BESTest total and section sum scores and individual items in people with mild to moderate overall MS disability. Methods This study used a test–retest design in a movement laboratory setting. Fifty-four people with mild to moderate overall MS disability according to the Expanded Disability Status scale (EDSS) were included, with 28 in the mild subgroup (EDSS 2.0–3.5) and 26 in the moderate subgroup (EDSS 4.0–5.5). Test–retest reliability of the mini-BESTest was evaluated by repeated measurements taken 1 week apart. Reliability and measurement error were analyzed. Results Test–retest reliability for the total scores were considered good to excellent, with intraclass correlation coefficients of .88 for the whole sample, .83 for the mild MS subgroup, and .80 for the moderate MS subgroup. Measurement errors were small, with standard error of measurement and minimal detectable change of 1.3 and 3.5, respectively, in mild MS, and 1.7 and 4.7, respectively, in moderate MS. The limits of agreement were − 3.4 and 4.6. Test–retest reliability for the section scores were fair to good or excellent; weighted kappa values ranged from .62 to .83. All items but 1 showed fair to good or excellent test–retest reliability, and percentage agreement ranged from 61% to 100%. Conclusions The mini-BESTest demonstrated good to excellent test–retest reliability and small measurement errors and is recommended for use in people with mild to moderate MS. Impact Knowledge of limits of agreement and minimal detectable change contribute to interpretability of the mini-BESTest total score. The findings of this study enhance the clinical usefulness of the test for evaluation of balance control and for designing individually customized balance training with high precision and accuracy in people with MS.

Sign in / Sign up

Export Citation Format

Share Document