scholarly journals Validation of the pediatric Radboud dysarthria assessment

2021 ◽  
pp. 1-12
Author(s):  
Marieke Ruessink ◽  
Lenie van den Engel-Hoek ◽  
Marjo van Gerven ◽  
Bea Spek ◽  
Bert de Swart ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation ◽  
Self Care ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Activity Level ◽  
Clinical Use ◽  
Spearman Correlation ◽  
Rater Reliability ◽  
Video Recordings

PURPOSE: The Radboud Dysarthria Assessment (RDA) was published in 2014. Adaptation into a pediatric version (p-RDA) was required because of relevant differences between children and adults. The purpose of this study was to assess the feasibility of the p-RDA and to test intra-rater and inter-rater reliability as well as the validity of the two severity scales (function and activity level). METHODS: Video recordings were made of 35 participants with (suspected) dysarthria (age 4 to 17 years) while being assessed using the p-RDA. Intra-rater reliability was assessed by one, and inter-rater reliability by two experiments using the Intraclass Correlation Coefficient (ICC). Validity of the severity scales was tested by correlating the consensus scores with the independently rated scores on four communication scales, three mobility scales, and one self-care scale using Spearman correlation coefficients (r s). RESULTS: The assessment was applicable for 89% of the tested sample, with good intra-rater and inter-rater reliability (ICC = 0.88–0.98 and 0.83–0.93). The p-RDA severity scales (function and activity level) correlated from substantially to strongly with the communication scales (r s = 0.69–0.82 and 0.77–0.92) and self-care scale (r s = 0.76–0.71) and correlated substantially with the mobility scales (r s = 0.49–0.60). CONCLUSION: The feasibility, reliability and validity of the p-RDA are sufficient for clinical use.

scholarly journals The Brazilian version of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C): reliability and validity in dementia

2013 ◽  
Vol 25 (9) ◽  
pp. 1503-1511 ◽  
Author(s):  
Florindo Stella ◽  
Orestes Vicente Forlenza ◽  
Jerson Laks ◽  
Larissa Pires de Andrade ◽  
Michelle A. Ljubetic Avendaño ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Rating Scale ◽  
Neuropsychiatric Symptoms ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Neuropsychiatric Inventory ◽  
Rater Reliability ◽  
Clinician Rating

ABSTRACTBackground:Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort.Methods:Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI).Results:Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS.Conclusion:The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains.

User testing of the psychometric properties of pictorial-based disability assessment Longshi Scale by healthcare professionals and non-professionals: a Chinese study in Shenzhen

2019 ◽  
Vol 33 (9) ◽  
pp. 1479-1491 ◽  
Author(s):  
Yulong Wang ◽  
Shanshan Guo ◽  
Jiejiao Zheng ◽  
Qing Mei Wang ◽  
Yuling Zhang ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Barthel Index ◽  
Public Hospital ◽  
Healthcare Professionals ◽  
Intraclass Correlation ◽  
Random Effect ◽  
Second Phase ◽  
Spearman Correlation ◽  
Rater Reliability

Objective:The aim of this study was to validate a novel pictorial-based Longshi Scale for evaluating a patient’s disability by healthcare professionals and non-professionals.Design:Prospective study.Setting:Rehabilitation departments from a grade A, class 3 public hospital, a grade B, class 2 public hospital, and a private hospital and seven community rehabilitation centers.Subjects:A total of 618 patients and 251 patients with functional disabilities were recruited in a two-phase study, respectively.Main measures:Outcome measure: pictorial scale of activities of daily living (ADLs, Longshi Scale). Reference measure: Barthel Index. The Spearman correlation coefficient was used to analyze the validity of Longshi Scale against Barthel Index.Results:In phase 1 study, from March 2016 to August 2016, the results demonstrated that the Longshi Scale was both reliable and valid (intraclass correlation coefficient based on two-way random effect (ICC2,1) = 0.877–0.974 for intra-rater reliability; ICC2,1= 0.928–0.979; κ = 0.679–1.000 for inter-rater reliability; intraclass correlation coefficient based on one-way random effect (ICC1,1) = 0.921–0.984 for test–retest reliability and Spearman correlation coefficient = 0.836–0.899). In the second phase, in March 2018, results further demonstrated that the Longshi Scale had good inter-rater and intra-rater reliability among healthcare professionals and non-professionals including therapists, interns, and personal care aids (ICC1,1= 0.822–0.882 on Day 1; ICC1,1= 0.842–0.899 on Day 7 for inter-rater reliability). In addition, the Longshi Scale decreased assessment time significantly, compared with the Barthel Index assessment ( P < 0.01).Conclusion:The Longshi Scale could potentially provide an efficient way for healthcare professionals and non-professionals who may have minimal training to assess the ADLs of functionally disabled patients.

Reliability and validity of the iSense optical scanner for measuring volume of transtibial residual limb models

2018 ◽  
Vol 43 (2) ◽  
pp. 213-220 ◽  
Author(s):  
Lucy Armitage ◽  
Li Khim Kwah ◽  
Lauren Kark
Keyword(s):  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Criterion Validity ◽  
Residual Limb ◽  
Limb Volume ◽  
Rater Reliability ◽  
Measuring Volume ◽  
Intraclass Correlation Coefficients ◽  
Optical Scanner

Background: Residual limb volume is often measured as part of routine care for people with amputations. These measurements assist in the timing of prosthetic fitting or replacement. In order to make well informed decisions, clinicians need access to measurement tools that are valid and reliable. Objectives: To assess the reliability and criterion validity of the iSense optical scanner in measuring volume of transtibial residual limb models. Study Design: Three assessors performed two measurements each on 13 residual limb models with an iSense optical scanner (3D systems, USA). Intra-rater and inter-rater reliability were calculated using intraclass correlation coefficients. Bland Altman plots were inspected for agreement. Criterion validity was assessed using a steel rod of known dimensions. Ten repeated measurements were performed by one assessor. A t-test was used to determine differences between measured and true rod volume. Results: Intra-rater reliability was excellent (range of intraclass correlation coefficients: 0.991–0.997, all with narrow 95% confidence intervals). While the intraclass correlation coefficients suggest excellent inter-rater reliability between all three assessors (range of intraclass correlation coefficients: 0.952–0.986), the 95% confidence intervals were wide between assessor 3 and the other two assessors. Poor agreement with assessor 3 was also seen in the Bland-Altman plots. Criterion validity was very poor with a significant difference between the mean iSense measurement and the true rod volume (difference: 221.18 mL; p < 0.001). Conclusions: Although intra-rater reliability was excellent for the iSense scanner, we did not find similar results for inter-rater reliability and validity. These results suggest that further testing of the iSense scanner is required prior to use in clinical practice. Clinical relevance The iSense offers a low cost scanning option for residual limb volume measurement. Intra-rater reliability was excellent, but inter-rater reliability and validity were such that clinical adoption is not indicated at present.

scholarly journals The Reliability and Validity of a Modified Squat Test to Predict Cardiopulmonary Fitness in Healthy Older Men

2018 ◽  
Vol 2018 ◽  
pp. 1-7 ◽  
Author(s):  
Chiu-Ping Yeh ◽  
Hsien-Cheng Huang ◽  
Yaju Chang ◽  
Ming-De Chen ◽  
Miaoju Hsu
Keyword(s):  
Older Adult ◽  
Intraclass Correlation ◽  
Maximal Oxygen Consumption ◽  
Reliability And Validity ◽  
Field Tests ◽  
Correlation Coefficients ◽  
Older Men ◽  
Activity Level ◽  
Cardiopulmonary Fitness ◽  
Fitness Level

Background. Shortcomings are noted in currently available cardiopulmonary field tests for the older adult and thus relevant research is still ongoing. Purpose. The purpose of this study was to investigate the reliability and validity of a modified squat test and to establish a regression model for predicting aerobic fitness in the older adult. Methods. Twenty-five healthy men aged 60 to 75 years completed this study. Each subject performed two modified squat tests with a prototype testing equipment and a maximal exercise test to determine maximal oxygen consumption. Recovery heart rates (HR) (0~30, 60~90, and 120~150 seconds) were measured following the modified squat tests. The fitness indexes included the sum of recovery HR, recovery HR index, age-adjusted recovery HR index, and immediate HR. Results. The results revealed that the age-adjusted recovery HR index fitness had the highest intraclass correlation coefficients (ICC) of 0.9 and Pearson’s correlation coefficients of 0.71, which suggested the modified squat test can reasonably assess cardiopulmonary fitness for the older adult. The regression equation for estimating aerobic power was V˙O2max = 16.781 + 16.732 × (age-adjusted recovery HR index) + 0.02467 × (physical activity level). Conclusion. The modified squat test is a valid and reliable field test and thus can be an option to assess the cardiopulmonary fitness level of healthy older men in clinics or communities.

scholarly journals The reliability and validity of PHQ-9 in patients with major depressive disorder in psychiatric hospital

2019 ◽  
Author(s):  
Yue Sun ◽  
Zhaoyan Fu ◽  
Qijing Bo ◽  
Zhen Mao ◽  
Xin Ma ◽  
...  
Keyword(s):  
Major Depressive Disorder ◽  
Depressive Disorder ◽  
Construct Validity ◽  
Correlation Coefficient ◽  
Psychiatric Hospital ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Hamilton Depression Scale ◽  
Major Depressive

Abstract Background: To assess the reliability and validity of Patient Health Questionnaire-9 (PHQ-9) for patients with major depressive disorder (MDD) and to assess the feasibility of its use in psychiatric hospitals in China. Methods: 109 outpatients or inpatients with MDD who qualified the Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV) criteria completed PHQ-9 and Hamilton Depression Scale (HAMD-17). Two weeks after the initial evaluation, 54 randomly selected patients underwent repeat assessment using PHQ-9. For validity analysis, the construct validity and criterion validity were assessed. The internal concordance coefficient and the test-retest correlation coefficients were used for reliability analysis. The correlation between total score and scores for each item and the correlation between scores for various items were evaluated using Spearman correlation coefficient. Results: Principal components factor analysis showed good construct validity of the PHQ-9. PHQ-9 total score showed a positive correlation with HAMD-17 total score (r=0.610, P<0.001). With HAMD as the standard, PHQ-9 depression scores of 7, 15, and 21 points were used as cut-offs for mild, moderate, and severe depression, respectively. Consistency assessment was conducted between the depression severity as assessed by PHQ-9 and HAMD (Kappa=0.229, P<0.001). Intraclass correlation coefficient between PHQ-9 total score and HAMD total score was 0.594 (95% confidence interval: 0.456–0.704, P<0.001). The Cronbach's α coefficient of PHQ-9 was 0.892. Correlation coefficients between each item score and the total score ranged from 0.567–0.789 (P<0.01); the correlation coefficient between various item scores ranged from 0.233–0.747. The test-retest correlation coefficient for total score was 0.737. Conclusions: PHQ-9 showed good reliability and validity, and high adaptability for patients with MDD in psychiatric hospital. It is a simple, rapid, effective, and reliable tool for screening and evaluation of the severity of depression.

scholarly journals Reliability and Validity of Three Instruments for Measuring Implant Stability Quotient

2020 ◽  
Author(s):  
Monica Blazquez-Hinarejos ◽  
Constanza Saka-Herrán ◽  
Victor Diez-Alonso ◽  
Jose Lopez-Lopez ◽  
Raúl Ayuso‐Montero ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
The Other ◽  
Resonance Frequency Analysis ◽  
Implant Stability ◽  
Good Reliability ◽  
Rater Reliability ◽  
Implant Stability Quotient

Background: Actually, resonance frequency analysis (RFA) is the most extended method for measuring implant stability. The implant stability quotient (ISQ) is the measure obtained by the different RFA devices, however, inter- and intra- rater reliability and validity of some devices remains unknown. Methods: Thirty implants were placed in 3 different pig mandibles. ISQ was measured axial and parallel with Osstell&reg; Beacon, Penguin&reg; and MegaISQ&reg; by 2 different operators and one operator performed a test-retest. Intraclass correlation coefficient was calculated to assess the intra- and inter-rater reliability. Pearson correlation coefficient was used to assess the validity. Results: The higher inter- and intra- rater reliability was obtained by Penguin&reg; when measuring axial. The highest ISQ values were obtained using Penguin&reg; in an axial measurement; the lowest, using the MegaISQ&reg; in an axial measurement. The highest correlation values with the other devices were obtained by MegaISQ&reg; measuring axially. Conclusion: Penguin&reg; had a good reliability for measuring ISQ both inter- and intra- rater. Osstell&reg; had good validity for measuring ISQ both axial and parallel and MegaISQ&reg; had the best validity for measuring ISQ axial.

scholarly journals Psychometric properties of the Brazilian version of the Vulnerable Elders Survey-13 (VES-13)

2015 ◽  
Vol 31 (3) ◽  
pp. 507-515 ◽  
Author(s):  
Laércio Lima Luz ◽  
Lívia Maria Santiago ◽  
João Francisco Santos da Silva ◽  
Inês Echenique Mattos
Keyword(s):  
Psychometric Properties ◽  
Correlation Coefficient ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Principal Component ◽  
Spearman Correlation ◽  
Convergent And Discriminant Validity ◽  
Brazilian Version

This study aims to assess the psychometric properties of the Brazilian version of the Vulnerable Elders Survey-13 (VES-13). Interviews were carried out with individuals aged 60 years and over receiving care at an ambulatory cancer centre. Test-retest reliability was assessed using the Spearman correlation coefficient, intraclass correlation coefficients and Cohen's kappa coefficient. Construct validity was assessed by testing convergent and discriminant validity using principal component analysis and Varimax rotation. The Spearman correlation coefficient value of the comparison between test and retest scores was 0.98 (p < 0.001). All intraclass correlation coefficient values were higher than 0.60 and kappa coefficients varied between 0.33 and 0.94. Three identified factors explained 72.6% of overall sample variance. VES-13 presented good convergent validity and reasonable discriminant validity. The psychometric properties of the adapted version of the VES-13 are consistent and adequate for use with the Brazilian population.

Remote evaluation of upper extremity motor function following stroke: The Arm Capacity and Movement Test (ArmCAM) (Preprint)

2020 ◽  
Author(s):  
Chieh-Ling Yang ◽  
Lisa A. Simposon ◽  
Janice Eng
Keyword(s):  
Upper Extremity ◽  
Motor Function ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Minimal Detectable Change ◽  
Special Equipment ◽  
Good Reliability ◽  
Rater Reliability ◽  
Movement Test

BACKGROUND Developing a simple measure that can be administered remotely via videoconferencing is needed for telerehabilitation for rural and remote population, or during the COVID-19 pandemic. OBJECTIVE To develop a valid and reliable measure [the Arm Capacity and Movement Test (ArmCAM)] administered remotely via videoconferencing to evaluate upper extremity motor function after stroke. METHODS A sample of individuals with stroke (N=31) was used to assess the reliability and validity of the ArmCAM (range: 0-30). Test-retest and inter-rater reliability were assessed through the intraclass correlation coefficients (ICC), standard error of measurement (SEM) and minimal detectable change (MDC). Validity was examined by the Pearson and Spearman rank correlation coefficients. RESULTS The ArmCAM consists of 10 items and takes 15 minutes to administer without any special equipment except for a computer and internet access. The ICC for test-retest reliability and inter-rater reliability were 0.997 and 0.993, respectively. The SEM and MDC95 were 0.74 and 2.05 points, respectively. With respect to validity, correlations between the ArmCAM and the Rating of Everyday Arm-use in the Community and Home Scale, Stroke Impact Scale-Hand, Fugl-Meyer Assessment for upper extremity, and Action Research Arm Test were good to excellent (correlation coefficients: 0.811-0.944). CONCLUSIONS he ArmCAM has good reliability and validity. It is an easy-to-use assessment that is designed to be administered remotely via video conferencing. CLINICALTRIAL NA (This is not a clinical trial)

scholarly journals Reliability and Agreement of Three Devices for Measuring Implant Stability Quotient in the Animal Ex Vivo Model

2021 ◽  
Vol 11 (8) ◽  
pp. 3453
Author(s):  
Monica Blazquez-Hinarejos ◽  
Constanza Saka-Herrán ◽  
Victor Diez-Alonso ◽  
Raul Ayuso-Montero ◽  
Eugenio Velasco-Ortega ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Ex Vivo ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Implant Stability ◽  
Ex Vivo Model ◽  
Rater Reliability ◽  
Implant Stability Quotient ◽  
Parallel Measurement

Resonance frequency analysis (RFA) is the most extended method for measuring implant stability. The implant stability quotient (ISQ) is the measure obtained by different RFA devices; however, inter- and intra-rater reliability and agreement of these instruments remain unknown. Thirty implants were placed in three different pig mandibles. ISQ was measured parallel and perpendicular (lingual) to the peg axis with Osstell® Beacon, Penguin® and MegaISQ® by two different investigators and furthermore, one performed a test-retest. Intraclass correlation coefficient was calculated to assess the intra- and inter-rater reliability. Pearson correlation coefficient was used to assess the agreement. Intraclass correlation coefficients ranged from 0.20 to 0.65 for the Osstell® Beacon; 0.57 to 0.86 for the Penguin®; and −0.01 to 0.60 for the MegaISQ®. The highest ISQ values were obtained using Penguin® (66.3) in a parallel measurement; the lowest, using the MegaISQ® (60.1) in a parallel measurement. The highest correlation values with the other devices were obtained by MegaISQ® in a parallel measurement. Osstell® Beacon and MegaISQ® showed lower reliability than Penguin®. Osstell® had good agreement for measuring ISQ both in parallel and perpendicular, and MegaISQ® had the best agreement for measuring ISQ in parallel.

scholarly journals Development and Relative Validity of a Semiquantitative Food Frequency Questionnaire to Estimate Dietary Intake among a Multi-Ethnic Population in the Malaysian Cohort Project

Nutrients ◽  
2021 ◽  
Vol 13 (4) ◽  
pp. 1163
Author(s):  
Suzana Shahar ◽  
Mohd Razif Shahril ◽  
Noraidatulakma Abdullah ◽  
Boekhtiar Borhanuddin ◽  
Mohd Arman Kamaruddin ◽  
...  
Keyword(s):  
Vitamin C ◽  
Correlation Coefficient ◽  
Food Frequency Questionnaire ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Weighted Kappa ◽  
Dietary Intakes ◽  
Food Frequency ◽  
Relative Validity ◽  
Spearman’S Correlation

Measuring dietary intakes in a multi-ethnic and multicultural setting, such as Malaysia, remains a challenge due to its diversity. This study aims to develop and evaluate the relative validity of an interviewer-administered food frequency questionnaire (FFQ) in assessing the habitual dietary exposure of The Malaysian Cohort (TMC) participants. We developed a nutrient database (with 203 items) based on various food consumption tables, and 803 participants were involved in this study. The output of the FFQ was then validated against three-day 24-h dietary recalls (n = 64). We assessed the relative validity and its agreement using various methods, such as Spearman’s correlation, weighed Kappa, intraclass correlation coefficient (ICC), and Bland–Altman analysis. Spearman’s correlation coefficient ranged from 0.24 (vitamin C) to 0.46 (carbohydrate), and almost all nutrients had correlation coefficients above 0.3, except for vitamin C and sodium. Intraclass correlation coefficients ranged from −0.01 (calcium) to 0.59 (carbohydrates), and weighted Kappa exceeded 0.4 for 50% of nutrients. In short, TMC’s FFQ appears to have good relative validity for the assessment of nutrient intake among its participants, as compared to the three-day 24-h dietary recalls. However, estimates for iron, vitamin A, and vitamin C should be interpreted with caution.

Sign in / Sign up

Export Citation Format

Share Document