scholarly journals The Brazilian version of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C): reliability and validity in dementia

2013 ◽  
Vol 25 (9) ◽  
pp. 1503-1511 ◽  
Author(s):  
Florindo Stella ◽  
Orestes Vicente Forlenza ◽  
Jerson Laks ◽  
Larissa Pires de Andrade ◽  
Michelle A. Ljubetic Avendaño ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Rating Scale ◽  
Neuropsychiatric Symptoms ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Neuropsychiatric Inventory ◽  
Rater Reliability ◽  
Clinician Rating

ABSTRACTBackground:Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort.Methods:Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI).Results:Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS.Conclusion:The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains.

scholarly journals The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia

2010 ◽  
Vol 22 (6) ◽  
pp. 984-994 ◽  
Author(s):  
K. de Medeiros ◽  
P. Robert ◽  
S. Gauthier ◽  
F. Stella ◽  
A. Politis ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Rating Scale ◽  
Neuropsychiatric Symptoms ◽  
Reliability And Validity ◽  
Face Validity ◽  
Delphi Panel ◽  
Rater Reliability ◽  
Versatile Tool ◽  
Clinician Rating ◽  
Almost All

ABSTRACTBackground: Neuropsychiatric symptoms (NPS) affect almost all patients with dementia and are a major focus of study and treatment. Accurate assessment of NPS through valid, sensitive and reliable measures is crucial. Although current NPS measures have many strengths, they also have some limitations (e.g. acquisition of data is limited to informants or caregivers as respondents, limited depth of items specific to moderate dementia). Therefore, we developed a revised version of the NPI, known as the NPI-C. The NPI-C includes expanded domains and items, and a clinician-rating methodology. This study evaluated the reliability and convergent validity of the NPI-C at ten international sites (seven languages).Methods: Face validity for 78 new items was obtained through a Delphi panel. A total of 128 dyads (caregivers/patients) from three severity categories of dementia (mild = 58, moderate = 49, severe = 21) were interviewed separately by two trained raters using two rating methods: the original NPI interview and a clinician-rated method. Rater 1 also administered four additional, established measures: the Apathy Evaluation Scale, the Brief Psychiatric Rating Scale, the Cohen-Mansfield Agitation Index, and the Cornell Scale for Depression in Dementia. Intraclass correlations were used to determine inter-rater reliability. Pearson correlations between the four relevant NPI-C domains and their corresponding outside measures were used for convergent validity.Results: Inter-rater reliability was strong for most items. Convergent validity was moderate (apathy and agitation) to strong (hallucinations and delusions; agitation and aberrant vocalization; and depression) for clinician ratings in NPI-C domains.Conclusion: Overall, the NPI-C shows promise as a versatile tool which can accurately measure NPS and which uses a uniform scale system to facilitate data comparisons across studies.

scholarly journals Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Psychometric Evaluation ◽  
Counseling Competencies ◽  
Counselors In Training ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

scholarly journals The Neuropsychiatric Inventory-Diary Rating Scale (NPI-Diary): A Method for Improving Stability in Assessing Neuropsychiatric Symptoms in Dementia

2018 ◽  
Vol 8 (3) ◽  
pp. 306-320 ◽  
Author(s):  
Francesca Morganti ◽  
Alex Soli ◽  
Paola Savoldelli ◽  
Gloria Belotti
Keyword(s):  
Health Care ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Care Setting ◽  
Rating Scale ◽  
Neuropsychiatric Symptoms ◽  
Validity And Reliability ◽  
Neuropsychiatric Inventory ◽  
Test Retest Reliability ◽  
Adequate Internal Consistency

Background: In health-care settings, the use of the Neuropsychiatric Inventory-Nursing Home (NPI-NH) may not always be consistent with the authors’ guidelines, which affects its reliability. To avoid this bias, a diary version of the NPI (NPI-Diary) was developed. Aims: This study aimed to evaluate the psychometric properties (internal consistency and reliability) of the NPI-Diary, and examined its convergence with the NPI-NH. Methods: Two raters administered the NPI-NH and NPI-Diary to 40 participants with Alzheimer’s disease, selected randomly from a hospital’s weekly turnover. Results: The NPI-Diary exhibited adequate internal consistency (total: α = 0.581) and test-retest reliability (total: ρ = 0.711; p < 0.01). The interrater reliability values (ICC) for the NPI-NH and NPI-Diary differed significantly (Total: NPI-NH ICC = 0.506, NPI-Diary ICC = 0.879; Frequency: NPI-NH ICC = 0.51, NPI-Diary ICC = 0.798; Severity: NPI-NH ICC = 0.491, NPI-Diary ICC = 0.809). The convergent validity between the two inventories was also significant (total: ρ = 0.48; p < 0.01). Conclusions: The NPI-Diary showed more appropriate validity and reliability compared to the NPI-NH, when administered in a highly variable sample, as is generally the case in the current health-care setting.

Development and assessment of the inter-rater and intra-rater reproducibility of a self-administration version of the ALSFRS-R

2019 ◽  
Vol 91 (1) ◽  
pp. 75-81 ◽  
Author(s):  
Leonhard A Bakker ◽  
Carin D Schröder ◽  
Harold H G Tan ◽  
Simone M A G Vugts ◽  
Ruben P A van Eijk ◽  
...  
Keyword(s):  
Rating Scale ◽  
Clinical Care ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
The Self ◽  
Coefficient Alpha ◽  
Rater Agreement ◽  
Self Administration ◽  
Limits Of Agreement ◽  
Rater Reliability

ObjectiveThe Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) is widely applied to assess disease severity and progression in patients with motor neuron disease (MND). The objective of the study is to assess the inter-rater and intra-rater reproducibility, i.e., the inter-rater and intra-rater reliability and agreement, of a self-administration version of the ALSFRS-R for use in apps, online platforms, clinical care and trials.MethodsThe self-administration version of the ALSFRS-R was developed based on both patient and expert feedback. To assess the inter-rater reproducibility, 59 patients with MND filled out the ALSFRS-R online and were subsequently assessed on the ALSFRS-R by three raters. To assess the intra-rater reproducibility, patients were invited on two occasions to complete the ALSFRS-R online. Reliability was assessed with intraclass correlation coefficients, agreement was assessed with Bland-Altman plots and paired samples t-tests, and internal consistency was examined with Cronbach’s coefficient alpha.ResultsThe self-administration version of the ALSFRS-R demonstrated excellent inter-rater and intra-rater reliability. The assessment of inter-rater agreement demonstrated small systematic differences between patients and raters and acceptable limits of agreement. The assessment of intra-rater agreement demonstrated no systematic changes between time points; limits of agreement were 4.3 points for the total score and ranged from 1.6 to 2.4 points for the domain scores. Coefficient alpha values were acceptable.DiscussionThe self-administration version of the ALSFRS-R demonstrates high reproducibility and can be used in apps and online portals for both individual comparisons, facilitating the management of clinical care and group comparisons in clinical trials.

scholarly journals Reliability and concurrent validity of an alternative method of lateral lumbar range of motion in athletes

2016 ◽  
Vol 28 (1) ◽  
pp. 23-26 ◽  
Author(s):  
M Hecimovich
Keyword(s):  
Lumbar Spine ◽  
Range Of Motion ◽  
Concurrent Validity ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Index Test ◽  
Low Back ◽  
Detectable Change ◽  
Rater Reliability

Background: Cricket bowling involves combined spinalmovements of side bending and rotation and, consequently, injuryto the low back is a common problem. Therefore the assessmentof lumbar spine kinematics has become a routine component inpreseason screening. This includes static measurement of lateralspinal flexion as asymmetrical range of motion may predispose anathlete to low back injury.Objectives: This study examined intra-rater reliability andconcurrent validity of the fingertip-to-floor distance test (FFD)when compared to a criterion range of motion measure.Methods: Thirty-four junior-level cricket players aged 13‑16years were recruited. Lumbar spine lateral flexion was measuredsimultaneously with the fingertip-to-floor distance test and digitalinclinometry methods. Relative and absolute intra-rater reliabilitywere investigated with intraclass correlation coefficients (ICC3,1)of agreement, standard error of measurement (SEM) estimates,Bland and Altman bias estimates and 95% limits of agreement,respectively. The concurrent validity of the fingertip-to-floordistance test, compared to digital inclinometry measures, wasexamined with Pearson correlation coefficients.Results: Intra-rater reliability demonstrated substantial agreementfor both measures (ICC3,1 > 0.84). The fingertip-to-floor distancetest SEM values ranged from 1.71‑2.01 cm with an estimatedminimum detectable change (MDC) threshold of 4.73‑5.55 cm.The inclinometry SEM values ranged from 1.00‑1.09° withminimal detectable change estimates of 2.77‑3.01°. There werestrong correlations between the index test and criterion measureoutcomes (r > 0.84, p < 0.001).Conclusions: This study’s results support the intra-rater reliabilityand concurrent validity of the finger-to-floor distance test,suggesting it to be a suitable surrogate measure for lumbar lateralflexion testing

scholarly journals Validation of the pediatric Radboud dysarthria assessment

2021 ◽  
pp. 1-12
Author(s):  
Marieke Ruessink ◽  
Lenie van den Engel-Hoek ◽  
Marjo van Gerven ◽  
Bea Spek ◽  
Bert de Swart ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation ◽  
Self Care ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Activity Level ◽  
Clinical Use ◽  
Spearman Correlation ◽  
Rater Reliability ◽  
Video Recordings

PURPOSE: The Radboud Dysarthria Assessment (RDA) was published in 2014. Adaptation into a pediatric version (p-RDA) was required because of relevant differences between children and adults. The purpose of this study was to assess the feasibility of the p-RDA and to test intra-rater and inter-rater reliability as well as the validity of the two severity scales (function and activity level). METHODS: Video recordings were made of 35 participants with (suspected) dysarthria (age 4 to 17 years) while being assessed using the p-RDA. Intra-rater reliability was assessed by one, and inter-rater reliability by two experiments using the Intraclass Correlation Coefficient (ICC). Validity of the severity scales was tested by correlating the consensus scores with the independently rated scores on four communication scales, three mobility scales, and one self-care scale using Spearman correlation coefficients (r s). RESULTS: The assessment was applicable for 89% of the tested sample, with good intra-rater and inter-rater reliability (ICC = 0.88–0.98 and 0.83–0.93). The p-RDA severity scales (function and activity level) correlated from substantially to strongly with the communication scales (r s = 0.69–0.82 and 0.77–0.92) and self-care scale (r s = 0.76–0.71) and correlated substantially with the mobility scales (r s = 0.49–0.60). CONCLUSION: The feasibility, reliability and validity of the p-RDA are sufficient for clinical use.

scholarly journals Reliability and Validity of the Dyskinesia Impairment Scale in Children and Young Adults with Inherited or Idiopathic Dystonia

2020 ◽  
Vol 9 (8) ◽  
pp. 2597
Author(s):  
Annika Danielsson ◽  
Inti Vanmechelen ◽  
Cecilia Lidbeck ◽  
Lena Krumlinde-Sundholm ◽  
Els Ortibus ◽  
...  
Keyword(s):  
Young Adults ◽  
Rating Scale ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Children And Youth ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Children And Young Adults ◽  
Test Retest Reliability ◽  
Idiopathic Dystonia

Background: The Dyskinesia Impairment Scale (DIS) is a new assessment scale for dystonia and choreoathetosis in children and youth with dyskinetic cerebral palsy. Today, the Burke–Fahn–Marsden Dystonia Rating Scale (BFM) is mostly used to assess dystonia in children with inherited dystonia. The aim of this study was to assess reliability and validity of the DIS in children and youth with inherited or idiopathic dystonia. Methods: Reliability was measured by (1) the intraclass correlation coefficients (ICCs) for inter-rater and test-retest reliability, as well as (2) standard error of measurement (SEM) and minimal detectable difference (MDD). For concurrent validity of the DIS-dystonia subscale, the BFM was administered. Results: In total, 11 males and 9 females (median age 16 years and 7 months, range 6 to 24 years) were included. For inter-rater reliability, the ICCs for the DIS total score and the dystonia and choreoathetosis subscale scores were 0.83, 0.87, and 0.71, respectively. For test-retest reliability, the ICCs for the DIS total score and the dystonia and choreoathetosis subscale scores were 0.95, 0.88, and 0.93, respectively. The SEM and MDD for the total DIS were 3.98% and 11.04%, respectively. The Spearman correlation coefficient between the dystonia subscale and the BFM was 0.88 (p < 0.01). Conclusions: Good to excellent inter-rater, test-retest reliability, and validity were found for the total DIS and the dystonia subscale. The choreoathetosis subscale showed moderate inter-rater reliability and excellent test-retest reliability. The DIS may be a promising tool to assess dystonia and choreoathetosis in children and young adults with inherited or idiopathic dystonia.

Evaluation of Stereo Acuity in Professional Baseball and LPGA Athletes Compared to Non-Athletes

2017 ◽  
pp. 34-42
Keyword(s):  
Convergent Validity ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Professional Women ◽  
Professional Baseball ◽  
Baseball Players ◽  
Intraclass Correlation Coefficients ◽  
Stereo Acuity

Purpose: To investigate stereo acuity of professional athletes in an open (baseball) and closed (golf) skilled sport compared to nonathletes using a new digitized version of the Titmus Stereo Test/Wirt Circles. Additionally, to examine the new test for reliability and validity. Methods: Participants included professional baseball players (PBP; n = 265) and professional women golfers (LPGA; n = 52), and nonathletes (n = 107). All participants were tested on the RightEye Fine Depth Perception (FDP) test and a subset (n = 20) was retested to determine reliability and internal consistency. A different subset (n = 81) was tested for validity comparing the Titmus Stereo Test/Wirt Circles to the RightEye FDP test. Cronbach’s Alpha, intraclass correlation coefficients (ICC) were examined for reliability and ANOVA was conducted to determine convergent validity as well as differences in stereo acuity between groups. Results: Results: The test was revealed to have high reliability and validity, therefore being a good measure of stereo acuity. Furthermore, significant differences (p<.001) between athletes and non-athletes were found. Both PBP and LPGA athletes were significantly different from non-athletes (p<.05). No differences were found between athlete groups. Conclusions: The RightEye FDP test is both reliable and valid and can therefore be used confidently as a measure of static stereo acuity. Elite athletes in open and closed skills show significantly better stereo acuity than non-athletes.

Reliability and validity of the iSense optical scanner for measuring volume of transtibial residual limb models

2018 ◽  
Vol 43 (2) ◽  
pp. 213-220 ◽  
Author(s):  
Lucy Armitage ◽  
Li Khim Kwah ◽  
Lauren Kark
Keyword(s):  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Criterion Validity ◽  
Residual Limb ◽  
Limb Volume ◽  
Rater Reliability ◽  
Measuring Volume ◽  
Intraclass Correlation Coefficients ◽  
Optical Scanner

Background: Residual limb volume is often measured as part of routine care for people with amputations. These measurements assist in the timing of prosthetic fitting or replacement. In order to make well informed decisions, clinicians need access to measurement tools that are valid and reliable. Objectives: To assess the reliability and criterion validity of the iSense optical scanner in measuring volume of transtibial residual limb models. Study Design: Three assessors performed two measurements each on 13 residual limb models with an iSense optical scanner (3D systems, USA). Intra-rater and inter-rater reliability were calculated using intraclass correlation coefficients. Bland Altman plots were inspected for agreement. Criterion validity was assessed using a steel rod of known dimensions. Ten repeated measurements were performed by one assessor. A t-test was used to determine differences between measured and true rod volume. Results: Intra-rater reliability was excellent (range of intraclass correlation coefficients: 0.991–0.997, all with narrow 95% confidence intervals). While the intraclass correlation coefficients suggest excellent inter-rater reliability between all three assessors (range of intraclass correlation coefficients: 0.952–0.986), the 95% confidence intervals were wide between assessor 3 and the other two assessors. Poor agreement with assessor 3 was also seen in the Bland-Altman plots. Criterion validity was very poor with a significant difference between the mean iSense measurement and the true rod volume (difference: 221.18 mL; p < 0.001). Conclusions: Although intra-rater reliability was excellent for the iSense scanner, we did not find similar results for inter-rater reliability and validity. These results suggest that further testing of the iSense scanner is required prior to use in clinical practice. Clinical relevance The iSense offers a low cost scanning option for residual limb volume measurement. Intra-rater reliability was excellent, but inter-rater reliability and validity were such that clinical adoption is not indicated at present.

Sign in / Sign up

Export Citation Format

Share Document