scholarly journals Psychometric properties of the Neuropsychiatric Inventory: a review

2019 ◽  
Author(s):  
Toni Saari ◽  
Anne Koivisto ◽  
Taina Hintsa ◽  
Tuomo Hänninen ◽  
Ilona Hallikainen

Neuropsychiatric symptoms (NPSs) cause a significant burden to individuals with memory disorders and their families. Insights into the clinical associations, neurobiology, and treatment of NPSs are largely dependent on informant questionnaires, such as the commonly used Neuropsychiatric Inventory (NPI). Like any scale, the utility of the NPI relies on its psychometric properties, but unlike many scales, the NPI faces unique challenges related to its skip-question and scoring formats.We examined and reviewed the psychometric properties of the NPI in a framework including psychometric properties pertinent for construct validation, and health-related outcome measurement in general. We found that aspects such as test-retest and inter-rater reliability are major strengths of the NPI in addition to its flexible and relatively quick administration. These properties are desired in clinical trials. However, it seems that the reported properties cover only some of the generally examined psychometric properties, representing perhaps necessary but not sufficient reliability and validity evidence for the NPI. There appear to be significant gaps in psychometric data, at least partially owing to small sample sizes in the studies that preclude more comprehensive analyses. Regarding construct validity, only one study examined structural validity with the NPI subquestions. Measurement error was not assessed in the reviewed studies. For future validation, we recommend using data from all subquestions, collecting larger samples, paying specific attention to construct validity and formulating hypotheses a priori. As the NPI is an outcome measure of interest in clinical trials, examining measurement error could be of practical importance.

2020 ◽  
pp. 1-15
Author(s):  
Toni Saari ◽  
Anne Koivisto ◽  
Taina Hintsa ◽  
Tuomo Hänninen ◽  
Ilona Hallikainen

Neuropsychiatric symptoms cause a significant burden to individuals with neurocognitive disorders and their families. Insights into the clinical associations, neurobiology, and treatment of these symptoms depend on informant questionnaires, such as the commonly used Neuropsychiatric Inventory (NPI). As with any scale, the utility of the NPI relies on its psychometric properties, but the NPI faces unique challenges related to its skip-question and scoring formats. In this narrative review, we examined the psychometric properties of the NPI in a framework including properties pertinent to construct validation, and health-related outcome measurement in general. We found that aspects such as test-retest and inter-rater reliability are major strengths of the NPI in addition to its flexible and relatively quick administration. These properties are desired in clinical trials. However, the reported properties appear to cover only some of the generally examined psychometric properties, representing perhaps necessary but insufficient reliability and validity evidence for the NPI. The psychometric data seem to have significant gaps, in part because small sample sizes in the relevant studies have precluded more comprehensive analyses. Regarding construct validity, only one study has examined structural validity with the NPI subquestions. Measurement error was not assessed in the reviewed studies. For future validation, we recommend using data from all subquestions, collecting larger samples, paying specific attention to construct validity and formulating hypotheses a priori. Because the NPI is an outcome measure of interest in clinical trials, examining measurement error could be of practical importance.


2013 ◽  
Vol 25 (9) ◽  
pp. 1503-1511 ◽  
Author(s):  
Florindo Stella ◽  
Orestes Vicente Forlenza ◽  
Jerson Laks ◽  
Larissa Pires de Andrade ◽  
Michelle A. Ljubetic Avendaño ◽  
...  

ABSTRACTBackground:Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort.Methods:Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI).Results:Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS.Conclusion:The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains.


2009 ◽  
Vol 21 (1) ◽  
pp. 86-99 ◽  
Author(s):  
Nefertiti Durant ◽  
Jacqueline Kerr ◽  
Sion Kim Harris ◽  
Brian E. Saelens ◽  
Gregory J. Norman ◽  
...  

Few studies have explored barriers to physical activity in parks and streets among children, adolescents, and their parents. The purpose of this article is to evaluate the psychometric properties of a new survey of barriers to physical activity in neighborhood parks and streets. Adolescents and parents of children and adolescents completed surveys twice. Two barrier subscales (environment and safety) emerged that applied to both locations and all participant groups. Results generally supported acceptable, internal consistency as well as construct validity, but test-retest reliabilities were lower than desired. These scales may be used to improve understanding of perceptions of barriers to physical activity in neighborhood parks and streets, but further development is needed.


2013 ◽  
Vol 18 (3) ◽  
pp. 142-152 ◽  
Author(s):  
Jennifer N Stinson ◽  
Anna Huguet ◽  
Patrick McGrath ◽  
Brittany Rosenbloom ◽  
Charlene Soobiah ◽  
...  

BACKGROUND: While paper headache pain diaries have been used to determine the effectiveness of headache treatments in clinical trials, recent advances in information and communication technologies have resulted in the burgeoning use of electronic diaries (e-diaries) for headache pain.OBJECTIVE: To qualitatively review headache e-diaries, assess their measurement properties, examine measurement components and compare these components with recommended reporting guidelines.METHODS: The databases Medline, the Cumulative Index to Nursing and Allied Health Literature, Embase, PsychInfo, the Education Resources Information Centre and ISI Web of Science were searched for self-report headache e-diaries for children and adults. A total of 21 publications that involved e-diaries were found; five articles reported on the development of an e-diary and 16 used an e-diary as an outcome measure in randomized controlled trials or observational studies. The diary measures’ components, features and psychometric properties, as well as the quality of evidence of their psychometric properties, were evaluated.RESULTS: Five headache e-diaries met the a priori criteria and were included in the final analysis. None of these e-diaries had well-developed evidence of reliability and validity. Three e-diaries showed evidence of feasibility. E-diaries with ad hoc measures developed by the study investigators were most common, with little to no supportive evidence of reliability and/or validity. Compliance with the reporting guidelines was variable, with only one-half of the e-diaries measuring the recommended primary outcome of headache frequency.CONCLUSIONS: Specific recommendations regarding the development (including essential components) and testing of headache e-diaries are discussed. Further research is needed to strengthen the measurement of headache pain in clinical trials using headache e-diaries.


2014 ◽  
Vol 45 (4) ◽  
pp. 365-377 ◽  
Author(s):  
Cecilia Kirk ◽  
Laura Vigeland

Purpose The authors provide a review of the psychometric properties of 6 norm-referenced tests designed to measure children's phonological error patterns. Three aspects of the tests' psychometric adequacy were evaluated: the normative sample, reliability, and validity. Method The specific criteria used for determining the psychometric adequacy of these tests were based on current recommendations in the literature. Test manuals and response forms were reviewed for psychometric adequacy according to these criteria. Results The tests included in this review failed to exhibit many of the psychometric properties required of well-designed norm-referenced tests. Of particular concern was lack of adequate sample size, poor evidence of construct validity, and lack of information about diagnostic accuracy. Conclusions To ensure that clinicians have access to valid and reliable tests, test developers must make a greater effort to establish that the tests they design have adequate psychometric properties. The authors hope that this review will help clinicians and other professionals to be more aware of some of the limitations of using these tests to make educational decisions.


2019 ◽  
Vol 27 (3) ◽  
pp. 534-553
Author(s):  
Alisha J. Hackney ◽  
N. Jennifer Klinedinst ◽  
Barbara Resnick

Background and PurposeLimited literature exists regarding the psychometric properties of the Patient-Reported Outcome Measurement Information System (PROMIS) Fatigue Short Form 8a. This study compared the psychometric properties of the 8a to the established PROMIS Fatigue Short Form 7a.MethodsThis was a cross-sectional study of 31 older adults with joint pain. Equivalent forms reliability and a Rasch analysis explored reliability (equivalent forms, internal consistency), validity (unidimensionality, item INFIT/OUTFIT), and additional psychometrics (item mapping).ResultsThe measures were equivalent in measuring fatigue (r = 0.75, p < .001) with good internal consistency (α = .87−.92). Both were unidimensional. Even though the 8a had better fitting items, neither measure could differentiate low levels of fatigue.ConclusionThe 8a has comparable psychometric properties to the 7a in this population. Future work is needed in larger, more diverse samples.


2019 ◽  
Author(s):  
Qing-Lan Liu ◽  
Fei Wang ◽  
Jie Sui ◽  
Kaiping Peng ◽  
Chuan-Peng Hu

The Free Will and Determinism Plus (FAD+) is a widely-used questionnaire in research of belief in free will and has been translated into different languages. The present study aimed to assess the psychometric properties of the Chinese version of FAD+. We first translated and back-translated the FAD+, and then surveyed 1474 young adults, with 1333 valid data, in different sites in China. The first half of the data (n = 590) were used for items analysis, which resulted in the removal of 3 items. The rest of the data (n = 743) were used to assess the reliability, construct validity, and factor structure of the 24-item Chinese FAD+. Results revealed that the Chinese FAD+ are relatively reliable (α [.60 ~ .78], ω [.60 ~ .78], test-retest correlation [.54~ .59]) and valid (four-factor structure). Our results suggest that the 24-item FAD+ could be potentially useful for future studies that will use a similar population as ours.


2009 ◽  
Vol 40 (2) ◽  
pp. 35-44 ◽  
Author(s):  
C. Boshoff

Over the years, marketers have been cautioned repeatedly about the use of measuring instruments that do not demonstrate sufficient evidence of reliability and validity, particularly construct validity. The use of marketing instruments that do not demonstrate sufficient evidence of construct validity can lead to invalid results and erroneous conclusions. In short, construct validity is not just a “nice to have” in marketing research – it is at the heart of marketing decision-making.This study assesses the psychometric properties of a recently published instrument by Walsh and Beatty (2007) to measure the customer-based corporate reputation of a service firm, and illustrates how, by using an approach proposed by Steenkamp and Trijp (1991) to assess the uni-dimensionality of the underlying dimensions of a multi-dimensional construct, one can enhance the construct validity of such an instrument. The result is a shortened, 17-item instrument with superior psychometric properties compared to the longer 31-item instrument.


2021 ◽  
Vol 5 (1) ◽  
Author(s):  
Meryl Brod ◽  
Lori McLeod ◽  
Denka Markova ◽  
Jill Gianettoni ◽  
Sanchita Mourya ◽  
...  

Abstract Background Hypoparathyroidism (HP) is a rare endocrine disorder characterized by absent or inappropriately low levels of circulating parathyroid hormone with associated significant physical and cognitive symptoms. This study evaluated the psychometric properties of the Hypoparathyroidism Patient Experience Scales (HPES), which were developed as disease-specific, patient-reported outcome (PRO) measures to assess the symptoms and impacts associated with HP in adults. Methods Data from a non-interventional, observational study (N = 300) and a Phase 2 clinical trial (N = 59) were used in the psychometric evaluation. Observational and trial assessments included: an online validation battery (baseline or screening) and retest (approximately 2 weeks after baseline or screening). In the trial, the primary efficacy endpoint was assessed at week 4 through re-administration of the HPES and validation battery subset. The observational study’s larger sample size allowed for evaluation of the HPES descriptive properties, scoring algorithm, test-retest reliability, and construct validity. The trial data examined responsiveness, meaningful within-patient change estimates, and treatment impact on HPES scores. Results Demographic and self-reported medical characteristics results were similar across the 2 studies. Factor analysis confirmed domains in the HPES-Symptom (n = 2) and HPES-Impact (n = 4). For both measures, total and domain scores demonstrated acceptable reliability and validity for both the observational and trial samples. Internal consistency evidence was strong. Test-retest reliability estimates generally approached the recommended 0.70 threshold. The construct validity correlations with other PRO measures were mainly as hypothesized, thus supporting the HPES scores and constructs. Mean scores for both measures also differed as anticipated and significantly across known-groups, thus providing evidence for the scores discriminating between meaningful groups. Trial results supported both HPES total and domain scores’ ability to detect change. The difference in mean total and domain scores for both measures demonstrated statistically significant improvements for TransCon PTH compared to placebo treated subjects despite the small sample and a short 4-week duration on fixed, non-optimized doses. Conclusions The HPES were found to be conceptually sound with adequate evidence supporting their reliability and validity. Incorporation of the HPES into clinical and research settings will help to further elucidate and assess the patient experience of living with HP and identify treatment differences.


2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Chris Margaret Aanondsen ◽  
Thomas Jozefiak ◽  
Kerstin Heiling ◽  
Stian Lydersen ◽  
Tormod Rimehaug

Abstract Background Several studies have assessed the Quality of Life (QoL) in Deaf and hard-of-hearing (DHH) children and adolescents. The findings from these studies, however, vary from DHH children reporting lower QoL than their typically hearing (TH) peers to similar QoL and even higher QoL. These differences have been attributed to contextual and individual factors such as degree of access to communication, the participants’ age as well as measurement error. Using written instead of sign language measures has been shown to underestimate mental health symptoms in DHH children and adolescents. It is expected that translating generic QoL measures into sign language will help gain more accurate reports from DHH children and adolescents, thus eliminating one of the sources for the observed differences in research conclusions. Hence, the aim of the current study is to translate the Inventory of Life Quality in Children and Adolescents into Norwegian Sign Language (ILC-NSL) and to evaluate the psychometric properties of the self-report of the ILC-NSL and the written Norwegian version (ILC-NOR) for DHH children and adolescents. The parent report was included for comparison. Associations between child self-report and parent-report are also provided. Methods Fifty-six DHH children completed the ILC-NSL and ILC-NOR in randomized order while their parents completed the parent-report of the ILC-NOR and a questionnaire on hearing- and language-related information. Internal consistency was examined using Dillon-Goldstein’s rho and Cronbach’s alpha, ILC-NSL and ILC-NOR were compared using intraclass correlation coefficients. Construct validity was examined by partial least squares structural equation modeling (PLS-SEM). Results Regarding reliability, the internal consistency was established as acceptable to good, whereas the comparison of the ILC-NSL with the ILC-NOR demonstrated closer correspondence for the adolescent version of the ILC than for the child version. The construct validity, as evaluated by PLS-SEM, resulted in an acceptable fit for the proposed one-factor model for both language versions for adolescents as well as the complete sample. Conclusion The reliability and validity of the ILC-NSL seem promising, especially for the adolescent version, even though the validation was based on a small sample of DHH children and adolescents.


Sign in / Sign up

Export Citation Format

Share Document