Estimating premorbid intelligence in people living with dementia: a systematic review

ABSTRACT Objectives: In diagnosing dementia, estimating premorbid functioning is critical for accurate detection of the presence and severity of cognitive decline. However, which assessments of premorbid intelligence are most suitable for use in clinical practice is not well established. Here, we systematically evaluate the validity of instruments for measuring premorbid intelligence in people living with dementia. Design and setting: In this systematic review, electronic databases (EMBASE, PsycINFO, MEDLINE, CINAHL, and AMED) were searched to identify studies reporting on objective measures of premorbid intelligence in dementia. Participants from included studies were recruited from local communities and clinical settings. Participants: A total of 1082 patients with dementia and 2587 healthy controls were included in the review. Measurements: The literature search resulted in 13 eligible studies describing 19 different instruments. The majority of instruments (n = 14) consisted of language-based measures, with versions of the National Adult Reading Test (NART) being most commonly investigated. Results: Preliminary evidence suggested comparable performance of patients with mild dementia and healthy controls on word reading tasks in English, Portuguese, Swedish, and Japanese. In moderate dementia, however, the performance was significantly impaired on most verbal tasks. There was a lack of reliability and validity testing of available instruments, with only one of the included studies reporting psychometric properties within the patient group. Conclusions: The results demonstrate that there is a wide range of tools available for estimating premorbid intelligence in dementia, with cautious support for the potential of word reading tasks across different languages in individuals with mild dementia. However, the review highlights the urgent need for extensive assessments of the psychometric properties of these tasks in dementia. We propose that further longitudinal research and assessments of nonverbal measures are necessary to validate these instruments and enhance diagnostic procedures for people living with dementia worldwide.

Download Full-text

Reliability and validity of the mean flow index (Mx) for assessing cerebral autoregulation in humans: A systematic review of the methodology

Journal of Cerebral Blood Flow & Metabolism ◽

10.1177/0271678x211052588 ◽

2021 ◽

pp. 0271678X2110525

Author(s):

Markus Harboe Olsen ◽

Christian Gunge Riberholt ◽

Jesper Mehlsen ◽

Ronan MG Berg ◽

Kirsten Møller

Keyword(s):

Systematic Review ◽

Cerebral Autoregulation ◽

Reliability And Validity ◽

Flow Index ◽

Mean Flow ◽

Optimal Method ◽

Discriminatory Ability ◽

Wide Range ◽

Repeatability And Reproducibility ◽

The Mean

Cerebral autoregulation is a complex mechanism that serves to keep cerebral blood flow relatively constant within a wide range of cerebral perfusion pressures. The mean flow index (Mx) is one of several methods to assess dynamic cerebral autoregulation, but its reliability and validity have never been assessed systematically. The purpose of the present systematic review was to evaluate the methodology, reliability and validity of Mx. Based on 128 studies, we found inconsistency in the pre-processing of the recordings and the methods for calculation of Mx. The reliability in terms of repeatability and reproducibility ranged from poor to excellent, with optimal repeatability when comparing overlapping recordings. The discriminatory ability varied depending on the patient populations; in general, those with acute brain injury exhibited a higher Mx than healthy volunteers. The prognostic ability in terms of functional outcome and mortality ranged from chance result to moderate accuracy. Since the methodology was inconsistent between studies, resulting in varying reliability and validity estimates, the results were difficult to compare. The optimal method for deriving Mx is currently unknown.

Download Full-text

Psychometric properties of home accessibility assessment tools: A systematic review

Canadian Journal of Occupational Therapy ◽

10.1177/0008417418824731 ◽

2019 ◽

Vol 86 (3) ◽

pp. 172-184 ◽

Cited By ~ 2

Author(s):

Alexandre Patry ◽

Claude Vincent ◽

Christian Duval ◽

Emmanuelle Careau

Keyword(s):

Systematic Review ◽

Psychometric Properties ◽

Home Environment ◽

Critical Appraisal ◽

Reliability And Validity ◽

Occupational Therapists ◽

Assessment Tools ◽

Good Reliability ◽

Standardized Measures

Background. Although home environment assessments are commonly performed by occupational therapists working in home care, use of nonstandardized measures created in-house or lack of measure use can cast a shadow over the quality of these assessments for people with disabilities. To ensure quality of home environment assessments, occupational therapists need standardized measures with demonstrated psychometric properties. Purpose. This study provides a critical appraisal of objective accessibility measures of the home environment. Method. A systematic review was undertaken for which three databases—CINAHL, PubMed, and Embase—were searched to identify accessibility measures of the home environment and evaluate their psychometric properties. Two authors independently assessed the quality of selected studies using the critical appraisal form for psychometric articles. Findings. Ten studies discussing seven accessibility measures were identified and selected for this review. No measures showed strong evidence of both good reliability and validity. Only one study addressed the responsiveness of a measure of accessibility. Implications. As occupational therapists are specialists of the person–environment relationship, the lack of evidence of the psychometric properties of objective accessibility measures of the home environment harms evidence-based occupational therapy practice. This review identified the most promising assessment tools, but further research is needed.

Download Full-text

Instruments for Detecting Moral Distress in Clinical Nurses: A Systematic Review

INQUIRY The Journal of Health Care Organization Provision and Financing ◽

10.1177/0046958021996499 ◽

2021 ◽

Vol 58 ◽

pp. 004695802199649

Author(s):

Xu Tian ◽

Yanfei Jin ◽

Hui Chen ◽

María F. Jiménez-Herrera

Keyword(s):

Systematic Review ◽

Psychometric Properties ◽

Moral Distress ◽

High Reliability ◽

Intervention Strategy ◽

Reliability And Validity ◽

Essential Information ◽

Retest Reliability ◽

Clinical Nurses ◽

Test Retest Reliability

Moral distress (MD) has become a seriously negative problem experienced by healthcare professionals, especially clinical nurses. Early and accurate detection of MD by the validated and reliable instrument is critically important to further develop an effective intervention strategy. We performed the current systematic review to comprehensively summarize the evidence of instruments for the detection of MD in clinical nurses. The research design was a systematic literature review. We assigned 2 investigators to independently search potential studies in PubMed, EMBASE, and China National Knowledge Infrastructure (CNKI) from their inception to June 2020. We used data extraction table extracting essential information, and the modified critical appraisal tool evaluating the reliability and validity of eligible instruments. Finally, we qualitatively summarized results of all included instruments. No ethical approval was required because this systematic review was performed based on published studies. We included 16 eligible studies covering 10 original and 6 revised or modified instruments for the final analysis. The overall quality of all instruments was moderate because test-retest reliability was inadequately examined in most instruments. Of 16 instruments, MDS-revised (MDS-R) was broadly validated and employed in different working or cultural settings. Meanwhile, it also extensively expands to specifically detect MD. Moreover, other instruments including moral distress risk scale (MDSR) and moral distress thermometer (MDT) should be further validated and utilized because it covered the gap missed by most instruments. Although several instruments have been made available for clinical nurses, some of them have inadequate psychometric properties test, especially test-retest reliability evaluation. Meanwhile, most of them have not be validated and employed in other working or cultural settings. We therefore suggested further studies to validate the psychometric properties of existing instruments and then employed instruments with high reliability and validity to detect MD in clinical nurses.

Download Full-text

Mobile App–Based Self-Report Questionnaires for the Assessment and Monitoring of Bipolar Disorder: Systematic Review

JMIR Formative Research ◽

10.2196/13770 ◽

2021 ◽

Vol 5 (1) ◽

pp. e13770

Author(s):

Eric C Chan ◽

Yuting Sun ◽

Katherine J Aitchison ◽

Sudhakar Sivapalan

Keyword(s):

Systematic Review ◽

Bipolar Disorder ◽

Rating Scale ◽

Mobile App ◽

Self Report ◽

Healthy Controls ◽

Young Mania ◽

Good Adherence ◽

Wide Range ◽

Meta Analyses

Background Bipolar disorder is a chronic, progressive illness characterized by recurrent episodes of mania and depression. Self-report scales have historically played a significant role in the monitoring of bipolar symptoms. However, these tools rely on episodic memory, which can be unreliable and do not allow the clinician to monitor brief episodic symptoms or the course of symptoms over shorter periods of time. Mobile app–based questionnaires have been suggested as a tool to improve monitoring of patients with bipolar disorder. Objective This paper aims to determine the feasibility and validity of mobile app–based self-report questionnaires. Methods We performed a systematic review of the literature according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The PubMed, PsycInfo, Web of Science, Ovid MEDLINE, and EMBASE databases were searched for papers published in English that assessed adherence to and the validity of mobile app–based self-report questionnaires. Relevant studies published from database creation to May 22, 2020, were identified, and results examining the validity of and rates of adherence to app-based self-report questionnaires are reported. Results A total of 13 records were identified for inclusion in this review. Of these studies, 4 assessed the concurrent validity of mobile app–based self-report tools, with the majority of findings indicating significant associations between data collected using these tools and the Young Mania Rating Scale, Hamilton Depression Rating Scale-17, or Montgomery-Åsberg Depression Rating Scale (P<.001 to P=.24). Three studies comparing the variability or range of symptoms between patients with bipolar disorder and healthy controls suggested that these data are capable of differentiating between known groups. Two studies demonstrated statistically significant associations between data collected via mobile app–based self-report tools and instruments assessing other clinically important factors. Adherence rates varied across the studies examined. However, good adherence rates (>70%) were observed in all but 1 study using a once-daily assessment. There was a wide range of adherence rates observed in studies using twice-daily assessments (42%-95%). Conclusions These findings suggest that mobile app–based self-report tools are valid in the assessment of symptoms of mania and depression in euthymic patients with bipolar disorder. Data collected using these tools appear to differ between patients with bipolar disorder and healthy controls and are significantly associated with other clinically important measures. It is unclear at this time whether these tools can be used to detect acute episodes of mania or depression in patients with bipolar disorder. Adherence data indicate that patients with bipolar disorder show good adherence to self-report assessments administered daily for the duration of the study periods evaluated.

Download Full-text

Mobile App–Based Self-Report Questionnaires for the Assessment and Monitoring of Bipolar Disorder: Systematic Review (Preprint)

10.2196/preprints.13770 ◽

2019 ◽

Author(s):

Eric C Chan ◽

Yuting Sun ◽

Katherine J Aitchison ◽

Sudhakar Sivapalan

Keyword(s):

Systematic Review ◽

Bipolar Disorder ◽

Rating Scale ◽

Mobile App ◽

Self Report ◽

Healthy Controls ◽

Young Mania ◽

Good Adherence ◽

Wide Range ◽

Meta Analyses

BACKGROUND Bipolar disorder is a chronic, progressive illness characterized by recurrent episodes of mania and depression. Self-report scales have historically played a significant role in the monitoring of bipolar symptoms. However, these tools rely on episodic memory, which can be unreliable and do not allow the clinician to monitor brief episodic symptoms or the course of symptoms over shorter periods of time. Mobile app–based questionnaires have been suggested as a tool to improve monitoring of patients with bipolar disorder. OBJECTIVE This paper aims to determine the feasibility and validity of mobile app–based self-report questionnaires. METHODS We performed a systematic review of the literature according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The PubMed, PsycInfo, Web of Science, Ovid MEDLINE, and EMBASE databases were searched for papers published in English that assessed adherence to and the validity of mobile app–based self-report questionnaires. Relevant studies published from database creation to May 22, 2020, were identified, and results examining the validity of and rates of adherence to app-based self-report questionnaires are reported. RESULTS A total of 13 records were identified for inclusion in this review. Of these studies, 4 assessed the concurrent validity of mobile app–based self-report tools, with the majority of findings indicating significant associations between data collected using these tools and the Young Mania Rating Scale, Hamilton Depression Rating Scale-17, or Montgomery-Åsberg Depression Rating Scale (<i>P</i><.001 to <i>P</i>=.24). Three studies comparing the variability or range of symptoms between patients with bipolar disorder and healthy controls suggested that these data are capable of differentiating between known groups. Two studies demonstrated statistically significant associations between data collected via mobile app–based self-report tools and instruments assessing other clinically important factors. Adherence rates varied across the studies examined. However, good adherence rates (>70%) were observed in all but 1 study using a once-daily assessment. There was a wide range of adherence rates observed in studies using twice-daily assessments (42%-95%). CONCLUSIONS These findings suggest that mobile app–based self-report tools are valid in the assessment of symptoms of mania and depression in euthymic patients with bipolar disorder. Data collected using these tools appear to differ between patients with bipolar disorder and healthy controls and are significantly associated with other clinically important measures. It is unclear at this time whether these tools can be used to detect acute episodes of mania or depression in patients with bipolar disorder. Adherence data indicate that patients with bipolar disorder show good adherence to self-report assessments administered daily for the duration of the study periods evaluated.

Download Full-text

Psychometric Properties of the iHandy Level Smartphone Application for Measuring Lumbar Spine Range of Motion and Lordosis: A Systematic Review of the Literature

Journal of Sport Rehabilitation ◽

10.1123/jsr.2018-0354 ◽

2020 ◽

Vol 29 (3) ◽

pp. 352-359

Author(s):

Mohammadreza Pourahmadi ◽

Hamid Hesarikia ◽

Ali Ghanjal ◽

Alireza Shamsoddini

Keyword(s):

Systematic Review ◽

Lumbar Spine ◽

Psychometric Properties ◽

Range Of Motion ◽

Correlation Coefficient ◽

Intraclass Correlation Coefficient ◽

Intraclass Correlation ◽

Wide Range ◽

Flexion Extension ◽

Asymptomatic Subjects

Context: Advent of smartphones has brought a wide range of clinical measurement applications (apps) within the reach of most clinicians. The vast majority of smartphones have numerous built-in sensors such as magnetometers, accelerometers, and gyroscopes that make the phone capable of measuring joint range of motion (ROM) and detecting joint positions. The iHandy Level app is a free app which has a visual display alike with the digital inclinometer in regard to numeric size. Objective: The purpose of this systematic review was to evaluate available evidence in the literature to assess the psychometric properties (ie, reliability and validity) of the iHandy Level app in measuring lumbar spine ROM and lordosis. Methods: PubMed/MEDLINE, Scopus, Ovid, Google Scholar, and ScienceDirect were searched from inception to September 2018 for single-group repeated-measures studies reporting outcomes of lumbar spine ROM or lordosis in adult individuals without symptoms of low back pain (LBP) or patients with LBP. The quality of each included study was assessed using the Quality Appraisal of Reliability Studies checklist. Results: A total of 4 studies with 273 participants were included. Two studies focused on measuring active lumbar spine ROM, and 2 studies evaluated lumbar spine lordosis. Three studies included asymptomatic subjects, and one study recruited patients with LBP. The results showed that the iHandy Level app has sufficient psychometric properties for measuring standing thoraco-lumbo-sacral flexion, extension, lateral flexion, isolated lumbar spine flexion ROM, and lumbar spine lordosis in asymptomatic subjects. One study reported poor concurrent validity with a bubble inclinometer (r = .19–.53), poor intrarater reliability (intraclass correlation coefficient = .19–.39), and poor to good interrater reliability (intraclass correlation coefficient = .24–.72) for the measurement of active lumbar spine ROM using the iHandy Level app in patients with LBP. Conclusions: This review provided a valuable summary of the research to date examining the psychometric properties of the iHandy Level app for measuring lumbar spine ROM and lordosis.

Download Full-text

Psychometric properties of the EQ-5D-5L: a systematic review of the literature

Quality of Life Research ◽

10.1007/s11136-020-02688-y ◽

2020 ◽

Author(s):

You-Shan Feng ◽

Thomas Kohlmann ◽

Mathieu F. Janssen ◽

Ines Buchholz

Keyword(s):

Systematic Review ◽

Psychometric Properties ◽

Convergent Validity ◽

Missing Values ◽

Scientific Evidence ◽

Correlation Coefficients ◽

Functional Health ◽

Extensive Experience ◽

Random Effects Models ◽

Wide Range

Abstract Purpose Although the EQ-5D has a long history of use in a wide range of populations, the newer five-level version (EQ-5D-5L) has not yet had such extensive experience. This systematic review summarizes the available published scientific evidence on the psychometric properties of the EQ-5D-5L. Methods Pre-determined key words and exclusion criteria were used to systematically search publications from 2011 to 2019. Information on study characteristics and psychometric properties were extracted: specifically, EQ-5D-5L distribution (including ceiling and floor), missing values, reliability (test–retest), validity (convergent, known-groups, discriminate) and responsiveness (distribution, anchor-based). EQ-5D-5L index value means, ceiling and correlation coefficients (convergent validity) were pooled across the studies using random-effects models. Results Of the 889 identified publications, 99 were included for review, representing 32 countries. Musculoskeletal/orthopedic problems and cancer (n = 8 each) were most often studied. Most papers found missing values (17 of 17 papers) and floor effects (43 of 48 papers) to be unproblematic. While the index was found to be reliable (9 of 9 papers), individual dimensions exhibited instability over time. Index values and dimensions demonstrated moderate to strong correlations with global health measures, other multi-attribute utility instruments, physical/functional health, pain, activities of daily living, and clinical/biological measures. The instrument was not correlated with life satisfaction and cognition/communication measures. Responsiveness was addressed by 15 studies, finding moderate effect sizes when confined to studied subgroups with improvements in health. Conclusions The EQ-5D-5L exhibits excellent psychometric properties across a broad range of populations, conditions and settings. Rigorous exploration of its responsiveness is needed.

Download Full-text

Systematic review of instruments for assessing culinary skills in adults: What is the quality of their psychometric properties?

PLoS ONE ◽

10.1371/journal.pone.0235182 ◽

2021 ◽

Vol 16 (8) ◽

pp. e0235182

Author(s):

Aline Rissatto Teixeira ◽

Daniela Bicalho ◽

Betzabeth Slater ◽

Tacio de Mendonça Lima

Keyword(s):

Systematic Review ◽

Psychometric Properties ◽

Data Extraction ◽

Adult Population ◽

Grey Literature ◽

Reliability And Validity ◽

Internal Consistency Reliability ◽

Validity And Reliability ◽

Ongoing Research

Background Culinary skills are important objects of study in the field of Public Health. Studies that propose to develop instruments for assessing such construct show lack of methodological uniformity to report validity and reliability of their instruments. Objective To identify studies that have developed instruments to measure culinary skills in adult population, and critically assess their psychometric properties. Design We conducted a systematic review according to the PRISMA statement. We searched literature PubMed/Medline, Scopus, LILACS, and Web of Science databases until January 2021, and consulted Google Scholar for relevant grey literature. Two reviewers independently selected the studies, conducted data extraction, and assessed the psychometric quality of the instruments. A third reviewer resolved any doubts or disagreements in all steps of the systematic review. Results The search identified 1148 potentially relevant studies, out of which 9 met the inclusion criteria. In addition, we included 3 studies by searching the related articles and the reference lists of these studies, totaling 12 included studies in this review. Ten studies reported the development of tools measuring culinary skills in adults and 2 studies performed cross-cultural adaptations of original instruments. We considered adequate quality of internal consistency reliability in four studies. One study received adequate rating for test-retest reliability. No studies presented adequate rating for content validity and four studies showed satisfactory results for at least one type of construct validity. One study reported criterion validity and the quality of this psychometric property was inadequate. Conclusions We identified many studies that surveyed culinary skills. Although the isolated measures appraised in this review show good promise in terms of quality of psychometric properties, no studies presented adequate measures for each aspect of reliability and validity. A more consistent and consensual definition of culinary skills is recommended. The flaws observed in these studies show that there is a need for ongoing research in the area of the psychometric properties of instruments assessing culinary skills.

Download Full-text

Self-Reported Stress and Questionnaires in People With Autism Spectrum Disorder: a Systematic Review

10.1101/2021.02.27.21252281 ◽

2021 ◽

Author(s):

Anoushka Thoen ◽

Jean Steyaert ◽

Kaat Alaerts ◽

Kris Evers ◽

Tine Van Damme

Keyword(s):

Systematic Review ◽

Autism Spectrum Disorder ◽

Psychometric Properties ◽

Reliability And Validity ◽

Autism Spectrum ◽

Spectrum Disorder ◽

Self Report ◽

Online Databases ◽

Experience Of Stress ◽

Insight Into

AbstractBackgroundTo gain more insight into the experience of stress in individuals with ASD, it is important to use appropriate self-report questionnaires. The goal of this systematic review was to provide an overview of these.MethodThe PRISMA guidelines were followed and four online databases were systematically searched.ResultsSeven questionnaires have been used previously in individuals with ASD. None of the 22 included studies intended to assess the psychometric properties, leading towards scarce evidence concerning their reliability and validity in this population.ConclusionsIt is important to consider which concept of stress one aims to measure as not all questionnaires cover the same aspects of stress. Further research concerning psychometric properties of the questionnaires in this population is required.

Download Full-text

Clausal Density Between Ages 4 and 9 Years for the Edmonton Narrative Norms Instrument: Reference Data and Psychometric Properties

Language Speech and Hearing Services in Schools ◽

10.1044/2020_lshss-20-00043 ◽

2020 ◽

pp. 1-15

Author(s):

Ling-Yu Guo ◽

Phyllis Schneider ◽

William Harrison

Keyword(s):

Diagnostic Accuracy ◽

Psychometric Properties ◽

Language Impairment ◽

Reference Data ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Criterion Validity ◽

Likelihood Ratios ◽

Generation Task ◽

Sensitivity Specificity

Purpose This study provided reference data and examined psychometric properties for clausal density (CD; i.e., number of clauses per utterance) in children between ages 4 and 9 years from the database of the Edmonton Narrative Norms Instrument (ENNI). Method Participants in the ENNI database included 300 children with typical language (TL) and 77 children with language impairment (LI) between the ages of 4;0 (years;months) and 9;11. Narrative samples were collected using a story generation task, in which children were asked to tell stories based on six picture sequences. CD was computed from the narrative samples. The split-half reliability, concurrent criterion validity, and diagnostic accuracy were evaluated for CD by age. Results CD scores increased significantly between ages 4 and 9 years in children with TL and those with LI. Children with TL produced higher CD scores than those with LI at each age level. In addition, the correlation coefficients for the split-half reliability and concurrent criterion validity of CD scores were all significant at each age level, with the magnitude ranging from small to large. The diagnostic accuracy of CD scores, as revealed by sensitivity, specificity, and likelihood ratios, was poor. Conclusions The finding on diagnostic accuracy did not support the use of CD for identifying children with LI between ages 4 and 9 years. However, given the attested reliability and validity for CD, reference data of CD from the ENNI database can be used for evaluating children's difficulties with complex syntax and monitoring their change over time. Supplemental Material https://doi.org/10.23641/asha.13172129

Download Full-text