Validity and Reliability of Tablet PC-Based Cognitive Assessment Tools for Stroke Patients

Objectives To determine the validity and reliability of a Latvian version of the National Institutes of Health Stroke Scale (LV-NIHSS) for evaluating Latvian stroke patients. Methods The adaption of the LV-NIHSS followed standard methods used for the adaption and validation of clinical assessment tools. The scale validity was tested by comparison with the Glasgow Coma Scale (GCS) and the modified Rankin scale (mRs). The reliability of the LV-NIHSS was evaluated by intra-rater and inter-rater agreement using intra-class correlation coefficient (ICC) analysis. Results A total of 296 stroke patients and 101 control subjects were evaluated. The mean age of the overall study population was 73.6 years (range, 37 – 94 years; 227 [57.2%] were female). The mean LV-NIHSS score of the patients with stroke was 8.4 ± 6.2. In terms of construct validity of the LV-NIHSS, it correlated with the GCS ( r = −0.571) and mRs ( r = 0.755). In terms of the reliability of the LV-NIHSS, the inter-rater agreement had an ICC of 0.99 and the intra-rater agreement had an ICC of 0.99. Conclusion The adaption of LV-NIHSS was successful and the evaluation showed that the scale was valid and reliable for evaluating Latvian stroke patients.

Download Full-text

The reliability and validity of the informant AD8 by comparison with a series of cognitive assessment tools in primary healthcare

International Psychogeriatrics ◽

10.1017/s1041610215001702 ◽

2015 ◽

Vol 28 (3) ◽

pp. 443-452 ◽

Cited By ~ 12

Author(s):

Muhammad Amin Shaik ◽

Xin Xu ◽

Qun Lin Chan ◽

Richard Jor Yeong Hui ◽

Steven Shih Tsze Chong ◽

...

Keyword(s):

Construct Validity ◽

Primary Healthcare ◽

Cognitive Assessment ◽

Convergent Validity ◽

Intraclass Correlation ◽

Assessment Tools ◽

Validity And Reliability ◽

Neuropsychological Battery ◽

Clinical Dementia Rating ◽

Primary Healthcare Centers

ABSTRACTBackground:The validity and reliability of the informant AD8 in primary healthcare has not been established. Therefore, the present study examined the validity and reliability of the informant AD8 in government subsidized primary healthcare centers in Singapore.Methods:Eligible patients (≥60 years old) were recruited from primary healthcare centers and their informants received the AD8. Patient-informant dyads who agreed for further cognitive assessments received the Mini-Mental State Examination (MMSE), Montreal Cognitive Assessment (MoCA), Clinical Dementia Rating (CDR), and a locally validated formal neuropsychological battery at a research center in a tertiary hospital.Results:1,082 informants completed AD8 assessment at two primary healthcare centers. Of these, 309 patients-informant dyads were further assessed, of whom 243 (78.6%) were CDR = 0; 22 (7.1%) were CDR = 0.5; and 44 (14.2%) were CDR≥1. The mean administration time of the informant AD8 was 2.3 ± 1.0 minutes. The informant AD8 demonstrated good internal consistency (Cronbach'sα= 0.85); inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.85); and test–retest reliability (weightedκ= 0.80). Concurrent validity, as measured by the correlation between total AD8 scores and CDR global (R= 0.65,p <0.001), CDR sum of boxes (R= 0.60,p< 0.001), MMSE (R= −0.39,p< 0.001), MoCA (R= −0.41,p< 0.001), as well as the formal neuropsychological battery (R= −0.46,p <0.001), was good and consistent with previous studies. Construct validity, as measured by convergent validity (R≥ 0.4) between individual items of AD8 with CDR and neuropsychological domains was acceptable.Conclusions:The informant AD8 demonstrated good concurrent and construct validity and is a reliable measure to detect cognitive dysfunction in primary healthcare.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Prevalence and risk factors of delirium and subsyndromal delirium in older adults

The Egyptian Journal of Internal Medicine ◽

10.1186/s43162-021-00042-3 ◽

2021 ◽

Vol 33 (1) ◽

Author(s):

Maha Hosam El-Din Ibrahim ◽

Manal Elmasry ◽

Fady Nagy ◽

Ahmed Abdelghani

Keyword(s):

Risk Factors ◽

Older Adults ◽

Functional Ability ◽

Cognitive Assessment ◽

Length Of Hospital Stay ◽

Assessment Method ◽

Assessment Tools ◽

Subsyndromal Delirium ◽

Confusion Assessment ◽

Definition Of

Abstract Background Delirium is a common geriatric problem associated with poor outcomes. Subsyndromal delirium (SSD) is characterized by the presence of certain symptoms of delirium yet, not satisfying the definition of full-blown delirium, defined by categorical elements, and is usually referred to as the presence of one or more symptoms in the confusion assessment method (CAM). This study aimed to investigate the prevalence and risk factors of delirium and SSD in older adults admitted to the hospital. Five hundred eighty-eight elderly (above 65 years) Egyptian patients were recruited from January 2019 to February 2020. After explaining the purpose of the study and assuring the confidentiality of all participants, an informed consent was obtained from the participant or a responsible care giver for those who were not able to give consent. All patients were subjected ‘on admission’ to thorough history taking, clinical examination, and comprehensive geriatric assessment including confusion assessment tools, mini-mental state examination, and functional assessment using Barthel index score. Results The current study showed that 19.6% of patients had delirium and 14.1% of patients had SSD with combined prevalence of 33.7%. Most common causes included metabolic, infection, organic brain syndrome, and dehydration. The current study reported significant proportionate relation between cognitive assessment and functional ability, so patients with a score of 23 MMSE had good functional ability, while cognitive assessment using mini-mental score shows inversed relation to delirium and SSD using CAM score. Conclusion Delirium is independently associated with adverse short-term and long-term outcomes, including an increase in mortality, length of hospital stay, discharge to an institution, and functional decline on discharge. Subsyndromal delirium (SSD) is characterized by the presence of certain symptoms of delirium, not yet satisfying the definition of full-blown delirium but it can identify patients with early cognitive and functional disabilities, and because of high prevalence of delirium and SSD. Efforts to prevent or early detection may identify patients who warrant clinical attention.

Download Full-text

Digital Competence Assessment Methods in Higher Education: A Systematic Literature Review

Education Sciences ◽

10.3390/educsci11080402 ◽

2021 ◽

Vol 11 (8) ◽

pp. 402

Author(s):

Linda Helene Sillat ◽

Kairit Tammets ◽

Mart Laanpere

Keyword(s):

Higher Education ◽

Literature Review ◽

Systematic Literature Review ◽

Reliability And Validity ◽

Assessment Tools ◽

Competence Assessment ◽

Validity And Reliability ◽

Digital Competence ◽

Need To Evaluate ◽

Assessment In Higher Education

The rapid increase in recent years in the number of different digital competency frameworks, models, and strategies has prompted an increasing popularity for making the argument in favor of the need to evaluate and assess digital competence. To support the process of digital competence assessment, it is consequently necessary to understand the different approaches and methods. This paper carries out a systematic literature review and includes an analysis of the existing proposals and conceptions of digital competence assessment processes and methods in higher education, with the aim of better understanding the field of research. The review follows three objectives: (i) describe the characteristics of digital competence assessment processes and methods in higher education; (ii) provide an overview of current trends; and, finally, (iii) identify challenges and issues in digital competence assessment in higher education with a focus on the reliability and validity of the proposed methods. On the basis of the findings, and as a result of the COVID-19 pandemic, digital competence assessment in higher education requires more attention, with a specific focus on instrument validity and reliability. Furthermore, it will be of great importance to further investigate the use of assessment tools to support systematic digital competence assessment processes. The analysis includes possible opportunities and ideas for future lines of work in digital competence evaluation in higher education.

Download Full-text

Validity and Reliability of Cognitive Assessment Using Virtual Environment Technology in Patients with Stroke

American Journal of Physical Medicine & Rehabilitation ◽

10.1097/phm.0b013e3181aa427d ◽

2009 ◽

Vol 88 (9) ◽

pp. 702-710 ◽

Cited By ~ 8

Author(s):

Jeonghun Ku ◽

Jang Han Lee ◽

Kiwan Han ◽

Sun I. Kim ◽

Youn Joo Kang ◽

...

Keyword(s):

Virtual Environment ◽

Cognitive Assessment ◽

Validity And Reliability

Download Full-text

Screening tools for the identification of dementia for adults with age-related acquired hearing or vision impairment: a scoping review

International Psychogeriatrics ◽

10.1017/s104161021700120x ◽

2017 ◽

Vol 29 (11) ◽

pp. 1771-1784 ◽

Cited By ~ 20

Author(s):

Annie Pye ◽

Anna Pavlina Charalambous ◽

Iracema Leroi ◽

Chrysoulla Thodi ◽

Piers Dawes

Keyword(s):

Hearing Impairment ◽

Cognitive Assessment ◽

Negative Impact ◽

Sensory Modality ◽

Vision Impairment ◽

Assessment Tools ◽

Screening Tools ◽

Screening Tests ◽

Cognitive Screening ◽

Age Related

ABSTRACTBackground:Cognitive screening tests frequently rely on items being correctly heard or seen. We aimed to identify, describe, and evaluate the adaptation, validity, and availability of cognitive screening and assessment tools for dementia which have been developed or adapted for adults with acquired hearing and/or vision impairment.Method:Electronic databases were searched using subject terms “hearing disorders” OR “vision disorders” AND “cognitive assessment,” supplemented by exploring reference lists of included papers and via consultation with health professionals to identify additional literature.Results:1,551 papers were identified, of which 13 met inclusion criteria. Four papers related to tests adapted for hearing impairment; 11 papers related to tests adapted for vision impairment. Frequently adapted tests were the Mini-Mental State Examination (MMSE) and the Montreal Cognitive Assessment (MOCA). Adaptations for hearing impairment involved deleting or creating written versions for hearing-dependent items. Adaptations for vision impairment involved deleting vision-dependent items or spoken/tactile versions of visual tasks. No study reported validity of the test in relation to detection of dementia in people with hearing/vision impairment. Item deletion had a negative impact on the psychometric properties of the test.Conclusions:While attempts have been made to adapt cognitive tests for people with acquired hearing and/or vision impairment, the primary limitation of these adaptations is that their validity in accurately detecting dementia among those with acquired hearing or vision impairment is yet to be established. It is likely that the sensitivity and specificity of the adapted versions are poorer than the original, especially if the adaptation involved item deletion. One solution would involve item substitution in an alternative sensory modality followed by re-validation of the adapted test.

Download Full-text

A Framework for (Tele-) Monitoring of the Rehabilitation Progress in Stroke Patients

Applied Clinical Informatics ◽

10.4338/aci-2015-03-ra-0034 ◽

2015 ◽

Vol 06 (04) ◽

pp. 757-768 ◽

Cited By ~ 8

Author(s):

V. David ◽

M. Haller ◽

S. Kotzian ◽

M. Hofmann ◽

S. Schlossarek ◽

...

Keyword(s):

Automated Analysis ◽

Web Interface ◽

Tablet Pc ◽

Monitoring Tool ◽

Stroke Patients ◽

Assessment Tests ◽

Movement Data ◽

Automated Evaluation ◽

Independent Life ◽

Tele Monitoring

SummaryBackground: Preservation of mobility in conjunction with an independent life style is one of the major goals of rehabilitation after stroke.Objectives: The Rehab@Home framework shall support the continuation of rehabilitation at home.Methods: The framework consists of instrumented insoles, connected wirelessly to a 3G ready tablet PC, a server, and a web-interface for medical experts. The rehabilitation progress is estimated via automated analysis of movement data from standardized assessment tests which are designed according to the needs of stroke patients and executed via the tablet PC application.Results: The Rehab@Home framework’s implementation is finished and ready for the field trial (at five patients’ homes). Initial testing of the automated evaluation of the standardized mobility tests shows reproducible results.Conclusions: Therefore it is assumed that the Rehab@Home framework is applicable as monitoring tool for the gait rehabilitation progress in stroke patients.

Download Full-text

Development and Evaluation of an Android-based Platform for Early MCI Detection in an Elderly Population

10.1101/2020.03.16.20037028 ◽

2020 ◽

Author(s):

Mahsa Roozrokh Arshadi Montazer ◽

Roohollah Zahediannasb ◽

Roxana Sharifian ◽

Mahshid Tahamtan ◽

Mahdi Nasiri ◽

...

Keyword(s):

Cognitive Assessment ◽

Convergent Validity ◽

Pearson Correlation ◽

Psychometric Evaluation ◽

Intermediate Stage ◽

The Elderly ◽

Assessment Tools ◽

Face Validity ◽

Elderly Subjects ◽

System Usability Scale

AbstractBackgroundMild cognitive impairment (MCI) is an intermediate stage of cognitive decline fitting in-between normal cognition and dementia. With the growing aging population, this study aimed to develop and psychometrically validate an android-based application for early MCI detection in elderly subjects.MethodThis study was conducted in two phases, including 1-Initial design and prototyping of the application named M-Check, 2-psychometric evaluation. After the design and development of the M-Check app, it was evaluated by experts and elderly subjects. Face validity was determined by two checklists provided to the expert panel and the elderly subjects. Convergent validity of the M-Check app was assessed using the Montreal Cognitive Assessment (MoCA) battery through Pearson correlation. Test-retest and internal consistency and reliability were evaluated using Intra-Class Correlation (ICC) and Kuder-Richardson coefficients, respectively. In addition, the usability was assessed by a System Usability Scale (SUS) questionnaire. SPSS 16.0 was employed to analyze the data.ResultThe app’s usability assessment by elderlies and experts scored 77.11 and 82.5, respectively. Also, the correlation showed that the M-Check app was negatively correlated with the MoCA test (r = -0.71, p <0.005), and the ICC was more than 0.7. Moreover, the Richardson’s Coder coefficient was 0.82, corresponding to an acceptable reliability.ConclusionIn this study, we validated the M-Check app for the detection of MCI based on the growing need for cognitive assessment tools that can identify early decline. Such screeners are expected to take much shorter time than typical neuropsychological batteries do. Additional work are yet to be underway to ensure that M-Check is ready to launch and used without the presence of a trained person.

Download Full-text

Flexibility during the COVID-19 Pandemic Response: Healthcare Facility Assessment Tools for Resilient Evaluation

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182111478 ◽

2021 ◽

Vol 18 (21) ◽

pp. 11478

Author(s):

Andrea Brambilla ◽

Tian-zhi Sun ◽

Waleed Elshazly ◽

Ahmed Ghazy ◽

Paul Barach ◽

...

Keyword(s):

Case Studies ◽

Assessment Tool ◽

Healthcare Facility ◽

Health Impact ◽

Design Guidelines ◽

Assessment Tools ◽

Validity And Reliability ◽

Evaluation Tool ◽

Healthcare Operations ◽

Healthcare Facilities

Healthcare facilities are facing huge challenges due to the outbreak of COVID-19. Around the world, national healthcare contingency plans have struggled to cope with the population health impact of COVID-19, with healthcare facilities and critical care systems buckling under the extraordinary pressures. COVID-19 has starkly highlighted the lack of reliable operational tools for assessing the level sof flexibility of a hospital building to support strategic and agile decision making. The aim of this study was to modify, improve and test an existing assessment tool for evaluating hospital facilities flexibility and resilience. We followed a five-step process for collecting data by (i) doing a literature review about flexibility principles and strategies, (ii) reviewing healthcare design guidelines, (iii) examining international healthcare facilities case studies, (iv) conducting a critical review and optimization of the existing tool, and (v) assessing the usability of the evaluation tool. The new version of the OFAT framework (Optimized Flexibility Assessment Tool) is composed of nine evaluation parameters and subdivided into measurable variables with scores ranging from 0 to 10. The pilot testing of case studies enabled the assessment and verification the OFAT validity and reliability in support of decision makers in addressing flexibility of hospital design and/or operations. Healthcare buildings need to be designed and built based on principles of flexibility to accommodate current healthcare operations, adapting to time-sensitive physical transformations and responding to contemporary and future public health emergencies.

Download Full-text