Development of an iPad-based assessment tool for measuring attention and validation in older employees

Work ◽  
2020 ◽  
Vol 67 (4) ◽  
pp. 811-815
Author(s):  
Yi-Nuo Shih ◽  
Jia-Lien Hsu ◽  
Chia-Chun Wu ◽  
Jia-Hui Hsiao
Keyword(s):  
Elderly Population ◽  
Assessment Tool ◽  
The Elderly ◽  
Auditory Attention ◽  
Research Project ◽  
Retest Reliability ◽  
Older Employees ◽  
Medium Interface ◽  
Test Retest Reliability ◽  
Voluntary Basis

BACKGROUND: In recent years, the elderly population has increasingly worked in various workplaces. Hence, measurements to assess the work attention of the elderly has become an important need. OBJECTIVES: The aims of this research project are to develop an iPad-based attention assessment tool, “Shih-Hsu Test of Attention” (SHTA) for work attention, that adopts touchscreen as the medium interface, and to explore criterion-related validity and test-retest reliability of this new attention assessment tool for elders. METHODS: Thirty-one participants aged between 65–85 years were recruited in this study on a voluntary basis. Each participant was assessed two times. The participants completed both the SHTA and Chu’s Attention Test (CAT), and the SHTA was used to test participants after three weeks. RESULTS: The analytical results demonstrate that the SHTA has acceptable criterion-related validity (γ= 0.400, p < 0.05*) and test-retest reliability (ICC = 0.920, p < 0.01**). CONCLUSIONS: Our preliminary findings show that the iPad-based auditory attention assessment tool, SHTA, has satisfactory criterion-related validity and test-retest reliability, which supports the use of SHTA as an attention assessment tool for older employees.

Validatie van de EAT-10 in het Nederlands ter screening van orofaryngeale dysfagie in een oudere populatie

2019 ◽  
Keyword(s):  
Internal Consistency ◽  
Elderly Population ◽  
Assessment Tool ◽  
Oropharyngeal Dysphagia ◽  
The Elderly ◽  
Clinical Environment ◽  
Good Internal Consistency ◽  
Test Retest Reliability ◽  
Symptoms And Signs

The prevalence of oropharyngeal dysphagia (OD) in the elderly population >76y is estimated at 26%. OD can lead to malnutrition, depression, diminished quality of life and increased mortality in the elderly. Despite these important complications, OD is still underdiagnosed due to a lack of a reliable and easily applicable screening tool. The Eating Assessment Tool-10 (EAT-10) questionnaire consists of ten statements about symptoms and signs of OD. In the current literature, a cut-off value of ≥3 points is preferred to be considered as in risk for OD. The EAT-10 questionnaire shows good internal consistency and reliability and is validated in different languages with comparable results. The purpose of this study is to validate the EAT-10 questionnaire in Dutch. The results show a strong test-retest reliability (Spearman's rho 0.841) and an internal consistency of 0.917 via Cronbach's alpha. The Dutch EAT-10 questionnaire is well applicable in a clinical environment with a mean duration of 2 minutes and 28 seconds (± 1 minute and 32 seconds) to complete the test. Validation of the Dutch EAT-10 questionnaire makes screening of OD in the Dutch (elderly) population possible.

Test–retest reliability and criterion-related validity of Shih–Hsu test of attention between people with and without schizophrenia

2021 ◽  
pp. 030802262199177
Author(s):  
Yi-Nuo Shih ◽  
Jia-Lien Hsu ◽  
Yi-Ching Wang ◽  
Chia-Chun Wu ◽  
Yin-huang Liao
Keyword(s):  
Mental Illness ◽  
Assessment Tool ◽  
Occupational Therapists ◽  
Future Application ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Voluntary Basis ◽  
Preliminary Application ◽  
High Test

Introduction The “Shih–Hsu Test of Attention” (SHTA) is an iPad-based attention assessment tool developed in recent years by occupational therapists and has acceptable criterion-related validity and high test–retest reliability in preliminary application. This research project explores the criterion-related validity and test–retest reliability of SHTA between people with and without schizophrenia. Method The participants were 76 adults with schizophrenia aged 20–64 years, and 66 adults without diagnosed mental illness aged 20–64 years were recruited in this study on a voluntary basis. Each participant was assessed twice. The participants completed both the SHTA and Chu’s Attention Test (CAT) in the first test and the SHTA after 3 weeks. Findings Analytical results indicate that the SHTA has satisfactory test–retest reliability (ICC = 0.67) and criterion-related validity (γ = 0.29, p < 0.05*) for adults with schizophrenia and has high test–retest reliability (ICC = 0.90) and criterion-related validity (γ = 0.25, p < 0.05*) for adults without diagnosed mental illness. The MDC% value for the subjects without diagnosed mental illness was 12.1%, indicating acceptable random measurement error. Conclusion Our preliminary findings show that the iPad-based attention assessment tool, SHTA, has satisfactory criterion-related validity and test–retest reliability, supporting the future application of SHTA as an attention assessment tool.

Measuring “Language Access Profiles” in Deaf and Hard-of-Hearing Children With the DHH Language Exposure Assessment Tool

2020 ◽  
pp. 1-25
Author(s):  
Matthew L. Hall ◽  
Stephanie De Anda
Keyword(s):  
Cluster Analysis ◽  
Exposure Assessment ◽  
Hard Of Hearing ◽  
Assessment Tool ◽  
Communication Mode ◽  
Developmental Potential ◽  
Language Access ◽  
Retest Reliability ◽  
Language Exposure ◽  
Test Retest Reliability

Purpose The purposes of this study were (a) to introduce “language access profiles” as a viable alternative construct to “communication mode” for describing experience with language input during early childhood for deaf and hard-of-hearing (DHH) children; (b) to describe the development of a new tool for measuring DHH children's language access profiles during infancy and toddlerhood; and (c) to evaluate the novelty, reliability, and validity of this tool. Method We adapted an existing retrospective parent report measure of early language experience (the Language Exposure Assessment Tool) to make it suitable for use with DHH populations. We administered the adapted instrument (DHH Language Exposure Assessment Tool [D-LEAT]) to the caregivers of 105 DHH children aged 12 years and younger. To measure convergent validity, we also administered another novel instrument: the Language Access Profile Tool. To measure test–retest reliability, half of the participants were interviewed again after 1 month. We identified groups of children with similar language access profiles by using hierarchical cluster analysis. Results The D-LEAT revealed DHH children's diverse experiences with access to language during infancy and toddlerhood. Cluster analysis groupings were markedly different from those derived from more traditional grouping rules (e.g., communication modes). Test–retest reliability was good, especially for the same-interviewer condition. Content, convergent, and face validity were strong. Conclusions To optimize DHH children's developmental potential, stakeholders who work at the individual and population levels would benefit from replacing communication mode with language access profiles. The D-LEAT is the first tool that aims to measure this novel construct. Despite limitations that future work aims to address, the present results demonstrate that the D-LEAT represents progress over the status quo.

Validity and Reliability of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE)

GeroPsych ◽  
2019 ◽  
Vol 32 (3) ◽  
pp. 145-151
Author(s):  
Mahshid Foroughan ◽  
Zahra Jafari ◽  
Ida Ghaemmagham Farahani ◽  
Vahid Rashedi
Keyword(s):  
Psychometric Properties ◽  
Elderly Population ◽  
Formal Education ◽  
The Elderly ◽  
Cognitive State ◽  
Validity And Reliability ◽  
Internal Reliability ◽  
Dsm Iv ◽  
Test Retest Reliability ◽  
Farsi Version

Abstract. This study examines the psychometric properties of the IQCODE and its applicability in the Iranian elderly population. A group of 95 elderly patients with at least 4 years of formal education who fulfilled the criteria of DSM-IV-TR for dementia were examined by the MMSE and the AMTs. The Farsi version of the IQCODE was subsequently administered to their primary caregivers. Results showed a significant correlation ( p = .01) between the score of the questionnaire and the results of the MMSE ( r = −0.647) and AMTs ( r = −0.641). A high internal reliability of the questionnaire was confirmed by Cronbach’s alpha coefficient (α = 0.927) and test-retest reliability by correlation coefficient ( r = 0.81). This study found that the IQCODE has acceptable psychometric properties and can be used for evaluating the cognitive state in the elderly population of Iran.

scholarly journals The Development and Psychometric Validation of the Diabetes Impact and Device Satisfaction Scale for Individuals with Type 1 Diabetes

2020 ◽  
Vol 14 (2) ◽  
pp. 309-317
Author(s):  
Michelle L. Manning ◽  
Harsimran Singh ◽  
Keaton Stoner ◽  
Steph Habif
Keyword(s):  
Type 1 Diabetes ◽  
Assessment Tool ◽  
Rapid Development ◽  
Insulin Delivery ◽  
Psychometric Validation ◽  
Specific Information ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Post Assessment

Background: With the rapid development of new insulin delivery technology, measuring patient experience has become especially pertinent. The current study reports on item development, psychometric validation, and intended use of the newly developed Diabetes Impact and Device Satisfaction (DIDS) Scale. Method: The DIDS Scale was informed by a comprehensive literature review, and field tested as part of two focus groups. The finalized measure was used at baseline and 6 months post-assessment with a large US cohort. Exploratory factor analyses (EFAs) were conducted to determine and confirm factor structure and item selection. Internal reliability, test–retest reliability, and convergent/divergent validity of the emerged factors were tested with demographics, diabetes-specific information, and diabetes behavioral and satisfaction measures. Results: In all, 778 participants with type 1 diabetes (66% female, mean age 47.13 ± 17.76 years, 74% insulin pump users) completed surveys at both baseline and post-assessment. EFA highlighted two factors—Device Satisfaction (seven items, Cronbach’s α = 0.85-0.90) and Diabetes Impact (four items, Cronbach’s α = 0.71-0.75). DIDS Scale demonstrated good concurrent validity and test–retest reliability. Conclusion: The DIDS Scale is a novel and a brief assessment tool with robust psychometric properties. It is recommended for use across all insulin delivery devices and is considered appropriate for use in longitudinal studies. Future studies are recommended to evaluate the performance of DIDS Scale in diverse populations with diabetes.

A Novel Tool for the Assessment of Sport Climbers’ Movement Performance

2020 ◽  
Vol 15 (6) ◽  
pp. 795-800 ◽  
Author(s):  
Nicola Taylor ◽  
David Giles ◽  
Micha Panáčková ◽  
James Mitchell ◽  
Joel Chidley ◽  
...  
Keyword(s):  
Performance Assessment ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Consultation Process ◽  
Retest Reliability ◽  
Performance Factors ◽  
Sport Climbing ◽  
Movement Performance ◽  
Test Retest Reliability

Purpose: To assess the validity and reliability of a novel movement-performance assessment tool for climbing/sport climbing. Methods: First, salient climbing movement-performance factors were identified through an iterative consultation process with 10 expert climbing coaches; the resulting Climber’s Movement Performance Assessment Tool (CM-PAT) contained 14 items in 5 categories. Second, 61 intermediate to advanced climbers ascended a single route, which was video recorded. Subsequently, 4 experienced (>10 y coaching) coaches used the CM-PAT to observe and score the climbers’ performance. Interrater reliability and comparisons with existing measures of climbing performance (6-mo self-reported ability, success and failure, climbing pace [m·min−1], and geometric entropy) were made. Results: Intraclass correlation coefficient (2,k) for the 4 raters demonstrated excellent reliability (>.81) between observers and good to excellent test–retest reliability (.71–.91). Pearson correlations between self-reported ability and CM-PAT scores explained 61% of the variance in self-reported climbing performance compared with 16% for geometric entropy and 52% for climbing pace. Considering differences in successful and unsuccessful climbers, the CM-PAT (P < .0005; d = 2.14), geometric entropy (P = .014; d = 0.67), and pace (P < .0005; d = 1.88) were able to differentiate between groups. Conclusions: The CM-PAT is the first sport climbing performance observational instrument to be developed through a thorough iterative process with expert coaches. Excellent interrater and test–retest reliability and excellent agreement with self-reported ability and with existing quantitative measures of performance support its recommendation for use in coaching and research contexts. Notably, a key advantage over existing measures is the identification of coachable elements of performance.

Validation of a Hidradenitis Suppurativa Self-Assessment Tool

2019 ◽  
Vol 23 (4) ◽  
pp. 388-390 ◽  
Author(s):  
Aditi Senthilnathan ◽  
Sree S. Kolli ◽  
Leah A. Cardwell ◽  
Irma Richardson ◽  
Steven R. Feldman ◽  
...  
Keyword(s):  
Hidradenitis Suppurativa ◽  
Assessment Tool ◽  
Multiple Scales ◽  
Weighted Kappa ◽  
Self Administration ◽  
Self Assessment ◽  
Good Test ◽  
Retest Reliability ◽  
Dermatology Clinic ◽  
Test Retest Reliability

Background: Hidradenitis suppurativa (HS) is a debilitating dermatologic condition presenting with recurrent abscesses. While there are multiple scales to determine HS severity, none are designed for self-administration. A validated severity self-assessment tool may facilitate survey research and improve communication by allowing patients to objectively report their HS severity between clinic visits. Objectives: The purpose of this study was to assess a self-administered HS measure. Methods: An HS self-assessment tool (HSSA) with 10 photographs of different Hurley stages was developed. The tool was administered to patients diagnosed with HS who visited the Wake Forest Baptist Health dermatology clinic over a span of 2 months. Physician-administered Hurley stage was recorded to determine criterion validity. To assess test-retest reliability of the measure, patients completed the HSSA again at least 30 minutes after the first completion. Results: Twenty-four patients completed the measure, and 20 of these patients completed it twice. Agreement between physician-determined Hurley stage and self-determined Hurley stage was 66.7% with a weighted kappa of 0.57 (95% confidence interval [CI]: 0.30-0.84). The weighted kappa for agreement between patients’ initial and second completion of the HSSA was 0.81 (95% CI: 0.64-0.99). Conclusions: The self-administered measure provides moderate agreement with physician-determined Hurley stage and good test-retest reliability.

scholarly journals Psychometric evaluation of the Chinese version of the Person-Centred Care Assessment Tool

BMJ Open ◽  
2020 ◽  
Vol 10 (7) ◽  
pp. e031580
Author(s):  
Cai Le ◽  
Ke Ma ◽  
Pingfen Tang ◽  
David Edvardsson ◽  
Lina Behm ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Intraclass Correlation ◽  
Psychometric Evaluation ◽  
Quality Of Healthcare ◽  
Hospital Staff ◽  
Chinese Version ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Care Assessment ◽  
Test Retest Reliability

ObjectiveThis study aims to test a Chinese cross-cultural adaptation of the English version of the Person-Centred Care Assessment Tool (P-CAT) and evaluate its psychometric properties.DesignP-CAT was translated/back-translated using established procedures before the psychometric evaluation of the Chinese version was made.SettingTwo hospitals covering urban and suburban areas of Kunming in the Yunnan province of China.Participants152 female hospital staff completed the survey.Main outcome measure(s)Construct validity and reliability, including internal consistency and test–retest reliability, were assessed among a sample of hospital staff.ResultsThe factor analysis resulted in a two-component solution that consisted of two subscales. The corrected item-total correlations for all of the items ranged from 0.14 to 0.44, with six items not meeting the cut-off level for item-total correlation (>0.3). The Chinese P-CAT demonstrated strong reliability, with a Cronbach’s alpha of 0.91–0.94 for the scales and a test–retest reliability coefficient of 0.88 for the overall scale scores. The intraclass correlation was 0.92 (95% CI 0.90 to 0.95).ConclusionP-CAT appears to be a promising measure for evaluating staff perceptions of person-centredness in Chinese hospital environments. The results show that P-CAT can be a useful tool for improving the quality of healthcare in terms of person-centred care in the Chinese context.

Sign in / Sign up

Export Citation Format

Share Document