The Learning Loss Scale as an Assessment Tool: An Empirical Examination of Convergent Validity with Performative Measures

2013 ◽  
Vol 28 (2) ◽  
pp. 130-143 ◽  
Author(s):  
John Hooker ◽  
Katherine Denker
GeroPsych ◽  
2014 ◽  
Vol 27 (1) ◽  
pp. 23-31 ◽  
Author(s):  
Anne Kuemmel (This author contributed eq ◽  
Julia Haberstroh (This author contributed ◽  
Johannes Pantel

Communication and communication behaviors in situational contexts are essential conditions for well-being and quality of life in people with dementia. Measuring methods, however, are limited. The CODEM instrument, a standardized observational communication behavior assessment tool, was developed and evaluated on the basis of the current state of research in dementia care and social-communicative behavior. Initially, interrater reliability was examined by means of videoratings (N = 10 people with dementia). Thereupon, six caregivers in six German nursing homes observed 69 residents suffering from dementia and used CODEM to rate their communication behavior. The interrater reliability of CODEM was excellent (mean κ = .79; intraclass correlation = .91). Statistical analysis indicated that CODEM had excellent internal consistency (Cronbach’s α = .95). CODEM also showed excellent convergent validity (Pearson’s R = .88) as well as discriminant validity (Pearson’s R = .63). Confirmatory factor analysis verified the two-factor solution of verbal/content aspects and nonverbal/relationship aspects. With regard to the severity of the disease, the content and relational aspects of communication exhibited different trends. CODEM proved to be a reliable, valid, and sensitive assessment tool for examining communication behavior in the field of dementia. CODEM also provides researchers a feasible examination tool for measuring effects of psychosocial intervention studies that strive to improve communication behavior and well-being in dementia.


2021 ◽  
Vol 13 (4) ◽  
Author(s):  
David Kim ◽  
Brandon Ruan ◽  
Lee Bartel ◽  
Bev Foster ◽  
Chelsea Mackinnon

Music serves as an important tool to improve the health and wellness of individuals in healthcare settings. In times of high caregiver burnout, therapeutic outlets such as music for care receivers and providers are becoming increasingly important. This paper presents the first iteration of the Caregiver Confidence using Music Scale (CCuMS), an assessment tool designed to evaluate caregivers’ readiness to adopt music care. Music care is defined as the informed and intentional use of music by anyone to improve the quality of care. The CCuMS was derived from a hierarchical cluster analysis of the Music Care Training program’s Level 1 post-evaluation survey (Post-MCTL1). Thematic interpretation of the statistical outputs from the cluster analysis was completed, resulting in the first iteration of the CCuMS. Initial validation methods that were feasible with current data were conducted. Specifically, face validity, content validity and convergent validity were calculated using Pearson correlations. The CCuMS shows promise as a measurement tool for use in healthcare settings due to the moderate correlation between the Post-MCTL1 and the CCuMS scale (r=0.524), and the strong correlation between the music care training thematic questionnaire and the CCuMS (r=0.970).


2020 ◽  
Vol 29 (1) ◽  
pp. 42-6
Author(s):  
Ira Tanti ◽  
Vivi Vidya Waty Wira ◽  
Yenni Pragustine ◽  
Laura Susanti Himawan ◽  
Nina Ariani

BACKGROUND Pain associated with oral problems is one of the most frequent chronic pain of temporomandibular disorders (TMDs). This study was conducted to analyze the psychometric properties of the Indonesian version of the graded chronic pain scale 2.0 (GCPS-ID) in Indonesian patients with TMDs. METHODS The English version of the GCPS version 2.0 was translated and back-translated according to international guidelines. This study conducted from June to December 2016 at the Dental Hospital, Faculty of Dentistry, Universitas Indonesia, and the participants were 202 TMDs patients who had never undergone temporomandibular joint surgery or suffered facial pain for more than 6 months. The evaluation of the GCPS-ID included the internal consistency test, test-retest reliability, and construct validity tests. RESULTS The GCPS-ID had a high internal consistency (Cronbach’s alpha = 0.896). The intraclass correlation coefficient of the pain intensity and the disability score were 0.789 and 0.706, respectively. The convergent validity demonstrated a moderately positive correlation between the GCPS-ID and the Indonesian version of oral health impact profile for TMD for pain (r = 0.595; p<0.001) and disability (r = 0.488; p<0.001). The discriminant validity between GCPS-ID and the subjective patient’s quality of life revealed a weak positive correlation (r = 0.195; p = 0.191). CONCLUSIONS GCPS-ID is a reliable and valid assessment tool for evaluating TMD pain in Indonesia.


Author(s):  
Melody S. Goodman ◽  
Nicole Ackermann ◽  
Kristyn A. Pierce ◽  
Deborah J. Bowen ◽  
Vetta Sanders Thompson

The Research Engagement Survey Tool (REST) examines the level of partner engagement in research studies. This study used mixed methods, including web-based surveys (N = 336), a modified Delphi process (N = 18), and cognitive response interviews (N = 16), with convenience sampling to develop and validate a short version of the REST. We conducted factor analysis and calculated internal consistency for the condensed REST. We validated the condensed REST against the comprehensive REST. All analyses were carried out on two scales (quality and quantity) based on Likert-type response options. We examined convergent validity with other measures theoretically associated with the REST (e.g., the Community Engagement Research Index and the Partnership Self-Assessment Tool). This study produced a 9-item condensed version of the REST. The condensed REST loads on 1 factor, has high internal consistency (Cronbach’s alpha = 0.92 for the quantity scale; 0.94 for the quality scale), is significantly correlated (ρ = 0.97; p < 0.001 for both scales) with the comprehensive (32-item) REST, and has negligible, low, and moderate correlation with other measures (e.g., the Partnership Assessment In community-based Research, trust in medical researchers, and the Coalition Self-Assessment Survey). Use of the condensed REST will reduce participant burden and time to complete. This standardized and validated quantitative measure is useful to compare engagement across projects or within a project over time.


Author(s):  
Alix Hall ◽  
Adam Shoesmith ◽  
Rachel C. Shelton ◽  
Cassandra Lane ◽  
Luke Wolfenden ◽  
...  

There is a lack of valid and reliable measures of determinants of sustainability specific to public health interventions in the elementary school setting. This study aimed to adapt and evaluate the Program Sustainability Assessment Tool (PSAT) for use in this setting. An expert reference group adapted the PSAT to ensure face validity. Elementary school teachers participating in a multi-component implementation intervention to increase their scheduling of physical activity completed the adapted PSAT. Structural validity was assessed via confirmatory factor analysis. Convergent validity was assessed using linear mixed regression evaluating the associations between scheduling of physical activity and adapted PSAT scores. Cronbach’s alpha was used to evaluate internal consistency and intracluster correlation coefficients for interrater reliability. Floor and ceiling effects were also evaluated. Following adaptation and psychometric evaluation, the final measure contained 26 items. Domain Cronbach’s alpha ranged from 0.77 to 0.92. Only one domain illustrated acceptable interrater reliability. Evidence for structural validity was mixed and was lacking for convergent validity. There were no floor and ceiling effects. Efforts to adapt and validate the PSAT for the elementary school setting were mixed. Future work to develop and improve measures specific to public health program sustainment that are relevant and psychometrically robust for elementary school settings are needed.


2016 ◽  
Vol 49 (3) ◽  
pp. 255-282 ◽  
Author(s):  
Wouter Poortinga ◽  
Tatiana Calve ◽  
Nikki Jones ◽  
Simon Lannon ◽  
Tabitha Rees ◽  
...  

Various studies have shown that neighborhood quality is linked to neighborhood attachment and satisfaction. However, most have relied upon residents’ own perceptions rather than independent observations of the neighborhood environment. This study examines the reliability and validity of the revised Residential Environment Assessment Tool (REAT 2.0), an audit instrument covering both public and private spaces of the neighborhood environment. The research shows that REAT 2.0 is a reliable, easy-to-use instrument and that most underlying constructs can be validated against residents’ own neighborhood perceptions. The convergent validity of the instrument, which was tested against digital map data, can be improved for a number of miscellaneous urban form items. The research further found that neighborhood attachment was significantly associated with the overall REAT 2.0 score. This association can mainly be attributed to the property-level neighborhood quality and natural elements components. The research demonstrates the importance of private spaces in the outlook of the neighborhood environment.


Assessment ◽  
2017 ◽  
Vol 26 (3) ◽  
pp. 404-418 ◽  
Author(s):  
Frank C. Worrell ◽  
Rodolfo Mendoza-Denton ◽  
Amanda Wang

In this article, we examined the psychometric properties of scores on a new instrument, the Cross Ethnic-Racial Identity Scale-Adult (CERIS-A) for use across different ethnic and racial groups. The CERIS-A measures seven ethnic-racial identity attitudes—assimilation, miseducation, self-hatred, anti-dominant, ethnocentricity, multiculturalist inclusive, and ethnic-racial salience. Participants consisted of 803 adults aged 18 to 76, including African Americans (19.3%), Asian Americans (17.6%), European Americans (37.0%), and Latino/as (17.8%). Analyses indicated that CERIS-A scores were reliable, and configural, metric, and scalar invariance were supported for the seven factors across gender; however, Miseducation, Ethnic-Racial Salience, and Ethnocentricity scores achieved only metric invariance across ethnic-racial groups. Self-Hatred, Ethnic-Racial Salience, Anti-Dominant, and Ethnocentricity scores were significantly and meaningfully related to race-based rejection sensitivity scores, providing evidence of convergent validity. We concluded that the CERIS-A is a potentially useful instrument for examining ethnic-racial identity attitudes across multiple racial/ethnic subgroups in the United States.


2021 ◽  
pp. 263207702098814
Author(s):  
Casie H. Morgan ◽  
Claire Estep ◽  
Barbara A. Morrongiello ◽  
David C. Schwebel

Physical risk-taking is associated with increased risk of unintentional injury, a global health challenge and the leading cause of death for children in the United States. To assess risk and develop prevention programs, valid tools to assess children’s physical risk-taking are needed. No ecologically valid behavioral measures are widely available. This study describes the development and validation of the “Activity Room” to measure children’s physical risk-taking while presenting low risk of actual injury. Participants were 59 children aged 4 to 6 years old (51% female; 51% non-Hispanic White) and their parents. Children completed two tasks to assess physical risk-taking: (a) vignettes (short stories presenting risk situations) and (b) the “Activity Room” (unsupervised engagement for 5 min in a room with apparatus designed to stimulate potential physical risk-taking). Parents responded to a questionnaire concerning children’s active play behaviors. Correlational analyses evaluated convergent validity of the Activity Room risk-taking outcome. The Activity Room proved feasible; all children engaged eagerly and safely. Convergent validity was demonstrated through two strategies. First, risk-taking in the Activity Room correlated with observed play behaviors, such as climbing and falling. Second, risk-taking in the Activity Room correlated with children’s risk-taking responses in the vignettes and with parent-reported child risk-taking. Results indicate the Activity Room task is a valid technique to assess young children’s risk-taking in an ecologically valid real-world behavioral task. Incorporation of the task as an assessment tool may benefit a range of studies investigating children’s physical risk-taking behavior, risky decision-making, and child injury prevention strategies.


Author(s):  
Blanca Poveda ◽  
Sharon Abrahams ◽  
R. Asaad Baksh ◽  
Sarah E. MacPherson ◽  
Jonathan J. Evans

Abstract Objectives: Social cognition is frequently impaired following an acquired brain injury (ABI) but often overlooked in clinical assessments. There are few validated and appropriate measures of social cognitive abilities for ABI patients. The current study examined the validity of the Edinburgh Social Cognition Test (ESCoT, Baksh et al., 2018) in measuring social cognition following an ABI. Methods: Forty-one patients with ABI were recruited from a rehabilitation service and completed measures of general ability, executive functions and social cognition (Faux Pas; FP, Reading the Mind in the Eyes; RME, Social Norms Questionnaire; SNQ and the ESCoT). Forty-one controls matched on age, sex and years of education also performed the RME, SNQ and ESCoT. Results: A diagnosis of ABI was significantly associated with poorer performance on all ESCoT measures and RME while adjusting for age, sex and years of education. In ABI patients, the ESCoT showed good internal consistency with its subcomponents and performance correlated with the other measures of social cognition demonstrating convergent validity. Better Trail Making Test performance predicted better ESCoT total, RME and SNQ scores. Higher TOPF IQ was associated with higher RME scores, while higher WAIS-IV working memory predicted better FP performance. Conclusions: The ESCoT is a brief, valid and internally consistent assessment tool able to detect social cognition deficits in neurological patients. Given the prevalence of social cognition deficits in ABI and the marked impact these can have on an individual’s recovery, this assessment can be a helpful addition to a comprehensive neuropsychological assessment.


Author(s):  
Nadja Schott ◽  
Bettina Johnen ◽  
Thomas Jürgen Klotzbier

Abstract Purpose Well-adapted and validated well-being (WB) instruments for the nursing home population are scarce. To our knowledge, the Laurens Well-Being Inventory for Gerontopsychiatry (LWIG) is a practical and reliable well-being assessment tool that has never been validated for German nursing home populations. Therefore, the purpose of our study was to (1) translate and cross-culturally adapt the LWIG to a German context and (2) test the reliability and validity of the German LWIG in a group of older nursing home residents using the Rasch model. Methods This study has a cross-sectional, descriptive study design. Cross-cultural adaption of the LWIG-GER from English to German was performed according to a standardized method. The data obtained from 104 long-term nursing home residents (57 women, 47 men) aged 60–99 years (mean 79.5, standard deviation ±9.11) were analyzed for psychometric testing (exploratory and confirmatory factor analysis, item fit, McDonald’s ω, convergent validity, and known-group validity, Rasch). Results The final LWIG-GER consists of 19 items with three subscales, including “psychological WB”, “social WB”, and “physical WB”. The LWIG-GER showed good overall reliability with McDonald’s ω of 0.83; the LWIG-GER dimensions’ scores were significantly correlated with depression, functional performance, activities, fear of falling, and education. Conclusions Our findings suggest that the German language version of the LWIG is a reliable and valid tool for measuring WB in nursing home residents. Furthermore, we propose that the LWIG-GER questionnaire can broaden and deepen our understanding of residents’ perception of quality of care and their environment.


Sign in / Sign up

Export Citation Format

Share Document