Development and Validation of a Brief Version of the Research Engagement Survey Tool

The Research Engagement Survey Tool (REST) examines the level of partner engagement in research studies. This study used mixed methods, including web-based surveys (N = 336), a modified Delphi process (N = 18), and cognitive response interviews (N = 16), with convenience sampling to develop and validate a short version of the REST. We conducted factor analysis and calculated internal consistency for the condensed REST. We validated the condensed REST against the comprehensive REST. All analyses were carried out on two scales (quality and quantity) based on Likert-type response options. We examined convergent validity with other measures theoretically associated with the REST (e.g., the Community Engagement Research Index and the Partnership Self-Assessment Tool). This study produced a 9-item condensed version of the REST. The condensed REST loads on 1 factor, has high internal consistency (Cronbach’s alpha = 0.92 for the quantity scale; 0.94 for the quality scale), is significantly correlated (ρ = 0.97; p < 0.001 for both scales) with the comprehensive (32-item) REST, and has negligible, low, and moderate correlation with other measures (e.g., the Partnership Assessment In community-based Research, trust in medical researchers, and the Coalition Self-Assessment Survey). Use of the condensed REST will reduce participant burden and time to complete. This standardized and validated quantitative measure is useful to compare engagement across projects or within a project over time.

Download Full-text

Validation of the Indonesian version of the graded chronic pain scale 2.0 in pain-related temporomandibular disorders

Medical Journal of Indonesia ◽

10.13181/mji.oa.191790 ◽

2020 ◽

Vol 29 (1) ◽

pp. 42-6

Author(s):

Ira Tanti ◽

Vivi Vidya Waty Wira ◽

Yenni Pragustine ◽

Laura Susanti Himawan ◽

Nina Ariani

Keyword(s):

Chronic Pain ◽

Internal Consistency ◽

Temporomandibular Disorders ◽

Convergent Validity ◽

Discriminant Validity ◽

Assessment Tool ◽

Intraclass Correlation ◽

Pain Scale ◽

Disability Score ◽

Positive Correlation

BACKGROUND Pain associated with oral problems is one of the most frequent chronic pain of temporomandibular disorders (TMDs). This study was conducted to analyze the psychometric properties of the Indonesian version of the graded chronic pain scale 2.0 (GCPS-ID) in Indonesian patients with TMDs. METHODS The English version of the GCPS version 2.0 was translated and back-translated according to international guidelines. This study conducted from June to December 2016 at the Dental Hospital, Faculty of Dentistry, Universitas Indonesia, and the participants were 202 TMDs patients who had never undergone temporomandibular joint surgery or suffered facial pain for more than 6 months. The evaluation of the GCPS-ID included the internal consistency test, test-retest reliability, and construct validity tests. RESULTS The GCPS-ID had a high internal consistency (Cronbach’s alpha = 0.896). The intraclass correlation coefficient of the pain intensity and the disability score were 0.789 and 0.706, respectively. The convergent validity demonstrated a moderately positive correlation between the GCPS-ID and the Indonesian version of oral health impact profile for TMD for pain (r = 0.595; p<0.001) and disability (r = 0.488; p<0.001). The discriminant validity between GCPS-ID and the subjective patient’s quality of life revealed a weak positive correlation (r = 0.195; p = 0.191). CONCLUSIONS GCPS-ID is a reliable and valid assessment tool for evaluating TMD pain in Indonesia.

Download Full-text

Development and Evaluation of a Swedish Short Version of the Questionnaire About the Process of Recovery (QPR)

Community Mental Health Journal ◽

10.1007/s10597-019-00494-6 ◽

2019 ◽

Vol 56 (2) ◽

pp. 376-382

Author(s):

Eklund Mona ◽

Neil Sandra ◽

Argentzell Elisabeth

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Convergent Validity ◽

Discriminant Validity ◽

Psychiatric Symptoms ◽

Internal Consistency Reliability ◽

Short Version ◽

Level Of Functioning ◽

Ceiling Effects ◽

Good Internal Consistency

Abstract The aim was to develop a short version of the Swedish Process of Recovery Questionnaire (QPR-Swe) for use with people with severe mental illness and to investigate its internal consistency, construct validity, known-groups validity and any floor or ceiling effects. Two independent samples were used, the first (N = 226) to develop the short version and the second (N = 266) to test its psychometric properties. A seven-item version was developed by selecting items based on item-total correlations. The QPR-Swe-7 showed good internal consistency reliability (α = 0.82). It showed moderate correlations with indicators of convergent validity (self-rated health, self-mastery and quality of life) and weak with those selected to test discriminant validity (psychiatric symptoms and level of functioning). QPR-Swe-7 differentiated between people receiving two different levels of housing support. No floor or ceiling effects were found. The QPR-Swe-7 had appropriate psychometric properties for use with people with a variety of mental disorders when a brief scale is warranted.

Download Full-text

Development of a self-assessment tool for resident doctors’ communication skills in India

Journal of Educational Evaluation for Health Professions ◽

10.3352/jeehp.2019.16.17 ◽

2019 ◽

Vol 16 ◽

pp. 17

Author(s):

Upendra Baitha ◽

Piyush Ranjan ◽

Siddharth Sarkar ◽

Charu Arora ◽

Archana Kumari ◽

...

Keyword(s):

Communication Skills ◽

Internal Consistency ◽

Assessment Tool ◽

Relevant Literature ◽

Questionnaire Development ◽

Second Phase ◽

New Delhi ◽

Self Assessment ◽

Good Communication ◽

Good Internal Consistency

Purpose: Effective communication skills are essential for resident doctors to provide optimum patient care. This study was conducted to develop and validate a questionnaire for the self-assessment of resident doctors’ communication skills in India.Methods: This was a mixed-methods study conducted in 2 phases. The first phase consisted of questionnaire development, including the identification of relevant literature, focus group discussions with residents and experts from clinical specialties, and pre-testing of the questionnaire. The second phase involved administering the questionnaire survey to 95 residents from the Departments of Medicine, Emergency Medicine, Pediatrics, and Surgery at the All India Institute of Medical Sciences, New Delhi, India in April 2019. Internal consistency was tested and the factor structure was analyzed to test construct validity.Results: The questionnaire consisted of 3 sections: (A) 4 items on doctor-patient conflicts and the role of communication skills in avoiding these conflicts, (B) 29 items on self-assessment of communication skills in different settings, and (C) 8 items on barriers to practicing good communication skills. Sections B and C had good internal consistency (Cronbach α: 0.885 and 0.771, respectively). Section C had a 2-factor solution, and the barriers were classified as ‘training’ and ‘infrastructure’ factors.Conclusion: This appears to be a valid assessment tool of resident doctors’ communication skills, with potential utility for identifying gaps in communication skills and developing communication skills modules.

Download Full-text

A Pszichopátiás Önértékelő Skála rövid változatának (SRP-SF) magyar nyelvű adaptációja

Mentálhigiéné és Pszichoszomatika ◽

10.1556/0406.22.2021.010 ◽

2021 ◽

Vol 22 (3) ◽

pp. 310-330

Author(s):

Kovács Dóra Csilla ◽

Mészáros Veronika ◽

Tanyi Zsuzsanna ◽

Ferenczi Andrea ◽

Jakubovits Edit ◽

...

Keyword(s):

Internal Consistency ◽

Sensation Seeking ◽

Convergent Validity ◽

Short Form ◽

Clinical Sample ◽

Dark Triad ◽

Self Report ◽

Short Version ◽

Crime Trends ◽

Present Sample

Bevezetés: A pszichopátia kutatásának története hosszú múltra tekint vissza a mentális egészségtudományokban. Ez idő alatt több megközelítés is született, melyekhez kapcsolódóan kérdőíveket is kidolgoztak a kutatók. Cél: Jelen tanulmány a Pszichopátiás Önértékelő Skála rövid változatának (Self Report Psychopathy Short Form; SRP-SF) magyar nyelvű adaptálását tűzi ki célul. A tanulmányban elemezzük a kérdőív faktorszerkezetét, belső konzisztenciáját, valamint konvergens validitását a nárcizmussal, a machiavellizmussal, a szenzoros élménykereséssel, a neuroticizmussal, az agresszióval, valamint konkurens validitását a pszichopátiát mérő mérőeszközzel. Módszerek: Keresztmetszeti, kérdőíves vizsgálatunkat 605 fős heterogén mintán folytattuk le. A kapcsolatrendszer elemzésére az SRP-SF mellett a fent említett konstruktumok mérésére alkalmas mérőeszközöket is használtunk, úgymint a Zuckerman–Kuhlman–Aluja személyiség-kérdőív 80 itemes rövid változatát, a Rövid Sötét Triád tesztet, illetve a Patológiás Nárcizmus kérdőívet. Eredmények: A megerősítő faktorelemzés eredménye rámutatott arra, hogy az általunk alkalmazott mintán a kérdőív háromfaktoros modellje illeszkedik a legjobban (illeszkedési mutatók: χ 2(164) = 817,741, p < 0,001; CFI = 0,930; TLI = 0,919; RMSEA [90% CI] = 0,081 [0,075–0,087]), a bűnügyi tendenciák skála jelenléte a jelen mintán nem megerősíthető. Az SRP-SF belső konzisztenciája megfelelőnek bizonyult (Cronbach-α = 0,659– 0,774). A kérdőív más mérőeszközökkel mutatott kapcsolataiból pedig arra lehet következtetni, hogy az állítások inkább az elsődleges pszichopátiát mérik, és a kérdőívben elkülönülnek a pszichopátia interperszonális és életmódbeli aspektusai. Következtetés: az SRP-SF egy olyan könnyen és gyorsan felvehető kérdőív, amely megfelelő pszichometriai mutatókkal rendelkezik és a bűnügyi tendenciák skálától eltekintve alkalmazható nem klinikai mintán is. Introduction: The research history of psychopathy has a long history in the mental health sciences. During this time, several approaches were developed, and in connection with the theories the researchers also developed questionnaires. Aim: The aim of the study is the Hungarian adaptation of the Self-Reporting Psychopathy Short Form (SRP-SF). We have analyzed the factor structure of the questionnaire, its internal consistency, and convergent validity of the questionnaire with narcissism, Machiavellianism, sensation seeking, neuroticism, aggression, and other measure of psychopathy. Methods: The study included 605 individuals, who were heterogeneous by profession. In addition to SRP-SF, an 80-item short version of the Zuckerman–Kuhlman–Aluja Personality Questionnaire, the Short Dark Triad test, and the Pathological Narcissism questionnaire were also administered to analyze the relationships of psychopathy. Results: The results of the confirmatory factor analysis showed that the three-factor model of the questionnaire fits best in the sample we used (fit indicators: χ 2(164) = 817.741, p < 0.001; CFI = 0.930; TLI = 0.919; RMSEA [90% CI] = 0.081 [0.075–0.087]) , the presence of the scale of crime trends in the present sample cannot be confirmed. The internal consistency of SRP-SF was found to be adequate (Cronbach’s α = 0.659–0.774). And from the relationships of the questionnaire with other measures, it can be concluded that the statements tend to measure primary psychopathy, and the interpersonal and lifestyle aspects of psychopathy are separated in the questionnaire. Conclusion: Except for the Crime trends scale, SRP-SF is an easy and quick to take test that has appropriate psychometric indicators and can be applied to a non-clinical sample

Download Full-text

The Chinese Assessment of physical literacy: Based on Grounded Theory Paradigm for children in grades 3-6

10.1101/2022.01.12.22269057 ◽

2022 ◽

Author(s):

Wang YongKang ◽

Fu QianQian

Keyword(s):

Factor Analysis ◽

Convergent Validity ◽

Quantitative Methods ◽

Assessment Tool ◽

Reliability And Validity ◽

Physical Literacy ◽

Self Assessment ◽

Qualitative And Quantitative Methods ◽

Confirmatory Factor ◽

Assessment Questionnaire

The aim of this study is to construct and validate “physical literacy self-assessment questionnaire” (PLAQ) for Chinese students in grades 3-6. This study uses qualitative and quantitative methods to construct evaluation indicators of PL and determine the weights of each indicator. The 60 items of original PLAQ was based on literature review and interviews, and administered to 1179 primary students graded 3-6 in China. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) are used to optimize the structure and verify the reliability and validity of the questionnaire. The model of PLAQ is composed of 4 first-level indicators, 10 second-level indicators and 35 third-level indicators. The results of EFA and CFA resulted in a 44-items, 4-factor questionnaire. EFA item loadings ranged from 0.558 to 0.896, and Cronbach's alpha ranged from 0.818 to 0.892. The results of CFA show that the constructed model fits well, and PLAQ has good convergent validity and discriminative validity. The PLAQ appeared to be reliable and valid that can be used as an assessment tool for students in grades 3-6. PLAQ can be used as a guide for the development of PL. Additionally, PLAQ gives us a shared understanding about what PL is and how it can be developed by Chinese children. However, studies on the accuracy and generalizability of the PLAQ should be conducted to improve it in the future.

Download Full-text

Creation and Initial Validation of the Caregiver Analysis of Reported Experiences with Swallowing Disorders (CARES) Screening Tool

American Journal of Speech-Language Pathology ◽

10.1044/2020_ajslp-20-00148 ◽

2020 ◽

Vol 29 (4) ◽

pp. 2131-2144

Author(s):

Samantha E. Shune ◽

Barbara Resnick ◽

Steven H. Zarit ◽

Ashwini M. Namasivayam-MacDonald

Keyword(s):

Caregiver Burden ◽

Internal Consistency ◽

Convergent Validity ◽

Screening Tool ◽

Assessment Tool ◽

Swallowing Disorders ◽

Analysis Model ◽

Validity And Reliability ◽

Specific Patient ◽

Swallowing Difficulties

Purpose Dysphagia is a debilitating condition with widespread consequences. Previous research has revealed dysphagia to be an independent predictor of caregiver burden. However, there is currently no systematic method of screening for or identifying dysphagia-related caregiver burden. The aim of this study was to develop a set of questions for a dysphagia-related caregiver burden screening tool, the Caregiver Analysis of Reported Experiences with Swallowing Disorders (CARES), and pilot the tool to establish preliminary validity and reliability. Method The questionnaire was developed through an iterative process by a team of clinical researchers with expertise in dysphagia, dysphagia-related and general caregiver burden, and questionnaire design. A heterogenous group of 26 family caregivers of people with dysphagia completed the CARES, along with the Eating Assessment Tool (EAT-10), the International Dysphagia Diet Standardisation Initiative Functional Diet Scale (IDDSI-FDS), and the Zarit Burden Interview (ZBI). Information on construct validity, item fit, convergent validity, internal consistency, and reliability was determined via Rasch analysis model testing, Cronbach's alpha, and Spearman's rho calculations. Results The final CARES questionnaire contained 26 items divided across two subscales. The majority of the questionnaire items fit the model, there was evidence of internal consistency across both subscales, and there were significant relationships between dysphagia-specific burden (CARES) and perceived swallowing impairment (EAT-10), general caregiver burden (ZBI), and diet restrictiveness (IDDSI-FDS). Conclusions Results from the current study provide initial support for the validity and reliability of the CARES as a screening tool for dysphagia-related burden, particularly among caregivers of adults with swallowing difficulties. While continued testing is needed across larger groups of specific patient populations, it is clear that the CARES can initiate structured conversations about dysphagia-related caregiver burden by identifying potential sources of stress and/or contention. This will allow clinicians to then identify concrete methods of reducing burden and make appropriate referrals, ultimately improving patient care.

Download Full-text

Introducing the tablet-based Oxford Cognitive Screen-Plus (OCS-Plus) as an assessment tool for subtle cognitive impairments

Scientific Reports ◽

10.1038/s41598-021-87287-8 ◽

2021 ◽

Vol 11 (1) ◽

Author(s):

Nele Demeyere ◽

Marleen Haupt ◽

Sam S. Webb ◽

Lea Strobel ◽

Elise T. Milosevich ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Assessment Tool ◽

Cognitive Impairments ◽

Attention And Memory ◽

Divergent Validity ◽

Retest Reliability ◽

Convergent And Divergent Validity ◽

Cognitive Screen ◽

Test Retest Reliability

AbstractHere, we present the Oxford Cognitive Screen-Plus, a computerised tablet-based screen designed to briefly assess domain-general cognition and provide more fine-grained measures of memory and executive function. The OCS-Plus was designed to sensitively screen for cognitive impairments and provide a differentiation between memory and executive deficits. The OCS-Plus contains 10 subtasks and requires on average 24 min to complete. In this study, 320 neurologically healthy ageing participants (age M = 62.66, SD = 13.75) from three sites completed the OCS-Plus. The convergent validity of this assessment was established in comparison to the ACE-R, CERAD and Rey–Osterrieth. Divergent validity was established through comparison with the BDI and tests measuring divergent cognitive domains. Internal consistency of each subtask was evaluated, and test–retest reliability was determined. We established the normative impairment cut-offs for each of the subtasks. Predicted convergent and divergent validity was found, high internal consistency for most measures was also found with the exception of restricted range tasks, as well as strong test–retest reliability, which provided evidence of test stability. Further research demonstrating the use and validity of the OCS-Plus in various clinical populations is required. The OCS-Plus is presented as a standardised cognitive assessment tool, normed and validated in a sample of neurologically healthy participants. The OCS-Plus will be available as an Android App and provides an automated report of domain-general cognitive impairments in executive attention and memory.

Download Full-text

72 Validating MyHEARTSMAP, an emergency psychosocial self-assessment and management tool, among youth with minor traumatic brain injuries or minor orthopaedic injuries seen in the Paediatric Emergency Department

Paediatrics & Child Health ◽

10.1093/pch/pxaa068.071 ◽

2020 ◽

Vol 25 (Supplement_2) ◽

pp. e30-e30

Author(s):

Erik Lamoureux ◽

Takuro Ishikawa ◽

Keith Yeates ◽

Miriam Beauchamp ◽

William Craig ◽

...

Keyword(s):

Emergency Department ◽

Convergent Validity ◽

Assessment Tool ◽

Social Issues ◽

Pearson Correlation ◽

Assessment Tools ◽

Management Tool ◽

Self Assessment ◽

Paediatric Emergency Department ◽

Paediatric Emergency

Abstract Background Fewer than 20% of the estimated 1.2 million Canadian youths living with mental health (MH) concerns receive adequate care. Paediatric emergency department (PED) visits related to MH are increasing across North America. The online self-assessment tool, MyHEARTSMAP, was developed to facilitate screening of MH concerns in the PED and general practice. MyHEARTSMAP assesses 10 psychosocial areas, mapping to four domains of MH (Psychiatry, Function, Social, and Youth Health) to provide domain-specific recommendations for patient management (Figure A). Objectives We evaluated the convergent validity of MyHEARTSMAP when compared to established psychosocial self-assessment tools: Paediatric Quality of Life (PedsQL) and Strengths and Difficulties Questionnaire (SDQ). Design/Methods We conducted a cross-sectional study among youths and parents enrolled in a larger cohort study: Advancing Concussion Assessment in Paediatrics (A-CAP). Participants were children aged 8 to 16 years old with mild traumatic brain injury or orthopaedic injury and their parents. Participants were recruited from two PEDs in Alberta and British Columbia and were asked to complete MyHEARTSMAP, in addition to the PedsQL and SDQ completed in their A-CAP study procedures. We evaluated three MH domains from MyHEARTSMAP (PSYCHIATRY FUNCTION, AND SOCIAL) to their corresponding score sections in PedsQL (EMOTIONAL, SCHOOL, and SOCIAL) and SDQ (EMOTIONAL, none, and CONDUCT and PEER). We calculated Pearson correlation coefficients between these corresponding domains and sections. Results We recruited 40 child and parent pairs from Alberta and 82 from BC. The children were on average aged 12.6 years old (SD 2.2) and 44% were female. The tools screened participants as “at-risk” for various MH concerns at a rate of 26.7% to 60.8% for MyHEARTSMAP, 2.5% to 13.9% for PedsQL, and 12.3% to 16.0% for SDQ. Overall, MyHEARTSMAP was moderately correlated with PedsQL (mean ±95% CI: r = 0.405±0.151) and SDQ (mean ±95% CI: r = 0.322±0.162). Correlations (±95% CI) by MyHEARTSMAP domain for the child and parent versions, respectively, were as follows: PSYCHIATRY PedsQL (r = 0.483±0.140 / 0.509±0.134) and SDQ (r = 0.417±0.150 / 0.598±0.116); FUNCTION PedsQL (r = 0.578±0.122 / 0.455±0.143); SOCIAL PedsQL (r = 0.249±0.170 / 0.158±0.175) and SDQ (r = 0.207±0.172 / 0.067±0.178). Conclusion In conclusion, MyHEARTSMAP PSYCHIATRY and FUNCTION domains have moderate convergent validity to PedsQL and SDQ. Unlike PedsQL and SDQ, the evaluation of social issues in MyHEARTSMAP is MH-specific, resulting in low convergent validity for the SOCIAL domain.

Download Full-text

Psychosocial Aspects of Exercise and Physical Activity in Childhood

Pediatric Exercise Science ◽

10.1123/pes.2015-0031 ◽

2015 ◽

Vol 27 (1) ◽

pp. 26-29

Author(s):

Lindsay E. Kipp

Keyword(s):

Physical Activity ◽

Construct Validity ◽

Youth Development ◽

Internal Consistency ◽

Life Skills ◽

Convergent Validity ◽

Assessment Tool ◽

Evaluation Research ◽

Internal Consistency Reliability ◽

Skills Transfer

Purpose:A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program.Method:In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the life skills transfer survey (LSTS), a measure of perceived life skills transfer.Results:Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS.Conclusion:Results from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

Download Full-text