The behavior flexibility rating scale-revised (BFRS-R): Factor analysis, internal consistency, inter-rater and intra-rater reliability, and convergent validity

2008 ◽  
Vol 29 (5) ◽  
pp. 398-407 ◽  
Author(s):  
Nienke Peters-Scheffer ◽  
Robert Didden ◽  
Vanessa A. Green ◽  
Jeff Sigafoos ◽  
Hubert Korzilius ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Rating Scale ◽  
Rater Reliability ◽  
R Factor

scholarly journals Development of the Therapist Empathy Scale

2013 ◽  
Vol 42 (3) ◽  
pp. 339-354 ◽  
Author(s):  
Suzanne E. Decker ◽  
Charla Nich ◽  
Kathleen M. Carroll ◽  
Steve Martino
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Rating Scale ◽  
Single Factor ◽  
Client Outcome ◽  
Rater Reliability ◽  
Empathy Scale ◽  
Therapist Empathy ◽  
The Impact

Background: Few measures exist to examine therapist empathy as it occurs in session. Aims: A 9-item observer rating scale, called the Therapist Empathy Scale (TES), was developed based on Watson's (1999) work to assess affective, cognitive, attitudinal, and attunement aspects of therapist empathy. The aim of this study was to evaluate the inter-rater reliability, internal consistency, and construct and criterion validity of the TES. Method: Raters evaluated therapist empathy in 315 client sessions conducted by 91 therapists, using data from a multi-site therapist training trial (Martino et al., 2010) in Motivational Interviewing (MI). Results: Inter-rater reliability (ICC = .87 to .91) and internal consistency (Cronbach's alpha = .94) were high. Confirmatory factor analyses indicated some support for single-factor fit. Convergent validity was supported by correlations between TES scores and MI fundamental adherence (r range .50 to .67) and competence scores (r range .56 to .69). Discriminant validity was indicated by negative or nonsignificant correlations between TES and MI-inconsistent behavior (r range .05 to −.33). Conclusions: The TES demonstrates excellent inter-rater reliability and internal consistency. Results indicate some support for a single-factor solution and convergent and discriminant validity. Future studies should examine the use of the TES to evaluate therapist empathy in different psychotherapy approaches and to determine the impact of therapist empathy on client outcome.

scholarly journals Development and Validation of a Rating Scale of Pain Expression during Childbirth (ESVADOPA)

2020 ◽  
Vol 17 (16) ◽  
pp. 5826
Author(s):  
Silvia Navarro-Prado ◽  
María Angustias Sánchez-Ojeda ◽  
Adelina Martín-Salvador ◽  
Trinidad Luque-Vara ◽  
Elisabet Fernández-Gómez ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Exploratory Factor Analysis ◽  
Internal Consistency ◽  
Content Validity ◽  
Convergent Validity ◽  
Rating Scale ◽  
Active Phase ◽  
Two Dimensions ◽  
Pain Expression ◽  
Scale Yielding

One of the most representative symptoms during childbirth is pain, which is one of the most prominent concerns of pregnant women. There are different instruments to assess pain, all of which require interrupting the woman, thus interfering with the intimacy of childbirth. This study seeks to develop and validate a rating scale of the expression of childbirth pain that does not require the mother’s attention and respects her privacy during labor. The study was conducted at a regional hospital in a border town in southern Spain between November 2018 and September 2019. Scale items were developed following a review of the scientific literature, and experts judged the content validity. After a pilot test, the scale was psychometrically evaluated. The psychometric tests consisted of internal consistency analysis, exploratory factor analysis, and determination of the content, construct, and convergent validity. The scale was evaluated by 36 experts in the field and was then applied to 55 women during the active phase of childbirth. The final version of the Rating Scale of Pain Expression during Childbirth (in Spanish, Escala de Valoración de la Expresión del Dolor durante el Trabajo de Parto—ESVADOPA) consists of six items in two dimensions. The scale had a Cronbach’s alpha coefficient of 0.78, and the content validity measured by Aiken’s V co-efficient was also 0.78. The exploratory factor analysis yielded two dimensions that explained 68.08% of the total variance. For convergent validity, a comparison was made with the visual analogue scale, yielding a medium–high value of 0.641. As indicated by the internal consistency and by the content and construct validity outcomes, the ESVADOPA successfully measures pain expression during childbirth and represents a suitable tool for pain expression during birth without the need for intervention or the need for the mother to speak the same language as the midwife.

scholarly journals The Japanese version of the questionnaire about the process of recovery: development and validity and reliability testing

2017 ◽  
Vol 17 (1) ◽  
Author(s):  
Akiko Kanehara ◽  
Risa Kotake ◽  
Yuki Miyamoto ◽  
Yousuke Kumakura ◽  
Kentaro Morita ◽  
...  
Keyword(s):  
Mental Health ◽  
Factor Analysis ◽  
Mental Health Services ◽  
Health Services ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Short Form ◽  
Japanese Version ◽  
Internal Consistency Reliability ◽  
Validity And Reliability

Abstract Background Personal recovery is increasingly recognised as an important outcome measure in mental health services. This study aimed to develop a Japanese version of the Questionnaire about the Process of Recovery (QPR-J) and test its validity and reliability. Methods The study comprised two stages that employed the cross-sectional and prospective cohort designs, respectively. We translated the questionnaire using a standard translation/back-translation method. Convergent validity was examined by calculating Pearson’s correlation coefficients with scores on the Recovery Assessment Scale (RAS) and the Short-Form-8 Health Survey (SF-8). An exploratory factor analysis (EFA) was conducted to examine factorial validity. We used intraclass correlation and Cronbach’s alpha to examine the test-retest and internal consistency reliability of the QPR-J’s 22-item full scale, 17-item intrapersonal and 5-item interpersonal subscales. We conducted an EFA along with a confirmatory factor analysis (CFA). Results Data were obtained from 197 users of mental health services (mean age: 42.0 years; 61.9% female; 49.2% diagnosed with schizophrenia). The QPR-J showed adequate convergent validity, exhibiting significant, positive correlations with the RAS and SF-8 scores. The QPR-J’s full version, subscales, showed excellent test-retest and internal consistency reliability, with the exception of acceptable but relatively low internal consistency reliability for the interpersonal subscale. Based on the results of the CFA and EFA, we adopted the factor structure extracted from the original 2-factor model based on the present CFA. Conclusion The QPR-J is an adequately valid and reliable measure of the process of recovery among Japanese users with mental health services.

scholarly journals Psychometric Evaluation of the Child Sensory Profile 2 (CSP2) Among Children with Dyslexia

2021 ◽  
Vol In Press (In Press) ◽  
Author(s):  
Mahnaz Estaki ◽  
Ameneh Dehghan ◽  
Ebrahim Mahmoudi ◽  
Navid Mirzakhany
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Internal Consistency ◽  
Sensory Processing ◽  
Convergent Validity ◽  
Standardized Test ◽  
Sensory Profile ◽  
Validity And Reliability ◽  
Persian Version ◽  
Confirmatory Factor

Background: Sensory integration is a necessary skill for acquiring reading skills because it strongly depends on the rapid and strong relation between written and verbal symbols. There is no standardized test for Iranian children with dyslexia to investigate their sensory processing problems. Therefore, understanding the validity and reliability of the child sensory profile 2 (CSP2) would be essential for a detailed assessment of sensory impairments in dyslexic children. Objectives: The current research aimed to establish the internal consistency, factor analysis, and convergent validity of the Persian version of CSP2 in children with dyslexia. Methods: The sample of this study included 200 dyslexic children aged 6 to 12 years who were referred to learning disabilities centers in Qom from September 2019 to February 2020 by using the multistage sampling method. To collect data, the CSP2 questionnaire and the dyslexia test (NEMA) were used. The factor structure was assessed by confirmatory factor analysis. The internal consistency of the CSP2 was examined by using Cronbach’s alpha. Convergent validity was assessed by examining the relationship between CSP2 and NEMA. Results: Internal consistency was obtained as 0.89, 0.92, 0.77, and 0.94 for the four subscales of sensory processing, namely registration, seeking, sensitivity, and avoiding, respectively. The result of confirmatory factor analysis gained support for Dunn's four-factor model. Total scores of NEMA were correlated with the scores of CSP2 subscales (seeking, avoiding, sensitivity, and registration). Conclusions: The Persian version of the Child Sensory Profile 2 is a valid (via confirmatory factor analysis and convergent validity) and reliable (via internal consistency) tool for assessing sensory processing in children with dyslexia.

Psychometric Analysis of Persian Version of Patient Safety Competency Self-Evaluation in Psychiatric Wards

2021 ◽  
Vol 15 (6) ◽  
pp. 2048-2053
Author(s):  
Mahya Torkaman ◽  
Marzieh Momennasab ◽  
Shahrzad Yektatalab ◽  
Mahin Eslamishahrbabaki
Keyword(s):  
Factor Analysis ◽  
Patient Safety ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Content Validity ◽  
Convergent Validity ◽  
Psychiatric Hospitals ◽  
Psychiatric Ward ◽  
Self Evaluation ◽  
Persian Version

Background: Assessment of the patient safety competency is necessary for the growth of nursing and safe care profession as well as evaluation of the nurses' educational needs. To this end, valid and reliable tools are required. Aim:The present study was conducted to determine psychometric properties of the Persian version of the patient safety competency self-evaluation (PSCSE) tool in Iranian psychiatric wards. Methods: All nurses (n = 209) working in two psychiatric hospitals of Kerman, Iran were included in the present cross-sectional study using census method. Followed by administering the Persian version of PSCSE to the participants, its internal consistency and reliability were assessed by test-retest method with an interval of 14 days. Other psychometric properties such as content, construct, and convergent validity of the tool were also examined. Results:The content validity index was 0.65 and the content validity ratio was 0.89. Item 14 was removed from the skill domain because it was not related to the psychiatric ward. According to the results of factor analysis, 40 items and three domains of knowledge (6 items), attitude (14 items), and skills (20 items) were confirmed with acceptable values. In terms of its convergent validity, PSCSE had a moderate correlation (r = 0.57) with the Assessment of the Safe Nursing Care (ASNC) scale. The correlation coefficient for test-retest was ICC = 0.92 for the whole instrument and 0.89, 0.89, and 0.92 for the domains of knowledge, attitude, and skill, respectively. The internal consistency coefficient (Cronbach's alpha) of the whole tool was 0.95 and 0.95, 0.79, and 0. 95 for the domains of knowledge, attitude, and skill, respectievly. Conclusion: Persian version of the nurses' competency tool in ensuring patient safety in psychiatric wards has acceptable psychometric characteristics. Keywords: Validity, Reliability, Confirmatory factor analysis, Patient safety competency, psychiatric nurse

scholarly journals Psychometric properties of the Danish Hospital Anxiety and Depression Scale in patients with cardiac disease: results from the DenHeart survey

2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Anne Vinggaard Christensen ◽  
Jane K. Dixon ◽  
Knud Juel ◽  
Ola Ekholm ◽  
Trine Bernholdt Rasmussen ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Factor Structure ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Depression Scale ◽  
Anxiety And Depression ◽  
Divergent Validity ◽  
Hospital Anxiety ◽  
Item Functioning ◽  
Confirmatory Factor

Abstract Background Anxiety and depression symptoms are common among cardiac patients. The Hospital Anxiety and Depression Scale (HADS) is frequently used to measure symptoms of anxiety and depression; however, no study on the validity and reliability of the scale in Danish cardiac patients has been done. The aim, therefore, was to evaluate the psychometric properties of HADS in a large sample of Danish patients with the four most common cardiac diagnoses: ischemic heart disease, arrhythmias, heart failure and heart valve disease. Methods The DenHeart study was designed as a national cross-sectional survey including the HADS, SF-12 and HeartQoL and combined with data from national registers. Psychometric evaluation included analyses of floor and ceiling effects, structural validity using both exploratory and confirmatory factor analysis and hypotheses testing of convergent and divergent validity by relating the HADS scores to the SF-12 and HeartQoL. Internal consistency reliability was evaluated by Cronbach’s alpha, and differential item functioning by gender was examined using ordinal logistic regression. Results A total of 12,806 patients (response rate 51%) answered the HADS. Exploratory factor analysis supported the original two-factor structure of the HADS, while confirmatory factor analysis supported a three-factor structure consisting of the original depression subscale and two anxiety subscales as suggested in a previous study. There were floor effects on all items and ceiling effect on item 8. The hypotheses regarding convergent validity were confirmed but those regarding divergent validity for HADS-D were not. Internal consistency was good with a Cronbach’s alpha of 0.87 for HADS-A and 0.82 for HADS-D. There were no indications of noticeable differential item functioning by gender for any items. Conclusions The present study supported the evidence of convergent validity and high internal consistency for both HADS outcomes in a large sample of Danish patients with cardiac disease. There are, however, conflicting results regarding the factor structure of the scale consistent with previous research. Trial registration ClinicalTrials.gov: NCT01926145.

scholarly journals Measuring the occupational balance of people with insomnia in a Chinese population: Preliminary psychometric evidence on the Chinese version of the Occupational Balance Questionnaire

2020 ◽  
pp. 156918612094453
Author(s):  
Eris CM Ho ◽  
Mona Dür ◽  
Tanja Stamm ◽  
Andrew MH Siu
Keyword(s):  
Factor Analysis ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Well Being ◽  
Living Environment ◽  
Chinese Version ◽  
Retest Reliability ◽  
Significant Difference ◽  
Test Retest Reliability ◽  
Insomnia Severity

Background Occupational balance, a fundamental concept in occupational therapy, is the arrangement of right amount and variety of occupations contributes to a person’s health and well-being. This study was aimed to investigate the reliability and validity of the Chinese version of the Occupational Balance Questionnaire (OB-Quest) for people with insomnia. Methods The OB-Quest was translated into traditional Chinese and reviewed by an expert panel for content validity, cultural relevance and translation accuracy. Internal consistency, factor analysis and convergent validity, as well as test–retest reliability, were explored. Results The participants (n = 205), 115 adults with insomnia and 90 adults without insomnia, completed a survey of demographic background, the Chinese version of OB-Quest and the Chinese Insomnia Severity Index (C-ISI). The Chinese version of OB-Quest demonstrated excellent test–retest reliability (ICC= 0.98) and good internal consistency (Cronbach’s α  =  0.80). Factor analysis indicated that a single-factor solution explained 42% of the variance, and 9 out of 10 items had a factor loading of 0.4 or above. The Chinese version of OB-Quest had significant correlations with C-ISI (r = –0.88; p < 0.001). A significant difference was found in occupational balance between groups with different levels of insomnia severity and without insomnia (F = 169.72; p < 0.001). As in a previous study, age, living environment and life role had no significant relationship with occupational balance. Conclusion The Chinese version of OB-Quest is a short, easy to understand and culturally relevant assessment for Chinese. It demonstrates satisfactory psychometric properties and had significant correlations with insomnia.

Measurement properties of the Physical Literacy Assessment for Youth (PLAY) Tools

2020 ◽  
Author(s):  
Hilary Ann Toccacelli Caldwell ◽  
Natascja A Di Cristofaro ◽  
John Cairney ◽  
Steven R Bray ◽  
Brian W. Timmons
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Measurement Properties ◽  
School Age Children ◽  
School Age ◽  
Literacy Assessment ◽  
Physical Literacy ◽  
Rater Reliability ◽  
Method Of Evaluation ◽  
Acceptable Internal Consistency

The Physical Literacy Assessment for Youth (PLAY) Tools are a suite of tools to assess an individual’s physical literacy. The purpose of this study is to examine the psychometric properties of the PLAY Tools, including inter-rater reliability, internal consistency, validity and the associations between the tools. In this study, 218 children and youth (8.4- to- 13.7-years old) and a parent/ guardian completed the appropriate physical literacy assessments (i.e., PLAYbasic, PLAYfun, PLAYparent and PLAYself) and the Bruiniks-Oseretsky Test of Motor Proficiency (BOT-2). Inter-rater reliability for PLAYfun was excellent (ICC=0.94). The PLAYbasic, PLAYfun total, running and object control scores, and PLAYparent motor competence domain were higher in males than females, and PLAYfun locomotor skills were lower in males than females (p<0.05). Age was positively correlated with PLAYbasic and PLAYfun (r=0.14-0.32, p<0.05). BOT-2 was positively correlated with PLAYfun and PLAYbasic (r=0.19-0.59, p<0.05). PLAYbasic is a significant predictor of PLAYfun (R<sup>2</sup>=0.742, p<0.001). PLAYfun, PLAYparent and PLAYself were moderately correlated with one another. PLAYfun, PLAYparent and PLAYself demonstrated acceptable internal consistency (α=0.74-0.87, ω=0.73-0.87). The PLAY Tools demonstrated moderate associations between one another, strong inter-rater reliability and good construct and convergent validity. Continued evaluation of these tools with other populations, such as adolescents, is necessary. •In school-age children, the PLAY Tools demonstrated strong inter-rater reliability, moderate associations with one another, acceptable internal consistency and good construct and convergent validity.•The results suggest that that PLAY Tools are an acceptable method of evaluation for physical literacy in school-age children.

scholarly journals The Neuropsychiatric Inventory-Diary Rating Scale (NPI-Diary): A Method for Improving Stability in Assessing Neuropsychiatric Symptoms in Dementia

2018 ◽  
Vol 8 (3) ◽  
pp. 306-320 ◽  
Author(s):  
Francesca Morganti ◽  
Alex Soli ◽  
Paola Savoldelli ◽  
Gloria Belotti
Keyword(s):  
Health Care ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Care Setting ◽  
Rating Scale ◽  
Neuropsychiatric Symptoms ◽  
Validity And Reliability ◽  
Neuropsychiatric Inventory ◽  
Test Retest Reliability ◽  
Adequate Internal Consistency

Background: In health-care settings, the use of the Neuropsychiatric Inventory-Nursing Home (NPI-NH) may not always be consistent with the authors’ guidelines, which affects its reliability. To avoid this bias, a diary version of the NPI (NPI-Diary) was developed. Aims: This study aimed to evaluate the psychometric properties (internal consistency and reliability) of the NPI-Diary, and examined its convergence with the NPI-NH. Methods: Two raters administered the NPI-NH and NPI-Diary to 40 participants with Alzheimer’s disease, selected randomly from a hospital’s weekly turnover. Results: The NPI-Diary exhibited adequate internal consistency (total: α = 0.581) and test-retest reliability (total: ρ = 0.711; p < 0.01). The interrater reliability values (ICC) for the NPI-NH and NPI-Diary differed significantly (Total: NPI-NH ICC = 0.506, NPI-Diary ICC = 0.879; Frequency: NPI-NH ICC = 0.51, NPI-Diary ICC = 0.798; Severity: NPI-NH ICC = 0.491, NPI-Diary ICC = 0.809). The convergent validity between the two inventories was also significant (total: ρ = 0.48; p < 0.01). Conclusions: The NPI-Diary showed more appropriate validity and reliability compared to the NPI-NH, when administered in a highly variable sample, as is generally the case in the current health-care setting.

scholarly journals The Brazilian version of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C): reliability and validity in dementia

2013 ◽  
Vol 25 (9) ◽  
pp. 1503-1511 ◽  
Author(s):  
Florindo Stella ◽  
Orestes Vicente Forlenza ◽  
Jerson Laks ◽  
Larissa Pires de Andrade ◽  
Michelle A. Ljubetic Avendaño ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Rating Scale ◽  
Neuropsychiatric Symptoms ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Neuropsychiatric Inventory ◽  
Rater Reliability ◽  
Clinician Rating

ABSTRACTBackground:Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort.Methods:Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI).Results:Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS.Conclusion:The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains.

Sign in / Sign up

Export Citation Format

Share Document