Developing a measure to assess clinicians’ ability to reflect on key staff–patient dynamics in forensic settings

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Adam Polnay ◽  
Helen Walker ◽  
Christopher Gallacher
Keyword(s):  
Reflective Practice ◽  
Factor Structure ◽  
Internal Consistency ◽  
Self Report ◽  
Face Validity ◽  
Good Test ◽  
Data Set ◽  
Retest Reliability ◽  
Content Type ◽  
Test Retest Reliability

Purpose Relational dynamics between patients and staff in forensic settings can be complicated and demanding for both sides. Reflective practice groups (RPGs) bring clinicians together to reflect on these dynamics. To date, evaluation of RPGs has lacked quantitative focus and a suitable quantitative tool. Therefore, a self-report tool was designed. This paper aims to pilot The Relational Aspects of CarE (TRACE) scale with clinicians in a high-secure hospital and investigate its psychometric properties. Design/methodology/approach A multi-professional sample of 80 clinicians were recruited, completing TRACE and attitudes to personality disorder questionnaire (APDQ). Exploratory factor analysis (EFA) determined factor structure and internal consistency of TRACE. A subset was selected to measure test–retest reliability. TRACE was cross-validated against the APDQ. Findings EFA found five factors underlying the 20 TRACE items: “awareness of common responses,” “discussing and normalising feelings;” “utilising feelings,” “wish to care” and “awareness of complicated affects.” This factor structure is complex, but items clustered logically to key areas originally used to generate items. Internal consistency (α = 0.66, 95% confidence interval (CI) = 0.55–0.76) demonstrated borderline acceptability. TRACE demonstrated good test–retest reliability (intra-class correlation = 0.94, 95% CI = 0.78–0.98) and face validity. TRACE indicated a slight negative correlation with APDQ. A larger data set is needed to substantiate these preliminary findings. Practical implications Early indications suggested TRACE was valid and reliable, suitable to measure the effectiveness of reflective practice. Originality/value The TRACE was a distinctive measure that filled a methodological gap in the literature.

scholarly journals Psychometric properties of the Suicidal Ideation Attributes Scale (SIDAS) in a longitudinal sample of people experiencing non-affective psychosis

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Kamelia Harris ◽  
Gillian Haddock ◽  
Sarah Peters ◽  
Patricia Gooding
Keyword(s):  
Suicidal Ideation ◽  
Construct Validity ◽  
Factor Structure ◽  
Internal Consistency ◽  
Suicide Ideation ◽  
Self Report ◽  
Affective Psychosis ◽  
Retest Reliability ◽  
High Internal Consistency ◽  
Test Retest Reliability

Abstract Background Suicidal ideation is a key precursor for suicide attempts and suicide deaths. Performing routine screening of suicide precursors can help identify people who are at high risk of death by suicide. This is, arguably, an important suicide prevention effort. The aim of this study was to assess the validity, reliability, and factor structure of the Suicidal Ideation Attributes Scale (SIDAS) in a three-month longitudinal study with people with a diagnosis of schizophrenia or non-affective psychosis and experiences of suicidal ideation and/or behaviours. It was predicted that the SIDAS would have high internal consistency, test-retest reliability, convergent, discriminant and construct validity. Methods Ninety-nine participants experiencing psychosis completed the SIDAS at baseline and 89 participants completed it 3 months later. Additionally, participants completed a demographic questionnaire, the Beck Scale for Suicide Ideation, the Beck Hopelessness Scale, and the Defeat and Entrapment Scales. The internal consistency, test-retest reliability, convergent validity, and discriminant validity of the SIDAS were investigated in comparison to other constructs. Factor analysis was performed to examine the factor structure of the scale. Results Principal component analysis yielded a theoretically coherent one-dimensional factor structure of SIDAS, suggesting good construct validity (PCA = .71). The SIDAS had high internal consistency (α = .89) and good test-retest reliability (α = .73). It was highly correlated with other self-report measures, including the Beck Scale for Suicide Ideation, Beck Hopelessness Scale, Defeat and Entrapment scales, indicating excellent construct validity. Conclusion The SIDAS is a valid and reliable self-report instrument for assessing the severity of suicidal ideation in a population of people with a diagnosis of schizophrenia or non-affective psychosis. Further research should test the psychometric properties of the scale in individuals experiencing different mental health problems in cross-cultural settings, in order to establish its broader validity, reliability, and clinical utility.

scholarly journals Evaluating the effectiveness of a single-day simulation-based program in psychiatry for medical students: a controlled study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Nadia Younes ◽  
Anne Laure Delaunay ◽  
M. Roger ◽  
Pierre Serra ◽  
France Hirot ◽  
...  
Keyword(s):  
Medical Students ◽  
Factor Structure ◽  
Internal Consistency ◽  
Controlled Study ◽  
Simulated Patients ◽  
Control Group ◽  
Retest Reliability ◽  
Knowledge And Attitudes ◽  
Simulation Group ◽  
Test Retest Reliability

Abstract Background Training in psychiatry requires specific knowledge, attitudes, and skills that are obtainable by simulation, of which the use is only recent and still needs further development. Evidence is accumulating on its effectiveness but requires further validation for medical students. We aimed to evaluate the effectiveness of a single-day optional teaching program in psychiatry by simulation for medical students and validate a scale measuring Confidence in Psychiatric Clinical Skills (CPCQ), as part of the assessment. Methods This was a controlled study in a French University that compared (using paired-sample Student t-tests) knowledge and attitudes (university grades and CPCQ scores) before, just after teaching with simulated patients, and 2 months later. Satisfaction with the program (including the quality of the debriefing) was also investigated. The CPCQ scale was validated by assessing the factor structure, internal consistency, and test-retest reliability. Finally, a comparison was run with a control group who received the usual psychiatric instruction using covariance analyses. Results Twenty-four medical students were included in the simulation group and 76 in the control group. Just after the simulation, knowledge and attitudes increased significantly in the simulation group. Satisfaction with the training and debriefing was very high. The CPCQ scale showed good psychometric properties: a single-factor structure, acceptable internal consistency (α = 0.73 [0.65–0.85]), and good test-retest reliability (ICC = 0.71 [0.35–0.88]). Two months after the simulation, knowledge and attitudes were significantly higher in the simulation group than the control group, despite a lack of difference in knowledge before the simulation. Conclusions Adding a simulation program in psychiatry to the usual teaching improved the knowledge and confidence of medical students. The CPCQ scale could be used for the evaluation of educational programs.

scholarly journals Psychometric properties of a self-report version of the Sexual Interest and Desire Inventory for Women (SIDI-F-SR)

2020 ◽  
Author(s):  
Julia Velten ◽  
Gerrit Hirschfeld ◽  
Milena Meyers ◽  
Jürgen Margraf
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Sexual Interest ◽  
Intraclass Correlation ◽  
Self Report ◽  
Clinical Psychologist ◽  
Retest Reliability ◽  
Absolute Agreement ◽  
Test Retest Reliability ◽  
Restriction Of Range

Background: The Sexual Interest and Desire Inventory Female (SIDI-F) is a clinician-administered scale that allows for a comprehensive assessment of symptoms related to Hypoactive Sexual Desire Dysfunction (HSDD). As self-report questionnaires may facilitate less socially desirable responding and as time and resources are scarce in many clinical and research settings, a self-report version was developed (SIDI-F-SR). Aim: To investigate the agreement between the SIDI-F and a self-report version (SIDI-F-SR) and assess psychometric properties of the SIDI-F-SR. Methods: A total of 170 women (Mage=36.61, SD=10.61, range=20-69) with HSDD provided data on the SIDI-F, administered by a clinical psychologist via telephone, and the SIDI-F-SR, delivered as an Internet-based questionnaire. A subset of 19 women answered the SIDI-F-SR twice over a period of 14 weeks. Outcomes: Intraclass correlation as well as predictors of absolute agreement between SIDI-F and SIDI-F-SR, as well as internal consistency, test-retest reliability, and criterion-related validity of the SIDI-F-SR were examined. Results: There was high agreement between SIDI-F and SIDI-F-SR (ICC=.86). On average, women scored about one point higher in the self-report vs. the clinician-administered scale. Agreement was higher in young women and those with severe symptoms. Internal consistency of the SIDI-F-SR was acceptable (α=.76) and comparable to the SIDI-F (α=.74). When corrections for the restriction of range were applied, internal consistency of the SIDI-F-SR increased to .91. Test-retest-reliability was good (r=.74). Criterion-related validity was low but comparable between SIDI-F and SIDI-F-SR.

Revision of the Infant Temperament Questionnaire

PEDIATRICS ◽  
1978 ◽  
Vol 61 (5) ◽  
pp. 735-739 ◽  
Author(s):  
William B. Carey ◽  
Sean C. McDevitt
Keyword(s):  
Internal Consistency ◽  
Content Area ◽  
Infant Temperament ◽  
Psychometric Characteristics ◽  
Good Test ◽  
Retest Reliability ◽  
New Form ◽  
Test Retest Reliability

The Infant Temperament Questionnaire, originally published in 1970, has been revised to improve its psychometric characteristics. The number of items was increased from 70 to 95, rating options were increased from three to six, more items have high-low reversals, and they are randomized as to content area. The new form was standardized on 203 4- to 8-month-old infants. Good test-retest reliability was maintained and internal consistency of the nine categories was raised to a higher level, thereby assuring a greater reliability of the instrument. These improvements should enhance the questionnaire's use in clinical and research applications.

scholarly journals Patient Continuity of Care Questionnaire in a cardiac sample: A Confirmatory Factor Analysis

BMJ Open ◽  
2020 ◽  
Vol 10 (7) ◽  
pp. e037129
Author(s):  
Emma Säfström ◽  
Lena Nasstrom ◽  
Maria Liljeroos ◽  
Lena Nordgren ◽  
Kristofer Årestedt ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Factor Structure ◽  
Continuity Of Care ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Evaluation Study ◽  
Sampling Procedure ◽  
Retest Reliability ◽  
Confirmatory Factor ◽  
Test Retest Reliability

ObjectiveEven though continuity is essential after discharge, there is a lack of reliable questionnaires to measure and assess patients’ perceptions of continuity of care. The Patient Continuity of Care Questionnaire (PCCQ) addresses the period before and after discharge from hospital. However, previous studies show that the factor structure needs to be confirmed and validated in larger samples, and the aim of this study was to evaluate the psychometric properties of the PCCQ with focus on factor structure, internal consistency and stability.DesignA psychometric evaluation study. The questionnaire was translated into Swedish using a forward–backward technique and culturally adapted through cognitive interviews (n=12) and reviewed by researchers (n=8).SettingData were collected in four healthcare settings in two Swedish counties.ParticipantsA consecutive sampling procedure included 725 patients discharged after hospitalisation due to angina, acute myocardial infarction, heart failure or atrial fibrillation.MeasurementTo evaluate the factor structure, confirmatory factor analyses based on polychoric correlations were performed (n=721). Internal consistency was evaluated by ordinal alpha. Test–retest reliability (n=289) was assessed with intraclass correlation coefficient (ICC).ResultsThe original six-factor structure was overall confirmed, but minor refinements were required to reach satisfactory model fit. The standardised factor loadings ranged between 0.68 and 0.94, and ordinal alpha ranged between 0.82 and 0.95. All subscales demonstrated satisfactory test–retest reliability (ICC=0.76–0.94).ConclusionThe revised version of the PCCQ showed sound psychometric properties and is ready to be used to measure perceptions of continuity of care. High ordinal alpha in some subscales indicates that a shorter version of the questionnaire can be developed.

Test-Retest Reliability of the Holyoake Codependency Index with Australian Students

2004 ◽  
Vol 94 (2) ◽  
pp. 482-484 ◽  
Author(s):  
Greg E. Dear
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Internal Validity ◽  
Self Report ◽  
Full Scale Test ◽  
Retest Reliability ◽  
External Focus ◽  
Scale Test ◽  
Test Retest Reliability ◽  
Report Measure

The Holyoake Codependency Index is a 13-item self-report measure of three aspects of codependency: External Focus, Self-sacrifice, and a sense of being overwhelmed by another person's problematic behavior (termed Reactivity). Previous studies have supported internal validity and the internal consistency and construct validity of the subscales. The present scores for 59 students indicate full scale test-retest reliability of .88 and for subscales (.76 to .82) over a 3-wk. interval.

scholarly journals Validation of the Strengths and Difficulties Self-Report in Norwegian Sign Language

2019 ◽  
Vol 25 (1) ◽  
pp. 91-104 ◽  
Author(s):  
Chris Margaret Aanondsen ◽  
Thomas Jozefiak ◽  
Kerstin Heiling ◽  
Tormod Rimehaug
Keyword(s):  
Mental Health ◽  
Sign Language ◽  
Internal Consistency ◽  
Mental Health Problems ◽  
Health Problems ◽  
Self Report ◽  
Equation Modeling ◽  
Retest Reliability ◽  
Strengths And Difficulties ◽  
Test Retest Reliability

Abstract The majority of studies on mental health in deaf and hard-of-hearing (DHH) children report a higher level of mental health problems. Inconsistencies in reports of prevalence of mental health problems have been found to be related to a number of factors such as language skills, cognitive ability, heterogeneous samples as well as validity problems caused by using written measures designed for typically hearing children. This study evaluates the psychometric properties of the self-report version of the Strengths and Difficulties Questionnaire (SDQ) in Norwegian Sign Language (NSL; SDQ-NSL) and in written Norwegian (SDQ-NOR). Forty-nine DHH children completed the SDQ-NSL as well as the SDQ-NOR in randomized order and their parents completed the parent version of the SDQ-NOR and a questionnaire on hearing and language-related information. Internal consistency was examined using Dillon–Goldstein’s rho, test–retest reliability using intraclass correlations, construct validity by confirmatory factor analysis (CFA), and partial least squares structural equation modeling. Internal consistency and test–retest reliability were established as acceptable to good. CFA resulted in a best fit for the proposed five-factor model for both versions, although not all fit indices reached acceptable levels. The reliability and validity of the SDQ-NSL seem promising even though the validation was based on a small sample size.

scholarly journals The Modified Gait Efficacy Scale: Establishing the Psychometric Properties in Older Adults

2012 ◽  
Vol 92 (2) ◽  
pp. 318-328 ◽  
Author(s):  
Alaina M. Newell ◽  
Jessie M. VanSwearingen ◽  
Elizabeth Hile ◽  
Jennifer S. Brach
Keyword(s):  
Older Adults ◽  
Correlation Coefficient ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Community Dwelling ◽  
Self Report ◽  
Retest Reliability ◽  
And Performance ◽  
Test Retest Reliability ◽  
Community Dwelling Older Adults

BackgroundPerceived ability or confidence plays an important role in determining function and behavior. The modified Gait Efficacy Scale (mGES) is a 10-item self-report measure used to assess walking confidence under challenging everyday circumstances.ObjectiveThe purpose of this study was to determine the reliability, internal consistency, and validity of the mGES as a measure of gait in older adults.DesignThis was a cross-sectional study.MethodsParticipants were 102 community-dwelling older adults (mean [±SD] age=78.6±6.1 years) who were independent in ambulation with or without an assistive device. Participants were assessed using the mGES and measures of confidence and fear, measures of function and disability, and performance-based measures of mobility. In a subsample (n=26), the mGES was administered twice within a 1-month period to establish test-retest reliability through the intraclass correlation coefficient (ICC [2,1]). The standard error of measure (SEM) was determined from the ICC and standard deviation. The Cronbach α value was calculated to determine internal consistency. To establish the validity of the mGES, the Spearman rank order correlation coefficient was used to examine the association with measures of confidence, fear, gait, and physical function and disability.ResultsThe mGES demonstrated test-retest reliability within the 1-month period (ICC=.93, 95% confidence interval=.85, .97). The SEM of the mGES was 5.23. The mGES was internally consistent across the 10 items (Cronbach α=.94). The mGES was related to measures of confidence and fear (r=.54–.88), function and disability (Late-Life Function and Disability Instrument, r=.32–.88), and performance-based mobility (r=.38–.64).LimitationsThis study examined only community-dwelling older adults. The results, therefore, should not be generalized to other patient populations.ConclusionThe mGES is a reliable and valid measure of confidence in walking among community-dwelling older adults.

scholarly journals Reliability and Construct Validity of Self-Report Questionnaires for Patients With Pelvic Girdle Pain

2012 ◽  
Vol 92 (1) ◽  
pp. 111-123 ◽  
Author(s):  
Margreth Grotle ◽  
Andrew M. Garratt ◽  
Hanne Krogstad Jenssen ◽  
Britt Stuge
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Pelvic Girdle ◽  
Self Report ◽  
Pelvic Girdle Pain ◽  
Consistency Test ◽  
Retest Reliability ◽  
Sf 36 ◽  
Test Retest Reliability

Background There is little evidence for the measurement properties of instruments commonly used for women with pelvic girdle pain. Objective The aim of this study was to examine the internal consistency, test-retest reliability, and construct validity of instruments used for women with pelvic girdle pain. Design This was a cross-sectional methodology study, including test-retest reliability assessment. Methods Women with pelvic girdle pain in pregnancy and after delivery participated in a postal survey that included the Pelvic Girdle Questionnaire (PGQ), Oswestry Disability Index (ODI), Disability Rating Index (DRI), Fear-Avoidance Beliefs Questionnaire (FABQ), Pain Catastrophizing Scale (PCS), and 8-item version of the Medical Outcomes Study 36-Item Short-Form Health Survey questionnaire (SF-36). Test-retest reliability was assessed with a random subsample 1 week later. Internal consistency was assessed with the Cronbach alpha, and test-retest reliability was assessed with the intraclass correlation coefficient (ICC) and minimal detectable change (MDC). Construct validity based on hypotheses was assessed by correlation analysis. Discriminant validity was assessed with the area under the receiver operating characteristic curve. Results All participants responded to the main (N=87) and test-retest (n=42) surveys. Cronbach alpha values ranged from .88 to .94, and ICCs ranged from .78 to .94. The MDC at the individual level constituted about 7% to 14% of total scores for the 8-item version of the SF-36, ODI, and PGQ activity subscale; about 18% to 22% for the DRI, PGQ symptom subscale, and PCS; and about 25% for the FABQ. Hypotheses were mostly confirmed by correlations between the instruments. The PGQ was the only instrument that significantly discriminated participants who were pregnant from participants who were not pregnant as well as pain locations. Limitations A comparison of responsiveness to change of the various instruments used in this study was not undertaken, but will be carried out in a future study. Conclusions Self-report instruments for assessing health showed good internal consistency, test-retest reliability, and construct validity for women with pelvic girdle pain. The PGQ was the only instrument with satisfactory discriminant validity, thus, it is recommended for evaluating symptoms and disability in patients with pelvic girdle pain.

Sign in / Sign up

Export Citation Format

Share Document