Style Preference Survey: A Report on the Psychometric Properties and a Cross-Validation Experiment

2013 ◽  
Vol 24 (02) ◽  
pp. 089-104 ◽  
Author(s):  
Sherri L. Smith ◽  
Todd Ricketts ◽  
Rachel A. McArdle ◽  
Theresa H. Chisolm ◽  
Genevieve Alexander ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Hearing Aids ◽  
Cross Validation ◽  
Hearing Aid ◽  
Self Report ◽  
Initial Experiment ◽  
Retest Reliability ◽  
Validation Experiment ◽  
Test Retest Reliability

Background: Several self-report measures exist that target different aspects of outcomes for hearing aid use. Currently, no comprehensive questionnaire specifically assesses factors that may be important for differentiating outcomes pertaining to hearing aid style. Purpose: The goal of this work was to develop the Style Preference Survey (SPS), a questionnaire aimed at outcomes associated with hearing aid style differences. Two experiments were conducted. After initial item development, Experiment 1 was conducted to refine the items and to determine its psychometric properties. Experiment 2 was designed to cross-validate the findings from the initial experiment. Research Design: An observational design was used in both experiments. Study Sample: Participants who wore traditional, custom-fitted (TC) or open-canal (OC) style hearing aids from 3 mo to 3 yr completed the initial experiment. One-hundred and eighty-four binaural hearing aid users (120 of whom wore TC hearing aids and 64 of whom wore OC hearing aids) participated. A new sample of TC and OC users (n = 185) participated in the cross-validation experiment. Data Collection and Analysis: Currently available self-report measures were reviewed to identify items that might differentiate between hearing aid styles, particularly preference for OC versus TC hearing aid styles. A total of 15 items were selected and modified from available self-report measures. An additional 55 items were developed through consensus of six audiologists for the initial version of the SPS. In the first experiment, the initial SPS version was mailed to 550 veterans who met the inclusion criteria. A total of 184 completed the SPS. Approximately three weeks later, a subset of participants (n = 83) completed the SPS a second time. Basic analyses were conducted to evaluate the psychometric properties of the SPS including subscale structure, internal consistency, test-retest reliability, and responsiveness. Based on the results of Experiment 1, the SPS was revised. A cross-validation experiment was then conducted using the revised version of the SPS to confirm the subscale structure, internal consistency, and responsiveness of the questionnaire in a new sample of participants. Results: The final factor analysis led to the ultimate version of the SPS, which had a total of 35 items encompassing five subscales: (1) Feedback, (2) Occlusion/Own Voice Effects, (3) Localization, (4) Fit, Comfort, and Cosmetics, and (5) Ease of Use. The internal consistency of the total SPS (Cronbach's α = .92) and of the subscales (each Cronbach's α > .75) was high. Intraclass correlations (ICCs) showed that the test-retest reliability of the total SPS (ICC = .93) and of the subscales (each ICC > .80) also was high. TC hearing aid users had significantly poorer outcomes than OC hearing aid users on 4 of the 5 subscales, suggesting that the SPS largely is responsive to factors related to style-specific differences. Conclusions: The results suggest that the SPS has good psychometric properties and is a valid and reliable measure of outcomes related to style-specific, hearing aid preference.

scholarly journals Psychometric properties of a self-report version of the Sexual Interest and Desire Inventory for Women (SIDI-F-SR)

2020 ◽  
Author(s):  
Julia Velten ◽  
Gerrit Hirschfeld ◽  
Milena Meyers ◽  
Jürgen Margraf
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Sexual Interest ◽  
Intraclass Correlation ◽  
Self Report ◽  
Clinical Psychologist ◽  
Retest Reliability ◽  
Absolute Agreement ◽  
Test Retest Reliability ◽  
Restriction Of Range

Background: The Sexual Interest and Desire Inventory Female (SIDI-F) is a clinician-administered scale that allows for a comprehensive assessment of symptoms related to Hypoactive Sexual Desire Dysfunction (HSDD). As self-report questionnaires may facilitate less socially desirable responding and as time and resources are scarce in many clinical and research settings, a self-report version was developed (SIDI-F-SR). Aim: To investigate the agreement between the SIDI-F and a self-report version (SIDI-F-SR) and assess psychometric properties of the SIDI-F-SR. Methods: A total of 170 women (Mage=36.61, SD=10.61, range=20-69) with HSDD provided data on the SIDI-F, administered by a clinical psychologist via telephone, and the SIDI-F-SR, delivered as an Internet-based questionnaire. A subset of 19 women answered the SIDI-F-SR twice over a period of 14 weeks. Outcomes: Intraclass correlation as well as predictors of absolute agreement between SIDI-F and SIDI-F-SR, as well as internal consistency, test-retest reliability, and criterion-related validity of the SIDI-F-SR were examined. Results: There was high agreement between SIDI-F and SIDI-F-SR (ICC=.86). On average, women scored about one point higher in the self-report vs. the clinician-administered scale. Agreement was higher in young women and those with severe symptoms. Internal consistency of the SIDI-F-SR was acceptable (α=.76) and comparable to the SIDI-F (α=.74). When corrections for the restriction of range were applied, internal consistency of the SIDI-F-SR increased to .91. Test-retest-reliability was good (r=.74). Criterion-related validity was low but comparable between SIDI-F and SIDI-F-SR.

THE OBSESSIVE COMPULSIVE INVENTORY: PSYCHOMETRIC PROPERTIES IN A NONCLINICAL STUDENT SAMPLE

2000 ◽  
Vol 28 (2) ◽  
pp. 153-159 ◽  
Author(s):  
Laura M. Simonds ◽  
Susan J. Thorpe ◽  
Sandra A. Elliott
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Self Report ◽  
Obsessive Compulsive ◽  
Student Sample ◽  
Retest Reliability ◽  
High Internal Consistency ◽  
Adequate Test ◽  
Test Retest Reliability

The psychometric properties of a new scale, the Obsessive Compulsive Inventory (OCI; Foa, Kozak, Salkovskis, Coles, & Amir, 1998), were examined in a nonclinical student sample. The study was a partial replication of the original validation study by Foa et al. Test-retest reliability, internal consistency, and convergent validity were examined using a sample of 126 undergraduate psychology students. Statistical analyses (Pearson's r and Cronbach's alpha) indicated adequate test-retest reliability for the full scales and subscales (coefficients ranging from 0.69 to 0.88) and high internal consistency (all coefficients exceeding 0.7). Convergent validity with the Maudsley Obsessional Compulsive Inventory (MOCI; Hodgson & Rachman, 1977) was adequate for the full scales and for the Washing and Checking subscales (coefficients ranging from 0.61 to 0.75). The OCI is a useful supplement to existing self-report measures of obsessive-compulsive symptomatology.

scholarly journals Examining the Factor Structure and Psychometric Properties of a Guilt Management Scale (GMS)

2018 ◽  
Vol 47 (2) ◽  
pp. 181-199
Author(s):  
Katy McIvor ◽  
Amy Degnan ◽  
Lauren Pugh ◽  
Laura Bettney ◽  
Richard Emsley ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Clinical Sample ◽  
Principal Component ◽  
Preliminary Evidence ◽  
Self Report ◽  
Clinical Samples ◽  
Retest Reliability ◽  
Thought Control ◽  
Test Retest Reliability

Background: Guilt is commonly associated with distress and psychopathology. However, there is a lack of validated measures that assess how people cope with this aversive emotional and cognitive experience. Aims: We therefore developed and validated a self-report measure that assesses how people manage their guilt: the Guilt Management Scale (GMS). Method: The GMS was administered to a non-clinical (n = 339) and clinical (n = 67) sample, alongside other validated measures of guilt severity, coping, thought control and psychological distress. Results from a principal component analysis (PCA) and assessments of test–retest reliability and internal consistency are presented. Results: The PCA yielded a six subscale solution (Self-Punishment, Reparation, People-Focused, Spirituality, Avoidance and Metacognition), accounting for 56.14% of variance. Test–retest reliability and internal consistency was found to be good–excellent for the majority of subscales. Across samples, Self-Punishment was related to higher levels of guilt and distress whilst Metacognition and Reparation were related to less guilt and distress in the non-clinical sample only. Conclusions: This paper provides preliminary evidence for the psychometric properties of the GMS in a non-clinical sample. With development and validation in clinical samples, the GMS could be used to inform psychological formulations of guilt and assess therapy outcomes.

scholarly journals Reliability and validity of the Persian version of 5-D itching scale among patients with chronic kidney disease

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Amin Kordi Yoosefinejad ◽  
Fatemeh Karjalian ◽  
Marzieh Momennasab ◽  
Shahrokh Ezzatzadegan Jahromi
Keyword(s):  
Chronic Kidney Disease ◽  
Kidney Disease ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Reliability And Validity ◽  
Hemodialysis Patients ◽  
Life Questionnaire ◽  
Retest Reliability ◽  
Persian Version ◽  
Test Retest Reliability

Abstract Background Hemodialysis is considered a major therapeutic method for patients with chronic kidney disease. Pruritus is a common complaint of hemodialysis patients. The 5-D pruritus scale is amongst the most common tools to evaluate several dimensions of itch. Psychometric properties of the 5-D scale have not been evaluated in Persian speaking population with hemodialysis; hence, the objective of this study was to assess reliability and validity of the Persian version of the scale. Methods Ninety hemodialysis patients (men: 50, women: 40, mean age: 54.4 years) participated in this cross-sectional study. The final Persian version of 5-D scale was given to the participants. Tests Compared: One-third of the participants completed the scale twice within 3–7 days apart to evaluate test- retest reliability. Other psychometric properties including internal consistency, absolute reliability, convergent, discriminative and construct validity, floor/ceiling effects were also evaluated. Results The Persian 5-D scale has strong test-retest reliability (ICC= 0.98) and internal consistency (Cronbach’s alpha= 0.99). Standard error of measurement and minimal detectable change were 0.33 and 0.91, respectively. Regarding convergent validity, the scale had moderate correlation with numeric rating scale (r =0.67) and quality of life questionnaire related to itch (r = 0.59). Exploratory factor analysis revealed two factors within the scale. No floor or ceiling effect was found for the scale. Conclusion The Persian version of 5-D the itching scale is a brief instrument with acceptable reliability and validity. Therefore, the scale could be used by experts, nurses, and other health service providers to evaluate pruritus among Persian speaking hemodialysis patients.

scholarly journals Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Critical Thinking ◽  
Medical Students ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Retest Reliability ◽  
Critical Thinking Disposition ◽  
Thinking Disposition ◽  
Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

Validation of the Beliefs of Physical Activity among Clergy (B-PAC) Instrument

2017 ◽  
Vol 32 (2) ◽  
Author(s):  
Shannon Gwin ◽  
Paul Branscum ◽  
E. Laurette Taylor
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Retest Reliability ◽  
Reliable Instrument ◽  
The Stability ◽  
Test Retest Reliability

The purpose of this study was to create a valid and reliable instrument to evaluate theory-basedbeliefs towards physical activity among clergy members. Data were collected from 174 clergy that par-ticipated in a 15-item online and paper-based survey. Psychometric properties of the instrument includedconfirmatory factor analysis (construct validity), and cronbach’s alpha (internal consistency reliability).In addition, the stability (test-retest reliability) of each subscale was evaluated with a sub-sample of 30participants. Results show the instrument was both valid and reliable, and will be useful in future studiestargeting this population. Future implications are discussed.

Psychometric properties of patient reported outcome (PRO) instruments in patients with small cell lung cancer (SCLC) in RESILIENT part 1.

2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e24027-e24027
Author(s):  
Jaba Kokhreidze ◽  
Veleka Allen ◽  
Cristina Ivanescu ◽  
Xiaopan Valerie Yao ◽  
Bin Zhang ◽  
...  
Keyword(s):  
Lung Cancer ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Life Questionnaire ◽  
Retest Reliability ◽  
Patient Reported ◽  
Eortc Qlq ◽  
Test Retest Reliability ◽  
Pro Instruments

e24027 Background: The ongoing two-part phase 2/3 RESILIENT study (NCT03088813) is investigating the efficacy and safety of liposomal irinotecan monotherapy in patients with SCLC who have progressed on or after first line platinum-based chemotherapy. This exploratory analysis from RESILIENT part 1 was conducted to confirm the psychometric properties of established PRO instruments that had not previously been validated in patients with SCLC. Methods: Patients completed the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ) Core 30 (C30) and the EORTC QLQ Lung Cancer 13 (LC13) before treatment assignment (baseline), every 6 weeks thereafter, at treatment discontinuation and at the 30-day follow-up visit. Psychometric methods included descriptive statistics (items and scales), correlations (item-to-item and item-to-total), internal consistency (Cronbach’s α), test-retest reliability (intraclass correlation coefficient [ICC], two-way random effects model), construct validity and sensitivity to change. The analysis included patients who received at least one dose of study drug and completed at least one PRO assessment. Results: Thirty patients were enrolled in RESILIENT part 1 and included in the analysis. At baseline, 68% of patients reported ‘not severe’ or ‘mild’ symptoms. Floor effects (i.e. more than 25% of responses of ‘not at all’) were observed for several of the functioning/impact and symptom scales of the EORTC QLQ C30 and LC13. Moderate to strong correlations were found among most questionnaire items within their respective scales. Acceptable evidence for internal consistency and good test-retest reliability were observed. Selected results for the EORTC QLQ LC13, including dyspnea scales, are shown in the Table. The magnitude of correlations among PRO instruments supported evidence for convergent validity in this sample. Conclusions: In RESILIENT part 1, patients experienced low and tolerable symptoms at enrollment, limiting the potential for further improvement. Overall, these PRO instruments had acceptable psychometric properties (e.g. construct validity, reliability and ability to detect change) in this sample. However, these analyses should be repeated in a larger sample using data from RESILIENT part 2. Clinical trial information: NCT03088813. [Table: see text]

Developing a measure to assess clinicians’ ability to reflect on key staff–patient dynamics in forensic settings

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Adam Polnay ◽  
Helen Walker ◽  
Christopher Gallacher
Keyword(s):  
Reflective Practice ◽  
Factor Structure ◽  
Internal Consistency ◽  
Self Report ◽  
Face Validity ◽  
Good Test ◽  
Data Set ◽  
Retest Reliability ◽  
Content Type ◽  
Test Retest Reliability

Purpose Relational dynamics between patients and staff in forensic settings can be complicated and demanding for both sides. Reflective practice groups (RPGs) bring clinicians together to reflect on these dynamics. To date, evaluation of RPGs has lacked quantitative focus and a suitable quantitative tool. Therefore, a self-report tool was designed. This paper aims to pilot The Relational Aspects of CarE (TRACE) scale with clinicians in a high-secure hospital and investigate its psychometric properties. Design/methodology/approach A multi-professional sample of 80 clinicians were recruited, completing TRACE and attitudes to personality disorder questionnaire (APDQ). Exploratory factor analysis (EFA) determined factor structure and internal consistency of TRACE. A subset was selected to measure test–retest reliability. TRACE was cross-validated against the APDQ. Findings EFA found five factors underlying the 20 TRACE items: “awareness of common responses,” “discussing and normalising feelings;” “utilising feelings,” “wish to care” and “awareness of complicated affects.” This factor structure is complex, but items clustered logically to key areas originally used to generate items. Internal consistency (α = 0.66, 95% confidence interval (CI) = 0.55–0.76) demonstrated borderline acceptability. TRACE demonstrated good test–retest reliability (intra-class correlation = 0.94, 95% CI = 0.78–0.98) and face validity. TRACE indicated a slight negative correlation with APDQ. A larger data set is needed to substantiate these preliminary findings. Practical implications Early indications suggested TRACE was valid and reliable, suitable to measure the effectiveness of reflective practice. Originality/value The TRACE was a distinctive measure that filled a methodological gap in the literature.

scholarly journals The Persian Version of the Fear of Cancer Recurrence Inventory (FCRI): Translation and Evaluation of Its Psychometric Properties

2019 ◽  
pp. 174-180
Author(s):  
Fatemeh Sadat Bateni ◽  
Maryam Rahmatian ◽  
Ahmad Kaviani ◽  
Sebastian Simard ◽  
Mehdi Soleimani ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Goodness Of Fit ◽  
Cancer Recurrence ◽  
Fear Of Cancer Recurrence ◽  
Retest Reliability ◽  
Persian Version ◽  
Fear Of Cancer ◽  
Test Retest Reliability

Background: This study aimed to translate and validate the Fear of Cancer Recurrence Inventory (FCRI) questionnaire into Persian and to investigate its psychometric properties. Methods: The FCRI was translated to Persian using a linguistic methodology according to WHO guidelines. A total of 450 breast cancer survivors who had the following inclusion criteria were included: time elapse of more than six months after the treatment prior to the study; absence ofobjective markers of recurrence, fluency in the Persian language, and signing the informed consent. Internal consistency was estimated with Cronbach's α coefficient and test-retest reliability with Interclass correlation.  Concurrent validity was estimated through Pearson’s correlation between the FCRI and Hospital Anxiety and Depression Scale (HADS). Principal component analysis (PCA) and confirmatory factor analysis (CFA) were employed to evaluate dimensionality. Results: The Persian version was acceptable for patients. The content validity index (CVI) was 0.80.  The instrument had good test-retest reliability (ICC= 0.96) and internal consistency (Cronbach’s α=0.86).  PCA and CFA indicated that the factor structure of the Persian version was similar to the original questionnaire and had acceptable goodness of fit.  Correlations between the FCRI and HADS was remarkable (r= 0.252 – 0.639), indicating acceptable concurrent validity. Conclusions: The Persian version of FCRI could be considered a good cross-cultural equivalent for the original English version. The questionnaire was a reliable and valid instrument in terms of internal consistency, test-retest reliability, and dimensionality.

scholarly journals Patient Continuity of Care Questionnaire in a cardiac sample: A Confirmatory Factor Analysis

BMJ Open ◽  
2020 ◽  
Vol 10 (7) ◽  
pp. e037129
Author(s):  
Emma Säfström ◽  
Lena Nasstrom ◽  
Maria Liljeroos ◽  
Lena Nordgren ◽  
Kristofer Årestedt ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Factor Structure ◽  
Continuity Of Care ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Evaluation Study ◽  
Sampling Procedure ◽  
Retest Reliability ◽  
Confirmatory Factor ◽  
Test Retest Reliability

ObjectiveEven though continuity is essential after discharge, there is a lack of reliable questionnaires to measure and assess patients’ perceptions of continuity of care. The Patient Continuity of Care Questionnaire (PCCQ) addresses the period before and after discharge from hospital. However, previous studies show that the factor structure needs to be confirmed and validated in larger samples, and the aim of this study was to evaluate the psychometric properties of the PCCQ with focus on factor structure, internal consistency and stability.DesignA psychometric evaluation study. The questionnaire was translated into Swedish using a forward–backward technique and culturally adapted through cognitive interviews (n=12) and reviewed by researchers (n=8).SettingData were collected in four healthcare settings in two Swedish counties.ParticipantsA consecutive sampling procedure included 725 patients discharged after hospitalisation due to angina, acute myocardial infarction, heart failure or atrial fibrillation.MeasurementTo evaluate the factor structure, confirmatory factor analyses based on polychoric correlations were performed (n=721). Internal consistency was evaluated by ordinal alpha. Test–retest reliability (n=289) was assessed with intraclass correlation coefficient (ICC).ResultsThe original six-factor structure was overall confirmed, but minor refinements were required to reach satisfactory model fit. The standardised factor loadings ranged between 0.68 and 0.94, and ordinal alpha ranged between 0.82 and 0.95. All subscales demonstrated satisfactory test–retest reliability (ICC=0.76–0.94).ConclusionThe revised version of the PCCQ showed sound psychometric properties and is ready to be used to measure perceptions of continuity of care. High ordinal alpha in some subscales indicates that a shorter version of the questionnaire can be developed.

Sign in / Sign up

Export Citation Format

Share Document