A New Approach to Collecting Survey Data: An Item Response Icon Scale (IRIS)

Author(s):  
Leslie Beth Herbert ◽  
Donald I. Tepas

Obtaining worker survey data can be a time consuming process. A survey often employs a large number of items, and considerable effort is required to assure that the items used will be understood by the target worker population. To facilitate the research process in a diverse worker population, a five-point Item Response Icon Scale (IRIS) was developed using the symbols found in Wingdings, a standard font included in many microcomputer word processing programs. The IRIS and a five-point verbal Likert-type Scale were found to be parallel forms, with demonstration of statistically significant parallel forms reliability and convergent validity. These findings, along with that of discriminant validity, indicate that IRIS and Likert-type Scale produce interchangeable data when given to individuals with reading skills. This suggests that the IRIS may be a valuable design tool for collecting survey data from worker groups with diverse reading skills and/or from different cultural backgrounds.

Author(s):  
Chee-Seng Tan ◽  
Shue-Ling Chong ◽  
Argel Bondoc Masanda ◽  
Sanju George

The nine-item Interdependent Happiness Scale (IHS; Hitokoto & Uchida, 2015) is a self-report of interpersonal happiness that focuses on three dimensions: relationship-oriented happiness, quiescent happiness, and ordinary happiness. Few studies have evaluated the psychometric properties of the IHS in diverse cultural backgrounds and the findings are inconsistent. This study investigated whether the IHS has sound psychometric qualities in three Asian countries. University students from Malaysia (n = 263), Philippines (n = 239), and India (n = 310) answered the IHS and self-rated creativity scale. Confirmatory factor analysis on each sample supported the nine-item second-order model with error covariances. The overall IHS score showed good reliability in all samples. The subscales, however, had mixed results except for the Indian sample. Similarly, the convergent validity test showed mixed results while discriminant validity is supported in all samples except for the quiescent happiness subscale in the Indian sample. Concurrent validity was established across three samples by showing a positive relationship with creativity score. The results highlight that the higher-order structure of the IHS is consistently supported in different cultural contexts. However, some of the items are perceived differently and require further improvement in enhancing the cross-cultural usability of the IHS to measure socially-oriented happiness.


GeroPsych ◽  
2014 ◽  
Vol 27 (1) ◽  
pp. 23-31 ◽  
Author(s):  
Anne Kuemmel (This author contributed eq ◽  
Julia Haberstroh (This author contributed ◽  
Johannes Pantel

Communication and communication behaviors in situational contexts are essential conditions for well-being and quality of life in people with dementia. Measuring methods, however, are limited. The CODEM instrument, a standardized observational communication behavior assessment tool, was developed and evaluated on the basis of the current state of research in dementia care and social-communicative behavior. Initially, interrater reliability was examined by means of videoratings (N = 10 people with dementia). Thereupon, six caregivers in six German nursing homes observed 69 residents suffering from dementia and used CODEM to rate their communication behavior. The interrater reliability of CODEM was excellent (mean κ = .79; intraclass correlation = .91). Statistical analysis indicated that CODEM had excellent internal consistency (Cronbach’s α = .95). CODEM also showed excellent convergent validity (Pearson’s R = .88) as well as discriminant validity (Pearson’s R = .63). Confirmatory factor analysis verified the two-factor solution of verbal/content aspects and nonverbal/relationship aspects. With regard to the severity of the disease, the content and relational aspects of communication exhibited different trends. CODEM proved to be a reliable, valid, and sensitive assessment tool for examining communication behavior in the field of dementia. CODEM also provides researchers a feasible examination tool for measuring effects of psychosocial intervention studies that strive to improve communication behavior and well-being in dementia.


2013 ◽  
Vol 29 (3) ◽  
pp. 213-219 ◽  
Author(s):  
Astrid Müller ◽  
Laurence Claes ◽  
Dirk Smits ◽  
Olaf Gefeller ◽  
Anja Hilbert ◽  
...  

This study evaluated the psychometric properties of the German version of the 21-item Exercise Dependence Scale (EDS-G), which was administered in a large representative German sample (N = 1,611). In order to examine convergent validity, we also asked participants to answer the Eating Disorder Examination-Questionnaire (EDE-Q). To investigate the discriminant validity, clients of fitness centers (N = 129), sport students (N = 85), and medical students (N = 129) filled out the EDS-G. In this German population-based sample, the seven-factor structure suggested by the original authors as well as a higher-order model (7 + 1 factor model) were supported. The total EDS-G scale showed an excellent internal reliability and was positively related to the EDE-Q total and subscale scores. The EDS-G scores differentiated between samples with varying degrees of exercise. In summary, the results indicate that the EDS-G is a psychometrically sound and potentially valid brief measure for the assessment of exercise dependence symptoms.


2010 ◽  
Vol 26 (1) ◽  
pp. 3-10 ◽  
Author(s):  
Nale Lehmann-Willenbrock ◽  
Simone Kauffeld

In research on trust in the organizational context, there is some agreement evolving that trust should be measured with respect to various foci. The Workplace Trust Survey (WTS) by Ferres (2002) provides reliable assessment of coworker, supervisor, and organizational trust. By means of a functionally equivalent translation, we developed a German version of the questionnaire (G-WTS) comprising 21 items. A total of 427 employees were surveyed with the G-WTS and questionnaires concerning several work-related attitudes and behaviors and 92 of these completed the survey twice. The hypothesized three-dimensional conceptualization of organizational trust was confirmed by confirmatory factor analysis. The G-WTS showed good internal consistency and retest reliability values. Concerning convergent validity, all of the three G-WTS dimensions positively predicted job satisfaction. In terms of discriminant validity, Coworker Trust enhanced group cohesion; Supervisor Trust fostered innovative behavior, while Organizational Trust was associated with affective commitment. Theoretical and practical contributions as well as opportunities for future research with the G-WTS are discussed.


2015 ◽  
Vol 31 (4) ◽  
pp. 302-309 ◽  
Author(s):  
Maria Pedro Sobral ◽  
Maria Emília Costa

Abstract. We developed a new instrument designed to measure fear of intimacy in romantic relationships. We suggest assessing fear of intimacy through two dimensions: self-revelation and dependence. The Fear of Intimacy Components Questionnaire (FICQ) was validated across three studies in which a 10-item solution systematically emerged. Consistently with a two component perspective, a two-factor solution fitted data the best: fear of losing the self (FLS) and fear of losing the other (FLO). Qualitative analyses verified content validity. Exploratory and confirmatory factor analyses tested the factor structure. Multigroup analyses supported the structural invariance across gender, age, and relationship status. Both factors showed adequate discriminant validity and internal consistency, and good 3-week period test-retest reliability. Associations between the FICQ and insecure attachment orientations demonstrated convergent validity. The association between the FICQ and relationship satisfaction above and beyond a preexisting measure offered criterion validity. By going beyond traditional self-revelation-focused conception of fear of intimacy, that is, by proposing a bi-dimensional structure to fear of intimacy, we believe that this new measure will contribute to future research on fear of intimacy.


2017 ◽  
Vol 2 (3) ◽  
pp. 417-424
Author(s):  
Hendryadi Hendryadi

This article aims to develop a short form of the locus of control scale. The study was conducted in two stages: a study of 66 respondents as pilot testing which aims to test content validity, structure validity, and internal consistency. Study 2 was conducted on 328 respondents used to test the validity and reliability of the scale evaluated by the PLS-SEM method (such as internal consistency, convergent validity, and discriminant validity). The analysis concludes that the 8-item locus of control scales tested have adequate validity and reliability. A short form locus of control scale was developed and validated in this study, so it can be used in future research and evaluation for HR management practitioners in employee selection Keywords: locus of control, EFA, CFA, scale construction


2014 ◽  
Vol 7 (2) ◽  
pp. 263-284 ◽  
Author(s):  
Budi Hartono ◽  
Deo F.N. Wijaya ◽  
Hilya M. Arini

Purpose – The purpose of this paper is to develop and to empirically verify a model of project risk management maturity (PRMM). Design/methodology/approach – Theoretical work to develop the initial model of risk maturity. Empirical study by a cross-sectional survey to the Indonesian construction industry. Findings – A new model of PRMM is developed and empirically tested. The model is valid (face validity, content validity, discriminant validity, convergent validity, and criterion validity) and reliable. Research limitations/implications – A more comprehensive, follow-up study is required to gain more insights on the actual maturity level of Indonesian construction industry. Practical implications – The model is applicable to assess the organizational maturity level which in turn could be used for improving organization performance. Originality/value – The work demonstrates a novel approach in developing models by emphasizing on the empirical verification.


Author(s):  
Mihyeon Seong ◽  
Juyoung Park ◽  
Soojin Chung ◽  
Sohyune Sok

This study aimed to develop an instrument for measuring the attitudes that reflect the characteristics of the pandemic (Adult Pandemic Attitude Scale (A-PAS)) and verifying its validity and reliability. This study used a methodological research design and was conducted with a development step and an evaluation step. The development step included development of preliminary items, content validity, face validity, and preliminary investigation. The evaluation step included item analysis, construct validity, convergent validity, discriminant validity, criterion validity, factor naming, reliability, and completion of the final instrument. The A-PAS developed in this study consisted of a total of 20 items in five dimensions. The internal consistency of 20 items of the A-PAS, Cronbach’s α was 0.92 for 20 items, Cronbach’s α for each factor, a subscale of instrument, was 0.61~0.87 and Raykov’s p coefficient of each factor, which is a subscale of the tool, was found to be 0.60 to 0.88. Analysis of construct validity showed the results as follows: χ2 (p) = 134.05 (p < 0.001), RMSEA = 0.02, RMR = 0.02, GFI = 0.94, CFI = 0.99. The study findings suggest that the developed instrument can be utilized to measure the attitudes of adults toward pandemics, and reflect the reality of the pandemic situation. The outcomes can be used as valuable data for intervention, prevention activities, and policy preparation. The instrument will be applied in the event of a pandemic, such as COVID-19, and will be helpful in promoting the health of the people.


2020 ◽  
Vol 22 (Supplement_2) ◽  
pp. ii145-ii145
Author(s):  
Giuliana Zarrella ◽  
Alice Perez ◽  
Jorg Dietrich ◽  
Michael Parsons

Abstract INTRODUCTION Subjective cognitive dysfunction is an important outcome measure in neuro-oncology and may provide additional information beyond performance-based neuropsychological testing. The Functional Assessment of Cancer Therapy-Brain (FACT-Br) is a frequently used quality of life (QoL) measure that includes indices of physical, emotional, social, and neurologic aspects of disease, but does not measure cognitive concerns. This study seeks to develop and validate an index of self-reported cognition derived from existing items on the FACT-Br. METHODS 145 patients (Mage=51.08, Medu=15.63) with heterogeneous brain tumor diagnoses completed neuropsychological evaluation including cognitive testing and self-report measures. Nine FACT-Br items regarding cognition were combined to form the Cognitive Index (CI). Reliability of the CI was measured with Cronbach’s alpha. Concurrent validity was assessed by correlating the CI with the Patient-Reported Outcomes Measurement Information System (PROMIS) Cognitive Abilities-8 or PROMIS Cognitive Concerns-8. Discriminant validity was assessed by correlation of the CI with other FACT-Br indices and the Beck Depression and Anxiety Inventories (BDI, BAI). RESULTS Internal consistency within the CI was high (Cronbach’s a 0.864). The CI correlated strongly with the PROMIS-Abilities (r =.680; p&lt; 0.001) and PROMIS-Concerns (r=.780; p&lt; 0.001) indicating high convergent validity. Moderate correlations were observed between the CI and the physical and functional subscales of the FACT (r=.453 and .555), whereas correlations with the social and emotional functioning subscales were weaker (r=.381 and .325). The FACT-Br-CI correlated strongly with BDI (r=-.622) and more weakly with the BAI (r=-.344). Consistent with prior literature, the CI showed modest correlations with neuropsychological measures, including verbal memory encoding (r=.300), verbal fluency (r=.252) and a composite measure of cognition (r=.249; all p’s&lt; .01). CONCLUSIONS The FACT-Br-CI is a reliable and valid measure of self-reported cognition. Studies that include the FACT-Br could be retrospectively analyzed to assess self-reported cognitive outcomes, enriching the information gained from prior research.


Author(s):  
Maggie H Bromberg ◽  
Rocio de la Vega ◽  
Emily F Law ◽  
Chuan Zhou ◽  
Tonya M Palermo

Abstract Objective Insomnia is a highly prevalent sleep disorder that is particularly common among adolescents with health conditions. We aimed to develop and validate a brief screening measure of insomnia in adolescents that can be used across clinical and community samples. We hypothesized that we would identify evidence supporting reliability, convergent/discriminant validity, and that we would determine preliminary clinical cutoff scores. Methods A team of experts in behavioral sleep medicine developed a 13-item brief screening measure of insomnia in adolescents (Adolescent Insomnia Questionnaire [AIQ]). We evaluated the psychometric properties of the AIQ in a sample of 315 youth (11–18 years old, Mean = 14.90, SD = 2.02; 64% female) who had chronic pain (n = 37), headache (n = 170), insomnia diagnosed by a sleep specialist (n = 22), or were otherwise healthy (n = 86). Results Using Exploratory and Confirmatory Factor Analysis, we identified three subscales consistent with major diagnostic criteria of insomnia. As expected, the measure showed strong reliability through high internal consistency (α =.91). We also found strong convergent validity through expected positive relationships between the AIQ and self-report measures of sleep disturbance, and divergent validity via weak relationships with parent-report of snoring. Results of receiver operating characteristic (ROC) identified a clinical cutoff score that may assist in clinical decision making. Conclusions We found that the AIQ has sound psychometric properties in a large heterogeneous sample of treatment-seeking youth and youth from the community. The AIQ can quickly screen adolescent insomnia and could address an important clinical need in identifying youth in need of insomnia treatment in pediatric practice settings.


Sign in / Sign up

Export Citation Format

Share Document