Using the Rating Scale Model to Examine the Psychometric Properties of the Self-Efficacy Scale for Driver Competence

2011 ◽  
Vol 27 (3) ◽  
pp. 164-170 ◽  
Author(s):  
Anna Sundström

This study evaluated the psychometric properties of a self-report scale for assessing perceived driver competence, labeled the Self-Efficacy Scale for Driver Competence (SSDC), using item response theory analyses. Two samples of Swedish driving-license examinees (n = 795; n = 714) completed two versions of the SSDC that were parallel in content. Prior work, using classical test theory analyses, has provided support for the validity and reliability of scores from the SSDC. This study investigated the measurement precision, item hierarchy, and differential functioning for males and females of the items in the SSDC as well as how the rating scale functions. The results confirmed the previous findings; that the SSDC demonstrates sound psychometric properties. In addition, the findings showed that measurement precision could be increased by adding items that tap higher self-efficacy levels. Moreover, the rating scale can be improved by reducing the number of categories or by providing each category with a label.

2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Evandro Morais Peixoto ◽  
Daniela Sacramento Zanini ◽  
Josemberg Moura de Andrade

Abstract Background The Kessler Distress Scale (K10) is a self-report scale for the assessment of non-specific psychological distress in the general and clinical population. Because of its ease of application and good psychometric properties, the K10 has been adapted to several cultures. The present study seeks to adapt the K10 to Brazilian Portuguese and estimate its validity evidence and reliability. Methods A total of 1914 individuals from the general population participated in the study (age = 34.88, SD = 13.61, 77.7% female). The adjustment indices were compared among three different measurement models proposed for the K10 through confirmatory factor analysis (CFA). The items’ properties were analyzed by Andrich’s Rating Scale Model (RSM). Furthermore, evidence based on relations to other variables (depression, stress, anxiety, positive and negative affects, and satisfaction with life) was estimated. Results CFA indicated the adequacy of the bifactor model (CFI= 0.985; TLI= 0.973; SMR= 0.019; RMSEA= 0.050), composed of two specific factors (depression and anxiety) and one general factor (psychological distress), corresponding to the theoretical hypothesis. Additionally, it was observed multiple-group invariance by gender and age range. The RSM provided an understanding of the organization of the continuum represented by the psychological distress construct (items difficulty), which varied from −0.89 to 1.00; good adjustment indexes; infit between 0.67 and 1.32; outfit between 0.68 and 1.34; and desirable reliability, α= 0.87. Lastly, theoretically coherent associations with the external variables were observed. Conclusions It is concluded that the Brazilian version of the K10 is a suitable measure of psychological distress for the Brazilian population.


2007 ◽  
Vol 27 (4) ◽  
pp. 140-148 ◽  
Author(s):  
Ingela Petersson ◽  
Anne G. Fisher ◽  
Helena Hemmingsson ◽  
Margareta Lilja

The objective of this study was to evaluate aspects of the validity and reliability of the Client-Clinician Assessment Protocol (C-CAP) Part I. C-CAP data for 103 people aging with disabilities in need of home modification services were analyzed using the Rasch rating scale model. The C-CAP Part I consists of a client self-report of ability in daily life tasks comprising three scales (independence, difficulty, and safety). The analysis demonstrated support for internal scale validity, person response validity, and person separation reliability of the C-CAP Part I, although the results differed among the three scales. The results of this study indicated that the C-CAP Part I has psychometric strengths and limitations. The instrument has the potential to be used in the home environment with people who are aging with disabilities. The C-CAP could complement already existing tools that are used to assess functioning in activities of daily living, especially regarding the focus on the clients' self-report of difficulty and safety in daily life at home and in the community.


Nutrients ◽  
2020 ◽  
Vol 12 (11) ◽  
pp. 3561
Author(s):  
Karla Vázquez-Espino ◽  
Carles Fernández-Tena ◽  
Maria Antonia Lizarraga-Dallo ◽  
Andreu Farran-Codina

Weak evidence exists on the relationship between nutritional knowledge and diet quality. Many researchers claim that this could be in part because of inadequate validation of the questionnaires used. The aim of this study was to develop a compact reliable questionnaire on nutrition knowledge for young and adult athletes (NUKYA). Researchers and the sport clubs medical staff developed the questionnaire by taking into consideration the latest athlete dietary guidelines. The questionnaire content was validated by a panel of 12 nutrition experts, and finally tested by 445 participants including athletes (n = 264), nutrition students (n = 49) and non-athletes with no formal nutrition knowledge (n = 132). After consulting the experts, 59 of the 64 initial items remained in the questionnaire. To collect the evaluation of experts, we used the content validity index, obtaining high indices for relevance and ambiguity (0.99) as well as for clarity and simplicity (0.98). The final questionnaire included 24 questions with 59 items. We ensured construct validity and reliability through psychometric validation based on the Classical Test Theory and the Item–Response Theory (Rasch model). We found significant statistical differences comparing the groups of nutrition knowledgeable participants with the rest of the groups (ANOVA p < 0.001). We verified the questionnaire for test–retest reliability (R = 0.895, p < 0.001) and internal consistency (Cronbach’s α=0.849). We successfully fit the questionnaire data to a rating scale model (global separation reliability of 0.861) and examined discrimination and difficulty indices for items. Finally, we validated the NUKYA questionnaire as an effective tool to appraise nutrition knowledge in athletes. This questionnaire can be used for guiding in educational interventions, studying the influence of nutrition knowledge on nutrient intake and assessing/monitoring sport nutritional knowledge in large groups.


2009 ◽  
Vol 24 (S1) ◽  
pp. 1-1
Author(s):  
C. Barkmann ◽  
B. Mack ◽  
E. Braehler ◽  
M. Schulte-Markwort

The Giessen Physical Complaints Inventory for children and adolescents (GBB-KJ) is currently the only German test for the standardised, multidimensional measurement of physical complaints in the self and external assessment of children and adolescents. The present study analysed the scalability of the five complaint dimensions in a mixed Rasch model with up to four clusters and four response models (partial credit, dispersion, equidistance and rating scale). The self-report data of N=1027 11- to 18-year-olds used in the study stem from the nationally representative Hamburg Health Survey (Barkmann, 2004). Of the five original 7 item scales, only cold problems could be Rasch scaled in a 3 cluster rating scale model without the exclusion of nonconform responding cases. In the 5 item rescaling approach, more than one valid model could be identified for each of the five dimensions. In principle, physical complaints proved to be adequate for probabilistic measuring models. Future studies must decide which of the solutions offers the more significant and consistent results in scientific research and clinical practice.


2021 ◽  
pp. 003329412110281
Author(s):  
Enoch Teye-Kwadjo ◽  
Gideon P. de Bruin

The Proactive Personality Scale (PPS) is used widely to measure proactive personality. Previous research has evaluated the psychometric properties of the 6-item PPS (hereafter called PPS-6) using classical test theory. There is a need to provide further validity evidence for the PPS-6 using modern test theory. This study evaluated the psychometric properties of the PPS-6 using Rasch analysis. A total of 429 participants completed the PPS-6. Rasch rating scale model (RSM) was used to analyse the data. RSM showed that the PPS-6 fitted the Rasch model well. RSM demonstrated that the PPS-6 functioned as a unidimensional measure with good internal consistency reliability. Items on the PPS-6 did not show any noticeable differential item functioning across gender. RSM showed that the response rating scale of the PPS-6 is suitable. Results suggest that the PPS-6 is a reliable measure for the assessment of proactive personality.


2017 ◽  
Vol 37 (2) ◽  
pp. 194-208 ◽  
Author(s):  
Leigh M. Harrell-Williams ◽  
Jennifer N. Lovett ◽  
Hollylynne S. Lee ◽  
Rebecca L. Pierce ◽  
Lawrence M. Lesser ◽  
...  

Recently adopted state standards for middle grades and high school mathematics content have an increased emphasis on statistical topics. With this change, teacher education programs may need to adapt how they prepare preservice secondary mathematics teachers (PSMTs) to teach statistics and require measures related to statistics teaching to assess the impact of programmatic changes and track teacher growth. Using responses from a sample of 290 PSMTs from 20 institutions across the United States, this study presents validity and reliability evidence for the high school version of the Self-Efficacy to Teach Statistics (SETS-HS), which could be used to assess statistics teaching efficacy. Confirmatory factor analysis results via Rasch modeling support the use of three subscales, which exhibit adequate reliabilities and correspond to the three levels in the Pre-K–12 Guidelines for Assessment and Instruction in Statistics Education endorsed by the American Statistical Association. Item and rating scale analyses indicate that the 46 items and the six-category scale employed in the SETS-HS perform as intended.


2020 ◽  
Vol Supplement 1 (1) ◽  
pp. 41-54
Author(s):  
ÇALIK VELI KOÇAK

Background: It is important that psychological structures have an impact on athlete performance, such as self-efficacy can be measured consistently. The aim of this study is to develop a measurement tool with psychometric properties that can measure the self-efficacy beliefs of athletes. Material and methods: The participants of the study consisted of 325 athletes (age 21.6 ± 4.2) who actively pursue sports in various sports branches in Turkey. In the validity and reliability analysis of the scale, exploratory and confirmatory factor analyzes were used. Cronbach’s Alpha reliability coefficient value of the total scale is .88. Results: The validity and reliability analysis results of the scale revealed that the scale was generally in perfect fit. As a result, it can be said that the Athlete Self Efficacy Scale (ASES) is a valid and reliable measurement tool and can be used to determine the self-efficacy levels of adult athletes. Conclusions: Validity and reliability studies of the Athlete Self Efficacy Scale should be repeated specific to the sport branch or in younger age groups. In addition, athlete's self-efficacy is a universal concept. In this respect, it is valid in other cultures and it is recommended to adapt the scale to other languages and cultures.


2020 ◽  
Vol 20 (2) ◽  
pp. 276-285
Author(s):  
María Cristina Enríquez-Reyna ◽  
Perla Lizeth Hernández-Cortés ◽  
José Alex Leyva Caro ◽  
Patricia Peche-Alejandro ◽  
Janeth Wendolyne Molina Sánchez ◽  
...  

Por cuestiones culturales, para muchas mujeres en México la adopción de una conducta activa fue restringida a la ejecución de tareas en el hogar. Se propuso analizar las propiedades psicométricas de la Escala de Autoeficacia para el Ejercicio. Como objetivo secundario, se analiza la asociación de las dimensiones de la escala por tipo de actividad física en adultas mayores independientes de la comunidad. Investigación instrumental y empírica con dos muestras que suman 614 mujeres mayores (M= 70.27 años, DE= 6.3). Las participantes presentan independencia funcional e integridad cognitiva y son asistentes de clubes de adultos mayores del área urbana. Se aplicaron la Escala de Autoeficacia para el Ejercicio y el Cuestionario de Actividad Física de Adultos Mayores. Se presentan propiedades psicométricas de la escala, análisis descriptivos e inferenciales con matriz de correlación de Spearman. Se utilizaron SPSS versión 21,0 y LISREL 8,80. La adaptación al castellano en esta población presenta cuatro dimensiones con propiedades psicométricas aceptables: estrés, demandas en competencia, influencias externas y el clima. Se estimó un gasto de 1,25 METs (DE= ,54) de actividad física en el hogar, 5,83 METs (DE= 4,40) de ejercicio y 2,09 METs (DE= 1,90) del tiempo libre. Se presenta modelo de ajuste y propiedades psicométricas de la Escala de Autoeficacia para el Ejercicio. Dirigir estrategias para incrementar la autoeficacia secundaria a influencias externas pudiera incrementar la actividad física de este creciente grupo poblacional. For cultural reasons, for many women in Mexico the adoption of active behavior was restricted to the execution of tasks at home. It was proposed to analyze the psychometric properties of the Self-efficacy to Regulate Exercise Scale. As a secondary objective, the association of scale dimensions by type of physical activity in older adults independent of the community was analyzed. Instrumental and empirical research with two samples totaling 614 older women (M = 70.27 years, SD = 6.3). The participants present functional independence and cognitive integrity and were assistants of seniors clubs in the urban area. The Self-efficacy to Regulate Exercise Scale and the Physical Activity Scale of the Elderly were applied. Psychometric properties of the scale, descriptive and inferential analyzes with Pearson's correlation matrix are presented. SPSS version 21.0 and LISREL 8.80 were used. The adaptation to Spanish in this population has four dimensions with acceptable psychometric properties: stress, competing demands, external influences and climate. It was estimated an expenditure of 1,25 METs (SD= ,54) of physical activity in the home, 5,83 METs (SD= 4,40) for exercise and 2,09 METs (SD= 1,90) during free time. After the elimination of three items an adjustment model with four dimensions are presented. Directing strategies to increase self-efficacy secondary to external influences could increase the physical activity of this growing population group. Por razões culturais, para muitas mulheres no México, a adoção de comportamento ativo restringia-se à execução de tarefas em casa. Foi proposto analisar as propriedades psicométricas da Escala de Autoeficácia para o Exercício. Como objetivo secundário, analisa-se a associação das dimensões da escala por tipo de atividade física em idosos independentes da comunidade. Pesquisa instrumental e empírica com duas amostras, totalizando 614 mulheres mais velhas (M = 70,27 anos, DP = 6,3). Os participantes apresentam independência funcional e integridade cognitiva e são assistentes de clubes idosos na área urbana. Foram aplicadas a Escala de Autoeficácia para Exercício e o Questionário de Atividade Física para Idosos. São apresentadas propriedades psicométricas da escala, análises descritivas e inferenciais com a matriz de correlação de Spearman. Foram utilizadas as versões 21.0 e LISREL 8.80 do SPSS. A adaptação ao espanhol nessa população possui quatro dimensões com propriedades psicométricas aceitáveis: estresse, demandas concorrentes, influências externas e clima. Estima-se uma despesa de 1,25 METs (DP =, 54) de atividade física em casa, 5,83 METs (DP = 4,40) de exercício e 2,09 METs (DP = 1,90) de tempo livre. O modelo de ajuste e as propriedades psicométricas da Escala de Autoeficácia para o Exercício são apresentados. Direcionar estratégias para aumentar a autoeficácia secundária a influências externas pode aumentar a atividade física desse crescente grupo populacional.


2021 ◽  
Author(s):  
Feng Liu ◽  
Zhen-xiang Zhang ◽  
Bei-lei Lin ◽  
Zhi-guang Ping ◽  
Yong-xia Mei

Abstract Background Self-efficacy is a significant predictor of return to work and affects the confidence of survivors to return to work after illness. The Return-to-work self-efficacy (RTW-SE) questionnaire is a self-report questionnaire to assess confidence in returning to work with good reliability and validity. The aim of this study was to translate and cross-culturally adapt the RTW-SE questionnaire into Chinese and examine the psychometric properties among young and middle-aged stroke survivors using rasch model analysis.Methods The cross-cultural adaptation and translation procedures followed a dual-translation approach. The psychometric properties of the RTW-SE questionnaire were examined using Rasch model analysis by Winsteps software. The unidimensionality and local independence were analyzed by principal component analysis and standardized residual correlations. Category diagnostics were performed for scale function, and the item fit, reliability, and separation were also validated. Item-person maps were used to examine the distribution and matching of item’s difficulty and person ability. Finally, the differential item functioning (DIF) was used to measure gender-related group equivalence.Results A total of 366 participants aged 23–59 years were recruited from three communities in Zhengzhou. The RTW-SE questionnaire demonstrated unidimensionality and a 5-point Likert rating scale was more appropriate to investigate young and middle-aged stroke survivors’self-efficacy. There was a good fit for the items with both person and item reliabilities greater than 0.8 and separation indices of 3.75 and 3.94, respectively. The item difficulty was identified from the item-person map as not covering person ability, but the scale did not have an age-related DIF.Conclusions The results confirm evidence of appropriate psychometric properties of the RTW-SE questionnaire and can be used as a reliable and validated instrument for measuring self-efficacy to return to work in young and middle-aged Chinese patients with stroke.


1995 ◽  
Vol 11 (1) ◽  
pp. 14-20 ◽  
Author(s):  
Sean M. Hammond

This paper presents an IRT analysis of the Beck Depression Inventory which was carried out to assess the assumption of an underlying latent trait common to non-clinical and patient samples. A one parameter rating scale model was fitted to data drawn from a patient and non-patient sample. Findings suggest that while the BDI fits the model reasonably well for the two samples separately there is sufficient differential item functioning to raise serious duobts of the viability of using it analogously with patient and non-patient groups.


Sign in / Sign up

Export Citation Format

Share Document