scholarly journals Examining Method Effect of Synonym and Antonym Test in Verbal Abilities Measure

2015 ◽  
Vol 11 (3) ◽  
pp. 419-431
Author(s):  
Wahyu Widhiarso ◽  
Haryanta

Many researchers have assumed that different methods could be substituted to measure the same attributes in assessment. Various models have been developed to accommodate the amount of variance attributable to the methods but these models application in empirical research is rare. The present study applied one of those models to examine whether method effects were presents in synonym and antonym tests. Study participants were 3,469 applicants to graduate school. The instrument used was the Graduate Academic Potential Test (PAPS), which includes synonym and antonym questions to measure verbal abilities. Our analysis showed that measurement models that using correlated trait–correlated methods minus one, CT-C(M–1), that separated trait and method effect into distinct latent constructs yielded slightly better values for multiple goodness-of-fit indices than one factor model. However, either for the synonym or antonym items, the proportion of variance accounted for by the method is smaller than trait variance. The correlation between factor scores of both methods is high (r = 0.994). These findings confirm that synonym and antonym tests represent the same attribute so that both tests cannot be treated as two unique methods for measuring verbal ability.

2017 ◽  
Vol 1 (1) ◽  
pp. 37
Author(s):  
Wahyu Widhiarso

Literatures in the field of psychometrics recommend researchers to employvarious of methods on measuring individual attributes. Ideally,each methods are complementary and measuresthe construct designed to be measured. However, some problems arise when among the methods is unique and unrelated to the construct being measured. The uniqueness of method can lead what is called the method effect. In testing construct validity using confirmatory factor analysis, the emergence of this effect tend to reducing the goodness of fit indices of the model. There are many ways to solve these problem, one of themis controling the method effects and accommodate it to the model. This paper introduces how to accommodate method effecton the confirmatory factor analysis using structural equation modeling. In the application section, author identify the emergence of method effects due to the differences item writing direction (favorable-unfavorable). The analysis showed that method effectemerge from different writing direction.


2010 ◽  
Vol 13 (2) ◽  
pp. 1032-1043 ◽  
Author(s):  
Helder Miguel Fernandes ◽  
José Vasconcelos-Raposo ◽  
Carla Maria Teixeira

This article presents a set of research studies that aim to adapt Carol Ryff‘s scales of psychological well-being (SPWB) and to analyze its psychometric properties in adolescents. The first two studies focused on the reliability and factorial validity of different Portuguese short versions of SPWB, revealing measurement models inadequacies and low internal consistency. In the third study we developed a shortened version (30 items), taking into account the application of psychometric criteria suggested by van Dierendonck (2005). The scales of this version revealed better reliability and adequate goodness of fit indices for the six-factor model, as proposed by Carol Ryff’s PWB theory. Although further research focused on the psychometrical properties reanalysis of this shortened version of SPWB is needed, this article provides a contribution to the research and intervention on positive mental health during adolescence.


2000 ◽  
Vol 16 (1) ◽  
pp. 13-19 ◽  
Author(s):  
Martin Dunbar ◽  
Graeme Ford ◽  
Kate Hunt ◽  
Geoff Der

Summary: Marsh (1996) produced evidence that method effects associated with negatively worded items might be responsible for the results of earlier factor analytic studies that reported finding positive and negative self-esteem factors in the Rosenberg Global self-esteem scale ( Rosenberg, 1965 ). He analyzed data collected from children using a 7-item self-esteem measure. This report details attempts to replicate Marsh 's analysis in data collected from two samples of adults who completed the full 10-item Global Self-Esteem (GSE) scale. The results reported here are similar to those given by Marsh in so much as a correlated uniquenesses model produced a superior fit to the data than the simple one factor model (without correlated uniquenesses) or the often reported two factor (positive and negative self-esteem) model. However, whilst Marsh reported that the best fit was produced by allowing negative item uniquenesses to correlate with each other, the model that produced the best fit to these data was one that contained correlated positive item uniquenesses. Supporting his claim that differential responding to negative and positive self-esteem items reflects a method effect associated with reading ability, Marsh also showed that factors associated with negative and positive items were most distinct among children who had poor reading scores. We report a similar effect among a sample of older adults where the correlation between these factors was compared across two groups who were selected according to their scores on a test of verbal reasoning.


Author(s):  
Sedigheh Salami ◽  
Paulo Felipe Ribeiro Bandeira ◽  
Cristiano Mauro Assis Gomes ◽  
Parvaneh Shamsipour Dehkordi

Aim: To examine the latent structure of the Test of Gross Motor Development—Third Edition (TGMD-3) with a bifactor modeling approach. In addition, the study examines the dimensionality and model-based reliability of general and specific contributions of the test’s subscales and measurement invariance of the TGMD-3. Methods: A convenience sample of (N = 496; Mage = 7.23 ± 2.03 years; 53.8% female) typically developed children participated in this study. Three alternative measurement models were tested: (a) a unidimensional model, (b) a correlated two-factor model, and (c) a bifactor model. Results: The totality of results, including item loadings, goodness-of-fit indexes, and reliability estimates, all supported the bifactor model and strong evidence of a general factor, namely gross motor competence. Additionally, the reliability of subscale scores was poor, and it is thus contended that scoring, reporting, and interpreting of the subscales scores are probably not justifiable. Conclusions: This study shows the advantages of using bifactor approach to examine the TGMD-3 factor structure and suggests that the two traditionally hypothesized factors are better understood as “grouping” factors rather than as representative of latent constructs. In addition, our findings demonstrate that the bifactor model appears invariant for sex.


2022 ◽  
pp. 003329412110636
Author(s):  
Bruno Faustino

The presence of dysfunctional cognitions about how individuals see themselves and others is a hallmark of psychopathology. The Brief Core Schemas Scale (BCSS) was developed to evaluate adaptive and dysfunctional beliefs about the self and others. This study describes the first psychometric analysis of the BCSS in the Portuguese population. Participants were recruited from community ( N = 320, Mage=27.31, DP = 12.75). Confirmatory factor analysis (CFA) was used to confirm the BCSS factorial structure. Four-factor model revealed moderate to adequate goodness-of-fit indices (χ2/df = 717.1, (246) p = .01; SRMR = .044; RMSEA = .077; CFI/TLI < .90). Negative views of the self and others correlated positively with early maladaptive schemas, distress, and symptomatology and correlated negatively with psychological well-being. An inversed correlational pattern was found with the positive views of the self and others. Despite the model's moderate adherence to the data, results suggest that the BCSS may be an asset in the assessment of dysfunctional and adaptive cognitions about the self and others. Further analysis is required to deepen the psychometric properties of the BCSS in the Portuguese population.


2015 ◽  
Vol 18 ◽  
Author(s):  
Javier Ortuño-Sierra ◽  
Lorena Rodríguez ◽  
Martin Debbané ◽  
Eduardo Fonseca-Pedrero

AbstractThe main purpose of this study was to analyze the psychometric properties of the Spanish version of the Burns Anxiety Inventory (Burns-A: Burns, 1993). The sample consisted of 417 participants, 387 (29.71% male) healthy participants (control group: M = 35.5 years; SD = 8.40) and 30 (36.66% female) patients (clinical group: M = 35.8 years; SD = 12.94). The internal consistency evaluated through Cronbach’ Alpha was 0.95 for the Total Score in both subsamples. The test-retest reliability (two weeks) for Total Score was 0.86 (F = 13.2, p ≤ .001) for the non-clinical subsample, and 0.95 (F = 36.5, p ≤ .001) for the clinical subsample. Confirmatory factor analyses supported the initial three-factor model. However, modifications to the initial three-factor model improved the goodness-of-fit indices. Results showed statistically significant differences in the mean scores of the Burns-A between the clinical and control groups. This study supports the Spanish version of the Burns-A as a brief and useful tool for the screening of anxiety symptoms in adult populations. Future studies should investigate measurement invariance across cultures.


2011 ◽  
Vol 109 (1) ◽  
pp. 147-166 ◽  
Author(s):  
Mithat Durak ◽  
Emre Senol-Durak

The Emotional Approach Coping Scale is frequently used to assess coping, which consists of emotional processing and emotional expression. The present aim was to examine the psychometric properties of this scale by utilizing two independent samples: university students ( n = 481) and community members ( n = 284). Based on goodness-of-fit indices in confirmatory factor analysis, a two-factor model yielded significant findings in these samples. The results of multigroup analysis revealed that the theoretical structure of the dispositional Emotional Approach Coping Scale was the same for men and women. In addition to sufficient internal consistency and test-retest reliability, the relationships between the Emotional Approach Coping Scale and five conceptually related measures (coping styles, positive affect, negative affect, depression, and trait anxiety) demonstrated concurrent validity. Furthermore, the present study provides a map of emotional approach coping styles in a non-Western culture.


2020 ◽  
Author(s):  
Sedigheh Salami ◽  
Paulo Felipe Ribeiro Bandeira ◽  
Cristiano Mauro Assis Gomes ◽  
Parvaneh Shamsipour Dehkordi

Aim: To examine the latent structure of the Test of Gross Motor Development, 3rd Edition (TGMD-3) with a bifactor modeling approach. Furthermore, the study examines the dimensionality, model-based reliability of general and specific contributions of the test's subscales and measurement invariance of the TGMD-3. Methods: Using a sample of 496 Iranian children (M age = 7.23±2.03 years; 53.8 female) from the five main geographic regions of Tehran city, three alternative measurement models were tested: (a) a unidimensional model, (b) a correlated 2-factor model, (c) a bifactor model. Results: The totality of results including item loadings, goodness-of-fit indexes and reliability estimates all supported the bifactor model and strong evidence of general fundamental movement factor. Additionally, the reliability of subscale scores was poor, it is thus contended that scoring, reporting and interpreting of the subscales scores are probably not justifiable. Suggesting that the 2 traditionally hypothesized factors are better understood as “grouping” factors rather than as representative of latent constructs. Furthermore, the bifactor model appears invariant for gender. Conclusion: This study is the first to address the bifactor model and new insights regarding the application and interpretation of the test battery most widely used with children.


2020 ◽  
Vol 11 (4) ◽  
pp. 204380872097434
Author(s):  
Yosi Yaffe

The Clance Impostor Phenomenon Scale (CIPS) is a measure widely used to assess individuals’ self-perceptions of intellectual and professional fraudulence. The study aimed to investigate the psychometric properties of the Hebrew form for the CIPS (HCIPS) in female Hebrew-speaking students, in an attempt to further clarify its structure and strengthen its validity in international settings. The study comprised a sample of 248 female students ( M age = 27.74, SD = 7.32), who completed an online version of the questionnaire. Our results generally demonstrated satisfactory psychometric properties of the HCIPS total scale, with its internal consistency, reliability, and item-total-correlations meeting the standard criteria. The exploratory factor analysis yielded a stable four-factor solution for the 19-items, with its factors accounting for 54.81% of the model’s variance. The confirmatory factor analysis confirmed the four-factor model as compatible, with its fit-indices meeting the minimal standards of goodness of fit. The study’s findings are the first to identify a four-factor model, which improves the imbalanced factorial composition characterizing the common three-factor model. Subject to the study’s limitations, this evidence suggests that the HCIPS is a sound instrument for assessing impostor feelings among female Hebrew-speaking students.


Healthcare ◽  
2021 ◽  
Vol 9 (5) ◽  
pp. 587
Author(s):  
Miguel Mora-Pelegrín ◽  
Beatriz Montes-Berges ◽  
María Aranda ◽  
María Agustina Vázquez ◽  
Elena Armenteros-Martínez

The aim of this study was to develop a measure to evaluate the management of empathic capacity. To this end, two studies were conducted. Study 1 (N = 277, 172 females) describes the scale creation procedure, factorial validity, and internal consistency. The exploratory factor analysis yielded a five-factor model with 18 items (62.4% of the variance explained). The dimensions were as follows: D1: identification, D2: incorporation, D3: reverberation, D4: separation, and D5: projection. The internal consistency was good (alpha values ranging from 0.70 to 0.80). Study 2 (N = 480, 323 females) examined the validity (including convergent validity) of the model and the relationships with sociodemographic variables. The five-factor model showed a robust goodness of fit, χ2 = 240.5, p < 0.001, root mean square residual (RMSR) = 0.05. The fit indices were satisfactory, Non-normed fit index (NNFI) = 0.89, comparative fit index (CFI) = 0.90, mean square error of approximation (RMSEA) = 0.04. The convergent validity analysis showed that, as empathy management increased, so too did the empathy level and emotional intelligence. Some differences by age and sex were found. In conclusion, the Empathy Management Scale is a valid and reliable instrument for analyzing the empathic process that allows vulnerabilities and strengths to be estimated, which could improve professional practice in the healthcare context.


Sign in / Sign up

Export Citation Format

Share Document