THE CONSTRUCT VALIDITY OF GRAMMATICALITY JUDGMENT TESTS AS MEASURES OF IMPLICIT AND EXPLICIT KNOWLEDGE

2013 ◽  
Vol 35 (3) ◽  
pp. 423-449 ◽  
Author(s):  
Xavier Gutiérrez

Grammaticality judgment tests (GJTs) have been, and continue to be, frequently used in the field of SLA as a measure of learners’ linguistic ability in the second language (L2). However, only a few studies have examined their construct validity as measures of implicit and explicit knowledge (Bowles, 2011; R. Ellis, 2005), and even fewer have explored in detail how features of these tests, such as time pressure and task stimulus, affect their construct validity (Loewen, 2009). The purpose of this paper is to examine the effect that time pressure and task stimulus have on the type of knowledge representations on which L2 learners draw when performing GJTs. The results show that the grammatical and ungrammatical sections of a timed and an untimed GJT loaded differently in both exploratory and confirmatory factor analyses. This finding can be interpreted as indicating that grammatical and ungrammatical sentences constitute measures of implicit and explicit knowledge, respectively. Additionally, the results show that time pressure and task stimulus have significant effects on learners’ performance on GJTs.

2015 ◽  
Vol 37 (2) ◽  
pp. 269-297 ◽  
Author(s):  
Aline Godfroid ◽  
Shawn Loewen ◽  
Sehoon Jung ◽  
Ji-Hyun Park ◽  
Susan Gass ◽  
...  

Grammaticality judgment tests (GJTs) have been used to elicit data reflecting second language (L2) speakers’ knowledge of L2 grammar. However, the exact constructs measured by GJTs, whether primarily implicit or explicit knowledge, are disputed and have been argued to differ depending on test-related variables (i.e., time pressure and item grammaticality).Using eye-tracking, this study replicates the GJT results in R. Ellis (2005). Twenty native and 40 nonnative English speakers judged sentences with and without time pressure. Analyses revealed that time pressure suppressed regressions (right-to-left eye movements) in nonnative speakers only. Conversely, both groups regressed more on untimed, grammatical items. These findings suggest that timed and untimed GJTs measure different constructs, which could correspond to implicit and explicit knowledge, respectively. In particular, they point to a difference in the levels of automatic and controlled processing involved in responding to the timed and untimed tests. Furthermore, untimed grammatical items may induce GJT-specific task effects.


2011 ◽  
Vol 27 (1) ◽  
pp. 59-64 ◽  
Author(s):  
Volkmar Höfling ◽  
Helfried Moosbrugger ◽  
Karin Schermelleh-Engel ◽  
Thomas Heidenreich

The 15 items of the Mindful Attention and Awareness Scale (MAAS; Brown & Ryan, 2003 ) are negatively worded and assumed to assess mindfulness. However, there are indications of differences between the original MAAS and a version with the positively rephrased MAAS items (“mirror items”). The present study examines whether the mindfulness facet “mindful attention and awareness” (MAA) can be measured with both positively and negatively worded items if we take method effects due to item wording into account. To this end, the 15 negatively worded items of the MAAS and additionally 13 positively rephrased items were assessed (N = 602). Confirmatory factor analyses (CFA) models with and without regard to method effects were carried out and evaluated by means of model fit. As a result, the positively and negatively worded items should be seen as different methods that influence the construct validity of mindfulness. Furthermore, a modified version of the MAAS (MAAS-Short) with five negatively worded items (taken from the MAAS) and five positively worded items (“mirror items”) was introduced as an alternative to assess MAA. The MAAS-Short appears superior to the original MAAS. The results and the limitations of the present study are discussed.


2019 ◽  
Vol 35 (4) ◽  
pp. 564-576 ◽  
Author(s):  
Tobias Ringeisen ◽  
Sonja Rohrmann ◽  
Anika Bürgermeister ◽  
Ana N. Tibubos

Abstract. By means of two studies, a self-report measure to assess self-efficacy in presentation and moderation skills, the SEPM scales, was validated. In study 1, factorial and construct validity were examined. A sample of 744 university students (41% females; more than 50% between 20 and 25 years) completed newly constructed self-efficacy items. Confirmatory factor analyses (CFAs) substantiated two positively correlated factors, presentation (SEPM-P) and moderation self-efficacy (SEPM-M). Each factor consists of eight items. The correlation patterns between the two SEPM subscales and related constructs such as extraversion, the preference for cooperative learning, and conflict management indicated adequate construct validity. In study 2, criterion validity was determined by means of latent change modeling. One hundred sixty students ( Mage = 24.40, SD = 4.04; 61% females) took part in a university course to foster key competences and completed the SEPM scales at the beginning and the end of the semester. Presentation and moderation self-efficacy increased significantly over time of which the latter was positively associated with the performance in a practical moderation exam. Across both studies, reliability of the scales was high, ranging from McDonald’s ω .80 to .88.


2021 ◽  
pp. 026540752110497
Author(s):  
Silje S. Hukkelberg ◽  
Ane Nærde

Although fathers are increasingly involved in childrearing, less is known about how parental stress is perceived among mothers and fathers separately. The present study investigated the construct validity of the PSS in a community-based sample of Norwegian father–mother dyads with a child aged 4. A total of 1030 mothers and fathers ( N = 515 dyads) responded to the PSS, which is a much used instrument that assesses stress related to childrearing across 18 items. Construct validity was investigated using exploratory and confirmatory factor analyses and the multitrait–multimethod approach (MTMM). The results revealed that six of the items showed extensive ceiling-effects for both parents, and were excluded from further analysis. Dimensionality was examined for the remaining 12 PSS items. The results supported a two-factor solution for both fathers and mothers, reflecting parental stressors (9 items) and lack of rewards (3 items). The MTMM approach indicated convergent and discriminant validity across traits (Parental stressors and Lack of rewards) and methods (father vs mother rating). We also explored the network of PSS items for mothers and fathers, and found both similarities and differences. Overall, the results of the factor analyses have implications for the use of the PSS. The networks of PSS suggest that some items may be especially important when addressing parental stress with mothers and fathers.


2008 ◽  
Vol 30 (2) ◽  
pp. 200-221 ◽  
Author(s):  
Ross Roberts ◽  
Nichola Callow ◽  
Lew Hardy ◽  
David Markland ◽  
Joy Bringer

The purpose of this research was to amend the Vividness of Movement Imagery Questionnaire (VMIQ; Isaac, Marks, & Russell, 1986) in line with contemporary imagery modality and perspective conceptualizations, and to test the validity of the amended questionnaire (i.e., the VMIQ-2). Study 1 had 351 athletes complete the 3-factor (internal visual imagery, external visual imagery, and kinesthetic imagery) 24-item VMIQ-2. Following single-factor confirmatory factor analyses and item deletion, a 12-item version was subject to correlated traits / correlated uniqueness (CTCU) analysis. An acceptable fit was revealed. Study 2 used a different sample of 355 athletes. The CTCU analysis confirmed the factorial validity of the 12-item VMIQ-2. In Study 3, the concurrent and construct validity of the VMIQ-2 was supported. Taken together, the results of the 3 studies provide preliminary support for the revised VMIQ-2 as a psychometrically valid questionnaire.


2010 ◽  
Vol 26 (1) ◽  
pp. 19-27 ◽  
Author(s):  
Christophe Maïano ◽  
Alexandre J.S. Morin ◽  
Johana Monthuy-Blanc ◽  
Jean-Marie Garbarino

The main objective of the present series of studies was to test the construct validity (i.e., content, factorial, and convergent validities) of the Fear of Negative Appearance Evaluation Scale (FNAES) in a community sample of French adolescents. A total sample of 683 adolescents was involved in three studies. The factorial validity and the measurement invariance of the FNAES were verified through a series of confirmatory factor analyses. The convergent validity of the FNAES was then verified through correlational analyses. The first study showed that the content and formulation of the French FNAES items were adequate for children and adolescents. The following two studies (Studies 2 to 3) provided (a) support for the factor validity, reliability, and convergent validity of a five-item French version of the FNAES, and (b) partial support for the measurement invariance of the resulting FNAES across genders. However, the latent mean structure of the FNAES did not prove to be invariant across genders, revealing a significantly higher latent mean score of FNAES in girls relative to boys. The present results, thus, provide preliminary evidence regarding the construct validity of the FNAES in a community sample of French adolescents. Recommendations for future practice and research regarding this instrument are outlined.


2010 ◽  
Vol 26 (4) ◽  
pp. 277-283 ◽  
Author(s):  
Marleen M. S. Derkman ◽  
Ron H. J. Scholte ◽  
William M. Van der Veld ◽  
Rutger C. M. E. Engels

The psychometric properties of the shortened version of the Sibling Relationship Questionnaire (SRQ; Furman & Buhrmester, 1985 ) were examined in a sample of 428 Dutch adolescents, aged 13 to 16. In order to examine the dimensions Warmth/Closeness and Conflict, as proposed by Furman and Buhrmester, we first conducted confirmatory factor analyses. Second, we investigated the construct validity by correlating Warmth/Closeness and Conflict with internalizing and externalizing behaviors and the quality of relationship with parents. Third, we determined the internal reliability of Warmth/Closeness and Conflict and the underlying qualities by computing Cronbach’s αs. The results confirmed the dimensions Warmth/Closeness and Conflict as major aspects of sibling relationships. Moreover, the construct validity of the instrument and internal consistency for these dimensions and the underlying qualities proved to be good. Our findings underscore the psychometric properties of the SRQ, in that it appears to be a valid and reliable measure to assess Warmth/Closeness and Conflict in sibling relationships.


1999 ◽  
Vol 22 (5) ◽  
pp. 735-808 ◽  
Author(s):  
Zoltan Dienes ◽  
Josef Perner

The implicit-explicit distinction is applied to knowledge representations. Knowledge is taken to be an attitude towards a proposition which is true. The proposition itself predicates a property to some entity. A number of ways in which knowledge can be implicit or explicit emerge. If a higher aspect is known explicitly then each lower one must also be known explicitly. This partial hierarchy reduces the number of ways in which knowledge can be explicit. In the most important type of implicit knowledge, representations merely reflect the property of objects or events without predicating them of any particular entity. The clearest cases of explicit knowledge of a fact are representations of one's own attitude of knowing that fact. These distinctions are discussed in their relationship to similar distinctions such as procedural-declarative, conscious-unconscious, verbalizable-nonverbalizable, direct-indirect tests, and automatic-voluntary control. This is followed by an outline of how these distinctions can be used to integrate and relate the often divergent uses of the implicit-explicit distinction in different research areas. We illustrate this for visual perception, memory, cognitive development, and artificial grammar learning.


2002 ◽  
Vol 28 (2) ◽  
Author(s):  
Gideon P. De Bruin ◽  
Martha J. Bernard-Phera

This study investigated the construct validity of the Career Development Questionnaire and the Career Decision- Making Self-Efficacy Scale for Grade 12 students from a low socioeconomic area in South Africa. The results of confirmatory factor analyses provided support for the construct validity of the Career Development Questionnaire and the Career Decision-Making Self-Efficacy Scale as measures of career maturity and career decision-making self efficacy respectively. Opsomming Hierdie studie het ondersoek ingestel na die konstrukgeldigheid van die Loopbaanontwikkelingsvraelys en die Loopbaan-besluitneming-selfdoeltreffendheidskaal vir Graad 12 leerlinge van ‘n lae sosio-ekonomiese gebied. Die resultate van bevestigende faktorontledings het ondersteuning gebied vir die konstrukgeldigheid van die twee vraelyste as meetinstrumente van onderskeidelik loopbaanvolwassenheid en loopbaanbesluit-nemingselfdoeltreffendheid.


TESTFÓRUM ◽  
2014 ◽  
Vol 3 (4) ◽  
pp. 74-83
Author(s):  
Jan Kuba

Cílem studie bylo ověřit konstruktovou validitu motivačních dimenzí Bochumského osobnostního dotazníku (inventáře profesních charakteristik osobnosti). V teoretické části byly definovány související osobnostní konstrukty, které byly v empirické části využity k ověření odvozených motivačních dimenzí. Kvantitativní data byla získána na vzorku 778 studentů a absolventů vysokých škol. K ověření konstruktové validity bylo využito explanatorních a konfirmatorních faktorových analýz, na jejichž základě byl vytvořen strukturní model ilustrující podobu vztahů mezi zkoumanými dimenzemi. Byly nalezeny dílčí doklady konstruktové validity motivačních dimenzí Bochumského osobnostního dotazníku. Závěrem jsou diskutována doporučení pro interpretaci výsledků psychodiagnostického posouzení a pro zvýšení validity metody.The aim of the study was to verify construct validity of motivational dimensions of the Czech version of the Business-Focused Inventory of Personality. Personality constructs linked to derived personality dimensions were defined in the theoretical part of the study. Quantitative data were obtained using the sample of 778 university undergraduates and graduates. Confirmatory factor analyses were used in order to explore construct validity of the method. Structural model based on the factor analyses was created to outline relations among the examined dimensions. Partial evidence on construct validity of the method was found.


Sign in / Sign up

Export Citation Format

Share Document