A Psychometric Examination of the Anagram Persistence Task: More Than Two Unsolvable Anagrams May Not Be Better

Assessment ◽  
2018 ◽  
Vol 27 (6) ◽  
pp. 1198-1212 ◽  
Author(s):  
Gilles E. Gignac ◽  
Ka Ki Wong
Keyword(s):  
Processing Speed ◽  
Test Performance ◽  
Convergent Validity ◽  
Response Times ◽  
Nonlinear Effects ◽  
Intelligence Test ◽  
Factorial Validity ◽  
Test Taking ◽  
Two Factors ◽  
Administration Time

The purpose of this investigation was to examine a single-anagram, a double-anagram, and multi-anagram versions of the Anagram Persistence Task (APT) for factorial validity, reliability, and convergent validity. Additionally, a battery of intelligence tests was administered to examine convergent validity. Based on an unrestricted factor analysis, two factors were uncovered from the 14 anagram (seven very difficult and seven very easy) response times: test-taking persistence and verbal processing speed. The internal consistency reliabilities for the single-anagram, double-anagram, and multi-anagram (seven difficult anagrams) measures were .42, .85, and .86, respectively. Furthermore, all three versions of the APT correlated positively with intelligence test performance ( r ≈ .22). However, the double-anagram and multi-anagram versions also evidenced negative, nonlinear effects with intelligence test performance ( r ≈ −.15), which suggested the possibility of testee adaptation. Taking psychometrics and administration time into consideration, simultaneously, the double-anagram version of the APT may be regarded as preferred.

scholarly journals A Multiprocess Item Response Model for Not-Reached Items due to Time Limits and Quitting

2019 ◽  
Vol 80 (3) ◽  
pp. 522-547
Author(s):  
Esther Ulitzsch ◽  
Matthias von Davier ◽  
Steffi Pohl
Keyword(s):  
Missing Data ◽  
Test Performance ◽  
Missing Values ◽  
Response Times ◽  
Computerized Testing ◽  
Item Response Model ◽  
Time Limits ◽  
Fine Grained ◽  
Test Taking ◽  
The One

So far, modeling approaches for not-reached items have considered one single underlying process. However, missing values at the end of a test can occur for a variety of reasons. On the one hand, examinees may not reach the end of a test due to time limits and lack of working speed. On the other hand, examinees may not attempt all items and quit responding due to, for example, fatigue or lack of motivation. We use response times retrieved from computerized testing to distinguish missing data due to lack of speed from missingness due to quitting. On the basis of this information, we present a new model that allows to disentangle and simultaneously model different missing data mechanisms underlying not-reached items. The model (a) supports a more fine-grained understanding of the processes underlying not-reached items and (b) allows to disentangle different sources describing test performance. In a simulation study, we evaluate estimation of the proposed model. In an empirical study, we show what insights can be gained regarding test-taking behavior using this model.

The nature of the test taking situation: Informational and affective influences on intelligence test performance

1996 ◽  
Vol 8 (2) ◽  
pp. 105-120 ◽  
Author(s):  
Richard M. Sorrentino ◽  
Melissa C. Brouwers ◽  
Steven E. Hanna ◽  
Christopher R.J. Roney
Keyword(s):  
Test Performance ◽  
Intelligence Test ◽  
Test Taking ◽  
Affective Influences

scholarly journals Investigation of cognition in schizophrenia: psychometric properties of instruments for assessing working memory updating

2015 ◽  
Vol 64 (3) ◽  
pp. 238-246 ◽  
Author(s):  
Arthur A. Berberian ◽  
Ary Gadelha ◽  
Natália M. Dias ◽  
Tatiana P. Mecca ◽  
Rodrigo A. Bressan ◽  
...  
Keyword(s):  
Working Memory ◽  
Processing Speed ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Principal Component ◽  
Total Sample ◽  
Factorial Validity ◽  
Healthy Controls ◽  
Working Memory Updating ◽  
Stage 1

Objective This study describes the development of two updating measures of working memory (WM): Letter Updating Test (LUT) and Word Updating Test (WUT). Methods In stage 1, items were created and the instruments were assessed by experts and laymen. In stage 2, tests were given to 15 patients with schizophrenia and 15 paired controls. All were able to understand and respond to the instruments. In stage 3, 141 patients with schizophrenia and 119 healthy controls aged 18 to 60 took part; they were assessed on WM, processing speed (PS) and functional outcome. Results The results showed adequate rates of internal consistency for both measures developed, for both the total sample and each group separately, as well as evidence of convergent validity, discriminant validity and sensitivity to differentiate performance among the groups. Principal component analysis yielded two components, one for updating tests and other for PS measures, indicating factorial validity. Positive and significant, yet low, correlations were found with functionality measures. Conclusion These results provide adequate psychometric parameters for the measures developed, applicable to cognitive research settings in schizophrenia.

scholarly journals Citizenship matters: Translating and adapting the Citizenship Measure to Norwegian

2021 ◽  
pp. 145507252110186
Author(s):  
Linda Nesse ◽  
Marianne Thorsen Gonzalez ◽  
Michael Rowe ◽  
Ruth Kjærsti Raanaas
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Mental Health Problems ◽  
Supported Housing ◽  
Measurement Properties ◽  
Convenience Sample ◽  
Marginalised Groups ◽  
Two Factors ◽  
Back Translation ◽  
High Internal Consistency

Citizenship is considered intertwined with recovery, and may be a useful perspective for advancing quality of life among marginalised groups. Yet, matters of citizenship among persons with co-occurring substance use and mental health problems both in research and practice. Aims: In order to measure citizenship among persons with co-occurring problems in a Norwegian study, a measure of citizenship was translated from English to Norwegian. The aims of the study were to 1) translate and adapt the Citizenship Measure, developed by Rowe and colleagues at the Yale Program for Recovery and Community Health, to Norwegian, and 2) to assess the internal consistency and convergent validity of the Norwegian translated measure. Methods: The translation process was carried out using forward and back translation procedures. To examine measurement properties, a convenience sample of 104 residents with co-occurring problems living in supported housing completed the measure. Results: Two factors were identified, related to rights, and to relational citizenship. The Norwegian translation of the Citizenship Measure showed has high internal consistency and adequate convergent validity. Conclusions: We argue that the measure can be useful in assessing perceived citizenship, and in initiating efforts to support citizenship among persons with co-occurring problems.

Halstead-Reitan Test Battery: A Problem of Differential Diagnosis

1980 ◽  
Vol 50 (2) ◽  
pp. 611-630
Author(s):  
Irmingard I. Lenzer
Keyword(s):  
Brain Damage ◽  
Test Performance ◽  
Construct Validation ◽  
Neuropsychological Test ◽  
Summary Score ◽  
Test Battery ◽  
Medical Patients ◽  
Test Taking ◽  
Limited Applicability ◽  
Schizophrenic Patients

The Halstead-Reitan Test Battery is one of the most widely recognized neuropsychological test batteries. Many claims have been made as to its validity. Despite these claims, doubts persist. A critical review of the literature shows that the battery can separate brain-damaged patients from normal patients, general medical patients, and patients with certain psychiatric disorders. However, the battery cannot separate brain-damaged patients as a group from schizophrenics as a group, though in individual cases there may exist pathognomonic signs indicating brain damage. The impairment index, as a summary score of the basic tests, as well as other “methods of inference,” fail at this point. Four alternatives are discussed. First, brain-damaged patients differ from schizophrenic patients not in test performance but in test-taking behavior. Second, the battery is a valid measure of brain damage but has limited applicability. Third, the battery is a measure not of brain damage but of degree of degradation of psychological processes. And fourth, schizophrenics perform poorly on the battery because they have undetected brain damage. Only the third and fourth alternatives appear viable. Both question the validity of the traditional criteria of brain damage. It is argued that future validation studies of the battery should be of construct validation type and not of the criterion-oriented type, as these are defined by Cronbach and Meehl (1955). Possible procedures for construct validation are briefly discussed.

IQ Constancy in Disadvantaged Negro Children

1971 ◽  
Vol 29 (1) ◽  
pp. 319-326 ◽  
Author(s):  
Norman A. Milgram
Keyword(s):  
Sex Differences ◽  
Multiple Regression ◽  
Test Performance ◽  
Test Taking ◽  
Comparison Test ◽  
Initial Comparison ◽  
Age Trends ◽  
Iq Scores ◽  
Formal Test

A longitudinal followup of 59 disadvantaged Negro children from age 3 to 8 indicated that: (1) their mean Binet IQ was relatively stable, while their Peabody IQ rose appreciably; (2) the magnitude of the correlation between earlier and later IQ scores was a function of the interval between test-retest and the age of the child on the initial comparison test; (3) ratings on test-taking behavior yielded significant sex differences and age trends; (4) ratings specific to formal test performance were significantly correlated with IQ scores of tests taken concurrent to the ratings and of tests taken one or more years later; (5) these ratings did not, however, enhance in multiple regression the correlation which obtained for predictor and criterion IQ scores alone. Findings were discussed in relation to other studies.

Construction and Validation of a Self-Efficacy Scale for Latex Barrier Use

2016 ◽  
Vol 19 ◽  
Author(s):  
Vicente Morell-Mengual ◽  
María Dolores Gil-Llario ◽  
Jesús Castro-Calvo
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Condom Use ◽  
Self Efficacy ◽  
Convergent Validity ◽  
Hiv Transmission ◽  
Confirmatory Factor ◽  
Two Factors ◽  
Preventive Methods ◽  
Negative Expectations

AbstractSome studies have concluded there is a relationship between perceived self-efficacy and behaviors that prevent HIV transmission. This paper presents the construction and validation of the latex barrier use self-efficacy scale (LBSS), which 480 participants filled out. Exploratory factor analysis yielded two components: positive expectations of self-efficacy (ES-POS) and negative expectations of self-efficacy (ES-NEG), which together accounted for 65.59% of total variance. That structure was later verified through confirmatory factor analysis. Internal consistency was .80 for the total scale, and .78 for each of the two factors. Moreover, the instrument had adequate convergent validity and was positively related with condom use self-efficacy, attitudes toward condom and latex barrier use, and ability to refuse sex if the partner refuses to use preventive methods. In conclusion, this instrument is a useful measure of self-efficacy in latex barrier use.

Sign in / Sign up

Export Citation Format

Share Document