The fourth dimension: How response times impact test performance

2008 ◽  
Author(s):  
Kyle E. Brink
Keyword(s):  
Test Performance ◽  
Impact Test ◽  
Response Times ◽  
Fourth Dimension

A Psychometric Examination of the Anagram Persistence Task: More Than Two Unsolvable Anagrams May Not Be Better

Assessment ◽  
2018 ◽  
Vol 27 (6) ◽  
pp. 1198-1212 ◽  
Author(s):  
Gilles E. Gignac ◽  
Ka Ki Wong
Keyword(s):  
Processing Speed ◽  
Test Performance ◽  
Convergent Validity ◽  
Response Times ◽  
Nonlinear Effects ◽  
Intelligence Test ◽  
Factorial Validity ◽  
Test Taking ◽  
Two Factors ◽  
Administration Time

The purpose of this investigation was to examine a single-anagram, a double-anagram, and multi-anagram versions of the Anagram Persistence Task (APT) for factorial validity, reliability, and convergent validity. Additionally, a battery of intelligence tests was administered to examine convergent validity. Based on an unrestricted factor analysis, two factors were uncovered from the 14 anagram (seven very difficult and seven very easy) response times: test-taking persistence and verbal processing speed. The internal consistency reliabilities for the single-anagram, double-anagram, and multi-anagram (seven difficult anagrams) measures were .42, .85, and .86, respectively. Furthermore, all three versions of the APT correlated positively with intelligence test performance ( r ≈ .22). However, the double-anagram and multi-anagram versions also evidenced negative, nonlinear effects with intelligence test performance ( r ≈ −.15), which suggested the possibility of testee adaptation. Taking psychometrics and administration time into consideration, simultaneously, the double-anagram version of the APT may be regarded as preferred.

scholarly journals Comparison of test performance on paper-based testing (PBT) and computer-based testing (CBT) by English-majored undergraduate students in China

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Wenjing Yu ◽  
Noriko Iwashita
Keyword(s):  
Undergraduate Students ◽  
Mixed Method ◽  
Test Performance ◽  
Impact Test ◽  
Comfort Level ◽  
Proficiency Tests ◽  
Structured Interviews ◽  
Computer Based ◽  
Computer Based Testing ◽  
Testing Mode

AbstractComputer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing mode impacted TEM 4 score and factors (i.e., computer familiarity level and attitude towards CBT) that might correlate with performance on CBT of TEM 4. Overall 92 Chinese undergraduate students were randomly assigned to one of the groups, i.e., CBT or paper-based testing (PBT), and took the test. A mixed method was employed, including (1) quantitative and qualitative analysis of test performance in two modes, as well as CBT group participants’ computer familiarity and attitudes towards the mode; and (2) thematic analysis of semi-structured interviews. The results revealed that (1) test scores in CBT and PBT were comparable; (2) two items in the computer familiarity questionnaire, i.e., comfort level of reading articles on the computer and forgetting time when using computers, positively correlated with CBT scores; and (3) participants’ attitude towards CBT did not impact test performance.

scholarly journals A Multiprocess Item Response Model for Not-Reached Items due to Time Limits and Quitting

2019 ◽  
Vol 80 (3) ◽  
pp. 522-547
Author(s):  
Esther Ulitzsch ◽  
Matthias von Davier ◽  
Steffi Pohl
Keyword(s):  
Missing Data ◽  
Test Performance ◽  
Missing Values ◽  
Response Times ◽  
Computerized Testing ◽  
Item Response Model ◽  
Time Limits ◽  
Fine Grained ◽  
Test Taking ◽  
The One

So far, modeling approaches for not-reached items have considered one single underlying process. However, missing values at the end of a test can occur for a variety of reasons. On the one hand, examinees may not reach the end of a test due to time limits and lack of working speed. On the other hand, examinees may not attempt all items and quit responding due to, for example, fatigue or lack of motivation. We use response times retrieved from computerized testing to distinguish missing data due to lack of speed from missingness due to quitting. On the basis of this information, we present a new model that allows to disentangle and simultaneously model different missing data mechanisms underlying not-reached items. The model (a) supports a more fine-grained understanding of the processes underlying not-reached items and (b) allows to disentangle different sources describing test performance. In a simulation study, we evaluate estimation of the proposed model. In an empirical study, we show what insights can be gained regarding test-taking behavior using this model.

scholarly journals Homogeneous Metal Foam Manufacturing and Impact Test Performance

2019 ◽  
Vol 15 (8) ◽  
pp. 2040
Author(s):  
Kaimal Ananthakrishnan ◽  
Boban Mathew Bevin ◽  
Jeyanthi S.
Keyword(s):  
Test Performance ◽  
Impact Test ◽  
Metal Foam

scholarly journals Modified Falling Mass Impact Test Performance on Functionally Graded Two Stage Aggregate Fibrous Concrete

Materials ◽  
2021 ◽  
Vol 14 (19) ◽  
pp. 5833
Author(s):  
Nandhu Prasad ◽  
Gunasekaran Murali ◽  
Nikolai Vatin
Keyword(s):  
Test Performance ◽  
Impact Test ◽  
Impact Resistance ◽  
American Concrete Institute ◽  
Functionally Graded ◽  
Test Results ◽  
Two Stage ◽  
Polypropylene Fibres ◽  
Fibre Composites ◽  
Fibrous Concrete

This research examined the performance of functionally graded two-stage fibrous concrete (FTSFC) against modified repeated falling-mass impacts. This study led to the concept of creating improved multiphysics model of fibre composites with better impact resistance for potential protective constructions. FTSFC was developed based on the bio-inspiring strength of turtle shells. The excellent impact resistance of FTSFC was accomplished by including a larger quantity of steel and polypropylene fibres in the outer layers. At the same time, one- and two-layered concrete were cast and compared to evaluate the efficiency of three-layered FTSFC. To minimize the dispersed test results, a modified form of the 544 drop-mass impact test was recommended by the American Concrete Institute (ACI). The modification was a knife-edge notched specimen instead of a solid cylindrical specimen without a notch. This modification predefined a crack path and reduced the dispersion of results. Cracking and failure impact numbers, ductility index, and failure mode were the testing criteria. The suggested modification to the ACI impact test decreased the coefficient of variance, showing that the dispersion of test results was reduced significantly. This study led to the concept of creating improved, fibre composites with better impact resistance for potential protective constructions.

scholarly journals Balance Performance of Post-Call Medical Residents

2021 ◽  
pp. 014556132098024
Author(s):  
Omer J. Ungar ◽  
Uri Amit ◽  
Anat Wengier ◽  
Oren Cavel ◽  
Yahav Oron ◽  
...  
Keyword(s):  
Sleep Deprivation ◽  
Test Performance ◽  
Response Times ◽  
Night Shift ◽  
Medical Residents ◽  
Balance Performance ◽  
Dynamic Posturography ◽  
Significant Deterioration ◽  
Before And After ◽  
Call Night

Background: Fatigue is thought of as a leading cause of iatrogenic accidents. A significant deterioration in qualitative balance function has been shown in sleep deprived individuals. Aim/Objectives: To quantify the degree to which balance is impaired by sleep deprivation (SD) in post-call medical residents. Methods: Medical residents voluntarily underwent computed dynamic posturography (CDP) before and after an on-call night, at an identical time of the day. Order of test performance was random to avoid behavioral learning. Each participant served as his or her own control. Results: Seventeen residents were enrolled (median age 32years). Average sleeping duration the night before and during the night shift was 6.5 and 1 hour, respectively. The average response times difference between alert and fatigued was 10.15 milliseconds (95% CI: 6.81-13.49 milliseconds), yielding a significantly prolonged response times from 120 milliseconds before to 130 milliseconds after the night shift ( P < .001). Comparison of additional measurements of CDP performance did not differ between test conditions. Conclusion: Medical residents are fatigued due to the effect of on-call nights. Sleep deprivation prolongs response times to vestibular stimuli. This finding probably has an effect on execution of manual skills and may reflect a more generalized slowing of responses and overall performance impairment. Significance: The vestibular system is susceptible to SD.

Sign in / Sign up

Export Citation Format

Share Document