scholarly journals Real-Time Generative Adaptive Digit Span Testing

2020 ◽  
Author(s):  
John Harmon Wolfe
Keyword(s):  
Real Time ◽  
Memory Span ◽  
Digit Span ◽  
Adaptive Testing ◽  
Research Strategy ◽  
Research Approach ◽  
Adaptive Tests ◽  
Item Parameters ◽  
Psychometric Models ◽  
Test Information Function

This paper explores the subject of generative adaptive testing using the digit span test as an example. A large-sample study of computer-generated and administered digit-span items on Navy recruits showed an almost perfect correlation (.98-.99) between digit span length and IRT difficulty. Predicted IRT parameters can be used for adaptive testing using items generated in real-time. Our results suggest that the best research strategy for developing generative adaptive tests may be to start with the most elementary cognitive tasks, and then build toward more complete psychometric models of complex mental tasks. The results of this study are sufficiently encouraging so that the same research approach should be tried with other forms of memory span tests and more complex working memory tests, including tests for figures, colors, and words. The paper advances the conjecture that the test information function of a generative CAT system has a mathematical relationship to the model fit and the distribution of the model-specified item parameters, independent of the content domain of the test.

scholarly journals Generative Adaptive Testing with Digit Span Items

2020 ◽  
Author(s):  
John Harmon Wolfe ◽  
Gerald E. Larson
Keyword(s):  
Real Time ◽  
Linear Function ◽  
San Diego ◽  
Computerized Adaptive Testing ◽  
Item Difficulty ◽  
Digit Span ◽  
Adaptive Testing ◽  
Training Center

The feasibility of generating items in real-time for computerized adaptive testing is explored, using forward digit span as an exemplar. A sample of 531 recruits at the Naval Training Center in San Diego were administered 36 computer-generated forward digit span items of varying lengths. Calibrations showed that the item difficulty was a simple linear function of the number of digits in the item, thus making the difficulty of newly generated items predictable. Simulations of Computerized adaptive testing with the approach were conducted with favorable results.

Benefits from Computerized Adaptive Testing as Seen in Simulation Studies

1999 ◽  
Vol 15 (2) ◽  
pp. 91-98 ◽  
Author(s):  
Lutz F. Hornke
Keyword(s):  
Measurement Error ◽  
Computerized Adaptive Testing ◽  
Test Procedure ◽  
Adaptive Testing ◽  
Parameter Estimates ◽  
Simulation Studies ◽  
Computerized Adaptive Test ◽  
Item Banks ◽  
Item Parameters ◽  
General Reliability

Summary: Item parameters for several hundreds of items were estimated based on empirical data from several thousands of subjects. The logistic one-parameter (1PL) and two-parameter (2PL) model estimates were evaluated. However, model fit showed that only a subset of items complied sufficiently, so that the remaining ones were assembled in well-fitting item banks. In several simulation studies 5000 simulated responses were generated in accordance with a computerized adaptive test procedure along with person parameters. A general reliability of .80 or a standard error of measurement of .44 was used as a stopping rule to end CAT testing. We also recorded how often each item was used by all simulees. Person-parameter estimates based on CAT correlated higher than .90 with true values simulated. For all 1PL fitting item banks most simulees used more than 20 items but less than 30 items to reach the pre-set level of measurement error. However, testing based on item banks that complied to the 2PL revealed that, on average, only 10 items were sufficient to end testing at the same measurement error level. Both clearly demonstrate the precision and economy of computerized adaptive testing. Empirical evaluations from everyday uses will show whether these trends will hold up in practice. If so, CAT will become possible and reasonable with some 150 well-calibrated 2PL items.

The Impact of corporate social responsibility (CSR) and relationship marketing on relationship maintainer and customer loyalty by mediating role of customer satisfaction

2018 ◽  
Vol 4 (4) ◽  
pp. 19-24
Author(s):  
Anam Bhatti ◽  
Sumbal Arif ◽  
Marium Marium ◽  
Sohail Younas
Keyword(s):  
Customer Satisfaction ◽  
Relationship Marketing ◽  
Customer Loyalty ◽  
Sampling Technique ◽  
Research Strategy ◽  
Equation Modeling ◽  
Survey Method ◽  
Research Approach ◽  
Questionnaire Method ◽  
The Impact

CSR has become one of the imperative implements in satisfying customers. The impartial of this research is to calculate CSR, relationship marketing, and customer satisfaction. There is no more study accompanied in Pakistan to quantify the effect of CSR and relationship marketing on the relationship maintainer and customer loyalty. To find out deductive approach and survey method is used as research approach and research strategy respectively. This research design is descriptive and quantitative study. For data, collection questionnaire method with semantic differential scale and seven point scales are adopted. Data has been collected by adopting the non-probability convenience technique as sampling technique and the sample size is 400. For factor confirmatory factor analysis, structure equation modeling and medication analysis, regression analysis Amos software were used. Strong empirical evidence supports that the customer’s perception of CSR performance is highly influenced by the values

An Alternative Method for Scoring Adaptive Tests

1996 ◽  
Vol 21 (4) ◽  
pp. 365-389 ◽  
Author(s):  
Martha L. Stocking
Keyword(s):  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Public Attention ◽  
Adaptive Tests ◽  
Adaptive Test ◽  
Alternative Method ◽  
Correct Score ◽  
Conventional Tests ◽  
Test Scoring ◽  
Adaptive Nature

Modern applications of computerized adaptive testing are typically grounded in item response theory (IRT; Lord, 1980 ). While the IRT foundations of adaptive testing provide a number of approaches to adaptive test scoring that may seem natural and efficient to psychometricians, these approaches may be more demanding for test takers, test score users, and interested regulatory institutions to comprehend. An alternative method, based on more familiar equated number-correct scores and identical to that used to score and equate many conventional tests, is explored and compared with one that relies more directly on IRT. It is concluded that scoring adaptive tests using the familiar number-correct score, accompanied by the necessary equating to adjust for the intentional differences in adaptive test difficulty, is a statistically viable, although slightly less efficient, method of adaptive test scoring. To enhance the prospects for enlightened public debate about adaptive testing, it may be preferable to use this more familiar approach. Public attention would then likely be focused on issues more central to adaptive testing, namely, the adaptive nature of the test.

scholarly journals ARTIST - a reAl-time low-effoRt mulTi-entity Interaction System for creaTing reusable and optimized MR experiences

2019 ◽  
Vol 5 ◽  
Author(s):  
Konstantinos Kotis
Keyword(s):  
Real Time ◽  
Development Time ◽  
Mixed Reality ◽  
Research Approach ◽  
The Novel ◽  
High Quality ◽  
Related Data ◽  
Novel Methods ◽  
Novel Concept ◽  
Heterogeneous Resources

ARTIST is a research approach introducing novel methods for real-time multi-entity interaction between human and non-human entities, to create reusable and optimized Mixed Reality (MR) experiences with low-effort, towards a Shared MR Experiences Ecosystem (SMRE2). As a result, ARTIST delivers high quality MR experiences, facilitating the interaction between a variety of entities which interact in a virtual and symbiotic way within a mega, virtual and fully-experiential world. Specifically, ARTIST aims to develop novel methods for low-effort (code-free) implementation and deployment of open and reusable MR content, applications and tools, introducing the novel concept of an Experience as a Trajectory (EaaT). In addition, ARTIST will provide tools for the tracking, monitoring and analysis of user behaviour and their interaction with the environment and with other users, towards optimizing MR experiences by recommending their reconfiguration, dynamically (at run-time) or statically (at development time). Finally, it will provide tools for synthesizing experiences into new mega and still reconfigurable EaaTs, enhancing them at the same time using semantically integrated related data/information available in disparate and heterogeneous resources.

scholarly journals A reAl-time low-effoRt mulTi-entity Interaction System for creaTing reusable and optimized MR experiences

2019 ◽  
Vol 5 ◽  
Author(s):  
Konstantinos Kotis
Keyword(s):  
Real Time ◽  
Development Time ◽  
Mixed Reality ◽  
Research Approach ◽  
The Novel ◽  
High Quality ◽  
Related Data ◽  
Novel Methods ◽  
Novel Concept ◽  
Heterogeneous Resources

ARTIST is a research approach introducing novel methods for real-time multi-entity interaction between human and non-human entities, to create reusable and optimized Mixed Reality (MR) experiences with low-effort, towards a Shared MR Experiences Ecosystem (SMRE2). As a result, ARTIST delivers high quality MR experiences, facilitating the interaction between a variety of entities which interact in a virtual and symbiotic way within a mega, virtual and fully-experiential world. Specifically, ARTIST aims to develop novel methods for low-effort (code-free) implementation and deployment of open and reusable MR content, applications and tools, introducing the novel concept of an Experience as a Trajectory (EaaT). In addition, ARTIST will provide tools for the tracking, monitoring and analysis of user behaviour and their interaction with the environment and with other users, towards optimizing MR experiences by recommending their reconfiguration, dynamically (at run-time) or statically (at development time). Finally, it will provide tools for synthesizing experiences into new mega and still reconfigurable EaaTs, enhancing them at the same time using semantically integrated related data/information available in disparate and heterogeneous resources.

Agent-Based Modeling for Simulation of Complex Business Systems

2011 ◽  
pp. 1852-1861
Author(s):  
Christopher Langdon
Keyword(s):  
Computer Science ◽  
Instrument Validation ◽  
Research Strategy ◽  
Agent Based Modeling ◽  
Scientific Study ◽  
Research Approach ◽  
Business Systems ◽  
Agent Based ◽  
Related Research ◽  
Advance Knowledge

This article aims to provide a synopsis of agent-based modeling and how to adapt an agent-based research strategy for the scientific study of complex business systems. Agent-based systems have been a popular field of study in computer science for some time. While computer science-related research has been focused on the artifact itself, such as computational languages and algorithms, research in the management sciences is explicitly focused on business problems. Research in Information Systems (IS) has begun to advance knowledge in the use of agent-based systems as a means to seek different, computational explanations for business phenomena that have eluded scientific inquiry reliant on traditional—specifically, law and axiomatic—explanation (Kimbrough, 2003). The focus on business problems requires a different research approach than what is successful in computer science. Key modifications include first, the explicit articulation of benefits specific to the management sciences, and second, instrument validation.

scholarly journals The Impact of Item Calibration Error on Variable-Length Cognitive Diagnostic Computerized Adaptive Testing

2020 ◽  
Vol 11 ◽  
Author(s):  
Xiaojian Sun ◽  
Yanlou Liu ◽  
Tao Xin ◽  
Naiqing Song
Keyword(s):  
Adverse Effects ◽  
Measurement Accuracy ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Unified Model ◽  
Variable Length ◽  
Calibration Error ◽  
Test Length ◽  
Test Efficiency ◽  
Item Parameters

Calibration errors are inevitable and should not be ignored during the estimation of item parameters. Items with calibration error can affect the measurement results of tests. One of the purposes of the current study is to investigate the impacts of the calibration errors during the estimation of item parameters on the measurement accuracy, average test length, and test efficiency for variable-length cognitive diagnostic computerized adaptive testing. The other purpose is to examine the methods for reducing the adverse effects of calibration errors. Simulation results show that (1) calibration error has negative effect on the measurement accuracy for the deterministic input, noisy “and” gate (DINA) model, and the reduced reparameterized unified model; (2) the average test lengths is shorter, and the test efficiency is overestimated for items with calibration errors; (3) the compensatory reparameterized unified model (CRUM) is less affected by the calibration errors, and the classification accuracy, average test length, and test efficiency are slightly stable in the CRUM framework; (4) methods such as improving the quality of items, using large calibration sample to calibrate the parameters of items, as well as using cross-validation method can reduce the adverse effects of calibration errors on CD-CAT.

Design effectiveness of academic library web sites

2019 ◽  
Vol 37 (3) ◽  
pp. 577-591 ◽  
Author(s):  
Fasola P. Abifarin ◽  
Shaka Apodoghe Imavah ◽  
Ayodele S. Olobashola
Keyword(s):  
Null Hypothesis ◽  
Web Search ◽  
Academic Library ◽  
Case Study Research ◽  
Research Strategy ◽  
Voluntary Action ◽  
Research Approach ◽  
Content Type ◽  
Design Effectiveness ◽  
Library Websites

Purpose Academic library websites need evaluation to determine whether users can derive useful experiences while visiting them to perform tasks. This is more so because visiting an academic library website is by voluntary action rather than compulsion as is the case with university, polytechnic and college sites where students must conduct academic transactions that cannot be reasonably avoided. The result of such an evaluation provides signposts for improvement so that academic library websites can continue to be useful to their users. Therefore, the purpose of this paper is to assess the structural effectiveness of academic library websites in Nigeria. Design/methodology/approach The case study, research strategy and survey research approach were adopted for the study. Through a Web search, 14 universities, one polytechnic and one college of education were identified while three academic library websites were selected for the study. The evaluation of the websites was un-moderated and conducted remotely by user participants who were recruited across the three tertiary institutions under study. A five-point scale questionnaire served as the research instrument while data were presented in tables and analyzed using the median score. The Kruskall–Wallis test by ranks was used to test the null hypothesis at a five per cent level of significance. Findings Out of the 20 items presented for assessment, Group 1 and 2 disagreed to 11 (55 per cent) while agreeing on the remaining 9 (45 per cent) on Lib 1 and Lib 2 websites. Group 3 agreed to 11 (55 per cent) while disagreeing on 9 (45 per cent) on the Lib 3 website. The null hypothesis proposed for the study was rejected as the p-value of 0.04 was significant at p < 0.05. This indicated that most of the critical issues pertaining to design effectiveness were perceived to be ineffective. Originality/value The findings from this study call for a review of the design of academic library websites in Nigeria so that users can identify which websites are easier to use.

Sign in / Sign up

Export Citation Format

Share Document