scholarly journals Theoretical evaluation of partial credit scoring of the multiple-response test item

2021 ◽  
Author(s):  
Rasmus Anders Xerxes Persson
Keyword(s):  
Domain Knowledge ◽  
Credit Scoring ◽  
Scoring Rules ◽  
Multiple Response ◽  
Response Type ◽  
Test Taker ◽  
Arbitrary Integer ◽  
Theoretical Evaluation ◽  
Rational Agents ◽  
Test Items

We compute and compare statistics of five different scoring rules for the selected-response type of test items where the number of keys is an arbitrary integer and the test-takers are perfectly rational agents. We consider a hypothetical test of factual recognition, in which the underlying ability that we seek to measure is the fraction of the item options that the test-taker truly recognizes (and not only guesses correctly), assumed directly proportional the test-taker’s domain knowledge. From these comparisons, two of these scoring rules are singled out as superior to the others.

scholarly journals Dealing with Incompatibilities among Procedural Goals under Uncertainty

2019 ◽  
Vol 22 (64) ◽  
pp. 47-62
Author(s):  
Mariela Morveli Espinoza ◽  
Juan Carlos Nieves ◽  
Ayslan Possebom ◽  
Cesar Augusto Tacla
Keyword(s):  
State Of The Art ◽  
Three Dimensional ◽  
Dimensional Vector ◽  
Theoretical Evaluation ◽  
Rational Agents ◽  
Abstract Argumentation ◽  
Novel Approach ◽  
Logical Strength ◽  
The Cost ◽  
Selection Of

By considering rational agents, we focus on the problem of selecting goals out of a set of incompatible ones. We consider three forms of incompatibility introduced by Castelfranchi and Paglieri, namely the terminal, the instrumental (or based on resources), and the superfluity. We represent the agent's plans by means of structured arguments whose premises are pervaded with uncertainty. We measure the strength of these arguments in order to determine the set of compatible goals. We propose two novel ways for calculating the strength of these arguments, depending on the kind of incompatibility thatexists between them. The first one is the logical strength value, it is denoted by a three-dimensional vector, which is calculated from a probabilistic interval associated with each argument. The vector represents the precision of the interval, the location of it, and the combination of precision and location. This type of representation and treatment of the strength of a structured argument has not been defined before by the state of the art. The second way for calculating the strength of the argument is based on the cost of the plans (regarding the necessary resources) and the preference of the goals associated with the plans. Considering our novel approach for measuring the strength of structured arguments, we propose a semantics for the selection of plans and goals that is based on Dung's abstract argumentation theory. Finally, we make a theoretical evaluation of our proposal.

Some New Developments in Adaptive Testing Technology

2008 ◽  
Vol 216 (1) ◽  
pp. 3-11 ◽  
Author(s):  
Wim J. van der Linden
Keyword(s):  
Item Response ◽  
Response Times ◽  
Adaptive Testing ◽  
Test Taker ◽  
Rule Based ◽  
New Developments ◽  
Test Items ◽  
Adaptive Use ◽  
Testing Technology ◽  
Multidimensional Adaptive Testing

In an ironic twist of history, modern psychological testing has returned to an adaptive format quite common when testing was not yet standardized. Important stimuli to the renewed interest in adaptive testing have been the development of item-response theory in psychometrics, which models the responses on test items using separate parameters for the items and test takers, and the use of computers in test administration, which enables us to estimate the parameter for a test taker and select the items in real time. This article reviews a selection from the latest developments in the technology of adaptive testing, such as constrained adaptive item selection, adaptive testing using rule-based item generation, multidimensional adaptive testing, adaptive use of test batteries, and the use of response times in adaptive testing.

Piloting a polychotomous partial-credit scoring procedure in a multiple-choice test

2014 ◽  
Vol 4 (1) ◽  
Author(s):  
Antonios Tsopanoglou ◽  
George S. Ypsilandis ◽  
Anna Mouti
Keyword(s):  
Pilot Study ◽  
Credit Scoring ◽  
Multiple Choice ◽  
Choice Test ◽  
Multiple Choice Test ◽  
Partial Credit ◽  
Language Competence ◽  
Test Items ◽  
Final Score ◽  
Potential Impact

AbstractMultiple-choice (MC) tests are frequently used to measure language competence because they are quick, economical and straightforward to score. While degrees of correctness have been investigated for partially correct responses in combined-response MC tests, degrees of incorrectness in distractors and the role they play in determining the test-taker's final score remain comparatively unexplored. This pilot study examines degrees of incorrectness in MC test items and their potential impact on the overall

Disentangling the Psycholinguistic Loci of Anomia with Cognitive Psychometric Models

2021 ◽  
Vol 42 (03) ◽  
pp. 256-274
Author(s):  
Grant M. Walker
Keyword(s):  
Object Naming ◽  
Response Type ◽  
Test Items ◽  
Testing Strategies ◽  
Formal Concepts ◽  
Psychometric Models ◽  
Type Data ◽  
Complex Relationships ◽  
Using Data ◽  
Selection Of

AbstractThis article reviews advanced statistical techniques for measuring impairments in object naming, particularly in the context of stroke-induced aphasia. Traditional testing strategies can be challenged by the multifaceted nature of impairments that arise due to the complex relationships between localized brain damage and disruption to the cognitive processes required for successful object naming. Cognitive psychometric models can combine response-type analysis with item-response theory to yield accurate estimates of multiple abilities using data collected from a single task. The models also provide insights about how the test items can be challenging in different ways. Although more work is needed to fully optimize their clinical utility in practice, these formal concepts can guide thoughtful selection of stimuli used in treatment or assessment, as well as providing a framework to interpret response-type data.

scholarly journals Information value of multiple response questions

Psihologija ◽  
2012 ◽  
Vol 45 (4) ◽  
pp. 467-485 ◽  
Author(s):  
Srdjan Verbic
Keyword(s):  
Item Response ◽  
Information Value ◽  
Multiple Response ◽  
Scoring Methods ◽  
Information Function ◽  
Test Items ◽  
Response Characteristics ◽  
Test Information ◽  
Independent Test ◽  
Test Information Function

Answers to Multiple Response (MR) questions carry more information than we usually utilize. Simple idea that all options of MR questions should be scored as independent test items has two major difficulties: 1) false options have item-response characteristics that are hard to model and use with other items; and 2) responses to individual options within the same MR question could be too dependent on each other. These difficulties lead to an overestimation of item discrimination and test information function. A few scoring methods that could increase information value obtained from MR questions are proposed and evaluated in this paper.

scholarly journals Modeling with ontologies design patterns: credit scorecard as a case study

2020 ◽  
Vol 17 (1) ◽  
pp. 429
Author(s):  
Jalil Elhassouni ◽  
Abderrahim El Qadi ◽  
Mehdi Bazzi ◽  
Mohamed El Haziti
Keyword(s):  
Credit Risk ◽  
Design Patterns ◽  
Domain Knowledge ◽  
Credit Scoring ◽  
Decision Making Process ◽  
Credit Risk Management ◽  
Scoring Model ◽  
Ontology Design ◽  
Credit Scoring Model

<span lang="EN-US">This paper proposes an ontological scorecard model for credit risk management. The purpose of credit scoring model is to reduce the possibility of potential losses with regard to issued loans. Loans are provided according to strict criteria which contain information about the client, loan structure, the purpose, repayment source and collateral. Several techniques have been used for credit risk assessment before granting a loan. Ontology design patterns is used here to enable the implementation of domain knowledge using the OWL rules and to improve the decision making process in credit monitoring. The modeling of our ontology will make the data publication simpler and graph structures intuitive, thus making its reusability and expandability easier.</span>

Sign in / Sign up

Export Citation Format

Share Document