Modeling combination of question order effect, response replicability effect, and QQ-equality with quantum instruments

The design of assessment tools is critical to accurately evaluate students' understanding of chemistry. Although extensive research has been conducted on various aspects of assessment tool design, few studies in chemistry have focused on the impact of the order in which questions are presented to students on the measurement of students' understanding and students' performance. This potential impact has been labeled the question order effect in other literature and may be considered as a threat to the construct validity of the assessment tool. The set of studies described in this article tested whether question order effects were present within a concept inventory on acid-based chemistry. In particular, we tested whether the order of two conceptually isomorphic questions, one pictorial and one verbal, affected students' performance on the concept inventory. Two different versions of the inventory were developed and collected from students enrolled in the second semester of first-year university chemistry courses (general chemistry;N= 774) at two different institutions and to students enrolled in the first semester of organic chemistry (N= 163) at one of the two institutions. Students were further divided in two groups based on their self-reported level of effort in answering the concept inventory. Interviews were also conducted with a total of 19 students at various stages of the studies. Analyses of differences in students' responses to the two versions of the inventory revealed no question order effect in all settings. Implications for instructors and researchers are provided.

Download Full-text

Causes and consequences of juvenile crime and violence: Public attitudes and question-order effect

American Journal of Criminal Justice ◽

10.1007/bf02887287 ◽

1998 ◽

Vol 23 (1) ◽

pp. 129-143 ◽

Cited By ~ 9

Author(s):

Timothy C. Hart

Keyword(s):

Public Attitudes ◽

Order Effect ◽

Juvenile Crime ◽

Question Order

Download Full-text

Bipolarity and/or duality of social survey measurement scales and the question-order effect

Quality & Quantity ◽

10.1007/s11135-011-9569-z ◽

2011 ◽

Vol 47 (2) ◽

pp. 839-852 ◽

Cited By ~ 2

Author(s):

Mitja Hafner-Fink ◽

Samo Uhan

Keyword(s):

Order Effect ◽

Measurement Scales ◽

Social Survey ◽

Question Order

Download Full-text

Modeling Combination of Question Order Effect, Response Replicability Effect, and QQ-Equality with Quantum Instruments

10.20944/preprints202010.0358.v1 ◽

2020 ◽

Author(s):

Masanao Ozawa ◽

Andrei Khrennikov

Keyword(s):

Decision Making ◽

Measurement Theory ◽

Order Effect ◽

Mathematical Framework ◽

Joint Paper ◽

Alarm Signal ◽

Question Order ◽

Projection Postulate ◽

Poll Data ◽

Opinion Polls

We continue to analyze basic constraints on human's decision making from the viewpoint of quantum measurement theory (QMT). As has been found, the conventional QMT based on the projection postulate cannot account for combination of the question order effect (QOE) and the response replicability effect (RRE). This was an alarm signal for quantum-like modeling of decision making. Recently, it was shown that this objection to quantum-like modeling can be removed on the basis of the general QMT based on quantum instruments. In the present paper we analyse the problem of combination of QOE, RRE, and the famous QQ-equality (QQE). This equality was derived by Busemeyer and Wang and it was shown (in the joint paper with Solloway and Shiffrin) that statistical data from many social opinion polls satisfies it. Now, we construct quantum instruments satisfying QOE, RRE, and QQE. The general features of our approach are formalized with postulates which generalize {\it Wang-Busemeyer} postulates for quantum-like modeling of decision making. Moreover, we show that our model closely reproduces the statistics of the famous Clinton-Gore Poll data with a prior belief state independent of the question order. This model successfully removes the order effect from the data to determine the genuine distribution of the opinions in the Poll. The paper also provides a psychologist-friendly introduction to the theory of quantum instruments - the most general mathematical framework for quantum measurements. We hope that this theory will attract attention of psychologists and will stimulate further applications.

Download Full-text

Application of Theory of Quantum Instruments to Psychology: Combination of Question Order Effect with Response Replicability Effect

Entropy ◽

10.3390/e22010037 ◽

2019 ◽

Vol 22 (1) ◽

pp. 37 ◽

Cited By ~ 1

Author(s):

Masanao Ozawa ◽

Andrei Khrennikov

Keyword(s):

Decision Making ◽

Social Science ◽

Quantum Physics ◽

Order Effect ◽

Quantum Formalism ◽

Psychological Behavior ◽

Question Order ◽

Back Action ◽

Orthogonal Projectors ◽

Atomic Type

Recently, quantum formalism started to be actively used outside of quantum physics: in psychology, decision-making, economics, finances, and social science. Human psychological behavior is characterized by a few basic effects; one of them is the question order effect (QOE). This effect was successfully modeled (Busemeyer–Wang) by representing questions A and B by Hermitian observables and mental-state transformations (back action of answering) by orthogonal projectors. However, then it was demonstrated that such representation cannot be combined with another psychological effect, known as the response replicability effect (RRE). Later, this no-go result was generalized to representation of questions and state transformations by quantum instruments of the atomic type. In light of these results, the possibility of using quantum formalism in psychology was questioned. In this paper, we show that, nevertheless, the combination of the QOE and RRE can be modeled within quantum formalism, in the framework of theory of non-atomic quantum instruments.

Download Full-text

A Question Order Effect in a Local Government Survey

Public Opinion Quarterly ◽

10.1086/269285 ◽

1991 ◽

Vol 55 (4) ◽

pp. 640 ◽

Cited By ~ 21

Author(s):

J. Edwin Benton ◽

John L. Daly

Keyword(s):

Local Government ◽

Order Effect ◽

Question Order

Download Full-text

Generalization of Classic Question Order Effects Across Cultures

Sociological Methods & Research ◽

10.1177/0049124117747304 ◽

2018 ◽

Vol 49 (3) ◽

pp. 567-602 ◽

Cited By ~ 4

Author(s):

Tobias H. Stark ◽

Henning Silber ◽

Jon A. Krosnick ◽

Annelies G. Blom ◽

Midori Aoyagi ◽

...

Keyword(s):

Necessary Conditions ◽

Strong Support ◽

Order Effect ◽

The United States ◽

Necessary Condition ◽

Order Effects ◽

The United Kingdom ◽

Question Order ◽

Perceptual Contrast ◽

Question Form

Questionnaire design is routinely guided by classic experiments on question form, wording, and context conducted decades ago. This article explores whether two question order effects (one due to the norm of evenhandedness and the other due to subtraction or perceptual contrast) appear in surveys of probability samples in the United States and 11 other countries (Canada, Denmark, Germany, Iceland, Japan, the Netherlands, Norway, Portugal, Sweden, Taiwan, and the United Kingdom; N = 25,640). Advancing theory of question order effects, we propose necessary conditions for each effect to occur, and found that the effects occurred in the nations where these necessary conditions were met. Surprisingly, the abortion question order effect even appeared in some countries in which the necessary condition was not met, suggesting that the question order effect there (and perhaps elsewhere) was not due to subtraction or perceptual contrast. The question order effects were not moderated by education. The strength of the effect due to the norm of evenhandedness was correlated with various cultural characteristics of the nations. Strong support was observed for the form-resistant correlation hypothesis.

Download Full-text