Question Order Effect and the Measurement of Candidate Preference in the 1982 Connecticut Elections

1984 ◽  
Vol 48 (3) ◽  
pp. 578 ◽  
Author(s):  
Irving Crespi ◽  
Dwight Morris
Keyword(s):  
Order Effect ◽  
Candidate Preference ◽  
Question Order

Probing the question order effect while developing a chemistry concept inventory

2017 ◽  
Vol 18 (1) ◽  
pp. 45-54 ◽  
Author(s):  
Molly A. Undersander ◽  
Travis J. Lund ◽  
Laurie S. Langdon ◽  
Marilyne Stains
Keyword(s):  
Assessment Tool ◽  
Order Effect ◽  
Assessment Tools ◽  
Concept Inventory ◽  
Order Effects ◽  
First Year ◽  
First Semester ◽  
Question Order ◽  
First Year University ◽  
The Impact

The design of assessment tools is critical to accurately evaluate students' understanding of chemistry. Although extensive research has been conducted on various aspects of assessment tool design, few studies in chemistry have focused on the impact of the order in which questions are presented to students on the measurement of students' understanding and students' performance. This potential impact has been labeled the question order effect in other literature and may be considered as a threat to the construct validity of the assessment tool. The set of studies described in this article tested whether question order effects were present within a concept inventory on acid-based chemistry. In particular, we tested whether the order of two conceptually isomorphic questions, one pictorial and one verbal, affected students' performance on the concept inventory. Two different versions of the inventory were developed and collected from students enrolled in the second semester of first-year university chemistry courses (general chemistry;N= 774) at two different institutions and to students enrolled in the first semester of organic chemistry (N= 163) at one of the two institutions. Students were further divided in two groups based on their self-reported level of effort in answering the concept inventory. Interviews were also conducted with a total of 19 students at various stages of the studies. Analyses of differences in students' responses to the two versions of the inventory revealed no question order effect in all settings. Implications for instructors and researchers are provided.

Bipolarity and/or duality of social survey measurement scales and the question-order effect

2011 ◽  
Vol 47 (2) ◽  
pp. 839-852 ◽  
Author(s):  
Mitja Hafner-Fink ◽  
Samo Uhan
Keyword(s):  
Order Effect ◽  
Measurement Scales ◽  
Social Survey ◽  
Question Order

scholarly journals Modeling Combination of Question Order Effect, Response Replicability Effect, and QQ-Equality with Quantum Instruments

2020 ◽  
Author(s):  
Masanao Ozawa ◽  
Andrei Khrennikov
Keyword(s):  
Decision Making ◽  
Measurement Theory ◽  
Order Effect ◽  
Mathematical Framework ◽  
Joint Paper ◽  
Alarm Signal ◽  
Question Order ◽  
Projection Postulate ◽  
Poll Data ◽  
Opinion Polls

We continue to analyze basic constraints on human's decision making from the viewpoint of quantum measurement theory (QMT). As has been found, the conventional QMT based on the projection postulate cannot account for combination of the question order effect (QOE) and the response replicability effect (RRE). This was an alarm signal for quantum-like modeling of decision making. Recently, it was shown that this objection to quantum-like modeling can be removed on the basis of the general QMT based on quantum instruments. In the present paper we analyse the problem of combination of QOE, RRE, and the famous QQ-equality (QQE). This equality was derived by Busemeyer and Wang and it was shown (in the joint paper with Solloway and Shiffrin) that statistical data from many social opinion polls satisfies it. Now, we construct quantum instruments satisfying QOE, RRE, and QQE. The general features of our approach are formalized with postulates which generalize {\it Wang-Busemeyer} postulates for quantum-like modeling of decision making. Moreover, we show that our model closely reproduces the statistics of the famous Clinton-Gore Poll data with a prior belief state independent of the question order. This model successfully removes the order effect from the data to determine the genuine distribution of the opinions in the Poll. The paper also provides a psychologist-friendly introduction to the theory of quantum instruments - the most general mathematical framework for quantum measurements. We hope that this theory will attract attention of psychologists and will stimulate further applications.

scholarly journals Application of Theory of Quantum Instruments to Psychology: Combination of Question Order Effect with Response Replicability Effect

Entropy ◽  
2019 ◽  
Vol 22 (1) ◽  
pp. 37 ◽  
Author(s):  
Masanao Ozawa ◽  
Andrei Khrennikov
Keyword(s):  
Decision Making ◽  
Social Science ◽  
Quantum Physics ◽  
Order Effect ◽  
Quantum Formalism ◽  
Psychological Behavior ◽  
Question Order ◽  
Back Action ◽  
Orthogonal Projectors ◽  
Atomic Type

Recently, quantum formalism started to be actively used outside of quantum physics: in psychology, decision-making, economics, finances, and social science. Human psychological behavior is characterized by a few basic effects; one of them is the question order effect (QOE). This effect was successfully modeled (Busemeyer–Wang) by representing questions A and B by Hermitian observables and mental-state transformations (back action of answering) by orthogonal projectors. However, then it was demonstrated that such representation cannot be combined with another psychological effect, known as the response replicability effect (RRE). Later, this no-go result was generalized to representation of questions and state transformations by quantum instruments of the atomic type. In light of these results, the possibility of using quantum formalism in psychology was questioned. In this paper, we show that, nevertheless, the combination of the QOE and RRE can be modeled within quantum formalism, in the framework of theory of non-atomic quantum instruments.

scholarly journals Modeling combination of question order effect, response replicability effect, and QQ-equality with quantum instruments

2021 ◽  
Vol 100 ◽  
pp. 102491
Author(s):  
Masanao Ozawa ◽  
Andrei Khrennikov
Keyword(s):  
Order Effect ◽  
Question Order

A Question Order Effect in a Local Government Survey

1991 ◽  
Vol 55 (4) ◽  
pp. 640 ◽  
Author(s):  
J. Edwin Benton ◽  
John L. Daly
Keyword(s):  
Local Government ◽  
Order Effect ◽  
Question Order

scholarly journals Generalization of Classic Question Order Effects Across Cultures

2018 ◽  
Vol 49 (3) ◽  
pp. 567-602 ◽  
Author(s):  
Tobias H. Stark ◽  
Henning Silber ◽  
Jon A. Krosnick ◽  
Annelies G. Blom ◽  
Midori Aoyagi ◽  
...  
Keyword(s):  
Necessary Conditions ◽  
Strong Support ◽  
Order Effect ◽  
The United States ◽  
Necessary Condition ◽  
Order Effects ◽  
The United Kingdom ◽  
Question Order ◽  
Perceptual Contrast ◽  
Question Form

Questionnaire design is routinely guided by classic experiments on question form, wording, and context conducted decades ago. This article explores whether two question order effects (one due to the norm of evenhandedness and the other due to subtraction or perceptual contrast) appear in surveys of probability samples in the United States and 11 other countries (Canada, Denmark, Germany, Iceland, Japan, the Netherlands, Norway, Portugal, Sweden, Taiwan, and the United Kingdom; N = 25,640). Advancing theory of question order effects, we propose necessary conditions for each effect to occur, and found that the effects occurred in the nations where these necessary conditions were met. Surprisingly, the abortion question order effect even appeared in some countries in which the necessary condition was not met, suggesting that the question order effect there (and perhaps elsewhere) was not due to subtraction or perceptual contrast. The question order effects were not moderated by education. The strength of the effect due to the norm of evenhandedness was correlated with various cultural characteristics of the nations. Strong support was observed for the form-resistant correlation hypothesis.

scholarly journals Testing quantum-like models of judgment for question order effect

2016 ◽  
Vol 80 ◽  
pp. 33-46 ◽  
Author(s):  
Thomas Boyer-Kassem ◽  
Sébastien Duchêne ◽  
Eric Guerci
Keyword(s):  
Order Effect ◽  
Question Order

Tracing Activations of Diagnostic Hypotheses Reveals Memory Dynamics of a Primacy Order Effect

2013 ◽  
Author(s):  
Felix G. Rebitschek ◽  
◽  
Josef F. Krems ◽  
Georg Jahn
Keyword(s):  
Order Effect
Sign in / Sign up

Export Citation Format

Share Document