Creating the Punishment Orientation Questionnaire: An Item Response Theory Approach

2019 ◽  
Vol 45 (8) ◽  
pp. 1283-1294
Author(s):  
Susan Yamamoto ◽  
Evelyn M. Maeder

The purpose of these studies was to examine the principles people engage in when thinking about punishment, using a new measure (the Punishment Orientation Questionnaire [POQ]). Although traditional conceptualizations of punishment divide it into utilitarianism (e.g., deterrence) and retributivism (“eye for an eye”), we argue that a more useful metric of lay attitudes concerns orientation toward or away from punishment. After pilot testing and factor analysis, we used item response theory to assess four scales: prohibitive utilitarianism (limiting punishment based on utility), prohibitive retributivism (aversion to punishing innocent people), permissive utilitarianism (willingness to give strict punishment based on the benefits thereof), and permissive retributivism (desire for just deserts). The POQ showed good predictive validity for capital jury eligibility and sentencing recommendation in response to a death penalty trial stimulus. This study provides a better understanding of how classic punishment philosophies manifest among laypersons and contributes data outside of classical test theory.

2019 ◽  
Vol 9 (2) ◽  
pp. 133-146
Author(s):  
Yance Manoppo ◽  
Djemari Mardapi

This study aimed to reveal: (1) the characteristics of items of Chemistry Test in National Examination by using the classical test theory and item response theory; (2) the amount of cheating which occured by using Angoff's B-index Method, Pair 1 Method, Pair 2 Method, Modified Error Similarity Analysis (MESA) Method, and G2 Method; (3) the methods that detect more cheating in the implementation of the Chemistry Test in National Examination for high schools in the year 2011/2012 in Maluku Province. The results of the analysis with the classical test theory approach show that 77.5% items have item difficulty functioning well, 55% items have discrimination yet qualified and 70% items have distractor that works well with the index reliability test of 0,772. The analysis using the item response theory approach shows that 14 (35%) items fit with the model, the maximum function information is 11,4069 at θ = -1,6, and the magnitude of the error of measurement is 2,296. The number of pairs who are suspected of cheating is as follows: 13 pairs according to Angoff's B-index Method, 212 pairs according to Pair 1 Method, 444 pairs according to Pair 2 Method, 7 pairs according to MESA Method, and 102 pairs according to G2 Method. The most widely detecting cheating in a row is a   Pair 2, Pair 1, G2, Angoff's B-index, and MESA.


Author(s):  

There are three purposes of this paper. The first is to present a brief introduction to item response theory in conjunction with marketing research. The second is to present a review of the current uses of item response theory in representative marketing research journals. The third is to present an example that illustrate and contrasts classical test theory and item response theory approaches to item and scale analysis. Several item response theory relevant papers were recently published in various marketing research journals. Because models under item response theory, from simple to complex, were used without any systematic introduction in marketing research, this paper briefly presents the main concepts in item response theory. A content analysis was done for the second purpose with 30 item response theory relevant articles in marketing research journals. Articles were sorted based on the taxonomy of item response theory models. Many articles reviewed relied on some type of unidimensional dichotomous item response theory models. Articles published recently within the past 10 years used more complicated item response theory models, both mathematically and statistically, than other previously published articles in marketing research journals. Lastly, data from a scale with three Likert-type items of four response categories were analysed using a traditional approach based on item statistics and coefficient alpha as well as using an item response theory approach by employing the graded response model. Main concepts of item response theory were explicated with figures.


2014 ◽  
Vol 18 (1) ◽  
pp. 115-128
Author(s):  
Yance Manoppo ◽  
Djemari Mardapi

Penelitian ini bertujuan untuk mengetahui: (1) karakteristik butir soal Kimia Ujian Nasional berdasarkan teori tes klasik dan teori respon butir; (2) besarnya  kecurangan yang terjadi dengan menggunakan Metode Angoff's B-index, Metode Pair1, Metode Pair2, Metode Modified Error Similarity Analysis (MESA) dan Metode G2; (3) metode yang lebih banyak mendeteksi adanya kecurangan dalam pelaksanaan UN Kimia tingkat SMA/MA Negeri tahun pelajaran 2011/2012 di Provinsi Maluku. Hasil analisis dengan pendekatan teori tes klasik menunjukkan 77,5% butir memiliki tingkat kesulitan butir berfungsi baik, 55% butir daya bedanya belum memenuhi syarat, dan 70% butir memiliki pengecoh berfungsi baik dengan indeks reliabilitas tes 0,772. Analisis dengan pendekatan teori respons butir menunjukkan 14 (35%) butir cocok dengan model, fungsi informasi maksimum 11,4069 pada θ = -1,6, dan besarnya kesalahan pengukuran 2,296. Jumlah pasangan yang diduga curang adalah: menurut Metode Angoff's B-index ada 13 pasangan, menurut Metode Pair1 ada 212 pasangan, menurut Metode Pair2 ada 444 pasangan, menurut Metode MESA ada 7 pasangan, dan menurut Metode G2 ada 102 pasangan. Metode yang paling banyak mendeteksi kecurangan secara berturut-turut adalah: Metode Pair2, Metode Pair1, Metode G2, Metode Angoff's B-index, dan Metode MESA. Kata kunci: ujian nasional, karakteristik butir, metode kecurangan ______________________________________________________________ AN ANALYSIS OF METHOD OF CHEATING ON  LARGE TEST SCALEAbstract This study aimed to reveal: (1) the characteristics of items of Chemistry Test in National Examination by using the classical test theory and item response theory; (2) the amount of cheating which occured by using Angoff's B-index Method, Pair 1 Method, Pair 2 Method, Modified Error Similarity Analysis (MESA) Method, and G2 Method; (3) the methods that detected more cheating in the implementation of the Chemistry Test in National Examination for high schools in the academic  year 2011/2012 in Maluku Province. The results of the analysis with the classical test theory approach show that 77.5% items have item difficulty functioning well, 55% items have discrimination  that has not  met the requirement yet, and 70% items have distractor that works well with the index reliability test of 0,772. The analysis using the item response theory approach shows that 14 (35%) items fit with the model, the maximum function information is 11,4069 at θ = -1,6, and the magnitude of the error of measurement is 2,296. The number of pairs who are suspected of cheating is as follows: 13 pairs according to Angoff's B-index Method, 212 pairs according to Pair 1 Method,  444 pairs according to Pair 2 Method, 7 pairs according to MESA Method, and 102 pairs according to G2 Method. The most widely detecting cheating in a row is a Pair 2 Method, Pair 1 Method, G2 Method, Angoff's B-index Method, and MESA Method. Keywords: national examination, items characteristics, methods of cheating


1997 ◽  
Vol 21 (1) ◽  
pp. 71-87 ◽  
Author(s):  
Lynda A. King ◽  
Daniel W. King

The Sex-Role Egalitarianism Scale (SRES) was developed to measure attitudes toward the equality of women and men across content domains representing marital, parental, employment, social-interpersonal-heterosexual, and educational roles. The instrument exists in four versions: two alternate 95-item full forms and two alternate 25-item abbreviated forms. Reliability indices derived from a classical test-theory approach, multifaceted generalizability procedures, and an item-response theory-based analysis all support consistency or precision of measurement. Evidence for convergent, discriminant, and nomological validity is presented, along with a series of recommendations for future psychometric and substantive research using the scale.


Sign in / Sign up

Export Citation Format

Share Document