scholarly journals On the Practical Consequences of Misfit in Mokken Scaling

2019 ◽  
Author(s):  
Daniela Ramona Crișan ◽  
Jorge Tendeiro ◽  
Rob Meijer
Keyword(s):  
Test Scores ◽  
Simulated Data ◽  
Scale Analysis ◽  
Mokken Scaling ◽  
Psychometric Instruments ◽  
Rules Of Thumb ◽  
Personality Questionnaires ◽  
Psychometric Quality ◽  
Selection Of

Mokken scale analysis is a popular method to evaluate the psychometric quality of clinical and personality questionnaires and their individual items. Although many empirical papers report on the extent to which sets of items form Mokken scales, there is less attention for the effect of violations of commonly used rules of thumb. In this study we investigated the practical consequences of retaining or removing items with psychometric properties that do not comply with these rules-of-thumb. Using simulated data, we concluded that items with low scalability had some influence on the reliability of test scores, person ordering and selection, and criterion-related validity estimates. Removing the misfitting items from the scale had, in general, a small effect on the outcomes. Although important outcome variables were fairly robust against scale violations in some conditions, we conclude that researchers should not rely exclusively on algorithms allowing automatic selection of items. In particular, content validity must be taken into account in order to build sensible psychometric instruments.

scholarly journals On the Practical Consequences of Misfit in Mokken Scaling

2020 ◽  
Vol 44 (6) ◽  
pp. 482-496 ◽  
Author(s):  
Daniela Ramona Crişan ◽  
Jorge N. Tendeiro ◽  
Rob R. Meijer
Keyword(s):  
Test Scores ◽  
Simulated Data ◽  
Scale Analysis ◽  
Mokken Scaling ◽  
Psychometric Instruments ◽  
Rules Of Thumb ◽  
Personality Questionnaires ◽  
Psychometric Quality ◽  
Selection Of

Mokken scale analysis is a popular method to evaluate the psychometric quality of clinical and personality questionnaires and their individual items. Although many empirical papers report on the extent to which sets of items form Mokken scales, there is less attention for the effect of violations of commonly used rules of thumb. In this study, the authors investigated the practical consequences of retaining or removing items with psychometric properties that do not comply with these rules of thumb. Using simulated data, they concluded that items with low scalability had some influence on the reliability of test scores, person ordering and selection, and criterion-related validity estimates. Removing the misfitting items from the scale had, in general, a small effect on the outcomes. Although important outcome variables were fairly robust against scale violations in some conditions, authors conclude that researchers should not rely exclusively on algorithms allowing automatic selection of items. In particular, content validity must be taken into account to build sensible psychometric instruments.

A nonparametric procedure for exploring differences in rating quality across test-taker subgroups in rater-mediated writing assessments

2019 ◽  
Vol 36 (4) ◽  
pp. 595-616 ◽  
Author(s):  
Stefanie A. Wind
Keyword(s):  
Measurement Properties ◽  
Scale Analysis ◽  
Test Taker ◽  
Writing Assessments ◽  
Research And Practice ◽  
Basic Measurement ◽  
Psychometric Quality ◽  
Nonparametric Procedure ◽  
Insight Into

Differences in rater judgments that are systematically related to construct-irrelevant characteristics threaten the fairness of rater-mediated writing assessments. Accordingly, it is essential that researchers and practitioners examine the degree to which the psychometric quality of rater judgments is comparable across test-taker subgroups. Nonparametric procedures for exploring these differences are promising because they allow researchers and practitioners to examine important characteristics of ratings without potentially inappropriate parametric transformations or assumptions. This study illustrates a nonparametric method based on Mokken scale analysis (MSA) that researchers and practitioners can use to identify and explore differences in the quality of rater judgments between subgroups of test-takers. Overall, the results suggest that MSA provides insight into differences in rating quality across test-taker subgroups based on demographic characteristics. Differences in the degree to which raters adhere to basic measurement properties suggest that the interpretation of ratings may vary across subgroups. The implications of this study for research and practice are discussed.

scholarly journals Implementation outcome assessment instruments used in physical healthcare settings and their measurement properties: a systematic review protocol

BMJ Open ◽  
2017 ◽  
Vol 7 (10) ◽  
pp. e017972 ◽  
Author(s):  
Zarnie Khadjesari ◽  
Silia Vitoratou ◽  
Nick Sevdalis ◽  
Louise Hull
Keyword(s):  
Systematic Review ◽  
Measurement Properties ◽  
Cochrane Library ◽  
Health Measurement ◽  
Healthcare Settings ◽  
Implementation Outcomes ◽  
Psychometric Quality ◽  
The Impact ◽  
Selection Of

IntroductionOver the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures.Methods and analysisThe following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored.Ethics and disseminationEthical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for reviewers of papers and grants to determine the psychometric quality of the measures used in implementation research.Trial registration numberInternational Prospective Register of Systematic Reviews (PROSPERO):CRD42017065348.

scholarly journals Research on the Fairness of MPACC Selection Based on Examiner Heterogeneity

2021 ◽  
Vol 235 ◽  
pp. 03010
Author(s):  
Yan Wang ◽  
Zhuqian He ◽  
Jingjie Zheng
Keyword(s):  
Regression Model ◽  
Test Scores ◽  
Test Results ◽  
Before And After ◽  
The Relationship ◽  
Selection Of

The selection of MPACC (Master of Professional Accountant) is a key step in the training of senior accounting personnel. This paper examines the relationship between examiner heterogeneity and MPACC second test scores. We try to clarify the reason for the unfair phenomenon because of the heterogeneity of examiners in MPACC second test results and seek ways to solve this problem. The study found that the MPACC second test results are unfair. This unfairness is caused by the heterogeneity of the examiner. However, standardized algorithms balance the differences in MPACC examiner heterogeneity. The regression model was constructed by using the MPACC second test scores before and after standardization, which verified the existence of examiner heterogeneity and the effect of the standardized algorithm on the examiner heterogeneity. This article is based on the differences of MPACC second test scores due to examiner’s heterogeneity. We propose the application of standardized algorithm, which will play an important role in improving the quality of MPACC enrollment and promoting the training of senior accounting personnel.

What does it mean to measure general mental health in adolescents? A meta-review of content and psychometrics

2021 ◽  
Author(s):  
Louise Black ◽  
Margarita Panayiotou ◽  
Neil Humphrey
Keyword(s):  
Quality Of Life ◽  
Mental Health ◽  
Life Satisfaction ◽  
General Population ◽  
Self Report ◽  
General Mental Health ◽  
Meta Review ◽  
Psychometric Quality ◽  
Selection Of

Mental health in adolescence is a major concern but clear strategies for measurement in general population samples are lacking. This meta-review focused on the content and psychometric properties of self-report measures to inform judicious selection of indicators and measures. We identified 22 brief measures from 19 systematic reviews, under the following domains: general mental health (positive and negative aspects together), life satisfaction, quality of life (mental health subscales only), symptoms, and wellbeing. Measures were often classified inconsistently within these appearing under multiple constructs. While overlap between measures within and between domains was generally low, only 25 unique indicators were found. Several indicators were found across the majority, and measures also consistently tapped mostly emotional content. Psychometric quality was generally low. Findings suggest well-developed measures are lacking. We provide guidance on existing measures, how better measures might be developed, and the implications for research considering general mental health in adolescence.

ON THE EXPERT’S RIGHT TO BE PRESENT AT LEGAL PROCEEDINGS

2016 ◽  
Vol 15 ◽  
pp. 163-171
Author(s):  
M. G. Shcherbakovskiy
Keyword(s):  
Initial Data ◽  
Legal Proceedings ◽  
Reliable Assessment ◽  
Data Acquiring ◽  
Selection Of

The article discusses the reasonsfor an expert to participate in legal proceedings. The gnoseological reason for that consists of the bad quality of materials subject to examination that renders the examination either completely impossible or compromises objective, reasoned and reliable assessment of the findings. The procedural reason consists ofa proscription for an expert to collect evidence himself or herself. The author investigates into the ways of how an expert can participate in legal proceedings. If the defense invites an expert to participate in the proceedings, then it is recommended that his or her involvement should be in the presence of attesting witnesses and recorded in the protocol. In the course of the legal proceedings an expert has the following tasks: adding initial data, acquiring new initial data, understanding the situation of the incident, acquiring new objects to be studied, including samples for examination. An expert’s participation in legal proceedings differs from the participation of a specialist or an examination on the scene of the incident. The author describes the tasks that an expert solves in the course of legal proceedings, the peculiarities ofan investigation experiment practices, the selection of samples for an examination, inspection, interrogation.

Implementasi Voip Server Berbasis IPV6 Dengan Raspberry PI

2019 ◽  
Vol 9 (01) ◽  
pp. 47-54
Author(s):  
Rabbai San Arif ◽  
Yuli Fitrisia ◽  
Agus Urip Ari Wibowo
Keyword(s):  
Internet Protocol ◽  
Wireless Transmission ◽  
Raspberry Pi ◽  
Test Results ◽  
Average Delay ◽  
Ipv6 Network ◽  
Ip Network ◽  
Selection Of ◽  
Better Than

Voice over Internet Protocol (VoIP) is a telecommunications technology that is able to pass the communication service in Internet Protocol networks so as to allow communicating between users in an IP network. However VoIP technology still has weakness in the Quality of Service (QoS). VOPI weaknesses is affected by the selection of the physical servers used. In this research, VoIP is configured on Linux operating system with Asterisk as VoIP application server and integrated on a Raspberry Pi by using wired and wireless network as the transmission medium. Because of depletion of IPv4 capacity that can be used on the network, it needs to be applied to VoIP system using the IPv6 network protocol with supports devices. The test results by using a wired transmission medium that has obtained are the average delay is 117.851 ms, jitter is 5.796 ms, packet loss is 0.38%, throughput is 962.861 kbps, 8.33% of CPU usage and 59.33% of memory usage. The analysis shows that the wired transmission media is better than the wireless transmission media and wireless-wired.

DESIGN, SIMULATION AND IMPLEMENTATION MONITORING SYSTEM FOR SYSTEM CONTROL C4 FEEDING PUMP FOR FEED VAPORIZATION IN THE BUTADIENE PLANT

2020 ◽  
Vol 1 (1) ◽  
pp. 31-35
Author(s):  
Fahmi Yunistyawan ◽  
Yunistyawan J Berchmans ◽  
Gembong Baskoro
Keyword(s):  
Motor Control ◽  
Control System ◽  
Field Operator ◽  
System Control ◽  
Variable Speed ◽  
Variable Speed Drive ◽  
Software And Hardware ◽  
Discharge Pressure ◽  
Selection Of

This study implements the auto start control system on an electric motor 3 phase C4Feeding pump when the discharge pressure is low-low (4.3 kg /cm²). The C4 feeding pumpmotor was initially manually operated from the local control station, this was very ineffectiveand inefficient because it still relied on the field operator to operate the pump motor and whenthe plant was in normal operating it is very risk if the field operator late to operate motor then itwill impact to quality of the product, and if the delay time to operate motor is too long then planthave to shut down, therefore improvement is needed in the C4 feeding pump motor controlsystem. In this paper, various types of 3-phase motor control are explained which allow it to beapplied to the C4 feeding pump motor that are on-off, inverter, and variable speed drive andefficient selection of the three systems control of the motor. Software and hardware used in thisthesis work are DCS CENTUM VP Yokogawa.

Thomas More’s Correspondence in a Spanish Ambiance

Moreana ◽  
2002 ◽  
Vol 39 (Number 149) (1) ◽  
pp. 41-60 ◽  
Author(s):  
Eugenio M. Olivares Merino
Keyword(s):  
The Subject ◽  
Selection Of

The recent reprinting of Álvaro de Silva’s 1998 edition of a selection of More’s letters prompts the author to examine the subject of Spanish translations of More, and of de Silva’s general commentary on More’s correspondence and on his relationship to other humanists. The author reflects on aspects of More’s personality as exposed in his letters and uses what he finds as a corrective to several biographical misconceptions. He points out the strengths and weaknesses of de Silva’s work and compares it with that of other translators, particularly Elizabeth Rogers, and notes the particularly Spanish quality of de Silva’s edition.

Sign in / Sign up

Export Citation Format

Share Document