scholarly journals ANALYSIS OF MEASURES ITEMS IN DEVELOPMENT OF INSTRUMENTS SELF-ASSESSMENT (RASCH MODELING APPLICATION)

Author(s):  
Lailiyah Lailiyah ◽  
Yetti Supriyati ◽  
Komarudin Komarudin

This analysis aims to determine the quality of the instrument items that have been developed in the empirical test phase one. Tests were carried out on 46 items to 219 respondents in SMA Ksatrya Jakarta. The item quality is seen from the fit or not fit and the level of difficulty of the item that has been developed. The fit or unfit criteria are seen in INFIT and OUTFIT, both MNSQ and ZSTD, and Pt-Measure Correlation values. The level of difficulty of the item is seen in the entry number column which is indicated by the magnitude of the logit value and has been sorted from the hardest to the easiest. Based on the results of analysis with the help of software winstep obtained 39 items statement fit with the model and the number of respondents 194, the three criteria above (MNSQ, ZSTD, and Pt.Measure Correlation) has been met. This means that 39 items are valid. The result of the analysis also shows the most difficult item sequence is item 5 with logit value 63,32, and the easiest item is item 44 with logit value 36,13. The resulting fit instrument must have gone through several stages of analysis. When there are items that are not fit, the item is issued, as well as the respondent. So that obtained a set of measuring instruments that are valid / fit with the model and can be used for the purposes of assessment.     Keyword: self-assessment, infit, outfit, ZSTD, and Rasch Model.

2018 ◽  
Vol 4 (1) ◽  
pp. 1-9
Author(s):  
Lailiyah Lailiyah ◽  
Yetti Supriyati ◽  
Komarudin Komarudin

This analysis aims to determine the quality of the instrument items that have been developed in the empirical test phase one. Tests were carried out on 46 items to 219 respondents in SMA Ksatrya Jakarta. The item quality is seen from the fit or not fit and the level of difficulty of the item that has been developed. The fit or unfit criteria are seen in INFIT and OUTFIT, both MNSQ and ZSTD, and Pt-Measure Correlation values. The level of difficulty of the item is seen in the entry number column which is indicated by the magnitude of the logit value and has been sorted from the hardest to the easiest. Based on the results of analysis with the help of software winstep obtained 39 items statement fit with the model and the number of respondents 194, the three criteria above (MNSQ, ZSTD, and Pt.Measure Correlation) has been met. This means that 39 items are valid. The result of the analysis also shows the most difficult item sequence is item 5 with logit value 63,32, and the easiest item is item 44 with logit value 36,13. The resulting fit instrument must have gone through several stages of analysis. When there are items that are not fit, the item is issued, as well as the respondent. So that obtained a set of measuring instruments that are valid / fit with the model and can be used for the purposes of assessment.     Keyword: self-assessment, infit, outfit, ZSTD, and Rasch Model.


2019 ◽  
Vol 20 (2) ◽  
pp. 72-87
Author(s):  
Ujang Suparman ◽  

The objectives of this research are to analyze critically the quality of test items used in SMP and SMA (mid semester, final semester, and National Examination Practice) in terms of reliability as a whole, level of difficulty, discriminating power, the quality of answer keys and distractors. The methods used to analyze the test items are item analysis (ITEMAN), two types of descriptive statistics for analyzing test items and another for analyzing the options. The findings of the research are very far from what is believed, that is, the quality of majority of test items as well as key answers and distractors are unsatisfactory. Based the results of the analysis, conclusions are drawn and recommendations are put forward.


2009 ◽  
Vol 99 (5) ◽  
pp. 460-471 ◽  
Author(s):  
Robert Trevethan

If self-referent instruments about people’s health are to be useful in clinical and research settings, those instruments must be developed according to well-established processes and principles of measurement. We outline the main processes that should occur in the development of self-referent measuring instruments in general, with a focus, for illustrative purposes, on those intended to assess foot health. Requirements and issues concerning different forms of reliability and validity receive the most attention. In particular, problems associated with indices of test-retest reliability, inter-item homogeneity, and construct validity are identified and discussed. Practicalities concerning administration and scoring are also considered. A list of questions is provided for prospective users to assess the characteristics and quality of self-referent instruments. (J Am Podiatr Med Assoc 99(5): 460–471, 2009)


2021 ◽  
Vol 9 (3) ◽  
pp. 329-345
Author(s):  
Ayi Darmana ◽  
Ani Sutiani ◽  
Haqqi Annazili Nasution ◽  
Ismanisa Ismanisa* ◽  
Nurhaswinda Nurhaswinda

Information about score obtained from a test is often interpreted as an indicator of the student's ability level. This is one of the weaknesses of classical analysis that are unable to provide meaningful and fair information. The acquisition of the same score if it comes from a test item with a different level of difficulty, must show different abilities. Analysis of the Rasch model will overcome this weakness. The purpose of this study was to analyze the quality of the items by validating the national chemistry exam instrument using the Rasch model. The research sample was 212 new students of the Department of Chemistry at the State University of Medan. The data collected was in the form of respondent's answer data to the 2013 chemistry UN questions, which amounted to 40 items multiple choice and uses the documentation method. Data analysis technique used the Rasch Model with Ministep software. The results of the analysis show the quality of the Chemistry National Exam (UN) questions is categorized as very good based on the following aspects: unidimension, item fit test, person map item, difficulty test level, person and item reliability. There is one item found to be gender bias, in which men benefit more than women. The average chemistry ability of respondents is above the average level of difficulty of the test items


Author(s):  
Inmaculada Méndez ◽  
Esther Secanilla ◽  
Juan P. Martínez ◽  
Josefa Navarro

In a global approach about the need of paying attention to staff working with and for older people with dementia and other diseases in residential care, it is necessary to investigate their emotional well-being to provide strategies to improve their quality of life and therefore their quality of patient care. Professional caregivers of people with dementia and other diseases have specific psycho-sociological problems. They are more prone to stress which can sometimes lead to the “burnout” due to specific functions in the workplace. To define the sample was decided to compare two residential centers of two regions, Murcia and Barcelona. We proceeded to the administration of the following measuring instruments: the scale Maslach Burnout Inventory (MBI) and an ad hoc survey conducted for professional caregivers. Finally, the results offer the possibility of carrying out programs to prevent emotional exhaustion in professional carers, as well as the possibility of designing psychoeducational programs for staff care and even future proactive and reactive interventions.


1989 ◽  
Vol 4 (2) ◽  
pp. 117-122 ◽  
Author(s):  
J.-F. Dreyfus ◽  
D. Cremniter ◽  
J.D. Guelfi

SummaryWe are still confronted by numerous different nosographic models and problems concerning the objective evaluation of patients progress during treatment. It is interesting to consider the consequences of this situation in psychiatry which still involves a relative diversity of practical methods used in clinical trials. The recommendations of the USA Food and Drug Administration, on the one hand, constitute a highly structured and precise reference. The World Health Organization, on the other hand, promulgates general recommendations resulting from a compromise designed to satisfy the greatest number of clinicians.Despite the apparently diverse principles and the different practical methods they propose, both those sets of recommendations have been useful in inspiring clinicians to reflect upon these different methodological approaches. The qualities of the inclusion criteria used in the study of patients and the sensitivity of the different measuring instruments have allowed psychotropic drug users as well as producers to recognize the need for a certain rigour in clinical trials.The FDA and WHO guidelines have certainly improved the quality of clinical trials in psychopharmacology. However, they also represent a source of resistance to innovation.A series of consensus meetings to first reconcile US and European points of view and later to include new techniques in the recognized sets of methods would therefore be helpful.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Mirjam Peters ◽  
Petra Kolip ◽  
Rainhild Schäfers

Abstract Background Home postpartum care is a major part of midwifery care in Germany. The user perspective plays an increasingly important role in the evaluation of health services, but there is a lack of valid and theoretically based measuring instruments, especially in midwifery care. The aim of this study was to develop and validate an instrument for measuring quality of midwifery care in the postpartum period from the perspective of women. Methods The following steps were taken to achieve this: (1) definition of the goals of midwifery work; (2) literature-based item development; (3) item selection based on a pre-test (n = 16); (4) item reduction and investigation of factor structure by means of explorative factor analysis (EFA; n = 133);(5) second EFA (n = 741) and confirmatory factor analysis (CFA; n = 744) based on a split representative sample survey; (6) hypothesis-based testing of correlations to sociodemographic characteristics of women and to characteristics of care. Results Measurement of Midwifery quality postpartum (MMAYpostpartum) consists of three scales with a total of 17 items which were found to have acceptable internal consistency: Personal Control (Cronbach’s alpha = .80), Trusting Relationship (Cronbach’s alpha = .87) and Orientation and Security (Cronbach’s alpha = .78). CFA verified and confirmed three factors: CFI = .928, TLI = .914, RMSEA = 0.073. Conclusion MMAYpostpartum is a predominantly valid, reliable short tool for evaluating the quality of midwifery care postpartum. It can be used to evaluate midwifery care, to compare different care models and in intervention research. It thus supports the orientation of midwives’ work towards the needs of women and their families.


1964 ◽  
Vol 7 (12) ◽  
pp. 1033-1035
Author(s):  
S. P. Krasivskii

2018 ◽  
Vol 42 ◽  
pp. 00036
Author(s):  
I Putu Suyoga Dharma ◽  
Pande Agus Adiwijaya

This experimental study aimed at investigating the effect of Problem Based Learning (PBL) and self-assessment (SA) on students’ writing competency and self-regulated learning in Tabanan Regency. This research applied 2x2 factorial design. 96 students were selected as sample through random sampling. Data were collected by test (writing competency) and questionnaire (self-regulation). Students’ writings were scored by analytical scoring rubric. The obtained data were analyzed statistically by MANOVA at 5% significance level. This research discovers: 1) there is a significant effect of PBL which occurs simultaneously and separately on students’ writing competency and self-regulated learning, 2) there is a significant effect of SA which ocurs simultaneously and separately on students’ writing competency and self-regulated learning, 3) there is a significant interaction between teaching model and assessment type on students’ writing competency and self-regulated learning which occurs simultaneously, 4) there is no significant interaction between teaching model and assessment type on students’ writing competency, and 5) there is a significant interaction between teaching model and assessment type on students’ self-regulated learning. This research results implies that PBL and SA should be applied in instruction process as a way to improve the quality of students’ writing competency and self-regulated learning.


Sign in / Sign up

Export Citation Format

Share Document