On the Depth of Decision Trees with Hypotheses

In this paper, based on the results of rough set theory, test theory, and exact learning, we investigate decision trees over infinite sets of binary attributes represented as infinite binary information systems. We define the notion of a problem over an information system and study three functions of the Shannon type, which characterize the dependence in the worst case of the minimum depth of a decision tree solving a problem on the number of attributes in the problem description. The considered three functions correspond to (i) decision trees using attributes, (ii) decision trees using hypotheses (an analog of equivalence queries from exact learning), and (iii) decision trees using both attributes and hypotheses. The first function has two possible types of behavior: logarithmic and linear (this result follows from more general results published by the author earlier). The second and the third functions have three possible types of behavior: constant, logarithmic, and linear (these results were published by the author earlier without proofs that are given in the present paper). Based on the obtained results, we divided the set of all infinite binary information systems into four complexity classes. In each class, the type of behavior for each of the considered three functions does not change.

Psychometric Evaluation of the Positive Mental Health (PMH) Scale Using Item Analysis According to the Rasch Model

Background: The investigation of patient-reported outcomes and psycho-oncological interventions mainly focuses on psychological distress or psychopathology. However, the recognition of the equal importance of positive mental health (PMH) has increased lately. The PMH-scale is a brief questionnaire allowing to assess well-being in individuals in the general population and in patients. Previous studies evaluated the psychometric properties of the PMH-scale using classical test theory (CTT). This study is the first to investigate the PMH-scale in patients with cancer using item analysis according to the Rasch model. Methods: In total, N = 357 cancer patients participated in the study. A Rasch analysis of the PMH-scale was conducted including testing of unidimensionality, local independence, homogeneity and differential item functioning (DIF) with regard to age, gender, type of cancer, the presence of metastases, psycho-oncological support, and duration of disease. Additionally, the ordering of the item thresholds as well as the targeting of the scale were investigated.Results: After excluding one misfitting item and accounting for local dependence by forming superitems, a satisfactory overall fit to the Rasch model was established (χ2 = 30.34, p = 0.21). The new PMH-8 scale proved to be unidimensional, and homogeneity of the scale could be inferred. All items showed ordered thresholds, there was no further item misfit. DIF was found for age, but as the impact of DIF was not substantial, no adjustment related to the age-DIF had to be made. The Person Separation Index (PSI = 0.89) was excellent, indicating excellent discriminatory power between different levels of positive mental health. Overall, the targeting of the PMH-8 was good for the majority of the present sample. However, at both ends of the scale item thresholds are missing as indicated by a slight floor effect (1.4%) and a considerable ceiling effect (9.8%). Conclusion: Overall, the results of the analysis according to the Rasch model support the use of the revised PMH-scale in a psycho-oncological context.

Developing mathematical literacy test with context of Bugis-Makassar local wisdom for junior high school students

Various studies on the development of mathematical literacy tests have not shown any research that focuses on developing mathematical literacy tests using the context of Bugis-Makassar local wisdom with Classical Test Theory (CTT). Thus, this study aimed to produce mathematical literacy tests using the context of Bugis-Makassar local wisdom based on CTT for junior high school students through development research using ADDIE design. The development of the test integrates mathematical literacy and local wisdom elements of Bugis-Makassar. There were 15 multiple-choice items developed and tested on 33 males and 68 females at seventh-grade junior high school students. The trial involved two schools in Makassar City using a convenience sampling technique. The test kit was validated by three mathematicians and produced an Aiken index score in the range of 0.67 to 0.89. The empirical data from the trial results were analyzed using CTT assisted by ITEMAN 4.3 software. The test analysis showed an average category for reliability test scores. As many as 47% of the items were in the medium category, and the rest were in the fair category. Meanwhile, 93% of the items have a good discriminatory ability, and 67% have distractors that were not functioning properly, then the tests items must be revised.

A study on radiotelephony English test design

Radiotelephony English is taught in college for the learners whose future professions are mainly pilots and air traffic controllers. The present study is to analyse the radiotelephony English test design in a university to see the extent of which it evaluates learners’ communicative competence in aviation scope. Theoretical frameworks on communicative competence, modern test theory and ICAO language proficiency requirements for the learners of radiotelephony communication are presented. The study reveals that learners’ communicative competence which includes both radiotelephony and everyday communication skills are important components in radiotelephony test design. The study points out that the application of modern test theory in designing radiotelephony test in college is vital in meeting the validity and reliability of the test and the students’ individual needs in English language learning for future career needs to be reflected in the test design.

Analysis of the difficulty index of item bank according to cognitive aspects during the Covid-19 pandemic

The Covid-19 pandemic is a major challenge for the education system. The face-to-face learning process shifted to online learning, including the school exams. In Aceh province, the school exams have changed from paper-based and computer-based. This research aims to analyze the difficulty index of an item bank based on cognitive aspects of Bloom’s Taxonomy. The study samples included 850 students. The data were the item bank of a final semester exam consisting of 200 multiple-choice items, answer keys, and students’ answer sheets. The empirical analysis of the item bank using classical test theory (CTT) found that 141 out of 200 items are valid based on content validity and computing data set using the Aiken’s V formula. Item tests have reliability of 0.983. The reliability is calculated using the Kuder-Richardson 21 formula. If the reliability coefficient is r11 ≥ 0.70, then the item is declared reliable. In addition, 62 out of 141 (43.97%) items from the item bank are classified with a moderate difficulty index, and 79 items (56.03%) are categorized with a high difficulty index. The cognitive aspects found in the items are remembering, understanding, applying, and analyzing. Students mostly found items with the cognitive aspects of remembering and understanding are difficult to solve.

Psychometric evaluation of the Relative Mastery Scale: An Occupational Adaptation instrument

This study evaluated the psychometric properties of the Relative Mastery Scale (RMS). Valid and reliable client-centered instruments support practice in value-based health care and community-based settings. Participants were 368 community-dwelling adults aged 18 to 95 years. Researchers conducted validity and reliability examinations of the RMS using classical test theory and Rasch measurement model. A partial credit model allowed exploration of individual scale properties. Spearman’s correlation coefficients between items were statistically significant at the .01 level. Cronbach’s alpha coefficient was .94 showing strong internal consistency. In exploratory factor analysis, Factor 1 accounted for 71% of variance with an eigenvalue of 4.26. In Rasch analysis, the 5-point rating scale demonstrated adequate functioning, confirmed unidimensionality, and person/item separation. The RMS instrument demonstrates sound psychometric characteristics. A valid and reliable measure of internal occupational adaptation supports application to monitor progress of internal occupational adaptation across a variety of individuals.

“Community and health-care service quality in Kosovo”: “a confirmatory analytical approach”

Purpose The purpose of this paper is to develop and test a modified service quality (SERVQUAL) model scale for measuring healthcare service quality in Kosovo. Design/methodology/approach An initial dimensions area methodology in construct development, followed by combined exploratory-analytical deductive research with the goal to test theory concepts and validate the measurement tool known from the theory of service quality using new empirical data in a specific context. A cross-sectional survey on a sample of 200 post-encountered patients and using structural equation modelling (SEM) and SEM path analysis to determine satisfaction. Findings The findings confirmed that a six-dimensional scale of SERVQUAL is not appropriate for the Kosovo health-care context. The scale development analysis with a new reduced four-dimensional model can be used to measure health service quality in the Kosovan context. Research limitations/implications The initial study concept was not piloted. It was developed by the researcher based on secondary data. Systematic random sampling was used, which may have resulted in conclusions that are not applicable to the general population. Finally, this study is applicable to the Kosovo context and cannot be generalized nor represent all patients treated in Kosovo hospitals and clinics. However, the above limitations are less significant compared to the importance of carrying out this type of study for the first time in Kosovo. Practical implications This study can help Kosovo health authorities to guide health system-wide improvements and health-care providers to remove quality shortfalls based on a culturally sensitive and validated multiple-item scale for the quality of their service. Originality/value This is the first research conducted to identify which of the service quality dimensions require attention by the health-care service providers in Kosovo and develop a validated tool for patient satisfaction measurement that can be used for commercial application.

Karakteristik Butir Soal Penilaian Akhir Semester Mata Pelajaran Sejarah Kelas XI SMA Negeri 1 Pangkalpinang

This research is a study of quantitative descriptive. The purpose of this research is to describe the characteristics of final semester exam items for grade XI in the History subject at SMA Negeri 1 Pangkalpinang using the classical test theory approach. The research of the subject was 138 students of class XI in Social Sciences Major. The result of the research shows that final exam questions in the history subject class XI of SMA Negeri 1 Pangkalpinang are proper to use. This shows that from the validity of the items which there are 39 items of questions (97.5%) which are proven empirically valid with a 0.818 reliability coefficient. Other than that, there are 27 items of questions (67,5%) that can fulfill the criteria for the difficulty level, distinguishing power, and distractor function so it can be used directly to measure the student's ability without correction. While 12 items of questions (30%) need to be fixed and 1 item of question (2,5%) is declared to be invalid so it can't be used to measure the student's ability in History Subject. Permasalahan yang melatarbelakangi penelitian ini adalah pengembangan soal penilaian akhir semester mata pelajaran sejarah yang tidak melalui tahapan analisis butir soal sehingga kualitas butir soal tidak diketahui. Penelitian ini merupakan penelitian deskriptif kuantitatif. Tujuan penelitian ini adalah untuk mendeskripsikan karakteristik butir soal penilaian akhir semester mata pelajaran sejarah kelas XI SMA Negeri 1 Pangkalpinang menggunakan pendekatan teori tes klasik. Subjek penelitian berjumlah 138 peserta didik kelas XI jurusan IPS. Hasil penelitian menunjukkan bahwa soal PAS mata pelajaran sejarah kelas XI SMA Negeri 1 Pangkalpinang telah layak digunakan. Hal ini dibuktikan dari validitas butir soal yang mana terdapat 39 butir soal (97,5%) terbukti valid secara empirik dengan koefisien reliabilitas sebesar 0,818. Selain itu terdapat 27 butir soal (67,5%) yang memenuhi kriteria tingkat kesukaran, daya beda, dan keberfungsian distraktor sehingga dapat digunakan langsung untuk mengukur kemampuan peserta didik tanpa perbaikan. Sedangkan sebanyak 12 butir soal (30%) perlu dilakukan perbaikan dan 1 butir soal (2,5%) dinyatakan gugur sehingga tidak dapat digunakan untuk mengukur kemampuan peserta didik pada mata pelajaran sejarah.

The Unified Narcissism Scale: Moving towards an integrated measure of narcissism

Narcissism as a psychological construct has had a contentious past both in its conceptualization and measurement. There is an emerging consensus that narcissism consists of grandiose and vulnerable subtypes, which share a common core. In the present research (N = 1002), we constructed a new measure of unified narcissism that reflects these contemporary understandings using items from the most widely used measures of grandiose and vulnerable narcissism: the Narcissistic Personality Inventory (NPI; Raskin & Terry, 1988, https://doi.org/10.1037/0022-3514.54.5.890), and the Pathological Narcissism Inventory (PNI; Pincus et al., 2009, https://doi-org/10.1037/a0016530). We used classical test theory and item response theory approaches to devise a 29-item Unified Narcissism Scale. The scale showed good internal consistency, and convergent and discriminant validity, and showed evidence of measurement invariance between men and women. This research gave strong support for the structure, reliability, and validity of the unified measure, which offers a promising avenue for further enhancing our knowledge of narcissism.