FMCE-PHQ-9 Assessment with Rasch Model in Detecting Concept Understanding, Cheating, and Depression amid the Covid-19 Pandemic

This research aims to see the ability of the FMCE-PHQ-9 test instrument amid the Covid-19 pandemic to measure conceptual understanding, cheating, and depression in students. The research was conducted on 64 physics education students at Sulthan Thaha Saifuddin State Islamic University Jambi. The instrument consists of 47 force and motion material items to fit the Winsteps 3.65.0 program. The analysis results using the Rasch Model showed that the MNSQ Outfit was 1.00 in the person column and 0.1 in the item column. Judging from the ZSTD value of 0.57 for the person and 0.1 for the item, the Points Measure value correlated with 0.4 to 0.85 while the item reliability value was 0.73 and the Cronbach's Alpha value was 0.56. therefore, the test instrument using the Rasch proclamation model found 31 fit items. The analysis results show that the concept ability was poor since, on average, the students could only answer questions with a low index of difficulty category. The research results on the level of cheating obtained data that 100 percent of students were not indicated to have the same pattern. Lastly, for the level of depression, only 16 percent of students did not experience depression, while 84 percent of students experienced it.

ELDERLY SATISFACTION TOWARDS THE INTEGRATED HEALTH POST (ES-IHP) QUESTIONNAIRES: VALIDATION USING RASCH MODELING

Integrated Health Post for the elderly (Posbindu) has been carried out to improve the health status of the elderly, but Posbindu’s utilization is still unsatisfactory. Satisfaction of the elderly towards the health care provided at the Posbindu contributed to their adherence. So far there is no instrument to measure the level of elderly satisfaction. The objectives of the study were to develop and assess the validity and reliability of the elderly satisfaction towards the integrated health post questionnaire using Rasch modeling. A cross-sectional study was carried out on 202 elderly from 16 Posbindu in Bandung, Indonesia. This study was performed from August to December 2019. The questionnaire was developed from a qualitative study, consisted of 36 items that covered the satisfaction concepts of structure, process, and output. Nine analytic tests were carried out, namely, the person fit order, person reliability, Cronbach's alpha, item reliability, item fit order, separation, the Wright map analysis, rating scale, and the differential item functioning as implemented by the Winstep version 3.73 software. Overall, the questionnaire demonstrated promising results. The overall value of person reliability was 0.93 with Cronbach's alpha of 0.96 and the value of item reliability was 0.94. However, 3 items were misfits and should be considered to be revised or removed. Further studies involving various regions in Indonesia should be carried out before this questionnaire is used in Indonesia

Developing and Validating the Narcissistic Personality Scale (NPS) among Older Thai Adults Using Rasch Analysis

Background: Being older could be stressful, especially among people with narcissistic personality disorders. Nevertheless, the tool is yet to be available among older Thai individuals. The study aimed to develop a tool to detect symptoms of narcissistic personality, and to validate its psychometric properties among older Thai adults. Methods: The Narcissistic Personality Scale (NPS) was developed based on nine domain symptoms of narcissistic personality disorder from the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), consisting of 80 items. The original scale was field-tested using Rasch analysis for item reduction, rendering a final 43 items. NPS was further investigated among 296 seniors aged 60 years old. Rasch analysis was used to assess its construct validity. Result: Of 43 items, 17 were further removed as infit or outfit mean square >1.5. The final 26-item NPS met all necessary criteria of unidimensionality and local independence without differential item functioning due to age and sex, and good targeting with subjects. Person and item reliability were 0.88 and 0.95, respectively. No disordered threshold or category was found. Conclusions: The NPS is a promising tool with a proven construct validity based on the Rasch measurement model among Thai seniors. This new questionnaire can be used as outcome measures in clinical practice.

Validity and reliability of beck depression inventory (BDI) bahasa melayu version

This pilot study was conducted to test the reliability and validity of the instrument to be used to assess the level of depression among public servants in the state of Selangor, Malaysia. The instrument used is the Beck Depression Inventory Bahasa Melayu Version. This instrument has two parts: Part A collects the demographic information and Part B has 21 items to measure depression. Although the basis of the existence of BDI is for use in clinical settings, there are many studies which have used BDI in non-clinical settings such as among university students and the general public. The BDI is empirically proven to be fit for use in both settings. A total of 30 public servants, who have been identified as a low performer at the Office of the State Secretary of Selangor, participated in this study. The Rasch Measurement Model using the Winsteps software version 3.72.3 was used to analyse the results. This Rasch analysis has shown that the reliability index of the Respondent obtained was 0.76 and the item reliability index was 0.83.

Gases Theory Representation Instrument (GeTRI): A Practical Tool To Analyze Sundanese Students’ Conception in the COVID-19 Pandemic

This research purposes to promote a Gases Theory Representation Instrument (GTRI) as a tool to identify the students’ conception on kinetic theory of gases. The method used in this research was FODEM (Formative Development Methods) model which has three comprehensive steps, which are need analysis, implementation, and formative evaluation. The participants involved in this research were 26 high school students in Sundanese tribe. The students’ responses were analyzed using Rasch model, which involved item reliability, person reliability, validity, difficulty level and students’ conception distributions. Students’ conception were classified into six categories which are Sound Understanding (SU), Partial Positive (PP), Partial Negative (PN), Misconception (MC), No Understanding (NU), and No Coding (NC). Based on the data analysis, it can be concluded that students’ conception are typically in the SU and PP categories. Besides, the Gases Theory Representation Instrument (GTRI) is reliable and valid to identify students’ conception on kinetic theory of gases.

Validating Italian General Ecological Behaviour Questionnaire of Travellers Using Dichotomous Rasch Model

Ecological behaviour and its impact on the environment are subjects of public concern and understanding individual behavioural measures to induce sustainable lifestyles is of extreme importance for policy makers to assess and promote sustainable mobility. To this end, a questionnaire with highly reliable items, evaluations of determinants and accurate measurements of ecological behaviour is a precondition for understanding the levers of behavioural change. This paper aims at an understanding of whether the dichotomous Rasch model provides a legitimate measurement of General Ecological Behaviour (GEB) using a 26-item questionnaire as a valid tool to assess the pro-environment behaviour of a large sample of users. A web questionnaire was administered using the snowball sampling plan in the Piedmont region (Italy), with a sample of 4473 respondents. The results suggest that using the dichotomous Rasch model, the proposed questionnaire is able to effectively measure the pro-environment behaviour of travellers. Unidimensionality, the perfect level of item reliability of 1, the very high item separation of 34.22, the absence of larger differential item functions, and the local independence are all good indicators of a valid model. This research shows how a good, validated, and reliable measurement of ecological behaviour would support public bodies in planning environment-focused transport policies thanks to the knowledge of which variables determine pro-environment behaviour. In addition, the proposed approach also allows us to measure the efficacy of the adopted policies.

Developing a Reliable Welfare Assessment Tool for Captive Hibernatory Bear Species

Animal welfare assessments are essential for the identification of welfare hazards and benchmarking of welfare improvements, though welfare assessments for zoo species are lacking. Bears are commonly housed in zoos but currently no composite welfare assessment tool exists for captive bears. This study describes the development of such a tool for use across hibernating bear species. A draft tool was developed using indicators derived from the literature and a modified Delphi analysis with an international group of bear keepers. A total of 18 bear keepers from 12 zoos were recruited to trial the tool on 24 brown bears and American black bears. The participating keepers assessed their bears three times across a period of nine days. Intraclass correlation coefficients analysis was used to analyse inter-, intra-rater and item reliability. The inter- and intra-rater reliability showed good to excellent levels of agreement (>0.7, p < 0.05). Item reliability was also assessed and showed good to excellent levels of agreement (>0.75, p < 0.05). The resulting bear welfare assessment is an important step in identifying and understanding challenges to bear welfare in captivity.

Validation Assessment of a Pain Interference Questionnaire among Student Pharmacists

Validation studies of pain interference instruments used among student pharmacists are rare yet essential for understanding their appropriate use and interpretation in pharmacy education and practice. This study conducted validation and reliability assessments of a five-item Pain Interference Scale previously administered to student pharmacists. Construct validity was assessed using Rasch analysis. Unidimensionality was measured using: point-biserial measure correlations; percent of raw variance explained by items; difference between expected; variance modeled by items; and Rasch model fit. To assess scale functioning, response frequency distribution, observed average and sample expected logit distribution, Andrich logit distribution, item separation, and item reliability were assessed. Visual examination of the Item-Person Map determined content validity. Items explained 64.2% of data raw variance. The difference between raw variance modeled and observed was 0.6. Point-biserial measure correlations were >0.77. Item mean-square infits were 0.7–1.3 while outfit measures were 0.72–1.16. There were >10 responses per response category, response frequency and Andrich thresholds progressively advanced, and observed average and sample expected logits advanced monotonically, Andrich logits = −2.33–1.69, item separation = 2.61, and item reliability = 0.87. Item probability curves indicated response categories were minimally yet adequately distinct. Cronbach’s alpha = 0.93. The Item-Person Map had a ceiling effect indicating content gaps. In conclusion, the pain interference instrument has acceptable construct validity yet contains content gaps. Additional difficult items should be added to the instrument to better capture pain interference among student pharmacists.

The reliability and validity of the Turkish version of the school-based asthma and allergy screening questionnaires

Background Asthma is an important public health disease affecting children that may result in school absenteeism and hospitalization. This study aims to assess the validity, reliability, and diagnostic accuracy of the Turkish version of the asthma and allergy screening questionnaire. Methods This study included primary and secondary school students from grades 2 to 7 and their parents or caregivers. For validity, 40 children with asthma and 39 children with allergies diagnosed by the questionnaire were used to determine the sensitivity. The specificity was calculated by using the data of 100 children without asthma and allergies. The study was completed with the participation of 704 students and parents. The intraclass correlation coefficient (ICC) was used to assess item reliability. Receiver operating characteristic (ROC) analysis was used to assess validity. Results When the cutoff point of the questionnaire was 2/3 for asthma, the sensitivity was 80.0% and 82.5% and the specificity was 56.6% and 76.8% according to the student and parent form, respectively. When the cutoff point of the questionnaire was 0/1 for allergies, the sensitivity was 74.4% and 84.6% and the specificity was 66.3% and 54.2% according to the student (SQ) and parent questionnaire (PQ), respectively. The reliability of test-retest correlation values (≥0.68) of asthma and allergy questionnaires were found to be statistically significant. The internal consistency Cronbach’s α values of the asthma SQ and PQ were 0.72 and 0.80, respectively. Conclusions According to the Turkish questionnaire for students and their parents, the sensitivity of asthma and allergy questionnaires was similar in proportion to the original questionnaire. The Turkish version of the questionnaire can be used for asthma and allergy screening in schools.

Uji Validitas Konstruk Work Role Performance pada Karyawan di Indonesia

Employee performance is critical to the overall success of the company. In achieving their goals, companies will face many challenges. This can be overcome in several ways, one of which is by improving employee performance. Therefore, it is important to measure the role performance of employee in Indonesia. Work role performance scale was first delevoped in Australia in 2007 and have not been adapted for Indonesian population. This study intends to evaluate the validity and the reliability of the Indonesian version of work role performance scale. Aiken’s V formula was used to evaluate the content validity of the scale. Both CTT and Rasch analysis were employed to evaluate the reliability of the scale. Participants in this study were employees, with a total of 370 (n = 370), collected by using accidental sampling techniques. The results showed Aiken’s V of 0.87 to 0.91 shows that items of the adapted scale were relevant to measure the construct. The adapted scale was found reliable with Cronbach’s alpha of 0.936 and Rasch’s person and item reliability were 0.87 and 0.98. In CFA results, the model fit was acceptable (RMSEA=0.08 and CFI=0.96) shows that the data fit the hypoteshized model.