Development of Self-assessment Instruments to Measure Student Affective Domains on Online Biology Learning

<p><em>The purpose of this study was to determine the process of developing a self-assessment assessment instrument that measures the affective domain in online biology learning that meets the content and construct validity. The type of research and development that adopted the Plomp development model was used in this study. The subjects of this study were students of class XI MIPA at SMA Negeri Padamara, Purbalingga Regency, Central Java, totalling 40 students in May 2021. The instruments used in this study were self-assessment questionnaires and teacher questionnaires. The validity test results with the calculation of the validity coefficient value show a value of 0.45 so that the assessment instrument can be valid. The reliability test results obtained a coefficient value of 0.957 so that the assessment instrument can be said to be reliable. Furthermore, the results of expert validation got a score of B. These results met the criteria well and could be used with slight revisions. Thus, it can be concluded that the evaluation instrument produced in this development has met content and construct validity.</em></p>

132 Assessment Tools to Measure Clinical Reasoning While Attending Simulation-Based Courses

Clinical reasoning is interconnected with decision-making which is a critical element to ensure patient safety [1]. To avoid practice mistakes, healthcare professionals should be competent with effective clinical reasoning skills. To develop effective clinical reasoning skills, healthcare professionals should get the chance to practise and be exposed to various experiences and levels of patient complexities. Simulation can immerse learners in scenarios that mimic clinical situations, simultaneously mitigating safety risks and increasing standardization in healthcare education [2]. Through simulation, learners can get the chance to practise clinical reasoning with focussed learning opportunities [3]. Several assessment tools have been used to measure clinical reasoning while attending simulation-based activities. However, we would like to explore the most valid and reliable tools to assess clinical reasoning while attending simulation, in addition to finding out whether these tools have considered the seniority and competency levels of their users.A scoping review was undertaken to answer the questions: What are the best available valid and reliable tools to evaluate clinical reasoning while attending simulation-based activities? Do we have valid and reliable clinical reasoning assessment tools for simulation that measure clinical reasoning considering different seniority and competency levels? We searched Medline, Scopus, Education Research Complete, and Google Scholar to identify relevant recent primary research conducted on this topic from 2000 onwards. The search included MeSH topics of: ‘Clinical reasoning’, ‘Simulation-based courses’ and ‘Clinical Reasoning tools’. The inclusion criteria were primary studies that described the use of tools measuring clinical reasoning while attending simulation-based courses. Two independent researchers agreed on the inclusion of the identified papers for full-text review. This review followed the review guidelines of Joanne Briggs institute.There are valid and reliable tools to evaluate clinical reasoning while attending simulation which is Clinical Reasoning Evaluation Simulation Tool CREST [1]; Lasater Clinical Judgment Rubric LCJR [4]; Creighton Competency Evaluation Instrument Creighton C-SEI- Tool [5]. However, the validity and reliability of these tools were tested on undergraduate student nurses, and there was no consideration for different seniority and competence levels, and applicability to other healthcare professions.There is an adequate number of tools to measure clinical reasoning while attending simulation. However, there is a significant basis to test the reliability and validity of these tools against different competence and seniority levels, and applicability to other healthcare professions.

The Normative Study of Acoustic and Aerodynamic Characteristics of Voice among Healthy Adult Turkish Speaker Population

Phonatory Aerodynamic System (PAS Model 6600) is an evaluation instrument that assesses the effectiveness of surgical interventions, treatments, and therapy for voice disorders. It can be used for the assessment of voice disorders by supporting other perceptual and instrumental methods. It is important to establish normative data, because the use of appropriate norms is necessary for diagnostic and descriptive accuracy. Therefore, this study is aimed primarily at establishing adult normative databases for phonatory aerodynamic measures obtained with the KayPENTAX PAS Model 6600 among healthy adult Turkish speakers and then examining the effect of age, gender, and age-gender interaction variables on these measures. The contribution of the study is considered so important since it will generate normative data for all measurements—except the mean pitch—by the five protocols of PAS for the first time. Two hundred and six healthy Turkish speakers with normal voice (106 women and 100 men) were included in the study and stratified into three age groups. Forty-five phonatory aerodynamic measures across five PAS protocols (vital capacity, maximum sustained phonation, comfortable sustained phonation, variation in sound pressure level, and voicing efficiency) were collected. Age, gender, and age-gender interaction variables were analyzed for 45 PAS parameters. Significant gender and age effect was found for 30 and 19 variables, respectively. Gender-age interaction together was observed for only 6 parameters. Significant differences were not found for the remaining 10 parameters. Significant age and gender effects were observed for 35 phonatory and aerodynamic measures which are essential part of the objective clinical assessment of voice. Consequently, normative data used as reference in voice assessment should be generated according to age and gender differences.

Validity and Reliability of a Digital-based Affective Evaluation Instrument on Indonesian MPK Learning at Ganesha University of Education

This study aimed at developing a digital-based affective evaluation instrument on Indonesian MPK Learning at Universitas Pendidikan Ganesha. This study was Research and Development (R&D) adapted from ADDIE Model (Analysis, Design, Development, Implementation, and Evaluation). The subjects of the study were 2 content experts, evaluation experts, language experts, 120 college students, and 3 lecturers of MPK Bahasa Indonesia. The data were collected from survey, interview, and affective scale. The data were analyzed quantitatively and described qualitatively. The results of the study show that the validity of a digital-based affective evaluation instrument on Indonesian MPK learning at Universitas Pendidikan Ganesha is very valid and it has very high degree of reliability.

Development of curriculum design evaluation instruments in strengthening Al-Irsyad ideology in Indonesia

The purpose of this research was to develop a curriculum design evaluation instrument in strengthening Al-Irsyad ideology. The research activity began with a literature review on the curriculum then continues with the development of the instrument. The results of the development of the instrument items were validated by 11 experts and tested on a limited scale by involving 17 teachers from Al-Irsyad Junior High School, Surakarta, Cirebon, and Purwokerto, Indonesia. The next activity was an expanded trial involving 53 teachers from Al-Irsyad schools in West Java, Central Java, and East Java, the territory of the Republic of Indonesia. Data from expert reviews were analyzed by using Aiken's formula. Limited trial data were analyzed with the EFA model using the help of the SPSS program, and data from the extended trial results were analyzed by CFA using the help of the Smart PLS version 2.0 program. The results indicated that the instrument has a good validity guarantee because the loading factor value ranges from 0.5571-0.9463 (&gt;0.5), and the AVE value ranges from 0.5901-0.8051 (&gt;0.5), and has guaranteed reliability because of the CR value ranges from 0.8394-0.9397 (&gt;0.7) and Cronbach alpha ranges from 0.7692-0.9286 (&gt;0.7). The instrument feasible to be used as a measurement tool in evaluating the Al-Irsyad curriculum design in Indonesia.

Design and validation of an evaluation instrument that assesses the pro-environmental behavior of Mexican university students

The purpose of this research was to design and validate a research instrument that delimits the degree of proenvironmental behavior (CPA). For the design and validation, the instrument was subjected to a review with specialists in the area. Subsequently, it was applied to the student community of the Autonomous University of Guerrero (UAGro). To define the adequacy and reliability of the items, along with their comprehension, was applied to a pilot group of 76 students. During the first review, the research instrument was approved by 15 experts, who also made suggestions. The reviewers endorsed the validity of the items’ content, and an optimum reliability score was obtained (Cronbach's alpha: 0.778). It is concluded that the evaluation instrument is valid in content, reliable, and accessible to monitor and evaluate the pro-environmental behavior in students.

Evaluasi Usability Aplikasi Elektronik-Kesehatan Ibu dan Anak (e-KIA)

<p>Teknologi informasi sudah berkembang disemua bidang dan tidak terkecuali sudah diterapkan ke bidang kesehatan. Salah satu langkah awal penerapan teknologi informasi pada bidang kesehatan adalah dengan membangun aplikasi untuk memonitor kesehatan ibu dan anak yang disebut dengan <em>e</em>-KIA. Aplikasi <em>e</em>-KIA yang sudah dibangun saat ini masih belum diketahui tingkat usabilitas dari penggunaan aplikasi tersebut. Pengujian <em>usability</em> ini penting untuk dilakukan sebelum aplikasi tersebut digunakan oleh masyarakat secara luas dan dapat digunakan sebagai <em>early warning</em> untuk mendeteksi kemungkinan-kemungkinan kesalahan yang terjadi. Untuk mengatasi hal tersebut pengujian <em>usability</em> dilakukan pada aplikasi <em>e</em>-KIA. Pengujian <em>usability</em> dimulai dengan melakukan studi litearatur terkait. Kemudian dilakukan pemilihan evaluator sekaligus melakukan <em>briefing</em> proses evaluasi. Tahap selanjutnya adalah merancang instrumen untuk evaluasi dan merancang skenario evaluasi. Evaluasi <em>usability</em> yang dilakukan difokuskan pada 3 hal yaitu <em>Severity Ranking (SR)</em>, <em>Ease of Fixing Ranking</em> (EFR), dan Kategori Masalah. Masalah yang ditemukan kemudian dikategorikan berdasarkan 10 prinsip heuristik Nielsen dan disederhanakan menjadi kategori <em>Selection Driven Command</em> (perbaikan interaksi), <em>Content Organization</em> (kelengkapan konten informasi), dan <em>Visual Representation</em> (pemilihan komponen desain yang tepat). Dari hasil evaluasi tersebut didapatkan temuan masalah <em>Selection Driven Command</em> (perbaikan interaksi) sejumlah 18 temuan, <em>Content Organization</em> (kelengkapan konten informasi) sejumlah 10 temuan, dan <em>Visual Representation</em> (pemilihan komponen desain yang tepat) sejumlah 7 temuan.</p><p> </p><p><strong><em>Abstract</em></strong></p><p><em><em>Information technology has emerged in all aspect including in the healthcare field. e-KIA is an application to monitor mother and child healthcare as initial steps in implementing information technology in the healthcare field. As a newly developed application, the usability level of e-KIA is not known yet. Usability testing is important steps to be taken before the application will be used by stakeholders. Usability testing could be used to identify problems that may occur in the early stage and could be used as early warning to application aspects need to be fixed. e-KIA Usability Testing is conducted to overcome the specified problems. Usability testing started by taking the literature review followed by evaluator selection and evaluation briefing. The next step is designing an evaluation instrument and evaluation scenario. The conducted usability testing is focus on Severity Ranking (SR), Ease of Fixing Ranking (EFR), and Problem Category. The identified problems are then categorized into Nielsen’s 10 Heuristic Principal. The identified problems are simplified to three categories of Selection Driven Command, Content Organization, and Visual Representation. The experiment has found 18 problems in Selection Driven category, 10 problem in Content Organization, and 7 problems in Visual Representation category. </em></em></p>

Developing a rubric for the assessment of student performance in compounding and dispensing practical

Objectives: To study the impact of assessment using a scoring rubric on the compounding and dispensing skills of the students. Methods: A rubric was prepared to evaluate the students’ psychomotor performance and attitude in compounding and dispensing. The rubric was applied by the teacher, the students themselves, and their classmates instead of the earlier used dichotomous checklist. Scores were compared pre- and post-implementation of the rubric. The students’ learning experience and outcomes were assessed through regular course evaluation surveys. Results: Student performance was improved from the baseline to the mid and end of term. The number of harmful scorings was reduced, and the number of admissible scorings was increased. Conclusion: The pharmaceutical compounding rubric showed to be a quantitative evaluation instrument for teachers. It also helped identify the challenging areas. The implementation of the rubric helped minimise errors.