scholarly journals Pengembangan sistem penilaian hasil belajar mata pelajaran menganalisis rangkaian listrik berbasis computerized adaptive testing

2014 ◽  
Vol 4 (1) ◽  
Author(s):  
Kamaruddin Kamaruddin ◽  
Haryanto Haryanto
Keyword(s):  
Research And Development ◽  
Learning Outcomes ◽  
Computerized Adaptive Testing ◽  
Standardized Test ◽  
Outcomes Assessment ◽  
Adaptive Testing ◽  
Item Bank ◽  
Assessment System ◽  
Electric Circuits ◽  
Learning Outcomes Assessment

Penelitian dan pengembangan ini bertujuan untuk: (1) menghasilkan instrumen tes terstandar untuk mata pelajaran Menganalisis Rangkaian Listrik yang tersimpan dalam bank soal elektronik; (2) menghasilkan perangkat lunak sistem penilaian berbasis CAT (SPBCAT) yang mampu melaksanakan tes secara adaptif; dan (3) SPBCAT yang mampu melakukan proses pengujian dengan unjuk kerja yang layak. Penelitian dan pengembangan ini dilaksanakan dalam empat tahap, yaitu: (1) definisi; (2) desain; (3) pengembangan; dan (4) pengujian. Kesimpulan dari hasil penelitian ini adalah: (1) instrumen tes terstandar yang berhasil dikembangkan berbentuk 105 butir pilihan ganda, tersusun dalam empat KD, dengan reliabilitas empiris, masing-masing 0,9086, 0,9067, 0,9087, dan 0,9086, dan tersimpan dalam bank soal elektronik; (2) SPBCAT mampu melaksanakan tes secara adaptif, dan menampilkan hasil tes dengan tepat; (3) perangkat lunak SPBCAT telah mampu menampilkan unjuk kerjanya secara layak dalam menguji 28 peserta tes secara serempak, dan mendapat penilaian sangat baik oleh pengguna. DEVELOPMENT OF LEARNING OUTCOMES ASSESSMENT SYSTEMS FOR ELECTRIC CIRCUITS ANALYZING SUBJECTS BASED ON COMPUTERIZED ADAPTIVE TESTINGAbstractThis research and development aim to: (1) produce standardized test instruments for Electric Circuits Analyzing subjects which is stored in an electronic item bank; (2) produce a software of learning outcomes assessment system based on CAT (SPBCAT) which able to performs test adaptively; and (3) SPBCAT which is able to perform adaptive testing process with decent performance. This research and development were conducted in four stages, i.e.: (1) the definition; (2) the design; (3) the development; and (4) the testing. The conclusions of this research are: (1) the standardized test instrument which has been successfully developed in the forms of 105 items of multiple choice, arranged in four KD, with empirical reliability is 0.9086, 0.9067, 0.9087, and 0.9086, and stored in the electronic item bank; (2) SPBCAT has been able to perform test adaptively, displays test result precisely; (3) SPBCAT has been able to show its performance properly by present test items simultaneously to 28 students and got a very good appraisal from its user.

scholarly journals Development of a Mechanical Engineering Test Item Bank to promote learning outcomes-based education in Japanese and Indonesian higher education institutions

2017 ◽  
Vol 5 (1) ◽  
pp. 41-73
Author(s):  
Jeffrey S. Cross ◽  
Estiyanti Ekawati ◽  
Satoko Fukahori ◽  
Shinnosuke Obi ◽  
Yugo Saito ◽  
...  
Keyword(s):  
Higher Education ◽  
Learning Outcomes ◽  
Test Item ◽  
Mechanical Engineering ◽  
Outcomes Assessment ◽  
Item Bank ◽  
Faculty Members ◽  
Learning Outcomes Assessment ◽  
Item Development ◽  
Outcomes Based Education

Following on the 2008-2012 OECD Assessment of Higher Education Learning Outcomes (AHELO) feasibility study of civil engineering, in Japan a mechanical engineering learning outcomes assessment working group was established within the National Institute of Education Research (NIER), which became the Tuning National Center for Japan. The purpose of the project is to develop among engineering faculty members, common understandings of engineering learning outcomes, through the collaborative process of test item development, scoring, and sharing of results. By substantiating abstract level learning outcomes into concrete level learning outcomes that are attainable and assessable, and through measuring and comparing the students’ achievement of learning outcomes, it is anticipated that faculty members will be able to draw practical implications for educational improvement at the program and course levels. The development of a mechanical engineering test item bank began with test item development workshops, which led to a series of trial tests, and then to a large scale test implementation in 2016 of 348 first semester master’s students in 9 institutions in Japan, using both multiple choice questions designed to measure the mastery of basic and engineering sciences, and a constructive response task designed to measure “how well students can think like an engineer.” The same set of test items were translated from Japanese into to English and Indonesian, and used to measure achievement of learning outcomes at Indonesia’s Institut Teknologi Bandung (ITB) on 37 risingfourth yearundergraduate students. This paper highlights how learning outcomes assessment can effectively facilitate learning outcomes-based education, by documenting the experience of Japanese and Indonesian mechanical engineering faculty members engaged in the NIER Test Item Bank project.Published online: 30 November 2017

scholarly journals Development Of Psychometrically Validated Standardized Test Instruments For Outcomes Assessment In Experiential Engineering Education

2018 ◽  
Vol 9 (1) ◽  
pp. 1-10
Author(s):  
Mukasa E. Ssemakula ◽  
Gene Y. Liao ◽  
Shlomo Sawilowsky
Keyword(s):  
Experiential Learning ◽  
Engineering Education ◽  
Learning Outcomes ◽  
Standardized Test ◽  
Outcomes Assessment ◽  
Learning Outcomes Assessment ◽  
Hands On ◽  
Hands On Learning ◽  
Major Trend ◽  
Work Done

There is a major trend in engineering education to provide students with realistic hands-on learning experiences. This paper reports on the results of work done to develop standardized test instruments to use for student learning outcomes assessment in an experiential hands-on manufacturing engineering and technology environment. The specific outcomes targeted for assessment are those defined under the MILL (Manufacturing Integrated Learning Laboratory) Manufacturing Competency Model. In a unique feature aimed at experiential learning, the test instruments incorporate the use of a physical manipulative to evaluate attainment of particular hands-on skills. The resulting standardized tests have been subjected to extensive psychometric analysis. The results of the analysis indicate excellent structure of the test instruments. The test instruments have shown high levels of stability, internal consistency, and reliability. These tests can be used as instruments for outcomes assessment to help document attainment of targeted learning outcomes for program assessment, accreditation, and other assessment purposes. Outcomes Assessment; Standardized Test; Psychometrically Validated; Experiential Learning

The Role of Point-Rating System of Learning Outcomes Assessment in implementing the Federal State Educational Standard of Higher Professional Education

2015 ◽  
Vol 3 (4) ◽  
pp. 3-7
Author(s):  
������������ ◽  
Natalya Dvulichanskaya ◽  
��������� ◽  
V. Ermolaeva
Keyword(s):  
Learning Outcomes ◽  
Professional Education ◽  
Outcomes Assessment ◽  
Assessment System ◽  
Rating System ◽  
Federal State ◽  
Learning Outcomes Assessment ◽  
Educational Standard ◽  
Higher Professional Education ◽  
State Educational

The authors propose the point-rating system (PRS) for assessing the learning outcomes as one of the modern technologies to implement the requirements introduced by the new generation of the Federal State Educational Standard of Higher Professional Education. Features of implementing PRS at the Department of Chemistry in BMSTU are provided; social and personality traits, as well as general scientific competencies of to-be engineers, developed as a result of PRS system implementation are outlined. Also highlighted are the merits of the outcomes assessment system under consideration as it helps students to develop the habit to smooth and systematic research activities and to enhance their self-esteem, reflection and motivation to learn. The authors compare the traditional system of learning outcomes assessment against the proposed point-rating system and consider problems of implementing it in the educational practice. The authors also provide evidence of the efficiency of their proprietary version of computer testing system, which stipulates the application of practice-oriented exercises.

scholarly journals E-Report: Holistic Assessment System In Elementary School

2021 ◽  
Vol 5 (3) ◽  
pp. 385
Author(s):  
I Wayan Widiana
Keyword(s):  
Elementary School ◽  
Elementary Schools ◽  
Outcome Assessment ◽  
Learning Outcomes ◽  
Outcomes Assessment ◽  
Learning Outcome ◽  
Assessment System ◽  
Achievement Level ◽  
Learning Outcomes Assessment ◽  
Good Learning

A good learning is supported by not only good planning and learning processes, but it is also supported by an assessment of students’ competencies achievement. This study aims to develop a learning outcome assessment system based on educational units (students’ reports) in elementary schools. This is development research using Development and Diffusion (R-D-D) model. The data in this study were collected through interviews, observations, questionnaires, documentation studies, FGDs, and product trials. The data were analyzed using a qualitative approach. The results showed that the percentage level of achievement of the unit-based learning outcomes assessment system was 97.3% so which fell into Very Good qualification with the achievement level scale of 5 in the conversion table. Based on this, it can be concluded that the Student Report (SR) system is appropriate to be used as an education unit-based learning outcome assessment system in elementary school. This research implies that teachers can use the developed E-report as a learning outcomes assessment system based on education units in elementary schools.

Valutare gli studenti per valutare il sistema: una esperienza della Provincia di Varese

2009 ◽  
pp. 123-140
Author(s):  
Emanuela Bonini ◽  
Alberto Vergani
Keyword(s):  
Learning Outcomes ◽  
Vocational Training ◽  
Assessment System ◽  
System Level ◽  
System Evaluation ◽  
Learning Outcomes Assessment ◽  
Crucial Component ◽  
Culture Models ◽  
Evaluation Of Learning ◽  
Italian Province

- The article presents the main results of a system level evaluation of learning outcomes concerning compulsory Vocational Training (VT) 3-years courses final formal examinations. This evaluation, carried out by the Education and Vocational Training Department of an italian Province (Varese), specifically deals with the use of single student learning standardized outcomes as a crucial component - if properly designed, managed and processed - of the evaluation of a local institutional VT system as a whole. This is quite a challenging task in Italy due both to the territorial differences existing in VT policies and institutional responsibilities and to the weakness of system evaluation culture, models and experiences in VT specifically and in education in general. The evaluation, conducted with the supervision of the two authors, will be presented and briefly discussed mainly by a methodological perspective. It will focus on the way in which learning contexts, training contents and trainees characteristics have been included into the evaluative analysis as factors potentially able: a) to explain, at a system level, the learning outcomes of the students; b) to offer the local stakeholders a comprehensive set of information and evidences to be used for the improvement of VT policies, programmes and single interventions.Key words: educational and vocational training, learning outcomes assessment, system evaluation, comparison, explicationParole chiave: istruzione e formazione professionale, valutazione di sistema, valutazione degli apprendimenti, comparazione, spiegazione

Computerized Adaptive Testing for Sleep Disorders: Development of An Item Bank and Validation in A Simulated Study

2020 ◽  
Author(s):  
Menghua She ◽  
Yaling Li ◽  
Dongbo Tu ◽  
Yan Cai
Keyword(s):  
Sleep Disorders ◽  
Computerized Adaptive Testing ◽  
Assessment Tool ◽  
Adaptive Testing ◽  
Item Bank ◽  
Accurate Assessment ◽  
Item Pool ◽  
Psychometric Characteristics ◽  
Predictive Utility ◽  
Item Fit

Abstract Background: As more and more people suffer from sleep disorders, developing an efficient, cheap and accurate assessment tool for screening sleep disorders is becoming more urgent. This study developed a computerized adaptive testing for sleep disorders (CAT-SD). Methods: A large sample of 1,304 participants was recruited to construct the item pool of CAT-SD and to investigate the psychometric characteristics of CAT-SD. More specifically, firstly the analyses of unidimensionality, model fit, item fit, item discrimination parameter and differential item functioning (DIF) were conducted to construct a final item pool which meets the requirements of item response theory (IRT) measurement. In addition, a simulated CAT study with real response data of participants was performed to investigate the psychometric characteristics of CAT-SD, including reliability, validity and predictive utility (sensitivity and specificity). Results: The final unidimensional item bank of the CAT-SD not only had good item fit, high discrimination and no DIF; Moreover, it had acceptable reliability, validity and predictive utility. Conclusions: The CAT-SD could be used as an effective and accurate assessment tool for measuring individuals' severity of the sleep disorders and offers a bran-new perspective for screening of sleep disorders with psychological scales.

Sign in / Sign up

Export Citation Format

Share Document