scholarly journals Development Of Psychometrically Validated Standardized Test Instruments For Outcomes Assessment In Experiential Engineering Education

2018 ◽  
Vol 9 (1) ◽  
pp. 1-10
Author(s):  
Mukasa E. Ssemakula ◽  
Gene Y. Liao ◽  
Shlomo Sawilowsky
Keyword(s):  
Experiential Learning ◽  
Engineering Education ◽  
Learning Outcomes ◽  
Standardized Test ◽  
Outcomes Assessment ◽  
Learning Outcomes Assessment ◽  
Hands On ◽  
Hands On Learning ◽  
Major Trend ◽  
Work Done

There is a major trend in engineering education to provide students with realistic hands-on learning experiences. This paper reports on the results of work done to develop standardized test instruments to use for student learning outcomes assessment in an experiential hands-on manufacturing engineering and technology environment. The specific outcomes targeted for assessment are those defined under the MILL (Manufacturing Integrated Learning Laboratory) Manufacturing Competency Model. In a unique feature aimed at experiential learning, the test instruments incorporate the use of a physical manipulative to evaluate attainment of particular hands-on skills. The resulting standardized tests have been subjected to extensive psychometric analysis. The results of the analysis indicate excellent structure of the test instruments. The test instruments have shown high levels of stability, internal consistency, and reliability. These tests can be used as instruments for outcomes assessment to help document attainment of targeted learning outcomes for program assessment, accreditation, and other assessment purposes. Outcomes Assessment; Standardized Test; Psychometrically Validated; Experiential Learning

scholarly journals Pengembangan sistem penilaian hasil belajar mata pelajaran menganalisis rangkaian listrik berbasis computerized adaptive testing

2014 ◽  
Vol 4 (1) ◽  
Author(s):  
Kamaruddin Kamaruddin ◽  
Haryanto Haryanto
Keyword(s):  
Research And Development ◽  
Learning Outcomes ◽  
Computerized Adaptive Testing ◽  
Standardized Test ◽  
Outcomes Assessment ◽  
Adaptive Testing ◽  
Item Bank ◽  
Assessment System ◽  
Electric Circuits ◽  
Learning Outcomes Assessment

Penelitian dan pengembangan ini bertujuan untuk: (1) menghasilkan instrumen tes terstandar untuk mata pelajaran Menganalisis Rangkaian Listrik yang tersimpan dalam bank soal elektronik; (2) menghasilkan perangkat lunak sistem penilaian berbasis CAT (SPBCAT) yang mampu melaksanakan tes secara adaptif; dan (3) SPBCAT yang mampu melakukan proses pengujian dengan unjuk kerja yang layak. Penelitian dan pengembangan ini dilaksanakan dalam empat tahap, yaitu: (1) definisi; (2) desain; (3) pengembangan; dan (4) pengujian. Kesimpulan dari hasil penelitian ini adalah: (1) instrumen tes terstandar yang berhasil dikembangkan berbentuk 105 butir pilihan ganda, tersusun dalam empat KD, dengan reliabilitas empiris, masing-masing 0,9086, 0,9067, 0,9087, dan 0,9086, dan tersimpan dalam bank soal elektronik; (2) SPBCAT mampu melaksanakan tes secara adaptif, dan menampilkan hasil tes dengan tepat; (3) perangkat lunak SPBCAT telah mampu menampilkan unjuk kerjanya secara layak dalam menguji 28 peserta tes secara serempak, dan mendapat penilaian sangat baik oleh pengguna. DEVELOPMENT OF LEARNING OUTCOMES ASSESSMENT SYSTEMS FOR ELECTRIC CIRCUITS ANALYZING SUBJECTS BASED ON COMPUTERIZED ADAPTIVE TESTINGAbstractThis research and development aim to: (1) produce standardized test instruments for Electric Circuits Analyzing subjects which is stored in an electronic item bank; (2) produce a software of learning outcomes assessment system based on CAT (SPBCAT) which able to performs test adaptively; and (3) SPBCAT which is able to perform adaptive testing process with decent performance. This research and development were conducted in four stages, i.e.: (1) the definition; (2) the design; (3) the development; and (4) the testing. The conclusions of this research are: (1) the standardized test instrument which has been successfully developed in the forms of 105 items of multiple choice, arranged in four KD, with empirical reliability is 0.9086, 0.9067, 0.9087, and 0.9086, and stored in the electronic item bank; (2) SPBCAT has been able to perform test adaptively, displays test result precisely; (3) SPBCAT has been able to show its performance properly by present test items simultaneously to 28 students and got a very good appraisal from its user.

A Framework for Engineering Dissection Exercise Creation and Implementation

2009 ◽  
Author(s):  
Kathleen M. Hart ◽  
Steven B. Shooter ◽  
Charles J. Kim
Keyword(s):  
Active Learning ◽  
Best Practices ◽  
Reverse Engineering ◽  
Engineering Education ◽  
Learning Outcomes ◽  
Positive Impact ◽  
Rigorous Approach ◽  
Engineering Activity ◽  
Hands On ◽  
Different Levels

Hands-on product dissection and reverse engineering exercises have been shown to have a positive impact on engineering education, and many universities have incorporated such exercises in their curriculum. The CIBER-U project seeks to examine the potential to utilize cyberinfrastructure to enhance these active-learning exercises. We have formulated a framework for product dissection and reverse engineering activity creation to support a more rigorous approach to assessing other exercises for satisfaction of the CIBER-U project goals and adapting the best practices. This framework is driven by the fulfillment of learning outcomes and considers the maturity of students at different levels. Prototype exercises developed with the framework are presented. The approach is sufficiently general that it can be applied to the consideration and adaption of other types of exercises while ensuring satisfaction of the established goals.

Sign in / Sign up

Export Citation Format

Share Document