scholarly journals Capstone Project Evaluation – Towards a Student-Centred Approach

Author(s):  
Cheryl Schramm ◽  
Adrian D.C. Chan

Capstone projects present a particular challenge to assessment as compared to individual course work. Projects unfold over a year, culminating in a final report, begging the question of (balancing the) assessment of process over product. Projects across an individual department, let alone across the engineering faculty, can differ in content, the balance of depth versus breadth, the balance of research versus application, the balance of design versus implementation, and size of teams. One approach to managing this diversity is the use of broadly interpreted categories and no explicit weighted marking scheme, with the final grade determined by consensus in a department-wide meeting, held privately from the students. While flexibility and the authority of the supervising faculty member is acknowledged and maintained in this approach, the needs of the students are not necessarily best served in this approach. The movement toward learning outcomes, including the CEAB Graduate Attribute Criteria, is providing a well-understood and documented language for established indicators. This paper presents the results of an effort this year to incorporate CEAB graduate attributes into a system of marking rubrics. The goal is to better serve the needs of students with an assessment strategy that is based on explicit expectations and transparency, one which includes all deliverables, and yet still accommodates for diversity in project experiences. The paper will present the compound assessment instrument developed and used on select project teams, as well as the feedback of the students involved in the experience. The work done this year is seen as preliminary and the intent is to invite feedback to move towards broaden the adoption of the assessment instruments within our community.

2020 ◽  
Vol 4 (3) ◽  
pp. 288
Author(s):  
Ni Komang Suci Yundarini ◽  
Dewa Nyoman Sudana ◽  
I Gede Astawan

The assessment instrument is an important component needed in the learning assessment process. However, in practice, there are still many teachers who have not been able to produce quality assessment instruments. The purpose of this study was to produce valid and reliable assessment instruments for social attitudes and social studies learning outcomes in class V on theme of lingkungan sekitar kita. In this study using a 4D development model, namely define, design, develop, disseminate. In this development research, it is only up to the development stage. The instrument used for the assessment of social attitudes was a questionnaire (questionnaire), while for the assessment of social studies learning outcomes used was a multiple-choice test. The data obtained would be analyzed the validity and reliability of each assessment instrument. The results of the analysis of the validity of the social attitude assessment instrument and social studies learning outcomes obtained an average value of 1, which means that the two assessment instruments have very high validity, while the results of the analysis of the reliability of the social attitude assessment instrument are 0,89 and the reliability of the social studies learning outcomes assessment instrument is 0,89. 0,85 which means that these two instruments have a high level of reliability. From these results, it can be concluded that the development of an assessment instrument for social attitudes and social studies learning outcomes is feasible to use in assessing students.


2019 ◽  
Vol 26 (4) ◽  
pp. 827-847 ◽  
Author(s):  
Carmen Barquero-Ruiz ◽  
José Luis Arias-Estero ◽  
David Kirk

The assessment of tactics is a subject of great interest in physical education and sport pedagogy. However, the lack of knowledge of the topic and the variety of assessment instruments make the assessment of tactics difficult. This study aimed to describe assessment in relation to tactical learning outcomes through an analysis of assessment instruments, based on variables that must be considered when using an instrument: (a) criteria definitions; (b) tactical levels; (c) indexes; (d) units of observation; (e) player/learner roles; and (f) institutional contexts. Hence, the following instruments were found: Game Performance Assessment Instrument, spatial location instruments, game performance evaluation tool, team sport assessment procedure, and system of tactical assessment in Soccer. Building on the review’s purpose, the following issues were found. First, some studies reviewed used non-validated criteria. Second, not all studies considered the three tactical levels (match level, partial forefront level and primary level). Third, the majority of the studies used indexes that masked the results. Fourth, the individual unit of observation was widely used to assess global tactical learning outcomes. Fifth, many instruments were used in contexts for which they were not validated. According to these limitations, general recommendations are proposed. First, researchers should use validated instruments as long as the characteristics of the instruments are aligned with the nature of the study. Second, it is recommended when validating an instrument to consider the following general guidelines: (a) only use validated criteria descriptions; (b) include all three tactical levels; (c) do not use indexes; (d) use the team as the unit of observation; (e) assess both defender and attacker roles; (f) develop the instrument in the same institutional context as the study context; (g) include context variables if applicable.


2019 ◽  
Vol 7 (1) ◽  
pp. 116
Author(s):  
Oki Sukmawa ◽  
Undang Rosidin ◽  
Feriansyah Sesunan

AbstrakBelum semua guru menggunakan instrumen asesmen kinerja (performance assessment) dalam kegiatan praktikum siswa. Guru masih menggunakan asesmen secara tertulis atau tes diakhir kegiatan pembelajaran, sehingga hasil belajar siswa hanya diperoleh dari aspek kognitif tanpa melihat proses belajar yang dilakukan siswa. Penelitian ini bertujuan untuk mengembangkan instrumen asesmen kinerja (performance assessment) praktikum mata pelajaran fisika di SMA serta mendeskripsikan kelayakan instrumen dari segi konstruksi, substansi, dan bahasa/budaya. Desain pengembangan menggunakan metode Research and Devolepment  dengan langkah-langkah: (1) analisis potensi dan masalah, (2) pengumpulan informasi dan data, (3) desain produk awal, (4) validasi desain produk, (5) revisi desain produk. Hasil analisis data menunjukan skor penilaian kelayakan instrumen menurut validator. Skor kelayakan aspek konstruksi sebesar 3,63 yang berarti secara kualitas sangat layak, kelayakan aspek substansi sebesar 3,38 yang berarti sangat layak, dan kelayakan aspek bahasa/budaya sebesar 3,89 yang berarti sangat layak. Apabila dirata-ratakan menjadi 3,63 atau secara kualitas sangat layak sehingga intrumen dapat digunakan.Kata kunci: instrumen asesmen kinerja, performance assessment,       praktikum. AbstractNot all teachers use performance assessment instruments in the activity of students’ practical. Teachers are still using a written assessment or test at the end of learning activities, so that student learning outcomes are only retrieved from the cognitive aspect without seeing the learning process that is done by the students. This research aims to develop instrument for performance assessment practical subjects of physics in senior high school as well as describing the appropriateness of instruments in terms of construction, substance, and language / culture. Developing design using the method of Research and Devolepment method with the steps: (1) analysis of the potential and problems, (2) collecting information and data, (3) the initial product design, (4) validation of design products, (5) revision of product design. The results of the data analysis showed the feasibility assessment instrument score according to the validator. Eligibility score of 3.63 construction aspects of meaning in a very decent quality, feasibility aspects of the substance of 3.38 which means very decent, and feasibility aspecs of the language/culture of 3.89 meaning very feasible. When averaged into 3.63 or is qualitatively decent thus the instrument can be used.Keywords: instruments of practical assessment, performance    assessment, practical.


2021 ◽  
Vol 6 (1) ◽  
pp. 75-83
Author(s):  
Dian Dwi Putri Ulan Sari Patongai ◽  
Saparuddin ◽  
Sahribulan

This study aims to analyze the practicality of an authentic assessment instrument for ecosystem materials in high school which has been developed using the 4D development model (Define, Design, Development, Disseminate) by Thiagarajan. The practicality of the instrument in terms of the user aspect is measured using a teacher response questionnaire filled out by the teacher and also students who are given an assessment instrument to use. Aspects assessed in the instrument are related to aspects of clarity and aspects of understanding/acceptance. Practically, teachers find it easy to use it in assessing student learning outcomes and students who feel enthusiastic about learning that apply authentic assessment instruments. From the results of data analysis carried out, the teacher gave a very positive response to both aspects which were assessed with a student response value of 92.5% greater than 85%. Meanwhile, the student response showed that the students gave a positive response to the implementation of authentic assessment of ecosystem materials with a response value of 84.11%. Thus, it can be concluded that the authentic assessment instrument for ecosystem material that has been developed can practically be used properly and gives a positive response from both teachers and students.  


2016 ◽  
Vol 7 (2) ◽  
pp. 13
Author(s):  
Wilis Okti Pamungkas

Authentic assessment is assessment instrument that assess the learning process and learning outcomes of students. Authentic assessment instrument which developed in this research is project assessment instrument with storyboard product. This study aims to develop project assessment instruments which are valid, reliable and effective to be used for all of the students. The research method used is the modified 4-D model. This research implemented in grade class XI of SMA N 10 Semarang and subjects of research is students in class XI with IPA concentration. The results of research showed that project assessment instruments valid, reliable, and proper to used for assessing learning process and learning outcomes. Project assessment instrument effective used in learning, because the vmean of project assessment and learning outcomes all of students gained a value with the minimum criteria of good, also there is an ascendant of N-gain with high category for students visual, student auditory, and student kinesthetic. Thus it can be concluded that the developed assessment instruments is valid, reliable, and effective. Keywords: Project Assessment; Storyboard; Visual, Auditory, and Kinesthetik Approach


2020 ◽  
Vol 3 (1) ◽  
pp. 41-50
Author(s):  
Dona Desilva ◽  
Indra Sakti ◽  
Rosane Medriati

ABSTRAK Tujuan dari penelitian ini yaitu: 1) menghasilkan desain instrumen penilaian hasil belajar fisika berorientasi HOTS, 2) mengembangkan instrumen penilaian hasil belajar fisika berorientasi HOTS (Higher Order Thinking Skills) yang valid dan 3) mendeskripsikan karakteristik instrumen penilaian hasil belajar fisika berorientasi HOTS yang valid, pada materi Elastisitas dan Hukum Hooke. Penelitian ini merupakan R&D level 1 yang diadaptasi menv vjadi delapan tahap yaitu potensi masalah, studi literatur dan pengumpulan informasi, desain produk, validasi desain, desain teruji, produk awal, validasi produk dan produk teruji. Subjek penelitian ini adalah guru mata pelajaran fisika di SMAN 02 Kota Bengkulu, SMAN 07 Kota bengkulu dan SMAN 10 Kota Bengkulu. Berdasarkan hasil pada tahap potensi dan masalah, diketahui bahwa instrumen penilaian hasil belajar fisika yang digunakan di 3 Sekolah tersebut belum brorientasi HOTS sehingga dilanjutkan dengan dikembangkannya instrumen penilaian hasil belajar fisika berorientasi HOTS. Hasil penelitian dan pengembangan menunjukkan bahwa 1) desain instrumen HOTS memiliki bentuk soal pilihan ganda dan uraian, disajikan sebagai paper test dengan konteks soal di luar kelas (kontekstual) dan materi Elastisitas dan Hukum Hooke serta indikator soal HOTS, 2) hasil uji validitas atau judgement ahli dan praktisi berada pada kategori sangat valid dengan peesentase 97,14% untuk aspek materi, 98,33% untuk aspek konstruksi dan 100% untuk aspek bahasa, dan 3) karakterisitik instrumen HOTS mengacu pada indikator HOTS (pada level kognitif C4 atau C5 atau C6), menggunakan Kata Kerja Operasional (KKO) level C4 atau C5 atau C6, kontekstual dan menggunakan stimulus (teks, gambar, tabel)). Kata Kunci: HOTS, instrumen penilaian, hasil belajar, penelitian dan pengembangan, Elastisitas dan Hukum Hooke ABSTRACT The purpose of this research was: 1) to produce physics learning outcomes assessment instrument design oriented HOTS, 2) to develop physics learning outcomes assessment instrument oriented HOTS which was valid and 3) to describe the characteristics of valid physics learning outcomes assessment instrument oriented HOTS, on the elasticity and Hooke’s law subject matter. This research was a level 1 R & D which was adapted into eight stages, namely potential problems, literature studies and information gathering, product design, validated design, tested design, first product, validated product and tested product. The subjects of this research were physics subject teachers at SMAN 02 Bengkulu City, SMAN 07 Bengkulu City and SMAN 10 Bengkulu City. Based on the results of the potential and the problem stage, it was known that the physics learning outcome assessment instruments used in the 3 Schools have not been oriented HOTS so that it was continued with the development of  physics learning outcomes assessment instrument oriented HOTS. The results of the research and the development showed that 1) The HOTS instrument design had the form of the question in multiple choice and essay, presentation of the questions in paper test, context of the question as outside the classroom (contextual), subject matter in Elasticity and Hooke's Law and indicators of the question in HOTS, 2) Validity test results by expert judgment and practitioners which was in the very valid category with a percentage of 97.14% for the material aspect, 98.33% for the construction aspect and 100% for the language aspect, and 3) The characteristics of HOTS instruments was referred to the HOTS indicator (at the cognitive level C4 or C5 or C6), used the Operational Verb (KKO) level C4 or C5 or C6, contextual and used stimulus (texts, images, tables). Keywords: HOTS, assessment instruments, learning outcomes, research and development, Elasticity and Hooke's Law


2020 ◽  
Vol 10 (2) ◽  
pp. 72
Author(s):  
Fatima Abu Salem ◽  
Issam Damaj ◽  
Lama Hamandi ◽  
Rached Zantout

A capstone project is a culminating experience that entails creativity, critical thinking, and advanced problem-solving skills. To that end, capstone projects enable students to prove their abilities, demonstrate their attained skills, and carry out a significant project in their field. In Computer Science Bachelor programs, there is a strong mapping between learning outcomes of capstone projects and all student learning outcomes. This paper presents an assessment framework for capstone courses that allows for sound evaluations of the performance of students and project qualities; besides assessing the student outcomes of the program. The developed framework comprises criteria, indicators, extensive analytic rubrics, and a summative statistical formulation. The presented course and framework are supported by the results, analysis, and evaluation of a pilot study for a single institution to explore the effectiveness of the proposed tool.


Author(s):  
Dewi Febrianty ◽  
Risnita Risnita ◽  
Afreni Hamidah

Practical performance assessment is an important part of the learning process, but several obstacles are found in its implementation. The objectives of this study are (1) to develop constructivism-based performance assessment instruments for class VII Yunior High School in  Life Organization subject,  (2) to describe aspects that need to be made in constructivism-based practical performance assessment instruments, and (3) to describe teacher responses in using constructivism-based practical performance assessment instruments. This research is a development research using a 4D model, the stages are defining, design, development and distribution. The trial subjects in this study consisted of 10 students for small group trials and 40 students for large group trials. The indicators used in the study include aspects related to the development of constructivist life-based practicum assessment instruments. Instrument used was a questionnaire to reveal the response of teachers and students to practical performance assessment instruments. The results of the data analysis showed that the content feasibility value is 86.31% at the intervals of 48.33 which means it is feasible to use. Most students gave a positive response to the assessment sheet given (96.67%), a small portion gave a negative response (33.3%). Because the average positive response of students is more than 75%, the performance assessment instrument is considered feasible to be applied.


2021 ◽  
pp. 095042222110365
Author(s):  
Gordon R. Elwell ◽  
Thad E. Dickinson ◽  
Michael D. Dillon

The capstone course serves to integrate accumulated knowledge with a culminating experience or project and is a common component in undergraduate and graduate programs. The research on capstones courses shows that many capstone experiences or projects involve students working with outside clients, such as local businesses and organizations, to solve problems or develop new projects or campaigns. Such capstone experiences or projects seek to offer students real-world, career-building experience, while the clients seek to benefit from the learned academic knowledge of the students. Where the literature is scarce on client-based capstone projects is when the client is the student’s employer or career-related organization. A graduate program in administration at a public Midwestern university in the USA offers a different approach to the student–client model by requiring a degree-culminating capstone project that challenges adult students to apply their learned knowledge to solve administrative problems not for an outside client but at their place of employment or career-related organization. The researchers surveyed 66 alumni and interviewed 6 on how the capstone project had benefited their work-related learning and its impact on their employer or career-related organization. Students perceived an improvement in their ability to define and analyze administrative problems in their workplace, while the employers or organizations which implemented the project recommendations experienced positive organizational change. This case study contributes to the literature on capstone courses by examining the relevance of a work- or career-related capstone project to students and their workplace.


2017 ◽  
Vol 44 (9) ◽  
pp. 1236-1241
Author(s):  
Christopher Lobanov-Rostovsky

The work of the Colorado Sex Offender Management Board (SOMB) has been called into question as a result of the manuscript “The Influence of Risk Assessment Instrument Scores on the Evaluators’ Risk Opinions and Sexual Offender Containment Recommendations” published in Criminal Justice and Behavior (2017). This response covers the following areas: significant nomenclature problems used to describe the Adult Standards and Guidelines, the dated nature of the SOMB citations in the manuscript, the flaws in the interpretation of the use of the 17 SOMB risk factors and the SOMB policy related to risk assessment, a potential confounding variable that may explain the results obtained, and finally the work of the SOMB to foster the use of validated risk assessment instruments and evidence-based policies and practices. The SOMB takes pride in providing up-to-date, research-supported practices for its providers and would never intentionally do otherwise, as suggested by the article.


Sign in / Sign up

Export Citation Format

Share Document