Reliability and Perceived Pedagogical Utility of a Weighted Music Performance Assessment Rubric

2010 ◽  
Vol 58 (2) ◽  
pp. 168-183 ◽  
Author(s):  
Marvin E. Latimer ◽  
Martin J. Bergee ◽  
Mary L. Cohen

The purpose of this study was to investigate the reliability and perceived pedagogical utility of a multidimensional weighted performance assessment rubric used in Kansas state high school large-group festivals. Data were adjudicator rubrics ( N = 2,016) and adjudicator and director questionnaires ( N = 515). Rubric internal consistency was moderately high (.88). Dimension reliability ranged from moderately low ( W = .47) to moderate ( W = .77). Total score reliability was moderately high ( W = .80) and rating reliability was moderate ( W = .72). Findings suggested that reliability on the whole was within the range of previously researched music performance assessment tools. Questionnaire results suggested that the rubric provided a better instrument for justifying ratings and more detailed descriptions of what constituted acceptable performances than previously researched nonrubric forms; hence, adjudicators and directors perceived the rubric as possessing improved pedagogical utility.

2009 ◽  
Vol 57 (1) ◽  
pp. 5-15 ◽  
Author(s):  
Charles R. Ciorba ◽  
Neal Y. Smith

Recent policy initiatives instituted by major accrediting bodies require the implementation of specific assessment tools to provide evidence of student achievement in a number of areas, including applied music study. The purpose of this research was to investigate the effectiveness of a multidimensional assessment rubric, which was administered to all students performing instrumental and vocal juries at a private Midwestern university during one semester ( N = 359). Interjudge reliability coefficients indicated a moderate to high level of agreement among judges. Results also revealed that performance achievement was positively related to participants' year in school (freshman, sophomore, junior, and senior), which indicates that a multidimensional assessment rubric can effectively measure students' achievement in the area of solo music performance.


2007 ◽  
Vol 55 (4) ◽  
pp. 344-358 ◽  
Author(s):  
Martin J. Bergee

This study examined performer, rater, occasion, and sequence as sources of variability in music performance assessment. Generalizability theory served as the study's basis. Performers were 8 high school wind instrumentalists who had recently performed a solo. The author audio-recorded performers playing excerpts from their solo three times, establishing an occasion variable. To establish a rater variable, 10 certified adjudicators were asked to rate the performances from 0 (poor) to 100 (excellent). Raters were randomly assigned to one of five performance sequences, thus nesting raters within a sequence variable. Two G (generalizability) studies established that occasion and sequence produced virtually no measurement error. Raters were a strong source of error. D (decision) studies established the one-rater, one-occasion scenario as unreliable. In scenarios using the generalizability coefficient as a criterion, 5 hypothetical raters were necessary to reach the .80 benchmark. Using the dependability index, 17 hypothetical raters were necessary to reach .80.


2018 ◽  
Author(s):  
Adnan

This study aims to get a description implementation of assessment activities in Indonesian language learning. The subjects of study are twenty one of Language Indonesian teachers of Senior high School in a district of West Nusa Tenggara province. Data collection by using questionnaire, interview, observation, and document analysis. The result of this study shows that most of teachers do assessment of Indonesian language learning by using test (essay and multiple choices). Based on the theory, assessment by using test can not be done on skill assessment. Skill assessment only can be done by assignment. Some of teachers did skill assessment by giving performance task and productive task for students. But, the teachers have not implemented performance assessment, and product assessment well because it was not supported of adequate assessment tools such as rubric of performance assessment, and product assessment. Thus, it can be concluded that teachers have not done assessment well.


Author(s):  
Rini Dian Anggraini ◽  
Titi Solfitri

Penelitian ini bertujuan untuk mengembangkan perangkat pembelajaran matematika untuk sekolah menengah pertama yaitu kurikulum Silabus, Rencana Pembelajaran dan Lembar Kerja Siswa 2013 tentang statistik dan probabilitas dengan menggunakan model pembelajaran berbasis masalah. Penelitian ini menggunakan model pengembangan oleh Borg dan Gall yang dimodifikasi oleh Sugiyono (2008) melalui langkah-langkah: (1) potensi dan masalah; (2) pengumpulan data; (3) desain produk; (4) validasi desain; (5) revisi desain; (6) uji coba kelompok kecil; (7) revisi produk; (8) uji coba kelompok besar; (9) revisi produk. Pada tahap potensi dan masalah, para peneliti melakukan analisis potensi dan masalah. Kemudian, peneliti mengumpulkan data yang diperlukan sebagai referensi untuk desain perangkat pembelajaran matematika yang akan dikembangkan. Desain perangkat pembelajaran yang telah dikembangkan kemudian divalidasi oleh tiga validator dan direvisi berdasarkan saran validator. Hasil perancangan perangkat pembelajaran kemudian diujicobakan dalam uji coba kelompok kecil yang subjeknya 8 siswa kelas VII SMP Negeri 23 Pekanbaru. Setelah dicoba dalam uji coba kelompok kecil, kemudian direvisi berdasarkan kuesioner dari siswa yang mengikuti uji coba kelompok kecil. Setelah itu, para peneliti melakukan uji coba dalam kelompok besar yang subjeknya adalah 39 siswa kelas VII SMP Negeri 23 Pekanbaru, direvisi lagi dan disempurnakan. Berdasarkan hasil analisis dan diskusi data, perangkat pembelajaran yang telah dikembangkan valid yang nilai untuk Silabus adalah 3,39, rata-rata nilai untuk 5 Rencana Pelajaran adalah 3,41. Nilai rata-rata untuk 5 Lembar Kerja Siswa adalah 3,34. Lembar Kerja Siswa yang telah dikembangkan adalah persyaratan praktis yang memenuhi syarat untuk digunakan oleh siswa sekolah menengah pertama.   This research aimed to develop mathematics learning device for junior high school that are Syllabus, Lesson Plan and Students Worksheet curriculum 2013 on statistics and probability by used problem based learning model. This research use development model by Borg and Gall modified by Sugiyono (2008) through the steps : (1) potentials and problems; (2) data collection; (3) design product; (4) validation of design; (5) revision of design; (6) small group trial; (7) revision of product; (8) large group trial; (9) revision of product. At potentials and problems stage, the researchers conducted analysis of potentials and problems. Then, researchers collect the necessary data as reference to design of mathematics learning device that will be developed. Design of learning device that had been developed then validated by three validators and revised based on validator suggestion. The result of learning device design and then try out in small group trial which subjects are 8 students of VII SMP Negeri 23 Pekanbaru. After try out in small group trial, then it revised based on questionnaire from the students who take the small group trial. After that, the researchers conducted try out in large group trial which subjects are 39 students of VII SMP Negeri 23 Pekanbaru, revised again and refined. Based on result of data analysis and discussion, learning device that had been developed is valid which value for Syllabus is 3,39, the average of value for 5 Lesson Plan are 3,41. The average of value for 5 Students Worksheet are 3,34. Students Worksheet that had been developed is qualify practical requirement to used by students of junior high school.


Author(s):  
Daniel Massoth

When technology is used for assessment in music, certain considerations can affect the validity, reliability, and depth of analysis. This chapter explores factors that are present in the three phases of the assessment process: recognition, analysis, and display of assessment of a musical performance. Each phase has inherent challenges embedded within internal and external factors. The goal here is not to provide an exhaustive analysis of any or all aspects of assessment but, rather, to present the rationale for and history of using technology in music assessment and to examine the philosophical and practical considerations. A discussion of possible future directions of product research and development concludes the chapter.


2021 ◽  
Vol 13 (6) ◽  
pp. 3092
Author(s):  
Sungwoo Lee ◽  
Sungho Tae ◽  
Hyungjae Jang ◽  
Chang U. Chae ◽  
Youngjin Bok

Eco-friendly building designs that use building information modeling (BIM) have become popular, and a variety of eco-friendly building assessment technologies that take advantage of BIM are being developed. However, existing building environmental performance assessment technologies that use BIM are linked to external assessment tools, and there exist compatibility issues among programs; it requires a considerable amount of time to address these problems, owing to the lack of experts who can operate the programs. This study aims to develop eco-friendly templates for assessing the embodied environmental impact of buildings using BIM authoring tools as part of the development of BIM-based building life cycle assessment (LCA) technologies. Therefore, an embodied environmental impact unit database was developed, for major building materials during production and operating stages, to perform embodied environmental impact assessments. Moreover, a major structural element library that uses the database was developed and a function was created to produce building environmental performance assessment results tables, making it possible to review the eco-friendliness of buildings. A case study analysis was performed to review the feasibility of the environmental performance assessment technologies. The results showed a less than 5% effective error rate in the assessment results that were obtained using the technology developed in this study compared with the assessment results based on the actual calculation and operating stage energy consumption figures, which proves the reliability of the proposed approach.


2007 ◽  
Vol 17 (4) ◽  
pp. 317-331 ◽  
Author(s):  
John E. Deaton ◽  
Benjamin Bell ◽  
Jennifer Fowlkes ◽  
Clint Bowers ◽  
Florian Jentsch ◽  
...  

2018 ◽  
Vol 18 (2) ◽  
pp. 165-173 ◽  
Author(s):  
Sanna-Mari Pudas-Tähkä ◽  
Sanna Salanterä

Abstract Background and aims: Pain assessment in intensive care is challenging, especially when the patients are sedated. Sedated patients who cannot communicate verbally are at risk of suffering from pain that remains unnoticed without careful pain assessment. Some tools have been developed for use with sedated patients. The Behavioral Pain Scale (BPS), the Critical-Care Pain Observation Tool (CPOT) and the Nonverbal Adult Pain Assessment Scale (NVPS) have shown promising psychometric qualities. We translated and culturally adapted these three tools for the Finnish intensive care environment. The objective of this feasibility study was to test the reliability of the three pain assessment tools translated into Finnish for use with sedated intensive care patients. Methods: Six sedated intensive care patients were videorecorded while they underwent two procedures: an endotracheal suctioning was the nociceptive procedure, and the non-nociceptive treatment was creaming of the feet. Eight experts assessed the patients’ pain by observing video recordings. They assessed the pain using four instruments: the BPS, the CPOT and the NVPS, and the Numeric Rating Scale (NRS) served as a control instrument. Each expert assessed the patients’ pain at five measurement points: (1) right before the procedure, (2) during the endotracheal suctioning, (3) during rest (4) during the creaming of the feet, and (5) after 20 min of rest. Internal consistency and inter-rater reliability of the tools were evaluated. After 6 months, the video recordings were evaluated for testing the test-retest reliability. Results: Using the BPS, the CPOT, the NVPS and the NRS, 960 assessments were obtained. Internal consistency with Cronbach’s alpha coefficient varied greatly with all the instruments. The lowest values were seen at those measurement points where the pain scores were 0. The highest scores were achieved after the endotracheal suctioning at rest: for the BPS, the score was 0.86; for the CPOT, 0.96; and for the NVPS, 0.90. The inter-rater reliability using the Shrout-Fleiss intraclass correlation coefficient (ICC) tests showed the best results after the painful procedure and during the creaming. The scores were slightly lower for the BPS compared to the CPOT and the NVPS. The test-retest results using the Bland-Altman plots show that all instruments gave similar results. Conclusions: To our knowledge, this is the first time all three behavioral pain assessment tools have been evaluated in the same study in a language other than English or French. All three tools had good internal consistency, but it was better for the CPOT and the NVPS compared to the BPS. The inter-rater reliability was best for the NVPS. The test-retest reliability was strongest for the CPOT. The three tools proved to be reliable for further testing in clinical use. Implications: There is a need for feasible, valid and reliable pain assessment tools for pain assessment of sedated ICU patients in Finland. This was the first time the psychometric properties of these tools were tested in Finnish use. Based on the results, all three instruments could be tested further in clinical use for sedated ICU patients in Finland.


2020 ◽  
Vol 4 (3) ◽  
Author(s):  
Sultan Sultan

ABSTRAK : Penilaian ini berisi proses pembelajaran IPS pada siswa kelas VI yang dilakukan di SD Negeri 18 Kendari. Tujuan dan karya tulis ini, adalah membuktikanbahwa kegiatan bermain dan membuat display dapat memberikan keberhasilan pada proses pembelajaran siswa dalam rangka pencapaian mastery learning. Dalam penelitian ini penulis melibatkan 12 siswa kelas VI yang ada di SD Negeri 18 Kendari yaitu siswa kelas VI untuk tahun pelajaran 2014/2015. Alat penilaian yang digunakan berbentuk tes dan non tes. Penelitian ini dilaksanakan dalam tiga siklus. Antara lain siklus I, siklus II dan siklus III merupakan rangkaian kegiatan yang saling berkaitan. Faktor yang diteliti dalam penelitian ini adalah proses pembelajaran siswa yakni mengamati kelancaran pembelajaran, suasana dan aktivitas pembelajaran serta hasil belajar siswa. Rubrik penilaian dilakukan pada saat siswa terlibat dalam kegiatan kelompok ketiga membuat display dan melakukan permainan. Rubrik bertujuan untuk melihat keterampilan-keterampilan yang diharapkan pada paradigma pembelajaran dalam pedoman KTSP yaitu,1) learning to know, 2) Learning to do, 3) leraning to be, dan 4) learning to live togather telah dicapai oleh siswa. Perbandingan hasil pre-test, siklus I, siklus II, dan siklus III, serta rubrik penilaian saat pembuatan display dan permainan menunjukan bahwa keterampilan yang diharapkan dari setiap kriteria penilaian dapat dilalui dengan nilai yang baik oleh semua kelompok. Meskipun penilaian rubrik dilakukan dalam kelompok, namun keterampilan itu tetap menjadi tanggung jawab setiap individu siswa. Hal penelitian ini menunjukan bahwa penerapan tehnik permainan dan display dapat meningkatkan hasil belajar IPS karena suasana belajar dirasakan menyenangkan dan siswa lebih aktif menyelesaikan tugas serta terjadi peningkatan prestasi belajar. Kata Kunci: Aktivitas, Prestasi Belajar, STADABSTRACT: This assessment contains the social studies learning process for grade VI students conducted at SD Negeri 18 Kendari. The purpose and this paper, is to prove that playing activities and making displays can provide success in the learning process of students in order to achieve mastery learning. In this study the authors involved 12 grade VI students in 18 Public Elementary School Kendari, namely grade VI students for the 2014/2015 school year. Assessment tools used in the form of tests and non-tests. This research was conducted in three cycles. Among other cycles I, cycle II and cycle III is a series of interrelated activities. The factors examined in this study were the students' learning processes, namely observing the smooth learning, the atmosphere and learning activities and student learning outcomes. The assessment rubric is done when students are involved in third group activities making displays and playing games. The rubric aims to look at the skills expected in the learning paradigm in the SBC guidelines, namely, 1) learning to know, 2) learning to do, 3) learning to be, and 4) learning to live togather has been achieved by students. Comparison of pre-test results, cycle I, cycle II, and cycle III, as well as the assessment rubric when making displays and games shows that the skills expected from each assessment criteria can be passed with good grades by all groups. Although the rubric assessment is done in groups, the skill remains the responsibility of each individual student. This study shows that the application of game and display techniques can improve social studies learning outcomes because the learning atmosphere is felt to be fun and students are more active in completing assignments and there is an increase in learning achievement. Keywords: Activities, Learning Achievement, STAD


Sign in / Sign up

Export Citation Format

Share Document