Evaluating and Assessing the Quality and Impact of Coaching Services

This chapter offers best practices, methods, and strategies for evaluating and assessing coaching services once they have been implemented. In order to determine the extent to which the coaching services that have been implemented are impacting retention, a comprehensive assessment combined with thoughtful analysis of the assessment data must be undertaken on a regular and continuous cycle. The Kirkpatrick and Kirkpatrick (2006) four-level assessment model to evaluate the impact and effectiveness of the selected coaching program on an annual basis, for either an outsourced coaching service or an internal coaching unit or department, is the recommended approach detailed in this chapter. The four levels of the assessment are as follows: Level 1 of the assessment will measure student reactions to the coaching services; Level 2 will assess student learning through the use of pre- and post-coaching assessments; Level 3 will assess transfer of knowledge and skills; and Level 4 will assess the impact and results as a result of the coaching program. The chapter provides advice and discussion about when to conduct each level of the four-part assessment model and a comprehensive sample assessment that can be modified to fit the needs of a wide variety of programs and institutions.

Author(s):  
Lania Muharsih ◽  
Ratih Saraswati

This study aims to determine the training evaluation at PT. Kujang Fertilizer. PT. Pupuk Kujang is a company engaged in the field of petrochemicals. Evaluation sheet of PT. Fertilizer Kujang is made based on Kirkpatrick's theory which consists of four levels of evaluation, namely reaction, learning, behavior, and results. At level 1, namely reaction, in the evaluation sheet is in accordance with the theory of Kirkpatrick, at level 2 that is learning should be held pretest and posttest but only made scale. At level 3, behavior, according to theory, but on assessment factor number 3, quantity and work productivity should not need to be included because they are included in level 4. At level 4, that is the result, here is still lacking to get a picture of the results of the training that has been carried out because only based on answers from superiors without evidence of any documents.   Keywords: Training Evaluation, Kirkpatrick Theory.    Penelitian ini bertujuan mengetahui evaluasi training di PT. Pupuk Kujang. PT. Pupuk Kujang merupakan perusahaan yang bergerak di bidang petrokimia. Lembar evaluasi PT. Pupuk Kujang dibuat berdasarkan teori Kirkpatrick yang terdiri dari empat level evaluasi, yaitu reaksi, learning, behavior, dan hasil. Pada level 1 yaitu reaksi, di lembar evaluasi tersebut sudah sesuai dengan teori dari Kirkpatrick, pada level 2 yaitu learning seharusnya diadakan pretest dan posttest namun hanya dibuatkan skala. Pada level 3 yaitu behavior, sudah sesuai teori namun pada faktor penilaian nomor 3 kuantitas dan produktivitas kerja semestinya tidak perlu dimasukkan karena sudah termasuk ke dalam level 4. Pada level 4 yaitu hasil, disini masih sangat kurang untuk mendapatkan gambaran hasil dari pelatihan yang sudah dilaksanakan karena hanya berdasarkan dari jawaban atasan tanpa bukti dokumen apapun.   Kata kunci: Evaluasi Pelatihan, Teori Kirkpatrick.


2021 ◽  
Vol 16 (7) ◽  
pp. 2732-2749
Author(s):  
Anaf Abdulkarem ◽  
Wenhua Hou

With the rapid technological developments, cross-border e-commerce (CBEC) as a sector is also expanding rapidly. In the past couple of decades, China has become a major force in promoting and developing CBEC and, therefore, it was needed to explore the various antecedents and outcomes of Chinese CBEC to expand the understanding and existing CBEC scholarship. Ample studies have been conducted to understand the antecedents and outcomes of CBEC. However, limited studies have explored such variables which can mitigate the adoption of CBEC. With this background, this empirical study was focused on addressing this gap by studying the moderating role of environmental context between organizational context and the four levels of CBEC adoption with the help of a technology-organization-environment framework. SMEs operating in China were targeted for data collection, where data were collected through an online survey. A final sample size of 208 was recorded. It was found that the organizational context has a direct and positive impact on all four levels of CBEC adoption. Furthermore, the moderating role of environmental context on Level 1 and 2 was not supported. Finally, the moderating role of environmental context on Level 3 and 4 was supported by the data. It was concluded that the organizational context plays a significant role in shaping CBEC at all four levels, whereas the environmental context has the potential to mitigate the relationships between organizational context and CBEC Level 3 and 4.


2021 ◽  
Vol 1 (2) ◽  
pp. 117-129
Author(s):  
Franty Faldy Palempung ◽  
Ferry J N Sumual

­Abstrak: Tulisan ini secara spesifik memaparkan dampak metode pembelajaran daring bagi ketuntasan belajar siswa. Peristiwa Covid-19 yang terjadi awal tahun 2020 hingga sampai sekarang, masih menyebakan kesulitan bagi semua element. Imbas dari pandemi ini di sektor Pendidikan mengharuskan pembelajaran online dilaksanakan. Akibat dari penerapan pembelajaran daring ini, masih menyebabkan kesulitan bagi sebagai indvidu bahkan institusi karena masih belum lengkapnya pra-sarana dalam kegiatan pembelajara daring. Topik ini ditulis dengan menggunakan metode kualitatif deskriftif dengan pendekatan studi literatur. Hasil pada uraian ini mengemukakan bahwa pengertian ketuntasan belajar menurut Permendikbud adalah pencapaian kompetensi sikap, pengetahuan, dan keterampilan meliputi ketuntasan penguasaan substansi dan ketuntasan belajar dalam konteks kurun waktu belajar. Ketuntasan belajar peserta didik merupakan komponen keluaran yang diperoleh dari hasil suatu proses pembelajaran yang didukung oleh orang tua, guru dan lingkungan. Berhasil tidaknya pembelajaran daring bagi ketuntasan pembelajaran, diperlukan kerja sama semua komponen Pendidikan itu sendiri.Abstract: This paper specifically describes the impact of online learning methods on the completion of student learning. The Covid-19 event that occurred in early 2020 until now, still makes it difficult for all elements. The impact of this pandemic in the Education sector requires that online learning be implemented. As a result of the application of online learning in, still causes difficulties for as an individual even an institution because it is still incomplete pre-facilities in the activities of online learners. This topic is written using qualitative methods with a literature study approach. The results in this description suggest that the understanding of the completion of learning according to Permendikbud is the achievement of attitude competence. Knowledge, and skills include the completion of the mastery of substance and the completion of learning in the context of the study period. The completion of learning of learners is a component of the output obtained from the results of a learning process supported by parents, teachers and the environment. The success of online learning for the completion of learning, requires the cooperation of all components of Education itself.


2013 ◽  
Vol 23 (2) ◽  
pp. 142-148
Author(s):  
Morgan M. Jenkins ◽  
Kimberly A. Williams ◽  
Laura A. Brannon

This research examines whether knowledge about floral preservatives increases consumers’ perception of quality, purchase intention, and price of a floral arrangement. A survey was administered to 222 participants at two locations in Manhattan, KS. Seventy-three percent of respondents fell within Generation Y (18 to 30 years old). The survey instrument presented four levels of presentation of a floral arrangement that were associated with increasing knowledge about the use of floral preservatives on consumers’ perceptions about the quality and price of that arrangement, as follows: Level 1 showed a photo of a floral arrangement without preservatives; Level 2 showed the same photo of a floral arrangement with a small, unlabeled packet of preservatives; Level 3 showed the same photo of a floral arrangement with a large, clearly labeled packet of preservatives; and Level 4 showed the same photos as Level 3 but was presented after a 191-word message describing the three functions of floral preservatives. Participants of the survey rated the quality of a floral arrangement higher from Level 2 (presence of floral preservatives not explicit) to Level 3 (presence of floral preservatives explicit) and from Level 3 to Level 4 (after reading a message about floral preservatives’ function and effectiveness). Their intent to purchase the floral arrangement generally increased with each level of presentation. Females indicated intention to purchase flowers more frequently than males. Participants increased the price that they were willing to pay for the floral arrangement at each level of presentation, starting at $25.46 at Level 1 (no floral preservatives use indicated) to $29.19 at Level 4. Participants were more knowledgeable about the benefits of floral preservatives and believed that floral preservatives increased the value of floral arrangements after reading a message describing their function and effectiveness more so than before reading a message. The younger the respondent, the more willing they were to pay more for floral arrangements with floral preservatives. As consumers become more aware of the use of floral preservatives and more knowledgeable about how and why they are effective, they attribute higher quality to floral arrangements with preservatives, they are willing to pay more for arrangements with preservatives, and their purchase intention frequency increases. Florists should always use preservatives in their processing and construction of fresh floral arrangements, consider providing a message about the function and effectiveness of floral preservatives to their customers, and then market their use of these materials.


2013 ◽  
Vol 9 (4) ◽  
pp. 359-370 ◽  
Author(s):  
Deborah Gill ◽  
Diane Lucas

The present study will be divided in three parts: (1) a discussion of authentic alternative assessments vs. traditional assessments in language and business classes; (2) an explanation on how to create authentic alternative assessments using technology-based and non-technology-based materials; and (3) tools to evaluate these authentic assessments. We will discuss alternative assessments which have been used in a number of different business and foreign language classes, student reactions to these assessments, and our observations as to the impact and results these assessments have had on student learning.


2018 ◽  
Vol 11 (7) ◽  
pp. 4129-4152 ◽  
Author(s):  
Jason L. Tackett ◽  
David M. Winker ◽  
Brian J. Getzewich ◽  
Mark A. Vaughan ◽  
Stuart A. Young ◽  
...  

Abstract. The CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations) level 3 aerosol profile product reports globally gridded, quality-screened, monthly mean aerosol extinction profiles retrieved by CALIOP (the Cloud-Aerosol Lidar with Orthogonal Polarization). This paper describes the quality screening and averaging methods used to generate the version 3 product. The fundamental input data are CALIOP level 2 aerosol extinction profiles and layer classification information (aerosol, cloud, and clear-air). Prior to aggregation, the extinction profiles are quality-screened by a series of filters to reduce the impact of layer detection errors, layer classification errors, extinction retrieval errors, and biases due to an intermittent signal anomaly at the surface. The relative influence of these filters are compared in terms of sample rejection frequency, mean extinction, and mean aerosol optical depth (AOD). The “extinction QC flag” filter is the most influential in preventing high-biases in level 3 mean extinction, while the “misclassified cirrus fringe” filter is most aggressive at rejecting cirrus misclassified as aerosol. The impact of quality screening on monthly mean aerosol extinction is investigated globally and regionally. After applying quality filters, the level 3 algorithm calculates monthly mean AOD by vertically integrating the monthly mean quality-screened aerosol extinction profile. Calculating monthly mean AOD by integrating the monthly mean extinction profile prevents a low bias that would result from alternately integrating the set of extinction profiles first and then averaging the resultant AOD values together. Ultimately, the quality filters reduce level 3 mean AOD by −24 and −31 % for global ocean and global land, respectively, indicating the importance of quality screening.


2020 ◽  
Vol 3 (2) ◽  
pp. 113-118
Author(s):  
Richardy Affan Sojuangon Siregar

Teknologi Informasi (TI) merupakan bagian yang tak terpisahkan dari upaya penerapan good governance sebagai langkah instansi dalam mencapai tujuan yang diharapkan. Direktorat Jenderal Sumber Daya Air (Ditjen SDA) sendiri memiliki kebijakan umum yang tertera pada Rencana Strategis 2015 – 2019 Ditjen SDA,  yaitu penataan dan penguatan sistem pengelolaan data dan informasi sumber daya air dilakukan secara terencana dan dikelola secara berkesinambungan dalam rangka pelayanan data dan informasi, baik ke dalam maupun ke luar Ditjen SDA. Fungsi pengelolaan teknologi informasi pada Ditjen SDA sendiri di lakukan oleh Subdirektorat Sistem Informasi dan Data (Subdit SISDA). Diketahui masih terdapat masalah dalam pengelolaan tata kelola TI oleh Subdit SISDA yaitu, kurang optimalnya pegawai dalam penggunaan TI dan juga kurangnya ketersedian informasi pada beberapa Aplikasi SISDA. Maka, perlu dilakukan suatu evaluasi tata kelola TI. Dalam penelitian ini menggunakan framework COBIT 5 dengan PAM (Process Assessment Model). Penelitian ini berfokus pada proses EDM04 (Ensure Resource Optimization) dan BAI04 (Manage Availablity and Capacity). Tujuan penelitian ini mengetahui capability level kondisi saat ini (as-is) dan kondisi yang di harapkan (to-be), kesenjangan (gap), serta memberikan rekomendasi pada Subdit SISDA. Hasil dari penelitian ini menunjukan kondisi saat ini proses EDM04 berada pada level 3 (Established Process) dan kondisi yang diharapkan berada pada level 5 (Optimising Process). Kemudian kondisi saat ini proses BAI04 berada pada level 2 (Managed Process) dan kondisi yang diharapkan berada pada level 4 (Predictable Process). Berdasarkan hasil tersebut, diketahui bahwa masing-masing proses memiliki gaps sebesar 2 antara as-is dan to-be, sehingga Subdit SISDA pada proses EDM04 direkomendasikan agar terlebih dahulu melakukan pelaksanaan aktivitas dan pemenuhan proses atribut work product pada level 4 (Predictable Process dan juga pada proses BAI04 direkomendasikan agar terlebih dahulu melakukan pelaksanaan aktivitas dan pemenuhan proses atribut work product pada level 3 (Established Process) sebagai solusi dari permasalahan yang ditemukan.


Author(s):  
Betty Belanus

This chapter uses the 2008 Bhutan program to examine visitor experience and the role of curators in crafting these experiences. Using the suggestive possibilities of a portable Buddhist shrine featured in the program and basing the analysis on 20 years of experience working with the Festival and its evaluation, the author lays out a framework for analyzing four levels of Festival visitor engagement: Level 1—Sensory Cultural Enlightenment/Being Present; Level 2—Choosing a Route/Moving Through; Level 3—Viewing and Taking part in the Live Performance/Active Experiencing; and Level 4—Revealing the Deeper Layers/Discovering More. The chapter concludes with observations about visitor studies relevant to museums as well as festivals.


Author(s):  
Anna Maria Wium ◽  
Brenda Louw

The role of speech-language therapists (SLTs) in schools in South Africa needs to be revisited based on the changing educational needs in the country. Th is article builds on a paper by Kathard et al. (2011), which discussed the changing needs of the country with regard to the role of SLTs working in schools. South African policy changes indicated a shift from supporting the child to supporting the teacher, but also place more emphasis on the support of all learners in literacy in an eff ort to address past inequities. Th is paper addresses several of the questions that emerged from Kathard et al. and explores the collaborative roles played by SLTs on four levels in the education context. Collaboration at the learner level (level 1) focuses on prevention and support, whereas collaboration at the teacher level (level 2) is described in terms of training, mentoring, monitoring and consultation. Collaboration can also occur at the district level (level 3), where the focus is mainly on the development and implementation of support programmes for teachers in areas of literacy and numeracy. Collaboration at the level of national and provincial education (level 4) is key to all other roles, as it impacts on policy. Th is last level is the platform to advocate for the employment of SLTs in schools. Such new roles and responsibilities have important implications for the preparation of future SLTs. Suggestions for curricular review and professional development are discussed. It is proposed that SASLHA responds to the changes by developing a position statement on the roles and responsibilities of SLTs in schools.


2013 ◽  
Vol 4 (1) ◽  
pp. 142-152
Author(s):  
Abha Lakshmi Singh ◽  
Md. Zahir Abbas

This paper examines the status of water and sanitation conditions in the residential suburbs of Aligarh city. The study is mainly based on primary sources of data collected through field/household surveys with the help of questionnaire interviews. Data was collected from 996 households living in 66 developed residential colonies. The services were categorized into three levels (standards), level 1 (basic), level 2 (intermediate) and level 3 (higher), to assess their standard. The standard score additive model has been used to arrive at a Composite Mean Standard Index (CMSI). The average value of CMSI of water and sanitation were calculated and further categorized into four levels, high, moderate, low and very low, for the purpose of planning. Maps were prepared accordingly. Results have shown that colonies located along the main roads have a high level of water and sanitation facilities compared with the colonies located along the wedges of two roads.


Sign in / Sign up

Export Citation Format

Share Document