Guidelines for Formative Evaluation Research in Campaign Design

2017 ◽  
pp. 52-68 ◽  
Author(s):  
Charles K. Atkin ◽  
Vicki Freimuth
Author(s):  
Si Chen ◽  
Nor Mardziah Osman ◽  
Guo Chao Alex Peng

Due to the prevalent use of Information Systems (IS) in modern organisations, evaluation research in this field is becoming more and more important. In light of this, a set of rigorous methodologies were developed and used by IS researchers and practitioners to evaluate the increasingly complex IS implementation used. Moreover, different types of IS and different focusing perspectives of the evaluation require the selection and use of different evaluation approaches and methodologies. This chapter aims to identify, explore, investigate, and discuss the various key methodologies that can be used in IS evaluation from different perspectives, namely in nature (e.g. summative vs. formative evaluation) and in strategy (e.g. goal-based, goal-free, and criteria-based evaluation). Six case studies are also presented and discussed in this chapter to illustrate how the different IS evaluation methodologies can be applied in practices. The chapter concludes that evaluation methodologies should be selected depending on the nature of the IS and the specific goals and objectives of the evaluation. Nonetheless, it is also proposed that formative criteria-based evaluation and summative criteria-based evaluation are currently among the more widely used in IS research. The authors suggest that the combined used of one or more of these approaches can be applied at different stages of the IS life cycle in order to generate more rigorous and reliable evaluation outcomes. Moreover, results and outcomes of IS evaluation research will not just be useful in practically guiding actions to improve the current system, but can also be used to generate new knowledge and theory to be adopted by future IS research.


1993 ◽  
Vol 47 (1) ◽  
pp. 56-64
Author(s):  
Marv Gardner

Reports on formative evaluation research designed to answer the following questions: “What is the pastoral dimension of pastoral counselor training?,” “What methods are in use to integrate the pastoral dimension into counselor training programs?,” and “What are the satisfaction levels of program participants with regard to this integration process?” Summarizes data gathered from 609 participants representing 26 training programs approved by the American Association of Pastoral Counselors. Analyzes and interprets the data on counselor attitudes, identity values, training content and training processes. Discusses the implications of the findings for training programs.


2018 ◽  
Vol 2 (1) ◽  
pp. 1
Author(s):  
Sitti Mania ◽  
Hasaruddin Hasaruddin

This research is aimed to: 1) find out the objective condition of supporting elements of Character Building Training Program in State Islamic University of Alauddin Makassar at the antecedent phase, 2) look over the efectivity of the program implementation at the transaction phase, and 3) identify the character of students as the outcome of CBT Program. This formative evaluation research applies qualitative research particulary countenance stake. The data are collected by observation, questionnaire, interview, and documentation. The data are analyzed by domain analysis technique, tacsonomy, and componential technique, based on evaluation phase and applied together with data collecting. This research points out that antecedents phase is on the high category and transaction and outcomes phase are on moderat category.


2019 ◽  
Vol 4 (1) ◽  
pp. 30-36
Author(s):  
Sri Nawati

This study aims to determine the success of the program through the correct mechanism for the preparation of supervision programs, supervision and supervisory reports conducted by elementary school supervisors in Paser Regency East Kalimantan. This is an evaluation research using Formative-Summative Model By Scriven, the subjects in this study are school supervisors, supervisor coordinators, teachers, and principals. Selection of informants in this study was conducted by purposive sampling of teachers and principals while supervisors became the main object in the study. Data analysis was done by qualitative descriptive analysis. The conclusion of the elementary school supervisory program in Paser Regency East Kalimantan is specifically through formative evaluation there has been deviation on the preparation, implementation, and reporting of the program results so that the result of summative evaluation shows the failure of the supervisor in conducting the supervision. In general, it can be concluded: 1) Elementary School Supervisor in Paser Regency has performed its duty in accordance with the regulation of the functional position of supervisor that is at least 10 schools. 2) Obstacles in the implementation of supervision of the supervisor have not been able to develop the program well. 3) Overall results of the implementation of the supervisory program cannot be used to formulate the success of education in Paser Regency East Kalimantan.        


2019 ◽  
Vol 4 (1) ◽  
pp. 30-36
Author(s):  
Sri Nawati

ABSTRACT   This study aims to determine the success of the program through the correct mechanism for the preparation of supervision programs, supervision and supervisory reports conducted by elementary school supervisors in Paser Regency East Kalimantan. This is an evaluation research using Formative-Summative Model By Scriven, the subjects in this study are school supervisors, supervisor coordinators, teachers, and principals. Selection of informants in this study was conducted by purposive sampling of teachers and principals while supervisors became the main object in the study. Data analysis was done by qualitative descriptive analysis. The conclusion of the elementary school supervisory program in Paser Regency East Kalimantan is specifically through formative evaluation there has been deviation on the preparation, implementation, and reporting of the program results so that the result of summative evaluation shows the failure of the supervisor in conducting the supervision. In general, it can be concluded: 1) Elementary School Supervisor in Paser Regency has performed its duty in accordance with the regulation of the functional position of supervisor that is at least 10 schools. 2) Obstacles in the implementation of supervision of the supervisor have not been able to develop the program well. 3) Overall results of the implementation of the supervisory program cannot be used to formulate the success of education in Paser Regency East Kalimantan.        


Author(s):  
Ineta Luka

The paper presents the main findings of the second stage of Erasmus+ project „Key Skills for European Union Hotel Staff” (2014-2016) – the online course designed for A2/B1 level of language competence in 12 European languages and B2/C1 English language course to promote tourism students’ and employees’ language competence and raise their intercultural awareness. It analyses pedagogical, linguistic and field professional literature on course creation and presents the conducted evaluation research containing formative evaluation from three perspectives – provider (document review), recipient (a focus group interview with 14 learners) and wider community (a focus group interview with 7 hospitality industry managers and a survey of 21 language teachers from six countries) to identify the initiative’s consequences and opportunities for modification and improvement. The strengths and weaknesses of the course have been identified and suggestions on how the process could be made more efficient/effective for the organisation, the end users and the community have been provided.


Imaji ◽  
2018 ◽  
Vol 15 (2) ◽  
Author(s):  
Lusi Susilowati ◽  
Sutiyono Sutiyono

Penelitian ini bertujuan untuk mendeskripsikan evaluasi pelaksanaan Kurikulum 2013 pada mata pelajaran seni tari di sekolah menengah atas Negeri di Sleman Yogyakarta. Penelitian ini merupakan penelitian evaluasi dengan pendekatan deskriptif kualitatif. Model evaluasi yang digunakan adalah evaluasi formatif yang dikembangkan oleh Scriven. Subjek dalam penelitian ini adalah dua guru dan 59 murid dari dua SMA Negeri di Sleman, Yogyakarta yang ditentukan dengan teknik sampling purposive. Instrumen yang digunakan adalah angket, panduan observasi, panduan wawancara, dan dokumentasi. Angket digunakan untuk mengetahui dan mengukur perencanaan pembelajaran dan cara mengajar guru. Observasi dilakukan untuk pengecekan kesesuaian antara RPP dan silabus dengan kegiatan pembelajaran. Wawancara dan dokumentasi digunakan untuk memperdalam informasi. Validasi instrumen yang digunakan adalah validasi expert judgment, dan teknik triangulasi data digunakan untuk menganalisis data yang meliputi tahap reduksi data, penyajian data, dan penarikan kesimpulan. Hasil penelitian menunjukkan bahwa 1) pemahaman guru terhadap Kurikulum 2013 dalam kategori sangat cukup, ini dibktikan dari jawaban interviuw yang memuaskan; 2) perencanaan pelaksanaan pembelajaran di dalam kelas sudah sangat sesuai dan hal ini dapat terlihat dari rata-rata penilaian angket yang diberikan, yaitu 80,3; 3) dan pelaksanaan pembelajaran sangat sesuai dan hal ini dapat dilihat dari rata-rata penilaian angket siswa terhadap berlangsungnya proses pembelajaran yaitu 80,59.Kata kunci: evalusi pelaksanaan pembelajaran kurikulum 2013, seni tari THE EVALUATION OF CURRICULUM 2013 IMPLEMENTATION ON ART DANCE SUBJECT IN STATE SENIOR HIGH SCHOOLSIN SLEMAN YOGYAKARTAAbstract The objective of this research is to describe the evaluation of the implementation of Curriculum 2013 on the art dance subject in state senior high schools in Sleman, Yogyakarta. This research was evaluation research with qualitative descriptive approach. The evaluation model was a formative evaluation which was developed by Scriven. The subjects of this research were two teachers and 59 students of two states senior high schools in Sleman, Yogyakarta which were selected by using the random sampling technique. The instruments were a questionnaire, observation guide, interview guide, and documentation. The questionnaire was used to know and to measure the lesson plan and the procedure of the teaching and learning process. The observation guide was used to check the compatibility among lesson plans and syllabus with the teaching and learning process. The interview guide and documentation were used to deepen the information. The instrument validities used were expert judgment and triangulation. The triangulation was used to analyze the data, consisting of data reduction, presentation, and conclusion. The result of this research shows that 1) the teachers’ comprehension of Curriculum 2013 is defficient enough 2) the planning of the teaching and learning process is very suitable, which could be seen from the average result of the questionnaire which is 80,3; 3) the implementation of the teaching and learning process is very suitable. Which could be seen from the average of students’ questionnaire result of the teaching and learning process, which is 80,59.Keywords: development, method, sight reading, rhythmic


2021 ◽  
Vol 7 (2) ◽  
pp. 120-129
Author(s):  
Bambang Afriadi ◽  
Agus Dudung

The purpose of this study is to describe the Program Practice Skills Teaching (PKM/ Praktik Keterampilan Mengajar)  in semester 106, at the Educational Development Institute State University of Jakarta. The evaluation model used in this study is a formative and summative evaluation model developed by Michele Shriven. Formative evaluation is carried out during the program to provide information to the program leader as program improvement materials. While the summative evaluation is done at the end of the program. This research use evaluation analysis with qualitative and quantitative approach. How to collect data on this evaluation research is using techniques observation, questionnaires, interviews, and documentation. The results showed that in the formative evaluation, it can be seen that in general the process of Program PKM was by existing guidelines. So can be maintained the existence of the PKM Program. While the results of the summative evaluation showed that the PKM Program, in the high category, is based on the value of the minimum PKM Program participants B provided by the teacher mentor and lecturer mentor of the final exam.


1985 ◽  
Vol 4 (2) ◽  
pp. 57-71
Author(s):  
Céline Mercier

Following the current literature, alternative resources for the mentally ill have already demonstrated their efficiency. However, the question remains of their role and specificity within the general service network in the field of mental health, especially when looking at their development and financial support. Social research, especially evaluation research, can contribute an answer to these questions concerning the organization of the service delivery system. This paper focuses on various evaluation approaches (systemic model, course of implementation and formative evaluation) of alternative resources and expectancies towards research.


Sign in / Sign up

Export Citation Format

Share Document