scholarly journals MODEL EVALUASI PRAKTIKUM KIMIA DI LEMBAGA PENDIDIKAN TENAGA KEPENDIDIKAN

2013 ◽  
Vol 16 (1) ◽  
pp. 234-248 ◽  
Author(s):  
Endang Susilanigsih
Keyword(s):  
Program Evaluation ◽  
Performance Evaluation ◽  
Student Performance ◽  
Goodness Of Fit ◽  
Evaluation Model ◽  
Laboratory Work ◽  
Evaluation Instrument ◽  
Technology And Society ◽  
Generalizability Coefficient ◽  
Fit Index

Penelitian ini bertujuan untuk memperoleh model evaluasi program yang teruji, untuk mengevaluasi kualitas praktikum kimia. Pengembangan model evaluasi program terdiri atas empat variabel sebagai komponen model yaitu: (1) environmemt context yang dieksplanasi menjadi environment, laboratory work, technology and society; (2) evaluasi Input; (3) evaluasi process; dan (4) evaluasi result yang disesuaikan dengan praktikum kimia analisis dasar. Penetapan konstruk instrumen terdiri atas instrumen penilaian model dan instrumen penilaian kinerja mahasiswa dilakukan melalui pendapat: (1) pakar evaluasi; (2) pakar psikometri, dan (3) praktisi laboratorium. Subjek coba penelitian ini terdiri atas mahasiswa dan praktisi. Uji model evaluasi program dilakukan dengan uji: (1) utility; (2) feasibility; (3) proprietly; dan (4)  accuracy. Uji kecocokan model untuk mengetahui reliability komponen program dan goodness of fit index menggunakan program Lisrel. Hasil pe-nelitian  menunjukkan bahwa evaluasi program yang dikembangkan diberi nama model ECIPR sudah teruji memenuhi kriteria: (1)  utility; (2)  feasibili-ty; (3) proprietly; dan (4)  accuracy  reliability untuk komponen Environment context =0,8649, input=0,8429, process=0,7828, result=0,9560. Goodness of fit index: p = 0,107 RMSEA=0,051, GFI=0,910. Dampak implentasi model yang dikembangkan terbukti dapat meningkatkan kinerja mahasiswa, keterampilan dan pengalaman laboratorium mahasiswa sebagai sasaran program.Kata kunci: model evaluasi program, praktikum kimia, keterampilan laboratorium______________________________________________________________ THE EVALUATION MODEL OF THE CHEMISTRY PRACTICUM IN TEACHER EDUCATION INSTITUTIONSAbstract This study aims to produce a program evaluation model which is valid to evaluate the quality of chemistry practicum. The program evaluation model consists of four variables as model components,i.e:(1) the context environment which is elaborated into environment, laboratory work, technology, and society; (2) the input evaluation; (3) the process evaluation; and (4) the result evaluation adjusted to basic analytic chemistry practicum.The establishment of the instrument constructs, consisting of a model evaluation instrument and a student performance evaluation instrument, was based on the opinions of (1) evaluation experts, (2) psychometrics experts, and (3) laboratory practitioners. The subjects for tryout in this research consisted of students and practitioners. The test of the program evaluation model was carried out on the basis of: (1) utility, (2) feasibility, (3) propriety, and (4) accuracy. The model fit test to find out the  reliability of the program components and the goodness of fit index used the LISREL program package. The calculation of the reliability coefficient of the instrument for the laboratory performance evaluation used the SPSS program based on the Generalizability coefficient model developed by Thorndike. The components of the variance were the person, rater, item, interactions of the person and rater, the person and item, the rater and item, and the interaction of the person, rater and item.The results of the study show that the ECIPR program evaluation model is valid and satisfies the criteria for: (1) utility, (2) feasibility, (3) propriety, and (4) accuracy. The  indicator reliability of the component of environment context is 0.8649, that of the input is 0.8429, that of the process is 0.7828, and that of the result is 0.9560. The goodness of fit index is indicated by p = 0.107, RMSEA = 0.051, and GFI = 0.910. The generalizability coefficient of the qualitative analytic instrument is 0.8726 and that of the quantitative analytic instrument is 0.9384. The implementation of the ECIPR model has been proved capable of improving the students’ performances, which have effects on the improvement of their laboratory skills and experiences as the program target.Keywords: program evaluation model, chemistry practicum, laboratory skills

A validation of the performance management scale

2018 ◽  
Vol 35 (6) ◽  
pp. 1253-1267 ◽  
Author(s):  
Khahan Na-nan ◽  
Kanokporn Chaiprasit ◽  
Peerapong Pukkeeree
Keyword(s):  
Factor Analysis ◽  
Performance Evaluation ◽  
Performance Management ◽  
Goodness Of Fit ◽  
Mean Square ◽  
Evaluation Performance ◽  
Content Type ◽  
Performance Review ◽  
And Performance ◽  
Fit Index

Purpose The purpose of this paper is to develop a performance management (PM) scale questionnaire that encompasses the pre-requisite, performance planning, performance evaluation, performance review, and performance application dimensions of PM. Design/methodology/approach In the study, the 33 questionnaire questions were first validated using exploratory factor analysis (EFA) and then by confirmatory factor analysis (CFA) along the three performance dimensions. The research sample consists of 330 entrepreneurs. The factor analysis results confirm the validity of the questionnaire as a reliable entrepreneur PM evaluation tool, as evidenced by the composite reliability of 0.845 and the average variance extracted of 0.532. Findings All constructs revealed the acceptable internal consistency reliability. A good model fit was found for the measurement model using several fit index like χ2=449.983, degree of freedom=415, p-value (p)=0.114, goodness of fit index=0.927, adjusted goodness of fit index=0.901, root mean square error of approximation=0.016, and root of mean square residuals=0.032. Research limitations/implications The PM model was examined using EFA and CFA only. A sample with only SMEs entrepreneurs and large sample size and sample area can be used in future research. Practical implications This research paper is an endeavor to explore only the reliability and validity of the PM model. Thus all the five dimension, namely “pre-requisite” “performance planning,” “performance evaluation,” “performance review,” and “performance application” proved out of be reliable and validated when it will be tested in case of SMEs’ high-growth sectors and high-impact sectors. Originality/value The main contribution of this research is that all factors have a good fit and acceptable reliability value; each factor can be measured individually depending on the nature of the research.

scholarly journals Validitas konstrak instrumen evaluasi outcome lembaga pendidikan guru vokasional

2016 ◽  
Vol 20 (2) ◽  
pp. 221-233 ◽  
Author(s):  
Nurhening Yuniarti ◽  
Soenarto Soenarto
Keyword(s):  
Teacher Education ◽  
Construct Validity ◽  
Root Mean Square ◽  
Goodness Of Fit ◽  
Outcome Evaluation ◽  
P Value ◽  
Mean Square ◽  
Evaluation Instrument ◽  
Vocational Teacher ◽  
Fit Index

Penelitian ini bertujuan untuk mendapatkan bukti validitas konstrak dari instrumen yang digunakan untuk kegiatan evaluasi outcome dari lembaga pendidikan guru vokasional. Instrumen ini terdiri atas 3 jenis instrumen. Teknik analisis data yang digunakan adalah confirmatory factor analysis (CFA). Kriteria yang digunakan untuk melihat kecocokan model adalah: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), dan CFI (Comparative Fit Index). Bukti validitas instrumen dapat dilihat pada besarnya faktor loading dan t-value.  Jika loading factor lebih besar dari 0,3 dengan t-valuelebih besar dari 1,96 maka butir pernyataan dapat dikategorikan valid. Berdasarkan hasil analisis diperoleh hasil: (1) pada instrumen I terdapat 26 butir yang dinyatakan valid; (2) pada instrumen II terdapat 23 butir yang dinyatakan valid; dan (3) pada instrumen III terdapat 18 butir yang dinyatakan valid.Kata kunci: validitas konstrak, evaluasi, lembaga pendidikan guru vokasional CONSTRUCT VALIDITY OF OUTCOME EVALUATION INSTRUMENT IN VOCATIONAL TEACHER EDUCATION INSTITUTIONAbstractThis research aims to get the construct validity evidence of the outcome evaluation instrument of vocational teacher education institution. The instrument consists of 3 kinds of instruments. The analysis technique that is used to test the construct validity is confirmatory factor analysis (CFA). The criteria used to determine the goodness of fit were: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), and CFI (Comparative Fit Index). The evidence of the construct validity was based on the standardized loading factor and t-value. If the loading factor > 0.3 with t-value > 1.96, the item is valid. Based on the analysis, the research results are: (1) 26 item of the instrument I are categorized valid; (2) 23 items of instrument II are categorized valid; and (3) 18 items of instrument III are categorized valid.Keywords: construct validity, evaluation, vocational teacher education institution

scholarly journals PENGEMBANGAN INSTRUMEN ASESMEN KEBUTUHAN PERKEMBANGAN UNTUK PENYUSUNAN KURIKULUM DAN EVALUASI PROGRAM BK

2013 ◽  
Vol 15 (1) ◽  
pp. 22-46
Author(s):  
Gendon Barus
Keyword(s):  
Elementary School ◽  
Program Evaluation ◽  
Needs Assessment ◽  
Goodness Of Fit ◽  
Measurement Model ◽  
Assessment Instrument ◽  
Guidance And Counseling ◽  
Evaluation Instrument ◽  
Developmental Needs ◽  
Guidance Curriculum

Penelitian pengembangan ini bertujuan menghasilkan instrumen asesmen kebutuhan peserta didik, disebut Invantori Kebutuhan Perkembangan Murid (IKPM). Penelitian mengikuti model Plomp (1999) dengan lima fase. Reliabilitas instrumen diestimasi dengan teknik Alpha Cronbach, validitas isi diperiksa oleh pakar dan telaah praktisi melalui FGD. Validitas empirik dan kecocokan model pengukuran dibuktikan dengan analisis faktor konfirmatori (CFA) dengan program Lisrel 8.30. Telaah praktisi melibatkan 60 orang guru kelas V dan VI SD dalam dua tahap FGD, sedangkan uji coba empirik dan implementasi melibatkan murid kelas V dan VI. Hasil penelitian pengembang-an ini adalah: 1) IKPM dapat digunakan untuk menghimpun data kebutuhan perkembangan sebagai dasar penyusunan kurikulum bimbingan dan melaksanakan evaluasi program, bimbingan dan alat ukur evaluasi program bimbingan klasikal di sekolah dasar dan 2) teridentifikasi butir-butir kebutuhan per-kembangan murid yang intens dan sangat intens untuk dipenuhi melalui layanan bimbingan klasikal.Kata kunci: instrumen asesmen kebutuhan, kurikulum bimbingan, instrument evaluasi program BK ______________________________________________________________DEVELOPMENT OF DEVELOPMENTAL NEEDS ASSESSMENT INSTRUMENT FOR CURRICULUM ARRANGEMENT AND EVALUATION OF BK PROGRAM Abstract The goal of this research is to produce a developmental needs assessment instrument, called Student’s Developmental Needs Inventory, which can be use to reveal the needs of students in elementary school. The research method follows the model of Research and Development (R & D) by Plomp (1999) with five phases. The instrument which is developed in this study guidance and counseling (Bimbingan Konseling, BK) in elementary school. Instrument reliability is estimated using by Alpha Cronbach technique, it content validity is checked by experts judgment and practitioner’s assessment with FGD technique. Furthermore, empirical validity and the goodness of fit measurement model was measured with Confirmatory Factor Analysis (CFA) through the application of Lisrel 8.30 program. However, try out of test and implementation involves students of grade five and six elementary schools. The results of this research: (1) the instrument can be used to gathering data of developmental needs as based of guidance curriculum arrangement and to conduct program evaluation in elementary school, and (2) there are several items of student’s developmental needs that needs to be fullfiled through classical guidance services.Key words: needs assessment instrument, guidance curriculum, program evaluation instrument of guidance and counseling

scholarly journals PENGEMBANGAN INSTRUMEN EVALUASI CIPP PADA PROGRAM PEMBELAJARAN TAHFIZ AL-QUR’AN DI PONDOK PESANTREN

2014 ◽  
Vol 18 (2) ◽  
pp. 215-233
Author(s):  
Muyasaroh Muyasaroh ◽  
Sutrisno Sutrisno
Keyword(s):  
Root Mean Square Error ◽  
Mean Square Error ◽  
Root Mean Square ◽  
Goodness Of Fit ◽  
Evaluation Model ◽  
Mean Square ◽  
Learning Program ◽  
Chi Square ◽  
Cronbach Alpha ◽  
Fit Index

Studi ini bertujuan untuk: (1) menghasilkan model pengembangan evaluasi program pembelajar’an tahfiẓ al-Quran diberi nama Coni P2, (2) menghasilkan teknik pelaksanaan evaluasi program pembelajaran tahfiẓ al-Qur’an, dan (3) menghasilkan struktur komponen dan indikator model evaluasi. Studi ini merupakan penelitian dan pengembangan (R&D) dengan menggunakan sembilan langkah dari 10 langkah model Borg dan Gall. Jumlah subjek uji coba pertama 33 orang, uji coba kedua 49 orang, dan uji coba ketiga 224 orang. Komponen model evaluasi yang digunakan adalah model evaluasi Stufflebeam (CIPP). Langkah-langkah evaluasi yang digunakan adalah langkah Malcolm Provus. Teknik pengumpul data yang digunakan adalah Delphi, FGD, kuesioner, observasi, wawancara, dan studi dokumentasi. Validitas konstruk dianalisis menggunakan CFA dan Reliabilitas menggunakan Cronbach Alpha. Hasil penelitian: (1) model evaluasi program Coni P2 dikembangkan dengan cara kajian teori, temuan di lapangan, Delphi, FGD, uji coba sebanyak tiga kali; (2) evaluasi di tiga pondok pesantren: Al-Ittifaqiah, Raudhatul Ulum, dan Raudhatul Qur’an ditemukan kesenjangan sarana belajar, kinerja guru, dan motivasi belajar santri; (3) komponen konstruk model evaluasi Coni P2 terdiri atas konteks, input, proses, dan produk, yang terbagi menjadi 13 indikator. Hasil analisis CFA: (1) Chi Square (χ²) = kecil; (2) ρ-value > 0,05; (3) Root Mean Square Error of Approximation (RMSEA) < 0,08; dan (4) Goodness of Fit Index (GFI) < 0,90.Kata kunci: pengembangan, evaluasi, tahfiẓ al-Qur’an______________________________________________________________ DEVELOPING CIPP EVALUATION INSTRUMENT FOR TAHFIZ AL-QUR’AN IN PONDOK PESANTRENAbstract The study aimed to: (1) generate an evaluation development  model of tahfiz Al-Qur’an learning program entitled Coni P2; (2) generate a technique of tahfiz Al-Qur’an learning program evaluation implementation; and (3) generate component structures and an indicators of evaluation model. The study was a research and development (R&D) type by implementing 9 of 10 steps in Borg and Gall’s model. The subject for the first trial the 33 people, for the second trial were 49 people, and for the third trial were 224 people. The implemented component of evaluation model was Stufflebeam Evaluation Model (CIPP). The evaluation steps that the researchers implemented were the ones taken from Malcolm Provus. The data gathering techniques that the researchers implemented were Delphi, FGD, questionnaires, observation, interview and study of documentation. The construct validity was analyzed by implementing CFA and the construct reliability was analyzed by implementing Cronbach Alpha. The results of the research were as follows: (1) the model of Coni P2 evaluation program was developed by implementing theoretical review, field findings, Delphi, FGD and three-time experiments; (2) from the evaluations performed in three pondok pesantren, namely Al-Ittifaqiah, Raudhatul Ulum and Raudhatul Qur’an, the researchers found discrepancy in learning facilities, teacher performance and santri’s learning motivation; and (3) the construct components of Coni P2 evaluation model consisted of context, input, process and product that were divided into 13 indicators. The results of CFA analysis were as follows: (1) (1) Chi Square (χ²) = kecil; (2) ρ-value > 0.05; (3) Root Mean Square Error of Approximation (RMSEA) < 0.08; dan (4) Goodness of Fit Index (GFI) < 0.90.Keywords: development, evaluation, tahfiz Al-Qur’an

Program Evaluation Model: Training Future School Counselors Through Community Partnership

2019 ◽  
Vol 22 (1b) ◽  
pp. 2156759X1983443
Author(s):  
Robin Hausheer
Keyword(s):  
Program Evaluation ◽  
School Counselors ◽  
Selection Process ◽  
Evaluation Model ◽  
Research Question ◽  
Counseling Students ◽  
Future Research ◽  
Evaluation Instrument ◽  
Instrument Selection ◽  
Model Training

This article presents an in-depth model to train school counseling students in program evaluation. Steps outlined in the model include partnering with a local nonprofit organization, conducting a literature review, developing a research question and hypothesis, detailing the evaluation instrument selection process, and outlining the program evaluation presentation. I provide an example of the model in action to illustrate each step and discuss benefits of model implementation and implications for school counselors, counselor educators, and future research.

scholarly journals Weighting of items in a tutorial performance evaluation instrument: Statistical analysis and results

2009 ◽  
Vol 14 (1) ◽  
Author(s):  
Melanie L. Lack ◽  
Judith C. Bruce ◽  
Piet J. Becker
Keyword(s):  
Performance Evaluation ◽  
Statistical Analysis ◽  
Nursing Students ◽  
Student Performance ◽  
Rating Scale ◽  
Pairwise Comparison ◽  
Learning Performance ◽  
Evaluation Instrument ◽  
Subjective Judgement ◽  
Efficient Calculation

Weighting of items in an evaluation instrument contributes to more meaningful and valid interpretations of student performance in respect of each learning outcome or item being assessed. It follows that the validity of instruments is important for meaningful inferences about students’ learning performance, including their performance in tutorial groups. The Delphi technique was used to elicit experts’ subjective judgement of the content validity of items in the tutorial performance evaluation instrument in rounds one and two. A sample of eight experts (n = 8) was selected by purposive, maximum variation sampling.In round three Delphi a weighted score was determined for each of the instrument items, subitems and Likert scale points through pairwise comparison by the experts. Mathematical modelling of experts’ weighting comparisons, recorded on visual analogue scales, resulted in proportional weights for each item; these weights are expressed as a percentage.The final instrument comprised weighted items measured on a rating scale with points that are not equidistant. A computerised tutorial performance evaluator (TPE) was developed for accurate, economical and efficient calculation of student scores. The purpose of this article is to report on the statistical analysis and results of the weighting of items in an instrument to assess and evaluate baccalaureate nursing students’ performance in problem-based learning tutorials.OpsommingDie waardebepaling van items in ‘n evalueringsinstrument dra by tot ‘n meer betekenisvolle en geldige interpretasie van studente se vermoë ten opsigte van elke leeruitkoms of item wat geassesseer word. Hieruit volg dit dat die geldigheid van instrumente belangrik is vir betekenisvolleafleidings betreffende studente se leervermoë, insluitend hulle prestasie in leergroepe. Die Delphi-tegniek is gebruik in rondtes een en twee om kundiges se subjektiewe oordeel oor die inhoudsgeldigheid van items in die leergroepgedragsevalueringsinstrument te bekom. ‘n Steekproef van agt kundiges (n = 8) is deur doelgerigte, maksimale-variasiesteekproeftrekking gekies.Die kundiges het in rondte drie van die Delphi-tegniektoepassing deur middel van gepaarde vergelyking ‘n waarde bepaal vir elk van die instrumentitems, sub-items en Likertskaalpunte. Die wiskundige modellering van kundiges se waardebepalingsvergelykings, aangeteken op visuele analogiese skale, het proporsionele gewigte vir elke item tot gevolg gehad. Hierdie gewigte word persentasiegewys voorgestel. Die finale instrument het bestaan uit items wat gemeet word teen ‘n graderingskaal met punte wat nie op ‘n gelyke afstand van mekaar is nie. ‘n Rekenaargebaseerde leergroepgedragsevalueringsinstrument is ontwikkel vir die akkurate, ekonomiese en doeltreffende berekening van studente se punte.Die doel van die artikel is om verslag te lewer oor die statistiese analise en resultate van die waardebepaling van items in ‘n instrument om baccalaureate-verpleegkundestudente se prestasie in probleemgebaseerde leergroepe te meet en te evalueer.

Factor analysis-validated comprehensive employee job performance scale

2018 ◽  
Vol 35 (10) ◽  
pp. 2436-2449 ◽  
Author(s):  
Khahan Na-Nan ◽  
Kanokporn Chaiprasit ◽  
Peerapong Pukkeeree
Keyword(s):  
Factor Analysis ◽  
Performance Evaluation ◽  
Job Performance ◽  
Goodness Of Fit ◽  
Employee Performance ◽  
Job Quality ◽  
Evaluation Tool ◽  
Content Type ◽  
Average Variance ◽  
Fit Index

Purpose The purpose of this paper is to develop an employee job performance (EJP) scale questionnaire that encompasses the job time, job quality and job quantity dimensions of employee performance. Design/methodology/approach In this study, the questionnaire questions were first validated using exploratory factor analysis (EFA) and then confirmatory factor analysis (CFA) along the three performance dimensions. The research samples were auto-parts assembly line workers. The factor analysis results confirmed the validity of the questionnaire as a reliable employee performance evaluation tool, as evidenced by the composite reliability (CR) and the average variance extracted (AVE). Findings The questionnaire questions identified three factors of EJP, namely, job time, job quality and job quantity, with 13 items. The factor analysis results confirmed the validity of the questionnaire as a reliable employee performance evaluation tool, as evidenced by a CR of 0.894 and AVE of 0.739, in addition to χ2=63.340, df=54, p=0.180, goodness of fit index=0.976, adjusted goodness of fit index=0.960, RMSEA=0.021 and root mean square residue=0.014. Research limitations/implications The EJP scale questionnaire was examined using only EFA and CFA. These scales are expected to help academics, researchers and practitioners test theories. Because of the features of the sample, the final results should be considered carefully. Practical implications Importantly, the factor analysis results suggest that the proposed EJP scale questionnaire can be applied to various industries and settings either as is or with minimal modifications. Originality/value The EJP questionnaire is novel and can serve as an excellent EJP tool to measure employees’ behavioral output. The questionnaire can provide empirical data on employee performance output based on the employee’s perspective.

Sign in / Sign up

Export Citation Format

Share Document