scholarly journals From randomized control trial to mixed methods: A practical framework for program evaluation based on methodological quality

2021 ◽  
Vol 37 (3) ◽  
pp. 599-608
Author(s):  
Salvador Chacón-Moscoso ◽  
Susana Sanduvete-Chaves ◽  
José A. Lozano-Lozano ◽  
Mariona Portell ◽  
M. Teresa Anguera
Keyword(s):  
Program Evaluation ◽  
Methodological Quality ◽  
Data Gathering ◽  
Original Plan ◽  
Measurement And Analysis ◽  
Structural Dimensions ◽  
Intervention Context ◽  
Quasi Experimental ◽  
Implementation Context ◽  
Randomized Control

La evidencia utilizada al tomar decisiones sobre el diseño, implementación y evaluación en los programas de intervención debe ser metodológicamente sólida. Dependiendo del contexto de la intervención, se pueden aplicar diferentes metodologías. Sin embargo, el contexto de la intervención es a menudo inestable y, para adaptarse a las circunstancias cambiantes, se hace necesario modificar el plan original. El marco propuesto en este documento se basa en enfoques que pueden considerarse dos extremos de un continuo (diseños experimentales / cuasiexperimentales y estudios basados en metodología observacional). En condiciones de contexto de intervención inestable, esto permite tomar decisiones desde un enfoque de calidad metodológica en cuanto a diseño, medición y análisis. Las dimensiones estructurales, i.e., las unidades (participantes, usuarios), el tratamiento (actividades del programa), los resultados (incluidas las decisiones sobre los instrumentos a utilizar y la recopilación de datos), el entorno (contexto de implementación) y el tiempo se detallarán como parte del marco práctico. El presente estudio tiene como objetivo especificar el grado de correspondencia / complementariedad entre componentes en estas dimensiones estructurales de la evaluación de un programa desde una perspectiva de complementariedad práctica basada en la calidad metodológica. The evidence used when making decisions about the design, implementation and evaluation in intervention programs should be methodologically sound. Depending on the context of the intervention, different methodologies may apply. Nonetheless, the intervention context is often unstable and, to adapt to changing circumstances, it sometimes becomes necessary to modify the original plan. The framework proposed herein draws on approaches that can be considered two extremes of a continuum (experimental/quasi-experimental designs and studies based on observational methodology). In unstable intervention context conditions, this enables decisions from a methodological quality approach regarding design, measurement, and analysis. Structural dimensions, i.e., units (participants, users), treatment (program activities), outcomes (results, including decisions about the instruments to use and data gathering), setting (implementation context) and time will be detailed as part of the practical framework. The present study aims to specify the degree of correspondence/complementarity between components in these structural dimensions of a program evaluation from a practical complementarity perspective based on methodological quality.

scholarly journals Effectiveness of Blending Learning Approach (BLA) on Graduate Students’ Learning Outcomes

2021 ◽  
Vol 3 (3) ◽  
pp. p23
Author(s):  
Emolyn M. Iringan
Keyword(s):  
Intrinsic Motivation ◽  
Data Gathering ◽  
Control Group ◽  
Learning Approach ◽  
Motivation To Learn ◽  
School Students ◽  
Project Completion ◽  
Instructional Mode ◽  
Quasi Experimental ◽  
Experimental Group

This quasi-experimental study aimed to assess the effectiveness of the Blended Learning Approach on graduate school students’ intrinsic motivation to learn, achievement, efficiency on project completion, and attitude towards coursework. The study used two groups, the control and experimental group which covered 30 students for each group. Students in the control group were exposed to the face-to-face instructional mode while the experimental group was exposed to the blended mode of instruction. Survey questionnaires, achievement tests, and documentary analyses were the data-gathering modalities that were utilized. The data were treated using mean, scales, and t-test. Results show that the BLA enhanced students’ intrinsic motivation to learn, efficiency in project completion, and achievement in the course, however, yielded no significant effect on their attitude toward their coursework.

scholarly journals PENGARUH PELATIHAN STAR RUN TERHADAP KECEPATAN DAN KELINCAHAN

2018 ◽  
Vol 6 (3) ◽  
Author(s):  
I Kadek Anom Sanjaya ◽  
I Ketut Yoda ◽  
I Nyoman Sudarmada
Keyword(s):  
Experimental Design ◽  
T Test ◽  
Control Group ◽  
Significance Level ◽  
Quasi Experimental ◽  
Randomized Control ◽  
Run Speed ◽  
Study Student

Penelitian ini bertujuan untuk mengetahui pengaruh pelatihan star run terhadap peningkatan kecepatan dan kelincahan pada siswa pesetra ekstrakurikuler sepakbola SMP Negeri 2 Pupuan tahun 2016. Jenis penelitian adalah eksperimen semu dengan rancangan “The non-randomized control group pretest posttest design”. Subyek penelitian ini siswa peserta ekstrakurikuler sepakbola SMP Negeri 2 Pupuan dengan jumlah 38 orang. Instrumen yang digunakan tes lari cepat (sprint) dengan jarak 50 meter untuk kecepatan dan Illinois agility run untuk kelincahan. Data dianalisis dengan uji-t independent pada taraf signifikansi () 0,05 dengan bantuan program SPSS 16.0. Berdasarkan hasil analisis data dengan menggunakan uji-t independent untuk kecepatan diperoleh nilai signifikansi (0,000) dan untuk kelincahan diperoleh nilai signifikansi (0,000) semua data lebih kecil dari nilai α (Sig < 0,05). Dapat disimpulkan bahwa pelatihan star run berpengaruh signifikan terhadap peningkatan kecepatan dan kelincahan pada siswa peserta ekstrakurikuler sepakbola SMP Negeri 2 Pupuan tahun pelajaran 2016/2017. Bagi para pelaku olahraga, disarankan untuk menggunakan pelatihan star run sebagai salah satu alternatif untuk meningkatkan kebugaran jsmani khususnya kecepatan dan kelincahan. Kata Kunci : pelatihan, star run, kecepatan, kelincahan This study aims to determine the influence of star training run against the increased speed and agility on the soccer extracurricular pesetra students SMP Negeri 2 Pupuan 2016. The study was a quasi-experimental design with "The non-randomized control group pretest posttest design". The subjects of this study student extracurricular participants soccer SMP Negeri 2 Pupuan by the number 38. The instruments used to run tests quickly (sprint) with a distance of 50 meters for speed and agility run for the Illinois agility. Data were analyzed by independent t-test at the significance level () 0.05 with SPSS 16.0. Based on the analysis of data using independent t-test for speed significance value (0,000) and for agility significance value (0.000) all data is smaller than the value α (Sig keyword : training, star run, speed, agility

scholarly journals Evaluating Rank-Coherence of Crowd Rating in Customer Satisfaction

2020 ◽  
Author(s):  
Venera Tomaselli ◽  
Giulio Giacomo Cantone
Keyword(s):  
Customer Satisfaction ◽  
Ad Hoc ◽  
Data Gathering ◽  
Social Contexts ◽  
Public Utility ◽  
Public Disclosure ◽  
Measurement And Analysis ◽  
Method Of Measurement ◽  
Weighted Measure ◽  
Rating Information

AbstractCrowd rating is a continuous and public process of data gathering that allows the display of general quantitative opinions on a topic from online anonymous networks as they are crowds. Online platforms leveraged these technologies to improve predictive tasks in marketing. However, we argue for a different employment of crowd rating as a tool of public utility to support social contexts suffering to adverse selection, like tourism. This aim needs to deal with issues in both method of measurement and analysis of data, and with common biases associated to public disclosure of rating information. We propose an evaluative method to investigate fairness of common measures of rating procedures with the peculiar perspective of assessing linearity of the ranked outcomes. This is tested on a longitudinal observational case of 7 years of customer satisfaction ratings, for a total amount of 26.888 reviews. According to the results obtained from the sampled dataset, analysed with the proposed evaluative method, there is a trade-off between loss of (potentially) biased information on ratings and fairness of the resulting rankings. However, computing an ad hoc unbiased ranking case, the ranking outcome through the time-weighted measure is not significantly different from the ad hoc unbiased case.

scholarly journals A Systematic Review of the Selected Evidences on the Effectiveness of Inter-professional Education (IPE) in Developing Interprofessional Learning Environment

2015 ◽  
Vol 5 (2) ◽  
pp. 76
Author(s):  
Said Nasser Al Harthy ◽  
Najla Al Subhi ◽  
Cyruz Tuppal ◽  
Mark Donald Reñosa
Keyword(s):  
Systematic Review ◽  
Learning Environment ◽  
Professional Education ◽  
Methodological Quality ◽  
The Other ◽  
Interprofessional Learning ◽  
Before And After ◽  
Quasi Experimental ◽  
Larger Sample ◽  
Before And After Study

Purpose: This systematic review aimed to provide available evidence in determining for the effectiveness of IPE as a modality in developing interprofessional learning environment for healthcare students.Methods: The computerized searches from 2009-2015 in ten electronic databases were performed. Two independent reviewers were consulted to assess the eligibility, level of evidences and methodological quality in each study. Result: nine out of ten studies were retrieved. These studies include (a) two RCT studies; scored eight and seven out of eight, (b) Three quasi-experimental pretestposttest design; scored seven, six, and six out of eight, (c) Three controlled before and after study; scored six, six, five and five out of eight, and (d) one controlled longitudinal; scored six out of eight respectively.Conclusion: Based on the systematic review, evidence showed that IPE was effective in building strong interprofessional learning environment. On the other hand, the authors recommend considering conduct of similar systematic review grounded on IPE with larger sample size within the health allied discipline.

scholarly journals PENGARUH PENERAPAN PEMBELAJARAN AKTIF TIPE HOLLYWOOD SQUARES MENGGUNAKAN LKS TERHADAP HASIL BELAJAR GEOGRAFI SISWA KELAS XI IPS SMAN I SUTERA KABUPATEN PESISIR SELATAN

JURNAL BUANA ◽  
2017 ◽  
Vol 1 (1) ◽  
pp. 36
Author(s):  
Fitri Rahmadani ◽  
Syafri Anwar ◽  
Nofrion Dion
Keyword(s):  
Active Learning ◽  
Learning Outcomes ◽  
Sampling Technique ◽  
Cognitive Domain ◽  
Average Value ◽  
Quasi Experimental ◽  
Randomized Control ◽  
Academic Year ◽  
Equality Test ◽  
Cluster Random Sampling

The purpose of the research to determine the effect of the application of active learning type of Hollywood Squares using LKS to the results of learning geography students class XI IPS SMAN 1 Sutera Pesisir Selatan Regency. The hypothesis in this study is "There is a significant influence on the application of active learning of the type of Hollywood Squares using LKS to the students' geography result of grade XI SMAN 1 Sutera Pesisir Selatan Regency". This type of research is quasi-experimental, with randomized control only design. The population in this study were students of class XI IPS SMAN 1 Sutera Pesisir Selatan Regency enrolled in the 2016/2017 academic year, selected sample using cluster random sampling technique, which selected XI IPS2 class as control class and class XI IPS1 as experiment class. To test the hypothesis used two equality test (t) at the 0.05 level.The result of the data analysis shows that the experimental class has an average value of cognitive domain of 81.25 while the control class has a mean of cognitive domain of 73.88. The calculation of the cognitive sphere t obtained (95) (62) is 1.66. Thus the hypothesis presented earlier can be accepted at 95% confidence level. Based on this it can be concluded that the application of active learning type Hollywood Squares using LKS can improve learning outcomes geography class XI IPS SMAN 1 Sutera Pesisir Selatan Regency.

scholarly journals Alternatives to Randomized Control Trials: A Review of Three Quasi-experimental Designs for Causal Inference

2015 ◽  
Vol 29 (119) ◽  
pp. 19 ◽  
Author(s):  
Brittany Gorrall ◽  
Jacob Curtis ◽  
Todd Little ◽  
Pavel Panko
Keyword(s):  
Causal Inference ◽  
Experimental Designs ◽  
Randomized Control Trials ◽  
Quasi Experimental ◽  
Randomized Control

<p><span>Los diseños de Pruebas Controladas Aleatorizadas (PCA) son típicamente vistas como el mejor diseño en la investigación en psicología. Como tal, no es siempre posible cumplir con las especificaciones de las PCA y por ello muchos estudios son realizados en un marco cuasi experimental. Aunque los diseños cuasi experimentales son considerados menos convenientes que los diseños PCA, con directrices estos pueden producir inferencias igualmente válidas. En este artículo presentamos tres diseños cuasi experimentales que son formas alternativas a los diseños PCA. Estos diseños son Regresión de Punto de Desplazamiento (RPD), Regresión Discontinua (RD), Pareamiento por Puntaje de Propensión (PPP). Adicionalmente, describimos varias mejorías metodológicas para usar con este tipo de diseños. </span></p>

scholarly journals Efektivitas Model Pembelajaran 3CM (Cool-Critical-Creative-Meaningfull) terhadap Kemampuan Berpikir Kritis Siswa SMP

2021 ◽  
Vol 10 (2) ◽  
pp. 213-224
Author(s):  
Titania Mega Rizti ◽  
Erlina Prihatnani
Keyword(s):  
Critical Thinking ◽  
Thinking Skills ◽  
Learning Model ◽  
Critical Thinking Skills ◽  
Control Group ◽  
Critical Thinking Ability ◽  
Thinking Ability ◽  
Quasi Experimental ◽  
Study Population ◽  
Randomized Control

AbstrakPembelajaran matematika diharapkan dapat mengasah kemampuan berpikir kritis, meskipun pembelajaran secara daring. Penelitian bertujuan menerapkan salah satu model pembelajaran yang menekankan pada aspek berpikir kritis yaitu model 3CM (Cool-Critical-Creative-Meaningfull) pada materi bangun ruang sisi datar dan menganalisis dampaknya terhadap kemampuan berpikir kritis siswa. Populasi penelitian adalah seluruh siswa SMPN di Salatiga, sampelnya 82 siswa dari SMPN 1 Salatiga dan SMPN 6 Salatiga yang dibagi menjadi kelompok eksperimen 1 dan 2. Desain penelitian eksperimen semu ini adalah randomized control grup pretest-postest design. Instrumen tes berbentuk 7 soal uraian, terdiri dari pretest dan posttest dengan rubrik penilaian berdasarkan aspek Focus, Reason, Inference, Situation, Clarity, and Overview. Uji hipotesis menunjukkan penerapan model pembelajaran 3CM dengan dua jenis kegiatan creative yang berbeda yaitu berbasis project dan berbasis problems posing menghasilkan kemampuan berpikir kritis yang sama. Penerapan 3CM dimungkinkan untuk menggunakan dua jenis kegiatan tersebut dalam melakukan aspek creative guna mengasah kemampuan berpikir kritis siswa.  The Effectiveness of The 3 CM (Cool-Critical-Creative-Meaningful) Learning Model on The Critical Thinking Ability of SMP StudentsAbstractMathematics learning is expected to hone thinking skills, although learning must be done boldly. This study aims to apply a learning model that emphasizes the critical thinking aspect, namely the 3CM (Cool-Critical-Creative-Meaningful) model on the flat-sided building material, and analyze its impact on students' critical thinking skills. The study population was all students of SMPN in Salatiga, the sample was 82 students from SMPN 1 Salatiga and SMPN 6 Salatiga who were divided into experimental 1 and 2 groups. This quasi-experimental research design was a randomized control group pretest-posttest design. The test instrument is in the form of a description of 7 questions consisting of a pretest and posttest with a rubric based on aspects Focus, Reason, Inference, Situation, Clarity, and Overview. Hypothesis testing that the application of the 3CM learning model with different types of Creative (based on project and problems posing) activities results in the same critical thinking skills.

scholarly journals Development of English Writing Skills through Blended Learning among ESL Learners in Malaysia

2021 ◽  
Author(s):  
Isyaku Hassan ◽  
Ayuni Madarina Abdul Rahman ◽  
Mohd Nazri Latiff Azmi
Keyword(s):  
Blended Learning ◽  
Language Learning ◽  
Traditional Approach ◽  
Writing Skills ◽  
Data Gathering ◽  
Control Group ◽  
Esl Students ◽  
English Writing ◽  
Quasi Experimental ◽  
Esl Learners

Developing writing proficiency is complex as students need to master specific rules and acquire certain skills. This complexity often obstructs students’ interest and eventually affects their comprehension and performance in language learning. Research has highlighted the significance of English as a Second Language (ESL), particularly in the Malaysian context. This study, therefore, aims to evaluate the effectiveness of blended learning in developing English writing skills, particularly among ESL learners at a Polytechnic in Malaysia. The study adopted quasi-experimental analysis in which pre-test and post-test were used as data-gathering instruments. The data were gathered from a purposive sample of 60 ESL students separated into an experimental group and a control group. The data were analyzed using the Mann-Whitney U test via the Statistical Package for Social Sciences (SPSS). The findings showed that blended learning is significantly effective in developing writing performance among ESL students in the selected institution. Further analysis revealed a slight improvement among students who learned through the traditional approach. This study highlights useful findings that could be useful in designing English curriculums, particularly in higher institutions. However, this experiment focuses on students’ performance, further research may explore instructors’ practices in Malaysian higher intuitions.

scholarly journals Penerapan Model Pembelajaran Kooperatif Tipe Lottery Card (Kartu Arisan) untuk Meningkatkan Kemampuan Pemahaman Konsep Matematis Siswa Kelas X MAN Salido

2019 ◽  
Vol 2 (1) ◽  
Author(s):  
Rivdya Eliza ◽  
Riza Setia Eka Putri
Keyword(s):  
Experimental Research ◽  
Null Hypothesis ◽  
Alternative Hypothesis ◽  
Control Group ◽  
Normality Test ◽  
Sample Test ◽  
Quasi Experimental ◽  
Randomized Control ◽  
Academic Year ◽  
Learning Concept

The Aim of this research were to figure out the learning concept comprehension of students at class X at MAN Salidoin the academic year of 2016/2017 through Cooperative Studying Model Lottery Card Type (Arisan's Card). This was a quasi experimental research with Randomized Control Group OnlyDesign.The population of this research was of students at class X at MAN Salidoin the academic year of 2016/2017. Then, found that students as the experimental class and the control class. To get the class sample test done first then normality, its homogeneity and similarity in average for all classes of the population. After all the class known to normal, homogenous and have the same average then conducted the election of class sample randomly. Before testing the hypotheses, firstly applied the normality test and homogenety test to the sample. Then, tested the hypotheses by applying t-test formula. He got that test t (1,838) > tabel t (1,645) with 0,05 degree of freedom and with 95 % level of credence. Then he concluded that null hypothesis (H0) and the alternative hypothesis (H1) is accepted. So, the ability of the students in understanding Math Concept is higher through the Cooperative Studying Model Lottery Card Type (Arisan's Card) than the students taught through conventional learning.Keywords: Understanding on mathematic concept’s ability, learning model of cooperative (Lottery card).

Sign in / Sign up

Export Citation Format

Share Document