Conducting and Evaluating Multilevel Studies: Recommendations, Resources, and a Checklist

2022 ◽  
pp. 109442812110607
Author(s):  
Vicente González-Romá ◽  
Ana Hernández
Keyword(s):  
Multilevel Methods ◽  
Top Down ◽  
Empirical Base ◽  
Multilevel Studies ◽  
Level 1 ◽  
Level 2

Multilevel methods allow researchers to investigate relationships that expand across levels (e.g., individuals, teams, and organizations). The popularity of these methods for studying organizational phenomena has increased in recent decades. Methodologists have examined how these methods work under different conditions, providing an empirical base for making sound decisions when using these methods. In this article, we provide recommendations, tools, resources, and a checklist that can be useful for scholars involved in conducting or assessing multilevel studies. The focus of our article is on two-level designs, in which Level-1 entities are neatly nested within Level-2 entities, and top-down effects are estimated. However, some of our recommendations are also applicable to more complex multilevel designs.

ANALISIS KEMAMPUAN KOMUNIKASI MATEMATIS DALAM MENYELESAIKAN MASALAH STATISTIKA

2018 ◽  
Vol 5 (2) ◽  
pp. 7 ◽  
Author(s):  
Ahmad Aunur Rohman
Keyword(s):  
Level 1 ◽  
Level 2

Penelitian ini dimaksudkan untuk mengetahui bagaimana kemampuan komunikasi matematis mahasiswa terhadap pemahaman statistika. Data dalam penelitian ini berupa hasil pekerjaan tes tertulis tentang kemampuan komunikasi matematis dan wawancara terhadap subjek penelitian. Pengumpulan data diperoleh dengan tes dan wawancara. Uji keabsahan data yang digunakan adalah triangulasi. Data penelitan yang terkumpul dianalisis dengan analisis data non statistik yang terdiri dari tiga alur, yaitu reduksi data, penyajian data, dan penarikan kesimpulan/verifikasi data. Hasil penelitian menunjukkan bahwa 1) Terdapat 5 mahasiswa yang berada pada level 0 (sangat kurang baik); 2) 24 mahasiswa berada pada level 1 (kurang baik); 3) 6 mahasiswa berada pada level 2 (cukup baik); Penelitian ini diharapkan dapat memacu individu lain untuk melakukan penelitian yang lebih baik dan mendalam tentang kemampuan komunikasi matematis.

EVALUASI PELATIHAN DI PT. PUPUK KUJANG CIKAMPEK

2018 ◽  
Vol 3 (2) ◽  
Author(s):  
Lania Muharsih ◽  
Ratih Saraswati
Keyword(s):  
Training Evaluation ◽  
Work Productivity ◽  
Learning Behavior ◽  
Level 3 ◽  
Level 1 ◽  
Four Levels ◽  
A Company ◽  
Level 2 ◽  
Evaluation Sheet ◽  
Assessment Factor

This study aims to determine the training evaluation at PT. Kujang Fertilizer. PT. Pupuk Kujang is a company engaged in the field of petrochemicals. Evaluation sheet of PT. Fertilizer Kujang is made based on Kirkpatrick's theory which consists of four levels of evaluation, namely reaction, learning, behavior, and results. At level 1, namely reaction, in the evaluation sheet is in accordance with the theory of Kirkpatrick, at level 2 that is learning should be held pretest and posttest but only made scale. At level 3, behavior, according to theory, but on assessment factor number 3, quantity and work productivity should not need to be included because they are included in level 4. At level 4, that is the result, here is still lacking to get a picture of the results of the training that has been carried out because only based on answers from superiors without evidence of any documents.   Keywords: Training Evaluation, Kirkpatrick Theory.    Penelitian ini bertujuan mengetahui evaluasi training di PT. Pupuk Kujang. PT. Pupuk Kujang merupakan perusahaan yang bergerak di bidang petrokimia. Lembar evaluasi PT. Pupuk Kujang dibuat berdasarkan teori Kirkpatrick yang terdiri dari empat level evaluasi, yaitu reaksi, learning, behavior, dan hasil. Pada level 1 yaitu reaksi, di lembar evaluasi tersebut sudah sesuai dengan teori dari Kirkpatrick, pada level 2 yaitu learning seharusnya diadakan pretest dan posttest namun hanya dibuatkan skala. Pada level 3 yaitu behavior, sudah sesuai teori namun pada faktor penilaian nomor 3 kuantitas dan produktivitas kerja semestinya tidak perlu dimasukkan karena sudah termasuk ke dalam level 4. Pada level 4 yaitu hasil, disini masih sangat kurang untuk mendapatkan gambaran hasil dari pelatihan yang sudah dilaksanakan karena hanya berdasarkan dari jawaban atasan tanpa bukti dokumen apapun.   Kata kunci: Evaluasi Pelatihan, Teori Kirkpatrick.

scholarly journals Celebrate Diversity?

2021 ◽  
Author(s):  
Christian Huber ◽  
Philipp Nicolay ◽  
Simone Weber
Keyword(s):  
Eine Hohe ◽  
Soziale Integration ◽  
Level 1 ◽  
Soziale Ausgrenzung ◽  
Level 2

ZusammenfassungSchulleistungen und soziale Integration sind im deutschen Schulsystem eng miteinander verbunden. Unklar ist, welche Rolle die Leistungs- und Verhaltensheterogenität für diesen Zusammenhang spielt. Vertreter*innen eines klassischen sozialpsychologischen Zugangs sagen für eine hohe Leistungs- und Verhaltensheterogenität eine Erhöhung des Risikos auf soziale Ausgrenzung (Risikohypothese) voraus, Vertreter*innen eines inklusionspädagogischen Zugangs eine Schutzfunktion (Schutzhypothese). Die vorliegende Studie untersucht, inwieweit die Leistungs- und Verhaltensheterogenität den Zusammenhang zwischen einem Förderbedarf in den Bereichen Lernen/Verhalten und sozialer Integration moderiert und ob die Richtung dieses Modertoreffekt im Sinne der Schutz- oder der Risikohypothese gedeutet werden kann. Hierzu wurden N = 1352 Grundschüler*innen in drei unterschiedlich heterogenen Schulsystemen (jahrgangsgetrennt, 1/2/3/4; teilweise jahrgangsübergreifend, 1–2/3–4; jahrgangsübergreifend, 1–4) in einer Querschnittstudie untersucht. Erhoben wurden, neben der sozialen Integration, Informationen über einen besonderen Förderbedarf in den Bereichen Lernen und Verhalten und Schulleistung. Das Schulsystem ging als unabhängige Variable auf Level 2, der Förderbedarf als unabhängige Variable auf Level 1 und die soziale Integration als abhängige Variable in die mehrebenenanalytische Auswertung ein. Analog zu bisher vorliegenden Befunden wurde ein signifikanter Haupteffekt beider Förderbedarfe auf die soziale Integration gefunden. Ferner zeigten vier von sechs Cross-Level-Effekten für den Förderbedarf Lernen Hinweise auf eine Gültigkeit der Schutzhypothese, kein Cross-Level-Effekt war im Sinne der Risikohypothese interpretierbar. Dieser Befund war nicht auf den Förderbedarf Verhalten übertragbar. Die Ergebnisse legen nahe, dass sich der Zusammenhang zwischen sozialer Integration und Förderbedarf Lernen mit zunehmender Leistungs- und Verhaltensheterogenität abschwächt. Gleichzeitig zeigte sich in den stark heterogenen Lerngruppen ein insgesamt erhöhtes Ausgrenzungsrisiko aller Schüler*innen unabhängig ihres Förderbedarfs. Die Ergebnisse lassen den Schluss zu, dass sich für Schüler*innen mit erhöhtem Förderbedarf Lernen im jahrgangsübergreifenden Lernen eine höhere Chance für eine gute soziale Integration einstellen könnte.

scholarly journals An Atmospheric Visibility Grading Method Based on Ensemble Learning and Stochastic Weight Average

Atmosphere ◽  
2021 ◽  
Vol 12 (7) ◽  
pp. 869
Author(s):  
Xiuguo Zou ◽  
Jiahong Wu ◽  
Zhibin Cao ◽  
Yan Qian ◽  
Shixiu Zhang ◽  
...  
Keyword(s):  
Ensemble Learning ◽  
Traffic Accidents ◽  
Feature Sets ◽  
Atmospheric Visibility ◽  
Average Accuracy ◽  
Level 3 ◽  
Visual Characteristics ◽  
Level 1 ◽  
Grading Model ◽  
Level 2

In order to adequately characterize the visual characteristics of atmospheric visibility and overcome the disadvantages of the traditional atmospheric visibility measurement method with significant dependence on preset reference objects, high cost, and complicated steps, this paper proposed an ensemble learning method for atmospheric visibility grading based on deep neural network and stochastic weight averaging. An experiment was conducted using the scene of an expressway, and three visibility levels were set, i.e., Level 1, Level 2, and Level 3. Firstly, the EfficientNet was transferred to extract the abstract features of the images. Then, training and grading were performed on the feature sets through the SoftMax regression model. Subsequently, the feature sets were ensembled using the method of stochastic weight averaging to obtain the atmospheric visibility grading model. The obtained datasets were input into the grading model and tested. The grading model classified the results into three categories, with the grading accuracy being 95.00%, 89.45%, and 90.91%, respectively, and the average accuracy of 91.79%. The results obtained by the proposed method were compared with those obtained by the existing methods, and the proposed method showed better performance than those of other methods. This method can be used to classify the atmospheric visibility of traffic and reduce the incidence of traffic accidents caused by atmospheric visibility.

scholarly journals Identifying trauma patients with benefit from direct transportation to Level-1 trauma centers

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Charlie A. Sewalt ◽  
Benjamin Y. Gravesteijn ◽  
Daan Nieboer ◽  
Ewout W. Steyerberg ◽  
Dennis Den Hartog ◽  
...  
Keyword(s):  
Logistic Regression ◽  
Trauma Center ◽  
Trauma Patients ◽  
Trauma Centers ◽  
Absolute Benefit ◽  
Predicted Probability ◽  
Prehospital Triage ◽  
Level 1 ◽  
Level 1 Trauma Center ◽  
Level 2

Abstract Background Prehospital triage protocols typically try to select patients with Injury Severity Score (ISS) above 15 for direct transportation to a Level-1 trauma center. However, ISS does not necessarily discriminate between patients who benefit from immediate care at Level-1 trauma centers. The aim of this study was to assess which patients benefit from direct transportation to Level-1 trauma centers. Methods We used the American National Trauma Data Bank (NTDB), a retrospective observational cohort. All adult patients (ISS > 3) between 2015 and 2016 were included. Patients who were self-presenting or had isolated limb injury were excluded. We used logistic regression to assess the association of direct transportation to Level-1 trauma centers with in-hospital mortality adjusted for clinically relevant confounders. We used this model to define benefit as predicted probability of mortality associated with transportation to a non-Level-1 trauma center minus predicted probability associated with transportation to a Level-1 trauma center. We used a threshold of 1% as absolute benefit. Potential interaction terms with transportation to Level-1 trauma centers were included in a penalized logistic regression model to study which patients benefit. Results We included 388,845 trauma patients from 232 Level-1 centers and 429 Level-2/3 centers. A small beneficial effect was found for direct transportation to Level-1 trauma centers (adjusted Odds Ratio: 0.96, 95% Confidence Interval: 0.92–0.99) which disappeared when comparing Level-1 and 2 versus Level-3 trauma centers. In the risk approach, predicted benefit ranged between 0 and 1%. When allowing for interactions, 7% of the patients (n = 27,753) had more than 1% absolute benefit from direct transportation to Level-1 trauma centers. These patients had higher AIS Head and Thorax scores, lower GCS and lower SBP. A quarter of the patients with ISS > 15 were predicted to benefit from transportation to Level-1 centers (n = 26,522, 22%). Conclusions Benefit of transportation to a Level-1 trauma centers is quite heterogeneous across patients and the difference between Level-1 and Level-2 trauma centers is small. In particular, patients with head injury and signs of shock may benefit from care in a Level-1 trauma center. Future prehospital triage models should incorporate more complete risk profiles.

Trauma Center Outcomes After Transition From Level 2 to Level 1: A National Trauma Data Bank Analysis

2021 ◽  
Vol 264 ◽  
pp. 499-509
Author(s):  
Sung Huang Laurent Tsai ◽  
Greg Michael Osgood ◽  
Joseph K. Canner ◽  
Amber Mehmood ◽  
Oluwafemi Owodunni ◽  
...  
Keyword(s):  
Trauma Center ◽  
Data Bank ◽  
National Trauma ◽  
National Trauma Data Bank ◽  
Level 1 ◽  
Level 2

Penerapan Capability Maturity Model Integration Untuk Mengukur Tingkat Kematangan Organisasi Dalam Proses Pengembangan Perangkat Lunak (Studi Kasus: Direktorat Innovation Center Universitas Amikom Yogyakarta)

Respati ◽  
2020 ◽  
Vol 15 (1) ◽  
pp. 43
Author(s):  
Ita Permatahati ◽  
Wing Wahyu Winarno ◽  
Mei P Kurniawan
Keyword(s):  
Software Development ◽  
Development Process ◽  
Model Integration ◽  
Maturity Model ◽  
Software Development Process ◽  
Maturity Level ◽  
Capability Maturity ◽  
Level 1 ◽  
A Company ◽  
Level 2

INTISARIMenerapkan standarisasi pada suatu perusahaan yang bergerak dibidang pengembangan perangkat lunak merupakan salah satu cara untuk meningkatkan kualitasnya. CMMI merupakan salah satu standarisasi yang penulis pilih untuk mengetahui tingkat kematangan dari divisi Innovation CenterAmikom. CMMI yang digunakan ialah CMMI for Development versi 1.3 yang fokus terhadap tingkat kematangan di level 2 dengan 6 proses area. Penelitian ini mengambil 1 sample proyek di Innovation Center(IC) yaitu apliksai presensi berbasis mobile. Berdasarkan hasil dari pengukuran yang telah dilakukan, proses pengembangan lunak di IC berada di tingkat 1 (Initial) yang diketahui bahwa belum semua praktik yang ada di masing-masing 6 proses area diterapkan. Kata kunci— proses pengembangan perangkat lunak, CMMI, CMMI-DEV, Representasi Bertingkat, Tingkat Kematangan. ABSTRACTApplying standards to a company engaged in the development of devices is one way to improve its quality. CMMI is one of the standards chosen by the author to find out the level of maturity of the Innovation Center at Amikom. CMMI is used for CMMI for Development version 1.3 which focuses on the level of maturity at level 2 with 6 process areas. This study took 1 sample project at the Innovation Center (IC), a mobile-based presence application. Based on the results of the measurements that have been made, the development process at the IC is at level 1 (Initial) related to all the practices that exist in each of the 6 process areas that are applied.Kata kunci—  software development process, CMMI, CMMI-DEV, Leveled Representation, Maturity Level.

Validation of a Group Embedded Figures Test for Young Children

1980 ◽  
Vol 51 (2) ◽  
pp. 483-486 ◽  
Author(s):  
Theodore R. Cromack ◽  
Meredith K. Stone
Keyword(s):  
Young Children ◽  
Second Grade ◽  
Embedded Figures Test ◽  
Embedded Figures ◽  
Level 1 ◽  
Group Embedded Figures Test ◽  
Test Level ◽  
Level 2 ◽  
Rod And Frame Test ◽  
Rod And Frame

This paper describes the development and concurrent validation of a group-administered measure of field-dependence/independence for early elementary children. Following the procedure used to validate the Children's Group Embedded Figures Test (Level 2, 9 to 11 yr.), a validation study of a group test for younger children was undertaken with a second-grade sample ( N = 77). The test was reliable (alpha = .84) and significantly related to both the individually administered Children's Embedded Figures Test ( r = .56) and Portable Rod-and-frame Test ( r = .57). This measure, designated the Children's Group Embedded Figures Test—Level 1, provides a promising research instrument for assessing cognitive style of young children.

scholarly journals Utilizing two-tiered screening for early detection of autism spectrum disorder

Autism ◽  
2017 ◽  
Vol 22 (7) ◽  
pp. 881-890 ◽  
Author(s):  
Meena Khowaja ◽  
Diana L Robins ◽  
Lauren B Adamson
Keyword(s):  
Early Detection ◽  
Young Children ◽  
False Positive ◽  
Screening Tool ◽  
False Positive Rate ◽  
Autism Spectrum ◽  
Screening Methods ◽  
Positive Rate ◽  
Level 1 ◽  
Level 2

Despite advances in autism screening practices, challenges persist, including barriers to implementing universal screening in primary care and difficulty accessing services. The high false positive rate of Level 1 screening methods presents especially daunting difficulties because it increases the need for comprehensive autism evaluations. This study explored whether two-tiered screening—combining Level 1 (Modified Checklist for Autism in Toddlers, Revised with Follow-Up) and Level 2 (Screening Tool for Autism in Toddlers and Young Children) measures—improves the early detection of autism. This study examined a sample of 109 toddlers who screened positive on Level 1 screening and completed a Level 2 screening measure prior to a diagnostic evaluation. Results indicated that two-tiered screening reduced the false positive rate using published Screening Tool for Autism in Toddlers and Young Children cutoffs compared to Level 1 screening alone, although at a cost to sensitivity. However, alternative Screening Tool for Autism in Toddlers and Young Children scoring in the two-tiered screening improved both positive predictive value and sensitivity. Exploratory analyses were conducted, including comparison of autism symptoms and clinical profiles across screening subsamples. Recommendations regarding clinical implications of two-tiered screening and future areas of research are presented.

Reliability and Construct Validity of Yo-Yo Tests in Untrained and Soccer-Trained Schoolgirls Aged 9–16

2016 ◽  
Vol 28 (2) ◽  
pp. 321-330 ◽  
Author(s):  
Susana C. A. Póvoas ◽  
Carlo Castagna ◽  
José Manuel da Costa Soares ◽  
Pedro Silva ◽  
Manuel Coelho-e-Silva ◽  
...  
Keyword(s):  
Heart Rate ◽  
Construct Validity ◽  
Coefficient Of Variation ◽  
Intermittent Exercise ◽  
Intraclass Correlation ◽  
Soccer Players ◽  
Confidence Limits ◽  
Peak Heart Rate ◽  
Level 1 ◽  
Level 2

Purpose:The reliability and construct validity of three age-adapted-intensity Yo-Yo tests were evaluated in untrained (n = 67) vs. soccer-trained (n = 65) 9- to 16-year-old schoolgirls.Methods:Tests were performed 7 days apart for reliability (9- to 11-year-old: Yo-Yo intermittent recovery level 1 children’s test; 12- to 13-yearold: Yo-Yo intermittent endurance level 1; and 14- to 16-year-old: Yo-Yo intermittent endurance level 2).Results:Yo-Yo distance covered was 40% (776 ± 324 vs. 556 ± 156 m), 85% (1252 ± 484 vs. 675 ± 252 m) and 138% (674 ± 336 vs. 283 ± 66 m) greater (p ≤ .010) for the soccer-trained than for the untrained girls aged 9–11, 12–13 and 14–16 years, respectively. Typical errors of measurement for Yo-Yo distance covered, expressed as a percentage of the coefficient of variation (confidence limits), were 10.1% (8.1–13.7%), 11.0% (8.6–15.4%) and 11.6% (9.2–16.1%) for soccer players, and 11.5% (9.1–15.8%), 14.1% (11.0–19.8%) and 10.6% (8.5–14.2%) for untrained girls, aged 9–11, 12–13 and 14–16, respectively. Intraclass correlation coefficient values for test-retest were excellent (0.795–0.973) in both groups. No significant differences were observed in relative exercise peak heart rate (%HRpeak) between groups during test and retest.Conclusion:The Yo-Yo tests are reliable for determining intermittent-exercise capacity and %HRpeak for soccer players and untrained 9- to 16-year-old girls. They also possess construct validity with better performances for soccer players compared with untrained age-matched girls, despite similar %HRpeak.

Sign in / Sign up

Export Citation Format

Share Document