HUBUNGAN PROJECT PLANNING DAN PROYEK SUKSES: META-ANALISIS

ABSTRAK Perencanaan proyek dianggap menjadi aspek penting untuk mencapai proyek yang sukses. Peneliti terdahulu banyak membuktikan bahwa perencanaan sangat berperan penting terhadap kesuksesan proyek. Menurut Wang dan Gibson (2008) dalam penelitiannya, perencanaan merupakan hal yang sangat penting, semakin banyak usaha yang dilakukan pada proses perencanaan, maka proyek akan menjadi lebih sukses. Namun sebaliknya, Chatzoglou dan Macaulay (1996) mengungkapkan bahwa setiap perencanaan yang ketat akan mengakibatkan keterlambatan secara berantai pada fase proyek berikutnya. Berdasarkan perbedaan pendapat dari para peneliti tersebut, maka perlu adanya penegasan dan pembuktian hubungan perencanaan terhadap kesuksesan proyek secara empiris dari sejumlah penelitian - penelitian terdahulu. Pada penelitian ini, perolehan data didapatkan dari 12 artikel yang berhubungan dengan perencanaan dan pengaruhnya terhadap kesuksesan proyek yang memiliki data statistik, yaitu nilai F, t, d maupun r. Data diolah dengan menggunakan metode Meta-Analisis. Hasil analisis data membuktikan bahwa terdapat hubungan positif antara perencanaan proyek (project planning) dan proyek sukses, yakni nilai korelasi populasi (true score) sebesar (ρ) = 0,429 dengan nilai interval kepercayaan 95%Kata kunci: Perencanaan, Proyek Sukses, Manajemen Proyek, Meta-Analisis ABSTRACTProject planning is considered to be an important aspect in achieving the successful project. Many previous researchers have proved that planning was very important aspect in the success of the project. According to Wang and Gibson (2008) in their research, planning was very important, the more effort done in the planning process, the project would become more successful. But conversely, Chatzoglou and Macaulay (1996) revealed that any strict planning will result in a series of delays in the next project phase. Based on the different opinions of the researchers, it is necessary to affirm and prove the relationship between planning and project success empirically from some previous studies. In this study, the acquisition of data obtained from 12 articles relating to planning and its effect on the success of projects that have statistical data, namely the value of F, t, d and r. Data were processed using the Meta-Analysis method. The results of the data analysis prove that there is a positive relationship between project planning and project success, namely the correlation value (true score) of (ρ) = 0.429 with a 95% confidence intervalKeywords: Planning, Project Success, Project Management, Meta-Analysis

A Fine-Tooth Comb for Measurement Reliability: Predicting True Score and Error Variance in Hierarchical Models

The primary objective of this work is to extend classical test theory (CTT), in particular, forthe case of repeated measurement studies. The guiding idea that motivates this work is that anytheory ought to be expanded when it is not compatible with commonly observed phenomena-namely, that homogeneous variance components appear to be the exception and not the rule inpsychological applications. Additionally, advancements in methodology should also be consideredin light of theory expansion, when appropriate. We argue both goals can be accomplishedby merging heterogeneous variance modeling with the central tenants of CTT. To this end, weintroduce novel methodology that is based on the mixed-effects location scale model. This allows for fitting explanatory models to the true score (between-group) and error (within-group)variance. Two illustrative examples, that span from educational research to infant cognition,highlight such possibilities. The results revealed that there can be substantial individual differences in error variance, which necessarily implies the same for reliability, and that true scorevariance can be a function of covariates. We incorporate this variance heterogeneity into novel reliability indices that can be used to forecast group or person-specific reliability. These extend traditional formulations that assume the variance components are homogeneous. This powerful approach can be used to identify predictors of true score and error variance, which can then be used to refine measurement. The methods are implemented in the user-friendly R packageICCier.

The IRAP is not suitable for individual use due to very wide confidence intervals around D scores

A meta-analysis suggested that the Implicit Relational Assessment Procedure (IRAP) has potential “as a tool for clinical assessment”. Here I present evidence to the contrary. Using all published and unpublished file-drawer data available to me, I bootstrapping 95% Confidence Intervals for each IRAP D score. Results demonstrate that Confidence Intervals are extremely wide: regardless of the estimated D score, the data is equally compatible with a ‘true’ score lying anywhere in the range of very negative to very positive. The IRAP is therefore not currently suitable for individual level use or assessment in research or applied settings.

Retrodictive validity and true-score inference

Experimental psychologists often seek to measure latent psychological attributes. A plethora of observation and data transformation methods are being used simultaneously in any given field, with few criteria to arbitrate between them. In this theoretical note, we extend classical validity theory by suggesting to use intended values in a benchmark experiment as singular validity criterion, which we term retrodictive validity. We formally introduce a statistical model of this situation. We mathematically derive that maximisation of retrodictive validity is guaranteed to maximise measurement accuracy as long as experimental aberration and measurement error are uncorrelated. In this case, retrodictive validity provides a lower bound on measurement accuracy. If this correlation is non-zero but positive, or negative and small, then maximisation of retrodictive validity has a potential, but is not guaranteed, to maximise measurement accuracy. In contrast, the method makes no assumption on the absolute size of the experimental aberration. This implies that weak experimental manipulations or inaccurate theoretical predictions can be leveraged for assessing measurement accuracy. We suggest that the criterion can be used for rational selection between measurement methods, including the choice of observables and of transformation methods or measurement models.

Approximating Bifactor IRT True-Score Equating With a Projective Item Response Model

Item response theory (IRT) true-score equating for the bifactor model is often conducted by first numerically integrating out specific factors from the item response function and then applying the unidimensional IRT true-score equating method to the marginalized bifactor model. However, an alternative procedure for obtaining the marginalized bifactor model is through projecting the nuisance dimensions of the bifactor model onto the dominant dimension. Projection, which can be viewed as an approximation to numerical integration, has an advantage over numerical integration in providing item parameters for the marginalized bifactor model; therefore, projection could be used with existing equating software packages that require item parameters. In this paper, IRT true-score equating results obtained with projection are compared to those obtained with numerical integration. Simulation results show that the two procedures provide very similar equating results.

A Primer on Reliability via Coefficient Alpha and Omega

Reliability is an important property to established for a measurement instrument. There are several types of reliabilities and each with its own purposes. However, whether warranted or not, internal consistency via coefficient alpha has been the standard for establishing the reliability of a measurement instrument for over 60 years. During this time, coefficient omega was proposed as an alternative, but has remained obscured. Nonetheless, neither coefficient has been further developed since their inception until recent years. A clearer discussion of the three classical true score model forms and their relationship to reliability, computational methods, and the asymptotic distribution of coefficient alpha provided the foundation for fruitful confidence interval research for each coefficient. In this respect, the normal theory bootstrap CI is the most optimal for both coefficients. Even so, there is still more promising research to pursue.

Estimating the Students’ Skill in Reciting and Writing Alqur’an at Faculty of Tarbiyah and Teacher Training IAIN Sultan Amai Gorontalo

<p class="ABSTRACTJUDUL">The purpose of this study was to estimate the instrument of reading and writing capability of the Qur’an in the practicum program students of the Faculty of Tarbiyah and Teacher Training IAIN Sultan Amai Gorontalo. This type of research is quantitative with an analysis approach to the generalization theory variance through the G-Study concept with a multifacet design p x r x I three facet variations. The results of the study prove the instrument of reading and reading ability of the Koran was tested, namely the estimated coefficient of reliability of the combined scores of the reading and writing assessment of the Koran from 20 students who were rated by 4 rater of 10 items which were judged by the magnitude of generalizability coefficient value of 0.82749 . The magnitude of this value indicates that the true score of the assessment results is quite high compared to the minimum reliability criteria, which is 0.70 fulfilling the reliable criteria.</p><p class="ABSTRACTJUDUL"> </p><p class="ABSTRACTJUDUL"><strong>Abstrak</strong></p><p class="ABSTRACT">Tujuan penelitian ini untuk mengestimasi instrument kemampuan baca tulis alqur’an pada program praktikum baca tulis Alqur’an mahasiswa Fakultas Ilmu Tarbiyah dan Keguruan IAIN Sultan Amai Gorontalo. Jenis penelitian ini menggunakan kuantitatif dengan pendekatan analisis varians teori generalisibilitas melalui konsep G-Study dengan desain multifacet p x r x I tiga variasi facet. Hasil penelitian membuktikan instrumen penilaian kemampuan baca tulis al-Qur’an teruji, yakni estimasi koefisien reliabilitas skor gabungan penilaian kemampuan baca tulis Alqur’an dari 20 mahasiswa yang dinilai oleh 4 rater terhadap 10 item yang dinilai diperoleh besarnya nilai koefisien generalizabilitas sebesar 0,82749. Besaran nilai tersebut menunjukkan bahwa true score hasil penilaian cukup tinggi dibandingkan kriteria reliabilitas minimal yaitu 0,70 memenuhi kriteria reliabel.</p><strong><span lang="EN-US"><br /></span></strong>

Peer-Rated Organizational Citizenship Behavior

Organizational Citizenship Behavior (OCB) is valuable to organizations and has become an important focus of employee performance evaluation. Employees’ peers may be particularly well-situated to rate their OCB. We investigated the proportion of variance in peer-rated OCB attributable to the ratee (true score) versus the rater (rater bias). Furthermore, we investigated whether these proportions were affected by the familiarity of the peer with the ratee. We found that high familiarity was associated with a greater proportion of ratee variance (.43 vs. .18), and a lower proportion of rater bias (.30 vs. .51), than was the case with low-to-moderate familiarity. Thus, when choosing peers as raters of OCB, there may be value in carefully considering the peers’ familiarity with the ratees.