Validity and Reproducibility of the Peer Assessment Rating Index Scored on Digital Models Using a Software Compared with Traditional Manual Scoring

The aim of this study was to assess the validity and reproducibility of digital scoring of the Peer Assessment Rating (PAR) index and its components using a software, compared with conventional manual scoring on printed model equivalents. The PAR index was scored on 15 cases at pre- and post-treatment stages by two operators using two methods: first, digitally, on direct digital models using Ortho Analyzer software; and second, manually, on printed model equivalents using a digital caliper. All measurements were repeated at a one-week interval. Paired sample t-tests were used to compare PAR scores and its components between both methods and raters. Intra-class correlation coefficients (ICC) were used to compute intra- and inter-rater reproducibility. The error of the method was calculated. The agreement between both methods was analyzed using Bland-Altman plots. There were no significant differences in the mean PAR scores between both methods and both raters. ICC for intra- and inter-rater reproducibility was excellent (≥0.95). All error-of-the-method values were smaller than the associated minimum standard deviation. Bland-Altman plots confirmed the validity of the measurements. PAR scoring on digital models showed excellent validity and reproducibility compared with manual scoring on printed model equivalents by means of a digital caliper.

Penilaian Tingkat Keberhasilan Perawatan Ortodontik dengan Piranti Lepasan Berdasarkan Indeks PAR di RSGM Universitas Baiturrahmah Tahun 2012-2017

AbstrakPerawatan ortodontik dapat dilakukan dengan menggunakan ortodontik cekat maupun lepasan. Observasi dilapangan, perawatan ortodontik di bagian ortodonti RSGM Universitas Baiturrahmah menggunakan alat ortodontik lepasan. Selama ini belum pernah dilakukan evaluasi tingkat keberhasilan perawatan ortodontik terhadap pasien yang telah selesai dirawat yang diukur dengan Peer Assessment Rating Index (indeks PAR). Tujuan: Menentukan tingkat keberhasilan perawatan ortodontik dengan piranti lepasan di bagian ortodonti RSGM Universitas Baiturrahmah berdasarkan indeks PAR. Metode: Jenis penelitian ini adalah kuantitatif dengan metode observasional analitik serta menggunakan pendekatan waktu penelitian cross-sectional study. Penelitian ini dilakukan di bagian ortodonti RSGM Universitas Baiturrahmah pada bulan September sampai Oktober 2018. Sampel yang diambil yaitu model gigi pasien yang telah selesai menjalani perawatan ortodontik dari tahun 2012 sampai 2017 di bagian ortodonti RSGM Universitas Baiturrahmah yang memenuhi kriteria inklusi dan eksklusi. Dari 122 model gigi, didapatkan 46 sampel yang memenuhi kriteria inklusi. Hasil: Tingkat keberhasilan perawatan ortodonti lepasan di RSGM Universitas Baiturrahmah banyak yang “tidak mengalami perbaikan” (60,9%), namun secara statistik terjadi perbedaan skor yang signifikan sebelum dan sesudah perawatan. Simpulan: Masing-masing komponen indeks PAR secara deskriptif mengalami penurunan skor sebelum dan sesudah perawatan, namun secara statistik yang mengalami perbedaan skor signifikan hanya pada segmen anterior rahang atas dan bawah serta overjet.

Validity and Reliability of Peer Assessment Rating Index Measurement Derived from Digital and Plaster Models

Aims The aim of the study was to determine the validity and reliability of Peer Assessment Rating (PAR) index score derived from digital and plaster models of the same patient. Subjects and Methods Thirty orthodontic plaster study models were digitalized using the 3Shape R700™ Orthodontic 3D scanner. PAR Index scoring was carried out on both the plaster and digital models by one independent examiner calibrated in the PAR Index. The measurements were repeated at a second sitting. Measurements were made on plaster models with the PAR Index ruler and on digital models with the 3Shape OrthoAnalyzer™ software. Statistical Analysis Used Bland-Altman plots were used to test for validity and intraexaminer reliability. Results For PAR Index score, overjet and overbite component scores, 28 out of 30 measurements were within 95% limits of agreement. Other components of the PAR Index score had all points within 95% limits of agreement. For intraexaminer reliability, digital models had 28 out of 30 measurements and plaster models had 27 out of 30 measurements that were within 95% limits of agreement. Conclusions Digital models are a clinically acceptable alternative to plaster models in the measurement of the PAR Index. Improvement in software design is necessary to attain greater agreement in the measurement of the overjet and overbite components of the PAR index score between plaster and digital models.