scholarly journals Evaluation of the Reliability, Reproducibility and Validity of Digital Orthodontic Measurements Based on Various Digital Models among Young Patients

2020 ◽  
Vol 9 (9) ◽  
pp. 2728 ◽  
Author(s):  
Seo-Hyun Park ◽  
Soo-Hwan Byun ◽  
So-Hee Oh ◽  
Hye-Lim Lee ◽  
Ju-Won Kim ◽  
...  

The advantages of intraoral model scanning have yielded recent developments. However, few studies have explored the orthodontic clinical use of this technique particularly among young patients. This study aimed to evaluate the reliability, reproducibility and validity of the orthodontic measurements: tooth width, arch length and arch length discrepancy in each digital model obtained by model scanner and intraoral scanner, relative to a plaster model. Arch length measured using two methods: curved arch length (CAL) measured automatically by digital program and sum of sectional liner arch length (SLAL) measured sum of anterior and posterior liner arch lengths. Arch length discrepancy calculated each arch length measurement methods: curved arch length discrepancy (CALD) and sum of sectional liner arch length discrepancy (SLALD). Forty young patients were eligible for the study. A plaster model (P), model-scanned digital model (MSD) and intraoral scanned digital model (ISD) were acquired from each patient. The reliability of the measurements was evaluated using Pearson’s correlation coefficient, while the reproducibility was evaluated using the intraclass correlation coefficient. The validity was assessed by a paired t-test. All measurements measured in P, MSD and ISD exhibited good reliability and reproducibility. Most orthodontic measurements despite of CAL in MSD exhibited high validity. Only the SLAL and SLALD in ISD group differed significantly, despite the good validity of the tooth width, CAL and CALD. The measurements based on the digital program appeared high reliability, reproducibility and accurate than conventional measurement. However, SLAL and SLALD in ISD group appeared shorter because of distortion during intraoral scanning. However, this could be compensated by using digital programed curved arch. Although the validity of SLAL and SLALD in the ISD group differed statistically, the difference is not considered clinically significant. Although MSD and ISD are acceptable for a clinical space analysis, clinicians should be aware of digital model-induced errors.

2020 ◽  
Vol 47 (2) ◽  
pp. 176-187
Author(s):  
Seohyun Park ◽  
Jongsoo Kim ◽  
Sohee Oh

The purpose of this study is to evaluate validity, reliability and reproducibility of tooth width (TW), arch length (AL) and arch length discrepancy (ALD) measured on a digital model taken via 3-dimensional model scanner and intraoral scanner compared to a plaster model.<br/>A total of 30 patients aged 12 to 18 were eligible for the study. 3 types of models were acquired from each patient: a conventional plaster model (P), a model scanned digital model (MSD) taken via Freedom UHD<sup>®</sup> and an intraoral scanned digital model (ISD) taken via CS3600<sup>®</sup> in-vivo. The reliability of TW and AL in each group was evaluated using Pearson’s correlation coefficient, while the reproducibility was evaluated with intraclass correlation coefficient. The validity of space analysis was assessed by paired t-test.<br/>As a result, all measurements of P, MSD and ISD groups showed favorable reliability and reproducibility. Most of measurements for space analysis in MSD group and TW in ISD group also presented high validity. AL and ALD presented statistically significant difference between P and ISD group. The validity of measurements of space analysis in ISD group was short in doubt to valid, but clinically acceptable. Both MSD and ISD are clinically acceptable to use for space analysis but clinician should be aware that errors can be found using a digital model.


2019 ◽  
Vol 32 (4) ◽  
pp. 525-531
Author(s):  
Zhenyu Ma ◽  
Qiuping He ◽  
Guanghui Nie ◽  
Cunxian Jia ◽  
Liang Zhou

ABSTRACTBackground:Older adults represent the segment of population most exposed to the risk of suicide nearly everywhere in the world. Previous studies showed that hopelessness was an important risk factor for suicide.Aims:This study aimed to evaluate the reliability and validity of the four-item Beck Hopelessness Scale (BHS-4) in psychological autopsy study among Chinese rural elderly.Method:Two-stage stratified cluster sampling method was used to select research sites. Using case-control psychological autopsy study, face-to-face interviews were conducted to collected information.Results:A total of 242 elderly suicide deaths and 242 matched living comparisons were investigated, including 135 males and 107 females for each group. Intraclass Correlation Coefficients (ICC) of the controls were 0.682-0.713. The median score of BHS-4 among suicides was significantly higher than that among controls. The corrected correlation coefficient between items and total score were 0.184-0.723. Cronbach’s Alphas coefficient was 0.834. Only one common factor was precipitated by exploratory factor analysis and the cumulative variance contribution rates were 59.558% for suicides and 52.722% for living controls. The correlation coefficient between hopelessness and depression were 0.481 among suicide death and 0.617 among living controls.Conclusion:The information provided by the informants through psychological autopsy method had high reliability to reflect the actual situation of suicides and controls. BHS-4 has good reliability and validity among Chinese rural elderly suicides. It is suitable for psychological autopsy study among Chinese rural elderly.


2018 ◽  
Vol 15 (1) ◽  
pp. 594
Author(s):  
Mehmet Yıldız ◽  
Uğur Fidan

Many laboratory and field tests are used in the literature to measure agility. The aim of the present study was to investigate the reliability and validity of a new Reactive Agility Test developed for badminton. A total of fourty male [ 20 elites (age: 20.8 ± 2.98 year, height: 174.55 ± 12.03 cm, weight: 65.70 ± 14.41 kg) and 20 sub-elites (age: 22.20±1,51, height: 170.01 ± 05.80 cm, weight: 62.45 ± 6,45 kg)] badminton players took part in the present study. For validity, the difference and relationship between newly developed reactive agility and planned changing direction tests in terms of elit and sub-elit players was examined. In the reliability measurements of test-retest, The Reactive Agility Test at same route was performed twice. Independent sample t test was carried out in order to detect the difference among the groups in the search for validity. The identification of the relations between the two different tests was performed with linear regression analysis. The reliability of test-retest was tried to be estimated with the coefficient of variances and intraclass correlation coefficient, and the Bland Altman method. In addition, a systematic difference between the test and the retest was estimated with the paired t test. At the end of the study, while there was not a significant difference found in the rates of planned changing direction of the elit and sub-elit players, it was detected that reactive agility rates were better in the elit players (7.14±4.85 sec and 9.87±5.07 sec, respectively). Moreover, a high coefficient determination was revealed between two tests (r2: 0.63, p<0.01). In the comparison of test-retest, a high intraclass correlation coefficient (0.930) and a very low coefficient of variances (4.7) were found. Furthermore, it was observed in the Bland Altman graph that a 95% of concordance range of the data obtained between two measurements was a good and narrow concordance.  In conclusion, it was determined that the new developed badminton specific Reactive Agility Test is a valid and reliable measurement method and it is suggested that this test protocol can be used to enhance and monitor reactive agility ability of badminton players.Extended English summary is in the end of Full Text PDF (TURKISH) file. ÖzetLiteratürde çevikliğin ölçülmesi amacıyla birçok laboratuvar ve saha testi kullanılmaktadır. Bu çalışmanın amacı badminton sporuna göre düzenlenmiş Reaktif Çeviklik Testinin güvenirlik ve geçerliğinin araştırılmasıdır. Araştırmaya toplam kırk erkek [20 elit (yaş: 20,8±2,98 yıl, boy uzunluğu: 174,55±12,03 cm, vücut ağırlığı:65,70±14,41 kg) ve 20 sub-elit (yaş: 22,20±1,51 yıl, boy uzunluğu: 170,01±05,80 cm, vücut ağırlığı:62,45±6,45 kg)] badminton oyuncusu katılmıştır. Geçerlik için yeni geliştirilen reaktif çeviklik ile planlı yön değiştirme testlerinin elit ve sub-elit katılımcılar arasındaki istatistiksel karşılaştırması ve ilişkisi analiz edilmiştir. Test-tekrar test güvenirlik ölçümlerinde aynı rotadaki reaktif çeviklik testi birer gün arayla iki kez uygulanmıştır. Geçerlik çalışmasında gruplar arası farkın belirlenmesi için bağımsız değişken t testi ve testler arası ilişkinin fonksiyonel olarak açıklanması ve bu ilişkinin bir modelle tanımlanması için basit doğrusal regresyon analizi yapılmıştır. Test-tekrar test güvenirliği varyasyon katsayısı, sınıf içi korelasyon katsayısı ve Bland Altman metodu ile kestirim edilmiştir. Ayrıca test- tekrar test arasında sistematik bir farkın olup olmadığı eşleştirilmiş t testi ile sınanmıştır.  Çalışma sonunda elit ve sub-elit oyuncuların planlı yön değiştirme bulguları anlamlı bir fark bulunmazken, reaktif çeviklik derecelerinin elit oyuncularda istatistiksel olarak anlamlı farklı (sırasıyla 7,14±4.85 sn ve 9,87±5,07 sn) şekilde düşük olduğu tespit edilmiştir. Bununla beraber her iki test arasında yüksek düzeyde  bir açıklayıcılık katsayısı tespit (r2: 0,63, p<0.01) edilmiştir. Test- tekrar test karşılaştırılmasında yüksek bir sınıf içi korelasyon katsayısı (0,930) ve çok düşük varyasyon katsayısı (4,7) belirlenmiştir. Ayrıca Bland-Altman grafiğinde iki ölçüm arasında elde edilen tüm verilerin %95 uyum aralığının dar ve iyi bir uyum gösterdiği gözlenmiştir. Sonuç olarak,  badminton sporuna göre düzenlenmiş Reaktif Çeviklik Testinin geçerli ve güvenilir bir ölçüm yöntemi olduğu tespit edilmiştir ve badminton oyuncularının reaktif çeviklik becerilerinin geliştirilmesinde ve gelişimlerinin takibinde kullanılabileceği önerilmektedir. 


2019 ◽  
Vol 32 (1) ◽  
pp. 69-74
Author(s):  
Seul Gi Koo ◽  
Hae Yean Park ◽  
Jongbae Kim ◽  
Areum Han

Objective The purpose of this study is to introduce a standardised assessment tool by verifying the reliability of the translated Korean version of the Feeding Abilities Assessment (K-FAA), which was developed to suit Korean culture. Methods The research subjects were 65 patients with dementia living in nursing homes. The K-FAA was completed by verifying the suitability of translation and reverse translation. The validity of the K-FAA was established through content validity, while its reliability was analysed based on internal consistency reliability for the items, test–retest reliability and inter-rater reliability. Results The content validity index determined, based on the assessment of professors, occupational therapists, and nurses, was more than .70. Cronbach’s α was more than .929, showing good internal consistency. A test–retest reliability of .884 was derived using Pearson’s correlation coefficient (p < .01), and an inter-rater reliability of .800 was derived using the kappa coefficients; intraclass correlation coefficient was .897, which also indicated good reliability. Conclusion The K-FAA was modified to fit the Korean domestic situation, and this assessment had high reliability. Therefore, K-FAA can evaluate the feeding ability of patients with dementia. Future studies should focus on providing evidence-based data to maintain or supplement the feeding ability of patients with dementia in Korea.


2020 ◽  
Vol 27 (2) ◽  
pp. 186-191
Author(s):  
Matteo Carosi ◽  
Giovanni Galeoto ◽  
Stefano Di Gennaro ◽  
Anna Berardi ◽  
Donatella Valente ◽  
...  

Purpose: The present study was designed to carry out an Italian translation of the Constant–Murley Score (CMS-IT) and, subsequently, evaluate its reliability and validity. Methods: This study included adults diagnosed with any type of clinical shoulder dysfunction who could read and respond to the questionnaires. Those individuals who underwent surgeries of any kind on the affected shoulder during the previous 12 months and individuals with shoulder instabilities were excluded. All of the participants were evaluated by two operators, and the CMS-IT, Disabilities of the Arm, Shoulder, and Hand (DASH) questionnaire, and visual analog scale (VAS) were administered. The internal consistency was evaluated using Cronbach’s α, whereas the intra-rater and inter-rater reliabilities were evaluated using the intraclass correlation coefficient (ICC). The validity of the construction was evaluated using Pearson’s correlation coefficient between the scores of the administered scales. Results: A population of 72 individuals participated in this study. The internal consistency of the CMS-IT showed a value of 0.81. The ICC values showed that inter- and intra-rater reliability were 0.994 and 0.963, respectively. CMS-IT is inversely correlated with the VAS (−0.55) and DASH (−0.47) scales. Conclusions: This study revealed that the CMS-IT contained good internal consistency and good reliability. The results suggested that the CMS-IT questionnaire is a reliable and valid tool for assessing the shoulder dysfunctions of the Italian population, and it deserves broad applications in both clinical practice and research contexts. The scale can also be used as an alternative to the current “gold standard” VAS and DASH.


2003 ◽  
Vol 93 (3) ◽  
pp. 185-189 ◽  
Author(s):  
Hazel Noakes ◽  
Craig Payne

Several decisions need to be made when prescribing foot orthoses for abnormal foot pronation. One of these decisions is how much force is needed from orthoses to supinate the foot. The supination resistance test has been described as one technique to help determine the amount of force needed. The aim of this project was to determine the reliability of the manual supination resistance test. Four clinicians of differing levels of experience performed the test on 44 subjects (88 feet) on 2 separate days. The test had good reliability overall, with an intertester intraclass correlation coefficient of 0.89. For the two more experienced clinicians, the intratester intraclass correlation coefficients were good (0.82 and 0.78), but for the two inexperienced clinicians they were poor (0.56 and 0.62). The supination resistance test may be clinically useful in the prescription of foot orthoses, but more work is needed to determine its validity and its relationship to clinical outcomes. (J Am Podiatr Med Assoc 93(3): 185-189, 2003)


2018 ◽  
Vol 27 (5) ◽  
Author(s):  
Kelsey Picha ◽  
Carolina Quintana ◽  
Amanda Glueck ◽  
Matt Hoch ◽  
Nicholas R. Heebner ◽  
...  

Context: Reaction time (RT) is crucial to athletic performance. Therefore, when returning athletes to play following injury, it is important to evaluate RT characteristics ensuring a safe return. The Dynavision D2® system may be utilized as an assessment and rehabilitation aid in the determination of RT under various levels of cognitive load. Previous research has demonstrated good reliability of simple protocols when assessed following a 24- to 48-hour test–retest window. Expanding reliable test–retest intervals may further refine novel RT protocols for use as a diagnostic and rehabilitation tool. Objective: To investigate the test–retest reliability of a battery of 5 novel RT protocols at different time intervals. Design: Repeated measures/reliability. Setting: Interdisciplinary sports medicine research laboratory. Participants: Thirty healthy individuals. Methods: Participants completed a battery of protocols increasing in difficulty in terms of reaction speed requirement and cognitive load. Prior to testing, participants were provided 3 familiarization trials. All protocols required participants to hit as many lights as quickly as possible in 60 seconds. After completing the initial testing session (session 1), participants waited 1 hour before completing the second session (session 2). Approximately 2 weeks later (average 14 [4] d), the participants completed the same battery of tasks for the third session (session 3). Main Outcome Measures: The intraclass correlation coefficient, standard error of measurement, minimal detectable change, and repeated-measures analysis of variance were calculated for RT. Results: The intraclass correlation coefficient values for each of the 5 protocols illustrated good to excellent reliability between sessions 1, 2, and 3 (.75–.90). There were no significant differences across time points (F < 0.105, P > .05). Conclusions: The 1-hour and 14-day test–retest intervals are reliable for clinical assessment, expanding the time frames previously reported in the literature of when assessments can be completed reliably. This study provides novel protocols that challenge cognition in unique ways.


2019 ◽  
Vol 30 (6) ◽  
pp. 1287-1294
Author(s):  
Nermin Serbecic ◽  
Sven Beutelspacher ◽  
Lovro Markovic ◽  
Abhijit Sina Roy ◽  
Rohit Shetty

Introduction: The aim of this study was to evaluate repeatability and reproducibility of newly calculated biomechanical parameters of the cornea, developed by our research group. Methods: One eye from each of the 23 healthy subjects was measured three times consecutively, three times at different daytimes and on three different days. The within-subject standard deviation and coefficient of variation, as well as the intraclass correlation coefficient, were calculated for every parameter in each group. Results: Excellent repeatability and reproducibility (coefficient of variation < 5%, intraclass correlation coefficient > 0.75) was found for corrected values measured at A1, HC, and A2 time points (2nd A2 Time, 2nd A1 Time, 2nd HC Time, 2nd HC Def Amp and 2nd A1 Def Amp). Corneal-specific stiffness parameters, which showed good repeatability and reliability, were DA_cor (coefficient of variation = 4.02%, intraclass correlation coefficient = 0.919), KcLinear (coefficient of variation = 4.03%, intraclass correlation coefficient = 0.895), areaForceCornea (coefficient of variation = 3.34%, intraclass correlation coefficient = 0.853) and E2 (coefficient of variation = 4.1%, intraclass correlation coefficient = 0.78). Overall, most parameters fell into the category of good reliability (high intraclass correlation coefficient) and poor reproducibility (low coefficient of variation), including all the parameters describing extraocular deformation (DA_ext, AEPvED, AUC EDef, areaForceExtra, Kg and μg). Comparing the coefficient of variation values for intrasession, intersession and daytime measurements, there were no indices for diurnal changes. Conclusion: Most parameters showed good repeatability and reliability. The extraocular stiffness parameters showed poor reproducibility. KcLinear can serve as a very reliable and repeatable indicator of corneal stiffness.


2013 ◽  
Vol 10 (1) ◽  
pp. 51-56 ◽  
Author(s):  
Marie-Thérèse Forster ◽  
Moritz Limbart ◽  
Volker Seifert ◽  
Christian Senft

Abstract BACKGROUND: Because navigated transcranial magnetic stimulation (nTMS) is increasingly used in neurosurgical research, interpretation of its results is of utmost importance. OBJECTIVE: To evaluate the test-retest reliability of nTMS. METHODS: Twelve healthy participants underwent nTMS at 2 different sessions separated by 10.3 ± 9.6 days. Investigated parameters included resting motor thresholds, hotspots, and centers of gravity calculated for the first dorsal interosseous, abductor pollicis brevis, extensor digitorum, tibial anterior, and abductor hallucis muscles. RESULTS: Excellent reliability of resting motor thresholds was observed. Hotspots and centers of gravity showed moderate to excellent repeatability along the anteroposterior axis (intraclass correlation coefficient, 0.54-0.89), whereas the x coordinate presented mainly poor to moderate stability (intraclass correlation coefficient, 0.11-0.89). Movement of centers of gravity over sessions was 0.57 ± 0.32 cm, and hotspots laid 0.79 ± 0.47 cm apart. Calculation of coefficient of variation revealed high reliability of investigated parameters in upper extremities; in lower extremity muscles, high variation across sessions was observed. CONCLUSION: nTMS can be considered a reliable tool, thus opening new fields of noninvasive investigations in neurosurgery. The results presented here should be considered in the interpretation of individual nTMS results.


2021 ◽  
Vol 49 (3) ◽  
pp. 747-756
Author(s):  
Joanna M. Stephen ◽  
Robert A. Teitge ◽  
Andy Williams ◽  
James D.F. Calder ◽  
Hadi El Daou

Background: Tibial torsion is a twist in the tibia measured as an angle between a proximal axis line and a distal axis line. Abnormal torsion has been associated with a variety of painful clinical syndromes of the lower limb. Measurements of normal tibial torsion reported by different authors vary by 100% (ranging from 20° to 42°), making it impossible to determine normal and pathological levels. Purpose: To address the problem of unreliable measurements, this study was conducted to define an automated, validated computer method to calculate tibial torsion. Reliability was compared with current clinical methods. The difference between measurements of torsion generated from computed tomography (CT) and magnetic resonance imaging (MRI) scans of the same bone, and between males and females, was assessed. Study Design: Controlled laboratory study. Methods: Previous methods of analyzing tibial torsion were reviewed, and limitations were identified. An automated measurement method to address these limitations was defined. A total of 56 cadaveric and patient tibiae (mean ± SD age, 37 ± 15 years; range, 17-71 years; 28 female) underwent CT scanning, and 3 blinded assessors made torsion measurements by applying 2 current clinical methods and the automated method defined in the present article. Intraclass correlation coefficient (ICC) values were calculated. Further, 12 cadaveric tibiae were scanned by MRI, stripped of tissue, and measured using a structured light (SL) scanner. Differences between torsion values obtained from CT, SL, and MRI scans, and between males and females, were compared using t tests. SPSS was used for all statistical analysis. Results: When the automated method was used, the tibiae had a mean external torsion of 29°± 11° (range, 9°-65). Automated torsion assessment had excellent reliability (ICC, 1), whereas current methods had good reliability (ICC, 0.78-0.81). No significant difference was found between the torsion values calculated from SL and CT ( P = .802), SL and MRI ( P = .708), or MRI and CT scans ( P = .826). Conclusion: The use of software to automatically perform measurements ensures consistency, time efficiency, validity, and accuracy not possible with manual measurements, which are dependent on assessor experience. Clinical Relevance: We recommend that this method be adopted in clinical practice to establish databases of normal and pathological tibial torsion reference values and ultimately guide management of related conditions.


Sign in / Sign up

Export Citation Format

Share Document