scholarly journals Testing the Reliability and Construct Validity of Short-Term Assessment of Risk and Treatability (START) in Non-Western Forensic Psychiatric Inpatients

2022 ◽  
Author(s):  
Weeerapong Sanmontree ◽  
Peera Wongupparaj
Keyword(s):  
Construct Validity ◽  
Mental Health Professionals ◽  
Ordinal Data ◽  
Intraclass Correlation ◽  
Asian Population ◽  
Psychiatric Inpatients ◽  
Short Term ◽  
Rater Reliability ◽  
Promising Tool ◽  
Forensic Psychiatric

The Short-Term Assessment of Risk and Treatability (START) is deemed the most appropriate instrument for assessing violence risks and management because of its balanced approach between dynamic risk and protective factors. Although several facets of reliability and predictive validity of this tool were strong, its inter-rater reliability, construct validity, and implementation in Asian population were under-investigated. The objective of this research was to examine the inter-rater reliability and construct validity of the START: Thai version within forensic psychiatric inpatients. The participants consisted of 118 forensic psychiatric inpatients hospitalized at Galya Rajanagarindra Institute in Thailand. Trained mental health professionals (i.e., psychiatrists, forensic nurses, clinical psychologists, social workers, and occupational therapists) assessed each participant across twenty domains of the Thai START. The inter-rater reliability was examined using the intraclass correlation coefficient and a confirmatory factor analysis for ordinal data was used to test the construct validity of the scale. The main finding showed a good-to-excellent inter-rater reliability and supported two relational constructs (i.e., strength vs vulnerability subscales) of the Thai START. The Thai START is a promising tool for using in Thai forensic psychiatric setting but some items were not significant in contributing to the scale. This study also provides the guideline for implementing the tool in non-Western forensic psychiatric populations.

Appraisal of a scoring instrument for training and testing neonatal intubation skills

2018 ◽  
Vol 104 (5) ◽  
pp. F521-F527 ◽  
Author(s):  
Romy N Bouwmeester ◽  
Mathijs Binkhorst ◽  
Nicole K Yamada ◽  
Rosa Geurtzen ◽  
Arno F J van Heijst ◽  
...  
Keyword(s):  
Construct Validity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Rater Reliability ◽  
Patient Simulator ◽  
Training Centre ◽  
Intraclass Correlation Coefficients ◽  
Tube Position ◽  
The Usa ◽  
Neonatal Patient

ObjectiveTo determine the validity, reliability, feasibility and applicability of a neonatal intubation scoring instrument.DesignProspective observational study.SettingSimulation-based research and training centre (Center for Advanced Pediatric and Perinatal Education), California, USA.SubjectsForty clinicians qualified for neonatal intubation.InterventionsVideotaped elective intubations on a neonatal patient simulator were scored by two independent raters. One rater scored the intubations twice. We scored the preparation of equipment and premedication, intubation performance, tube position/fixation, communication, number of attempts, duration and successfulness of the procedure.Main outcome measuresIntraclass correlation coefficients (ICC) were calculated for intrarater and inter-rater reliability. Kappa coefficients for individual items and mean kappa coefficients for all items combined were calculated. Construct validity was assessed with one-way analysis of variance using the hypothesis that experienced clinicians score higher than less experienced clinicians. The approximate time to score one intubation and the instrument’s applicability in another setting were evaluated.ResultsICCs for intrarater and inter-rater reliability were 0.99 (95% CI 0.98 to 0.99) and 0.89 (95% CI 0.35 to 0.96), and mean kappa coefficients were 0.93 (95% CI 0.85 to 1.01) and 0.71 (95% CI 0.56 to 0.92), respectively. There were no differences between the more and less experienced clinicians regarding preparation, performance, communication and total scores. The experienced group scored higher only on tube position/fixation (p=0.02). Scoring one intubation took approximately 15 min. Our instrument, developed in The Netherlands, could be readily applied in the USA.ConclusionsOur scoring instrument for simulated neonatal intubations appears to be reliable, feasible and applicable in another centre. Construct validity could not be established.

scholarly journals Assessment of the nursing care product (APROCENF): a reliability and construct validity study

2017 ◽  
Vol 25 (0) ◽  
Author(s):  
Danielle Fabiana Cucolo ◽  
Márcia Galan Perroca
Keyword(s):  
Construct Validity ◽  
Nursing Care ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Principal Component ◽  
Weighted Kappa ◽  
Kappa Index ◽  
Rater Reliability ◽  
Care Product ◽  
Spearman’S Correlation

ABSTRACT Objectives: to verify the reliability and construct validity estimates of the "Assessment of nursing care product" scale (APROCENF) and its applicability. Methods: this validation study included a sample of 40 (inter-rater reliability) and 172 (construct validity) assessments performed by nurses at the end of the work shift at nine inpatient services of a teaching hospital in the Brazilian Southeast. The data were collected between February and September/2014 with interruptions. Cronbach's alpha and Spearman's correlation coefficients were calculated, as well as the intraclass correlation and the weighted kappa index (inter-rater reliability). Exploratory factor analysis was used with principal component extraction and varimax rotation (construct validity). Results: the internal consistency revealed an alpha coefficient of 0.85, item-item correlation ranging between 0.13 and 0.61 and item-total correlation between 0.43 and 0.69. Inter-rater equivalence was obtained and all items evidenced significant factor loadings. Conclusion: this research evidenced the reliability and construct validity of the scale to assess the nursing care product. Its application in nursing practice permits identifying improvements needed in the production process, contributing to management and care decisions.

scholarly journals Myotonometry for the evaluation of Achilles tendon mechanical properties: a reliability and construct validity study

2020 ◽  
Vol 6 (1) ◽  
pp. e000726 ◽  
Author(s):  
Alessandro Schneebeli ◽  
Deborah Falla ◽  
Ron Clijsen ◽  
Marco Barbero
Keyword(s):  
Mechanical Properties ◽  
Construct Validity ◽  
Achilles Tendon ◽  
Intraclass Correlation ◽  
Standing Position ◽  
Validity Study ◽  
Minimal Detectable Change ◽  
Rater Reliability ◽  
Tendon Stiffness ◽  
Very High

ObjectiveThis study evaluates the intra-rater and inter-rater reliability of the MyotonPRO and its construct validity for the assessment of Achilles tendon stiffness.DesignReliability and construct validity study.MethodsForty healthy participants were assessed using the MyotonPRO by two raters on two different occasions. Tendon was evaluated in three different positions (relaxed, 0° plantarflexion and standing) and during different isometric contractions (range 0–3 kg). Reliability was calculated using intraclass correlation coefficient (ICC and 95% CI) standard error of measurement and minimal detectable change. Construct validity was evaluated between the different positions and the different contraction intensities using Friedman test.ResultsIntra-rater reliability was very high ICC2,k 0.87–0.98. The reliability of the 0.5 kg contraction was moderate with an ICC2,k of 0.59. Inter-rater reliability ranged from high to very high with an ICC2,k of 0.76–0.86. The reliability of the 0.5 kg, 1 kg contraction and the standing position was moderate with an ICC2,k of 0.55, 0.54 and 0.56 respectively. Inter-session reliability ranged from high to very high with an ICC2,k of 0.70–0.89. The reliability of the 0.5 kg contraction was moderate with an ICC2,k of 0.54. Construct validity was demonstrated between different contraction levels and different positions.ConclusionMyotonPRO is a reliable tool for the evaluation of Achilles tendon stiffness during different contraction levels and in different positions. Construct validity was supported by changes of tendon stiffness during the explored conditions. MyotonPRO can be implemented, as a ready to use device, in the evaluation of tendon tissue mechanical properties.

Reliability and Validity of the UMove Mobility Screen

2021 ◽  
pp. JNM-D-21-00001
Author(s):  
Chris Wells ◽  
Julie Pittas ◽  
Cynthia Roman ◽  
Krystal Lighty ◽  
Barbara Resnick
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Functional Mobility ◽  
Alpha Coefficient ◽  
Rater Reliability ◽  
Interclass Correlation ◽  
The Mean ◽  
Future Work

Background and PurposeThe UMove Mobility Screen (UMove) was developed to help bedside nurses accurately assess patient’s mobility. Objectives: The purpose of this study was to assess reliability and validity of the UMove.MethodsInterclass correlation coefficient (ICC) and alpha coefficient was completed to assess was based on internal consistency and inter-rater reliability. Construct validity was determined by ICC using two-way random model.ResultsAmong the 176 participants the mean age was 57 years (SD = 15), and 60% were men (N = 105). Internal consistency and inter-rater reliability were acceptable (alpha coefficient of .94 and an intraclass correlation of .98). There was evidence of construct validity with an intraclass correlation of .95 between the UMove and the standard therapists' evaluation of patient functional mobility.ConclusionsThere was evidence for reliability and validity of UMove. Future work should focus on the effectiveness of UMove on clinical outcomes.

scholarly journals Intra and Inter-Rater Reliability and Convergent Validity of FIT-HaNSA in Individuals with Grade П Whiplash Associated Disorder

2016 ◽  
Vol 10 (1) ◽  
pp. 179-189 ◽  
Author(s):  
Michael Pierrynowski ◽  
Colleen McPhee ◽  
Saurabh P. Mehta ◽  
Joy C. MacDermid ◽  
Anita Gross
Keyword(s):  
Construct Validity ◽  
Rating Scale ◽  
Motor Vehicle ◽  
Intraclass Correlation ◽  
Neck Disability Index ◽  
Correlation Coefficients ◽  
Control Group ◽  
Healthy Controls ◽  
Rater Reliability ◽  
Study Results

Background: Whiplash-Associated Disorders (WAD) are common following a motor vehicle accident. The Functional Impairment Test - Hand, and Neck/Shoulder/Arm (FIT-HaNSA) assesses upper extremity physical performance. It has been validated in patients with shoulder pathology but not in those with WAD. Objectives: Establish the Intra and inter-rater reliability and the known-group and construct validity of the FIT-HaNSA in patients with Grade II WAD (WAD2). Methods: Twenty-five patients with WAD2 and 41 healthy controls were recruited. Numeric Pain Rating Scale (NPRS), Neck Disability Index (NDI), Disabilities of the Arm, Shoulder and Hand (DASH), cervical range of motion (CROM), and FIT-HaNSA were completed at two sessions conducted 2 to 7 days apart by two raters. Intraclass correlation coefficients (ICC) were used to describe Intra and inter-rater reliability. Spearman rank correlation coefficients (ρ) were used to quantify the associations between scores of the FIT-HaNSA and other measures in the WAD2 group (convergent construct validity). Results: The Intra and inter-ICCs for the FIT-HaNSA scores ranged from 0.88 to 0.89 in the control group and 0.78 to 0.85 in the WAD2 group. Statistically significant differences in FIT-HaNSA performance between the two groups suggested known group construct validity (P < 0.001). The correlations between the NPRS, NDI, DASH, CROM and FIT-HaNSA were generally poor (ρ < 0.4). Conclusion: The study results indicate that the total FIT-HaNSA score has good Intra and inter-rater reliability and the construct validity in WAD2 and healthy controls.

scholarly journals Structured Reporting of Rectal Cancer Staging and Restaging: A Consensus Proposal

Cancers ◽  
2021 ◽  
Vol 13 (9) ◽  
pp. 2135
Author(s):  
Vincenza Granata ◽  
Damiano Caruso ◽  
Roberto Grassi ◽  
Salvatore Cappabianca ◽  
Alfonso Reginelli ◽  
...  
Keyword(s):  
Rectal Cancer ◽  
Correlation Coefficient ◽  
Clinical Decision Making ◽  
Intraclass Correlation ◽  
Clinical Decision ◽  
Cancer Staging ◽  
Structured Reporting ◽  
Quality Analysis ◽  
Promising Tool ◽  
Structured Reports

Background: Structured reporting (SR) in oncologic imaging is becoming necessary and has recently been recognized by major scientific societies. The aim of this study was to build MRI-based structured reports for rectal cancer (RC) staging and restaging in order to provide clinicians all critical tumor information. Materials and Methods: A panel of radiologist experts in abdominal imaging, called the members of the Italian Society of Medical and Interventional Radiology, was established. The modified Delphi process was used to build the SR and to assess the level of agreement in all sections. The Cronbach’s alpha (Cα) correlation coefficient was used to assess the internal consistency of each section and to measure the quality analysis according to the average inter-item correlation. The intraclass correlation coefficient (ICC) was also evaluated. Results: After the second Delphi round of the SR RC staging, the panelists’ single scores and sum of scores were 3.8 (range 2–4) and 169, and the SR RC restaging panelists’ single scores and sum of scores were 3.7 (range 2–4) and 148, respectively. The Cα correlation coefficient was 0.79 for SR staging and 0.81 for SR restaging. The ICCs for the SR RC staging and restaging were 0.78 (p < 0.01) and 0.82 (p < 0.01), respectively. The final SR version was built and included 53 items for RC staging and 50 items for RC restaging. Conclusions: The final version of the structured reports of MRI-based RC staging and restaging should be a helpful and promising tool for clinicians in managing cancer patients properly. Structured reports collect all Patient Clinical Data, Clinical Evaluations and relevant key findings of Rectal Cancer, both in staging and restaging, and can facilitate clinical decision-making.

scholarly journals Psychometric analysis of the Brazilian-version Kidscreen-27 questionnaire

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Pablo Magno da Silveira ◽  
Alexsandra da Silva Bandeira ◽  
Marcus Vinicius Veber Lopes ◽  
Adriano Ferreti Borgatto ◽  
Kelly Samara da Silva
Keyword(s):  
Public Schools ◽  
Construct Validity ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Well Being ◽  
Discriminatory Power ◽  
Brazilian Version ◽  
Related Quality ◽  
Health Related ◽  
Delta G

Abstract Background The objective of this study was to verify the reliability, discriminatory power and construct validity of the Kidscreen-27 questionnaire in Brazilian adolescents. Methods Adolescents that participated of the pilot study (210 adolescents; 52.9% boys; 13.7 years old) and of the baseline (816 participants; 52.7% girls; 13.1 years old) of the Movimente Project in 2016/2017 composed the sample of the present study. This project was carried out in six public schools in the city of Florianópolis, Santa Catarina, Brazil. Test–retest reproducibility was assessed by the intraclass correlation coefficient and Gwet coefficient; internal consistency through McDonald's Omega; Hankins' Delta G coefficient verified the scale's discriminatory power and; confirmatory factor analysis to assess construct validity. Results Reproducibility values ranged from 0.71 to 0.78 for the dimensions (ICC), and ranged from 0.60 to 0.83 for the items (Gwet). McDonald's Ômega (0.82–0.91) for internal consistency measures. Discriminatory power ranging from 0.94 for the dimension Social Support and Friends to 0.98 for Psychological Well-Being. The factorial loads were > 0.40, except for item 19 (0.36). The fit quality indicators of the model were adequate (X2[df] = 1022.89 [311], p < 0.001; RMSEA = 0.053 (0.049–0.087); CFI = 0.988; TLI = 0.987), confirming the five-factor structure originally proposed. Conclusions The Brazilian-version Kidscreen-27 achieved good levels of reproducibility, internal consistency, discriminatory power and construct validity. Its use is adequate to measure the health-related quality of life of adolescents in the Brazilian context.

scholarly journals Ultrasound Imaging Evaluation of Textural Features in Athletes with Soleus Pathology—A Novel Case-Control Study

2021 ◽  
Vol 18 (4) ◽  
pp. 1983 ◽  
Author(s):  
Blanca De-la-Cruz-Torres ◽  
Emmanuel Navarro-Flores ◽  
Daniel López-López ◽  
Carlos Romero-Morales
Keyword(s):  
Ultrasound Imaging ◽  
Soleus Muscle ◽  
Muscle Injury ◽  
Intraclass Correlation ◽  
Muscle Thickness ◽  
Tendon Injury ◽  
Muscle Injuries ◽  
Imaging Evaluation ◽  
Rater Reliability ◽  
Group A

Background: the aim of this study was to compare the echotexture of patients with soleus muscle injury and age matched controls. Methods: a sample of 62 athletes was recruited at the private clinic and was divided in two group: a healthy group (n = 31) and a soleus pathology group whose athletes had soleus muscle injury, located in the central tendon (n = 31). The muscle thickness (MTh), echointensity (EI) and echovariation (EV) were analyzed. An intra-rater reliability test (Intraclass Correlation Coefficient-ICC) was performed in order to analyze the reliability of the values of the measurements. Results: Sociodemographic variables did not show statistically significant differences (p > 0.05). Ultrasound imaging measurements who reported statistically significant differences were EI (p = 0.001) and standard deviation (SD) (p = 0.001). MTh and EV variables did not show statistically significant differences (p = 0.381 and p = 0.364, respectively). Moreover, reliability values for the MTh (ICC = 0.911), EI (ICC = 0.982), SD (ICC = 0.955) and EV (ICC = 0.963). Based on these results the intra-rater reliability was considered excellent. Conclusion: Athletes with a central tendon injury of soleus muscle showed a lower EI when they were compared to healthy athletes. The echogenicity showed by the quantitative ultrasound imaging measurement may be a more objective parameter for the diagnosis and follow-up the soleus muscle injuries.

scholarly journals Longitudinal Reproducibility of CO2-Triggered BOLD MRI for the Hemodynamic Evaluation of Adult Patients with Moyamoya Angiopathy

2021 ◽  
pp. 1-7
Author(s):  
Constantin Roder ◽  
Uwe Klose ◽  
Helene Hurth ◽  
Cornelia Brendle ◽  
Marcos Tatagiba ◽  
...  
Keyword(s):  
Intraclass Correlation ◽  
Collateral Flow ◽  
Surgical Revascularization ◽  
Bold Mri ◽  
Promising Tool ◽  
Hemodynamic Evaluation ◽  
Group 2 ◽  
Group 1

<b><i>Background and Purpose:</i></b> Hemodynamic evaluation of moyamoya patients is crucial to decide the treatment strategy. Recently, CO<sub>2</sub>-triggered BOLD MRI has been shown to be a promising tool for the hemodynamic evaluation of moyamoya patients. However, the longitudinal reliability of this technique in follow-up examinations is unknown. This study aims to analyze longitudinal follow-up data of CO<sub>2</sub>-triggered BOLD MRI to prove the reliability of this technique for long-term control examinations in moyamoya patients. <b><i>Methods:</i></b> Longitudinal CO<sub>2</sub> BOLD MRI follow-up examinations of moyamoya patients with and without surgical revascularization have been analyzed for all 6 vascular territories retrospectively. If revascularization was performed, any directly (by the disease or the bypass) or indirectly (due to change of collateral flow after revascularization) affected territory was excluded based on angiography findings (group 1). In patients without surgical revascularization between the MRI examinations, all territories were analyzed (group 2). <b><i>Results:</i></b> Eighteen moyamoya patients with 39 CO<sub>2</sub> BOLD MRI examinations fulfilled the inclusion criteria. The median follow-up between the 2 examinations was 12 months (range 4–29 months). For 106 vascular territories analyzed in group 1, the intraclass correlation coefficient was 0.784, <i>p</i> &#x3c; 0.001, and for group 2 (84 territories), it was 0.899, <i>p</i> &#x3c; 0.001. Within the total follow-up duration of 140 patient months, none of the patients experienced a new stroke. <b><i>Conclusions:</i></b> CO<sub>2</sub> BOLD MRI is a promising tool for mid- and long-term follow-up examinations of cerebral hemodynamics in moyamoya patients. Systematic prospective evaluation is required prior to making it a routine examination.

scholarly journals Intra-Rater (Live vs. Video Assessment) and Inter-Rater (Expert vs. Novice) Reliability of the Test of Gross Motor Development—Third Edition

2021 ◽  
Vol 18 (4) ◽  
pp. 1652
Author(s):  
Aida Carballo-Fazanes ◽  
Ezequiel Rey ◽  
Nadia C. Valentini ◽  
José E. Rodríguez-Fernández ◽  
Cristina Varela-Casal ◽  
...  
Keyword(s):  
Physical Education ◽  
Motor Development ◽  
Intraclass Correlation ◽  
Slow Motion ◽  
Healthy Children ◽  
Gross Motor ◽  
Rater Reliability ◽  
Video Assessment ◽  
Gross Motor Development ◽  
Ball Skills

The Test of Gross Motor Development (TGMD) is one of the most common tools for assessing the fundamental movement skills (FMS) in children between 3 and 10 years. This study aimed to examine the intra-rater and inter-rater reliability of the TGMD—3rd Edition (TGMD-3) between expert and novice raters using live and video assessment. Five raters [2 experts and 3 novices (one of them BSc in Physical Education and Sport Science)] assessed and scored the performance of the TGMD-3 of 25 healthy children [Female: 60%; mean (standard deviation) age 9.16 (1.31)]. Schoolchildren were attending at one public elementary school during the academic year 2019–2020 from Santiago de Compostela (Spain). Raters scored each children performance through two viewing moods (live and slow-motion). The ICC (Intraclass Correlation Coefficient) was used to determine the agreement between raters. Our results showed moderate-to-excellent intra-rater reliability for overall score and locomotor and ball skills subscales; moderate-to-good inter-rater reliability for overall and ball skills; and poor-to-good for locomotor subscale. Higher intra-rater reliability was achieved by the expert raters and novice rater with physical education background compared to novice raters. However, the inter-rater reliability was more variable in all the raters regardless of their experience or background. No significant differences in reliability were found when comparing live and video assessments. For clinical practice, it would be recommended that raters reach an agreement before the assessment to avoid subjective interpretations that might distort the results.

Sign in / Sign up

Export Citation Format

Share Document