Construct validity and reliability of tests for sacroiliac dysfunction: standing flexion test (STFT) and sitting flexion test (SIFT)

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Rafael P. Ribeiro ◽  
Filipe G. Guerrero ◽  
Eduardo N. Camargo ◽  
Luiza R. Pivotto ◽  
Mateus A. Aimi ◽  
...  
Keyword(s):  
Construct Validity ◽  
Kappa Statistic ◽  
Measurement Properties ◽  
Clinical Tests ◽  
Validity And Reliability ◽  
Evaluation Team ◽  
Rater Reliability ◽  
3 Dimensional ◽  
Dimensional Measurements ◽  
Flexion Test

Abstract Context Sacroiliac dysfunction is characterized by a hypomobility of the range of motion of the joint, followed by a positional change regarding the relationship between the sacrum and the iliac. In general, the clinical tests that evaluate the sacroiliac joint (SIJ) and its dysfunctions lack validity and reliability values. Objectives This article aims to evaluate the construct validity and intra- and inter-rater reliability of the standing flexion test (STFT) and sitting flexion test (SIFT). Methods In this prospective study, the sample consisted of 30 individuals of both sexes, and the evaluation team was composed of five researchers. The evaluations took place on two different days: first day, inter-rater reliability and construct validity; and second day, intra-rater reliability. The reference standard for the construct validity was 3-dimensional measurements obtained utilizing the BTS SMART-DX system. For statistical analysis, the percentage (%) agreement and the kappa statistic (K) were utilized. Results The construct validity was determined for STFT (70% agreement; K=0.49; p<0.01) and SIFT (56.7% agreement; K=0.29; p<0.05). The intra-rater reliability was determined for STFT (66.3% agreement; K=0.43; p<0.01) and SIFT (56.7% agreement; K=0.38; p<0.01). The inter-rater reliability was determined for STFT (10% agreement; K=−0.02; p=0.825) and SIFT (13.3% agreement; K=0.01; p=0.836). Conclusions The STFT confirmed the construct validity and was reliable when applied by the same rater to healthy people, even if the rater had no experience. It was not possible to achieve minimum scores using the SIFT either for construct validity or reliability. We suggest that further studies be conducted to investigate the measurement properties of palpatory clinical tests for SIJ mobility, especially in symptomatic patients.

scholarly journals Validity and Reliability of the Richmond Agitation-Sedation Scale in Pediatric Intensive Care Patients: A Multicenter Study

2022 ◽  
Vol 9 ◽  
Author(s):  
Rocío Tapia ◽  
Jesús López-Herce ◽  
Ángel Arias ◽  
Jimena del Castillo ◽  
Santiago Mencía
Keyword(s):  
Intensive Care ◽  
Construct Validity ◽  
Rating Scale ◽  
Pediatric Intensive Care ◽  
Measurement Properties ◽  
Critically Ill Children ◽  
Validity And Reliability ◽  
Sedation Scale ◽  
Richmond Agitation Sedation Scale ◽  
Rater Reliability

Background: There is limited data about the psychometric properties of the Richmond Agitation-Sedation Scale (RASS) in children. This study aims to analyze the validity and reliability of the RASS in assessing sedation and agitation in critically ill children.Methods: A multicenter prospective study in children admitted to pediatric intensive care, aged between 1 month and 18 years. Twenty-eight observers from 14 PICUs (pediatric intensive care units) participated. Every observation was assessed by 4 observers: 2 nurses and 2 pediatric intensivists. We analyzed RASS inter-rater reliability, construct validity by comparing RASS to the COMFORT behavior (COMFORT-B) scale and the numeric rating scale (NRS), and by its ability to distinguish between levels of sedation, and responsiveness to changes in sedative dose levels.Results: 139 episodes in 55 patients were analyzed, with a median age 3.6 years (interquartile range 0.7–7.8). Inter-rater reliability was excellent, weighted kappa (κw) 0.946 (95% CI, 0.93–0.96; p &lt; 0.001). RASS correlation with COMFORT-B scale, rho = 0.935 (p &lt; 0.001) and NRS, rho = 0.958 (p &lt; 0.001) was excellent. The RASS scores were significantly different (p &lt; 0.001) for the 3 sedation categories (over-sedation, optimum and under-sedation) of the COMFORT-B scale, with a good agreement between both scales, κw 0.827 (95% CI, 0.789–0.865; p &lt; 0.001), κ 0.762 (95% CI, 0.713–0.811, p &lt; 0.001). A significant change in RASS scores (p &lt; 0.001) was recorded with the variance of sedative doses.Conclusions: The RASS showed good measurement properties in PICU, in terms of inter-rater reliability, construct validity, and responsiveness. These properties, including its ability to categorize the patients into deep sedation, moderate-light sedation, and agitation, makes the RASS a useful instrument for monitoring sedation in PICU.

scholarly journals Validitas dan Reliabilitas Ujian SOCA (Students Oral Case Analysis): Studi di Salah Satu Fakultas Kedokteran di Indonesia

2016 ◽  
Vol 5 (3) ◽  
pp. 148
Author(s):  
Rizka Aries Putranti ◽  
Ova Emilia ◽  
Efrayim Suryadi
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Cognitive Complexity ◽  
Case Analysis ◽  
Medical Faculty ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Significant Difference ◽  
Kappa Value

Background: Medical faculty has to make sure that the students meet the minimal competence needed using apropriate exam. While the exam itself should facilitate students to learn. Oral examination has known for its ability to facilitate students learn but low in validity and reliability. Medical faculty of Lampung University (FK Unila) apply the student oral case analysis (SOCA) exam as one of block assessment component, as with MCQ, tutorial, and laboratory exam. This study aimed to evaluate validity and reliability of SOCA examination at FK UnilaMethod: Video of 65 students doing SOCA examination and 28 question rubrics had taken when odd semester exam year 2014-2015 has been carying out at FK Unila. Video and question rubrics were assessed by 5 panelis and analysed using Lawshe's content validity ratio (CVR) to determinate its content validity. Students performance on the video were re-assessed by another assessor to see inter-rater reliability, than analysed using kappa Cohen. Two expert in medical education assessed the cognitive comlpexity of the question rubrics. Data of SOCA's student's mark from year II, III, and IV were analysed for construct valdity and internal consistency.Results: 93,7% of the overall question in 65 video were valid (CVR>99%) and 71,8% question number in 28 question rubrics also valid according to 5 panelis. SOCA cognitive complexity were at level of analyse, know how and 4a. Inter-rater reliability analysis showed 0,549 (moderate agreement) kappa value. Mann Whitney analysis for construct validity showed no significant difference of all year. Cronbach alpha analysis showed internal consistency at the point 0,575.Conclusion: FK Unila's SOCA of odd semester examination year 2014-2015 has sufficient content validity, sufficient cognitive complexity and sufficent inter-rater reliability but lack in construct validity and internal consistency. Keywords: SOCA, validity, reliability

scholarly journals Validity and Reliability Assessment Tool of Nursing Students Professional Behavior

Jurnal NERS ◽  
2015 ◽  
Vol 10 (2) ◽  
pp. 208
Author(s):  
Fatikhu Yatuni Asmara
Keyword(s):  
Nursing Students ◽  
Construct Validity ◽  
Content Validity ◽  
Assessment Tool ◽  
Reliability Assessment ◽  
Reliability Test ◽  
Validity And Reliability ◽  
Professional Behaviour ◽  
Rater Reliability ◽  
Validity Test

Introduction: Shieffield Peer Review Assessment (SPRAT) is an instrument to assess medical student’s performance using Multi Source Feedback (MSF) method. The previous study stated that MSF with SPRAT is an effective tool assessing professional behaviour (PB) of nursing students both in clinical setting and community setting. However it needs more items to be added. Based on that explanation, it needs conducting validity and reliability test to make sure that the tool is valid and reliable. Method: There were two types of validity test used, content validity test and construct validity test as well as reliability test, namely inter-rater reliability test and item covariance test. Participants were four clinical instructors and 116 nursing students. Result: Content validity test showed that two items must be added as part of assessment item, namely diciplines and faithness. Furthermore construct validity test showed that five items were not valid since they had pearson correlation score <0.3. However the items were included as consideration of nursing students’s PB. Inter-rater reliability test and item covariance reliability test showed that the tool was reliable with score 0.460 and 0.912 respectively. Discussion: The assessment tool can be applied to assess PB of nursing students since it valid and reliable. It needs to investigate the effectiveness of the tool in difference of PB of nursing students.Keywords: validity, reliability, assessment tool of PB (professional behaviour)

scholarly journals An investigation of the measurement properties of the de Morton Mobility Index for measuring mobility capacity in hospital patients with Parkinson’s disease

2020 ◽  
pp. 026921552096647
Author(s):  
Tobias Braun ◽  
Detlef Marks ◽  
Christian Thiel ◽  
Alexandra Menig ◽  
Christian Grüneberg
Keyword(s):  
Parkinson’S Disease ◽  
Parkinson's Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Measurement Properties ◽  
Rater Reliability ◽  
Mobility Index ◽  
Hospital Patients ◽  
The Mean

Objective: To examine the measurement properties of the de Morton Mobility Index (DEMMI), a performance-based clinical outcome assessment of mobility capacity, in hospital patients with Parkinson’s disease. Design: Cross-sectional study. Participants: Hospital patients with Parkinson’s disease. Main outcome measure(s): Structural validity and unidimensionality (Rasch analysis), construct validity, internal consistency reliability, and inter-rater reliability of the de Morton Mobility Index (scale range: 0–100 points) were established. The minimal detectable change, the 95% limits of agreement and possible floor and ceiling effects were calculated to indicate interpretability. Results: We analysed validity ( n = 100; mean age: 70 years; 71% male) and reliability ( n = 47; mean age: 71 years; 68% male) in two samples. The mean Hoehn and Yahr stage was 3.2 and the mean disease duration was 12 years in both samples. Rasch analysis indicated unidimensionality with an overall fit to the model (chi-square = 21.49, P = 0.122). Seventy-three percent of hypotheses on construct validity were confirmed. Internal consistency reliability (Cronbach’s alpha = 0.91) and inter-rater reliability (intraclass correlation coefficient = 0.88; 95% confidence interval: 0.80 to 0.93) were sufficient. The minimal detectable change with 90% confidence was 17.5 points and the limits of agreement were 31%. No floor or ceiling effects were observed. The mean administration time was 6.6 minutes. Conclusion: This study provides evidence of unidimensionality, sufficient internal consistency reliability, inter-rater reliability, construct validity, and feasibility of the de Morton Mobility Index in hospital patients with Parkinson’s disease. Trial registration: German Clinical Trials Register (DRKS00004681). Registered May 6, 2013.

scholarly journals Validation of the Equine Behaviour Assessment and Research Questionnaire (E-BARQ): A New Survey Instrument for Exploring and Monitoring the Domestic Equine Triad

Animals ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. 1982 ◽  
Author(s):  
Kate Fenner ◽  
Sarah Matlock ◽  
Jane Williams ◽  
Bethany Wilson ◽  
Andrew McLean ◽  
...  
Keyword(s):  
Construct Validity ◽  
Quantitative Data ◽  
Assessment Tool ◽  
Questionnaire Validation ◽  
Subjective Ratings ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Validity Testing ◽  
Significant Alignment ◽  
Behavioural Assessment

The Equine Behaviour Assessment and Research Questionnaire (E-BARQ) was developed to obtain quantitative data on the domestic equine triad: training, management and behaviour. It can be taken repeatedly, thus collecting longitudinal data to enable evaluation of how changes in a horse’s training and management are reflected in that horse’s behaviour over time and how these changes can impact horse welfare in the longer term. Questionnaire validation and reliability were tested by determining (a) whether an owner’s subjective ratings of their horse’s problematic behaviours or undesirable temperament traits were reflected in the questionnaire scores obtained for that horse (construct validity), (b) whether two respondents, equally familiar with a particular horse, reported comparable scores for that horse through the questionnaire (inter-rater reliability), and (c) whether the same respondent, scoring the same horse after a known interval of time, recorded similar responses (intra-rater reliability). Construct validity testing of 1923 responses showed significant alignment between owners’ reported experience of focal horses’ behaviour and those horses’ E-BARQ scores, with scores varying from 1.13 to 1.34 for ridden horse behaviour (all p < 0.001) and from 1.06 to 1.43 for non-ridden horse behaviour (all p < 0.001). Inter-rater reliability testing of ten horse–rider pairs revealed that 203 of the 215 question items were significantly aligned (p < 0.001) when tested by two independent raters. Of the remaining 19 items, four had fair alignment (ĸ = 0.174–0.316; p = 0.281) and ten items, largely related to whether the horse shows behavioural signs related to anxiety when taken away from home, did not align (ĸ = 0; p = 1). Intra-rater reliability tests showed that the responses significantly aligned on all 215 question items tested (p < 0.001). The results of these tests confirmed the construct validity and reliability of E-BARQ as a standardised behavioural assessment tool for horses.

scholarly journals The Validity and Reliability Test of Modified Picture Vocabulary Test IV in 48-59 Months Old Children

1970 ◽  
Vol 2 (01) ◽  
pp. 65-76
Author(s):  
Sumarni ◽  
Amendi Nasution ◽  
Luh K Wahyuni ◽  
Trevino Pakasi
Keyword(s):  
Construct Validity ◽  
Correlation Coefficient ◽  
Internal Consistency ◽  
Standard Error ◽  
Internal Consistency Reliability ◽  
Vocabulary Test ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Standard Error Of Measurement ◽  
Error Of Measurement

Objectives: To investigate the validity and reliability of Modified Picture Vocabulary Test IV (PPVTIV) in 48-59 months old child. Methods 228 items in 19 sets of PPVT IV were translated in Indonesian language and revised according to Indonesian culture. One hundred and five 48-59 months old children were tested. The results wereanalyzed for its construct validity and reliability. The construct validity was valued by the correlation coefficient between the set score and the total score and the correlation coefficient between the itemscore and the set score. The reliability was valued by intra-class correlation coefficient, standard error of measurement (SEM) and Cronbach alpha.Results: The construct validity of Modified PPVT IV was good (r>0.256; α=0.01 n=100) and the reliability was high (internal consistency with Cronbach alpha= 0.938, inter-rater reliability= 0.957-0,985 and standard error of measurement (SEM) = 6.4).Conclusions: Modified PPVT IV was a valid instrument with satisfactory reliability. To increase the construct validity, there were 36 items that should be substituted.Key Words: Modified PPVT IV, construct validity, internal consistency reliability, inter-rater reliability, standard error of measurement Received in

Visual Assessment of the Spine Bruckel Instrument, a Novel Status Tool to Reflect Appearance of the Spine in Patients with Ankylosing Spondylitis

2010 ◽  
Vol 37 (3) ◽  
pp. 628-632
Author(s):  
DOMINIK W. PODBIELSKI ◽  
JANE BRUCKEL ◽  
EMMA POMEROY ◽  
ROBERT D. INMAN ◽  
ROBERT W. WARREN ◽  
...  
Keyword(s):  
Ankylosing Spondylitis ◽  
Construct Validity ◽  
Spinal Deformity ◽  
Structural Damage ◽  
Kappa Statistic ◽  
Visual Assessment ◽  
Spinal Mobility ◽  
Validity And Reliability ◽  
Practical Applications ◽  
Busy Clinical Setting

Objective.The Visual Assessment of the Spine Bruckel Instrument (VASBI) is a new status tool developed by the Spondylitis Association of America and the University of Toronto to reflect spinal appearance in patients with ankylosing spondylitis (AS). Our objective was to validate the VASBI according to the Outcome Measures in Rheumatoid Arthritis Clinical Trials filter (truth, discrimination, and feasibility).Methods.Three hundred patients with AS were asked to rate their degree of perceived spinal deformity using the VASBI. To evaluate construct validity, VASBI scores were compared with functional outcome, spinal mobility, and radiographic spinal damage. Test-retest reliability was evaluated using kappa statistic (κ).Results.Patient VASBI demonstrated strong correlation with spinal mobility (r = 0.543) and moderate correlation with functional impairment (r = 0.490) and structural damage (r = 0.309). Reliability for VASBI was very good (κ = 0.973, p < 0.001).Conclusion.The VASBI is a novel tool with practical applications in a busy clinical setting as it simplifies assessment of AS spinal deformity. Our study demonstrates that the VASBI has good feasibility, construct validity, and reliability.

scholarly journals A Tunisian version of the Confusion Assessment Method for the intensive care unit (CAM-ICU): translation and validation

2019 ◽  
Author(s):  
Imen Ben Saida ◽  
Saiid Kortli ◽  
Badii Amamou ◽  
Nawres Kacem ◽  
Mariem Ghardallou ◽  
...  
Keyword(s):  
Critically Ill ◽  
Critically Ill Patients ◽  
Kappa Statistic ◽  
Confusion Assessment Method ◽  
Assessment Method ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Diagnostic And Statistical Manual ◽  
Dsm 5 ◽  
Poor Outcomes

Abstract Background Delirium is common in critically ill patients and is associated with poor outcomes. In Tunisia, it remains however underdiagnosed, lacking a validated screening tool. The CAM-ICU is one of the most commonly used tools for detecting delirium in ICUs. The aim of the present study was to translate and validate a Tunisian version of the CAM-ICU. Methods A forward and backward translation was performed according to the guidelines suggested by the translation and cultural adaptation group. For the validation and inter-rater reliability assessment of the Tunisian CAM-ICU, two trained intensivists independently evaluated delirium in ICU patients admitted between October 2017 and June 2018. The results were compared with the reference evaluation carried out by a psychiatrist using the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5). The inter-rater reliability was calculated using the kappa statistic. Results The related material of the Tunisian translated version of the CAM-ICU is currently available at the website www.icudelirium.org (last access: October 19, 2019). The study enrolled 137 patients. The Tunisian CAM-ICU showed a very high inter-rater reliability for both intensivists in terms of assessing delirium (Kappa=0.844, p<0.001). Using the DSM-5 rater as the reference standard, the sensitivity of the two intensivists’ evaluations were 80.4% vs. 95.7%. Specificity was 98.9% for both respectively. Conclusions The Tunisian version of the CAM-ICU showed excellent validity and reliability in detecting delirium in critically ill patients. It could therefore be used in Tunisian ICUs or where Tunisian translators are available following appropriate training. Trial registration: Not applicable.

scholarly journals Development and Validation of the Danish Big Five Inventory-2

2020 ◽  
pp. 1-10 ◽  
Author(s):  
Anna Vedel ◽  
Kaare B. Wellnitz ◽  
Steven Ludeke ◽  
Christopher J. Soto ◽  
Oliver P. John ◽  
...  
Keyword(s):  
Construct Validity ◽  
Big Five ◽  
English Language ◽  
Level Structure ◽  
Measurement Properties ◽  
Item Pool ◽  
Validity And Reliability ◽  
Preliminary Measurement ◽  
Big Five Inventory ◽  
Development And Validation

Abstract. Following the publication of the Big Five Inventory- 2 (BFI-2) and its abbreviated forms (the 30-item BFI-2-S and 15-item BFI-2-XS), two studies were conducted to develop and validate a Danish translation of these measures. Study 1 first developed a preliminary Danish BFI-2 item pool consisting of translations of the 60 BFI-2 items, then tested and refined this item pool using two waves of data collection, and identified a set of 60-item formulations for the Danish BFI-2. Study 1 then examined the domain- and facet-level structure of the Danish BFI-2, and the construct validity and reliability of this measure. Study 2 tested the generalizability of the measurement properties of the Danish BFI-2 found in Study 1 as well as the preliminary measurement properties of its abbreviated forms (the Danish BFI-2-S and BFI-2-XS) in a new sample. The results of these studies indicate that the Danish BFI-2 is a reliable and valid personality measure with psychometric properties and construct validity corresponding to the English-language original. The preliminary results regarding measurement properties of the abbreviated forms are encouraging and should inspire further validation.

Sign in / Sign up

Export Citation Format

Share Document