scholarly journals Predictive Validity, Diagnostic Accuracy and Test-Retest Reliability of the Strength of Urges to Drink (SUTD) Scale

2019 ◽  
Vol 16 (19) ◽  
pp. 3714 ◽  
Author(s):  
Emma Beard ◽  
Jamie Brown ◽  
Robert West ◽  
Colin Drummond ◽  
Eileen Kaner ◽  
...  
Keyword(s):  
Diagnostic Accuracy ◽  
Predictive Validity ◽  
Retest Reliability ◽  
Identification Test ◽  
Test Retest Reliability ◽  
The Impact ◽  
Accuracy Data ◽  
Alcohol Reduction ◽  
Alcohol Toolkit Study

This study compared the 1-item Strength of Urges to Drink (SUTD) scale with the 10-item Alcohol Use Disorders Identification Test (AUDIT) on (i) test-retest reliability, (ii) predictive validity, and (iii) diagnostic accuracy. Data come from 2960 participants taking part in the Alcohol Toolkit Study (ATS), a monthly population survey of adults in England. The long-term test-retest reliability of the SUTD was ‘fair’, but lower than that for the AUDIT (Kappaweighted 0.24 versus 0.49). Individuals with “slight/moderate” urges to drink had higher odds of reporting an attempt to cut down relative to those not experiencing urges (adjusted odds ratios (AdjORs) 1.78 95% confidence interval (CI) 1.43–2.22 and 1.54 95% CI 1.20–1.96). Drinkers reporting “moderate/slight/strong” urges to drink had mean change in consumption scores which were 0.16 (95% CI −0.31 to −0.02), 0.40 (95% CI −0.56 to −0.24) and 0.37 (95% CI −0.69 to −0.05) units lower than those reporting no urges. For all outcomes, strong associations were found with AUDIT scores. The accuracy of the SUTD for discriminating between drinkers who did and did not reduce their consumption was ‘acceptable’, and similar to that for the AUDIT (ROCAUC 0.6). The AUDIT had better diagnostic accuracy in predicting change in alcohol consumption. The SUTD may be an efficient dynamic measure of urges to drink for population surveys and studies assessing the impact of alcohol-reduction interventions.

scholarly journals Development and Validation of an Emotional Intelligence Test for Medical Students

2021 ◽  
pp. 37-47
Author(s):  
R. Deepa ◽  
Anuja S. Panicker
Keyword(s):  
Emotional Intelligence ◽  
Medical Students ◽  
Predictive Validity ◽  
Medical Curriculum ◽  
Reliability And Validity ◽  
Medical Professionals ◽  
Second Phase ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
The Impact

Aims: Emotional intelligence is an important ability that has to be fostered among medical professionals. To foster an ability, it has to be assessed. The tests/tools already available are culture-sensitive and context-sensitive. Hence there is a need to develop a test to assess the emotional intelligence abilities of medical students. This paper describes a multiphase study in which an instrument was developed to assess the emotional intelligence of medical students. Study Design:  The study was done in four phases. The first three phases were to develop the instrument and establish its reliability and validity. The fourth phase was to demonstrate the predictive validity of the developed instrument. Place and Duration of Study: A private teaching hospital in South India; Two years. Methodology: In the first phase, the emotional challenges of medical students (n =55) were understood to develop the situations for the situational judgment tests. In the second phase, the instrument was developed with 38 items contributing to the constructs of EI. In the third phase, a pilot study was conducted, in which the developed tool was administered on a sample of 150 medical students. The data was used to verify the content validity, construct validity, internal consistency reliability (0.8), and predictive validity. In the fourth phase (n = 102) the test-retest reliability (with a ten-month interval between the tests) and the predictive validity (established by studying the association between EI measured with the tool and the academic performance of respondents) of the purified instrument were studied. Results: A tool to assess the EI of medical students was developed. The tool demonstrated test-retest reliability (0.6) and predictive validity (r = 0.29; P < .01). Conclusion: The tool would provide a premise for the development of training programs and their inclusion in the medical curriculum, which in turn would yield medical professionals who can deliver enhanced patient care. The study also showed the impact of EI on the academic achievement of medical students and hence their knowledge and skills will also be improved by including EI in their curriculum.

scholarly journals Validity, reliability, and calibration of the physical activity unit 7 item screener (PAU-7S) at population scale

2021 ◽  
Vol 18 (1) ◽  
Author(s):  
Helmut Schröder ◽  
Isaac Subirana ◽  
Julia Wärnberg ◽  
María Medrano ◽  
Marcela González-Gross ◽  
...  
Keyword(s):  
Physical Activity ◽  
Predictive Validity ◽  
Internal Consistency ◽  
Regression Models ◽  
Weighted Kappa ◽  
Linear Regression Models ◽  
Retest Reliability ◽  
Activity Unit ◽  
Test Retest Reliability ◽  
Acceptable Internal Consistency

Abstract Background Validation of self-reported tools, such as physical activity (PA) questionnaires, is crucial. The aim of this study was to determine test-retest reliability, internal consistency, and the concurrent, construct, and predictive validity of the short semi-quantitative Physical Activity Unit 7 item Screener (PAU-7S), using accelerometry as the reference measurement. The effect of linear calibration on PAU-7S validity was tested. Methods A randomized sample of 321 healthy children aged 8–16 years (149 boys, 172 girls) from the nationwide representative PASOS study completed the PAU-7S before and after wearing an accelerometer for at least 7 consecutive days. Weight, height, and waist circumference were measured. Cronbach alpha was calculated for internal consistency. Test-retest reliability was determined by intra-class correlation (ICC). Concurrent validity was assessed by ICC and Spearman correlation coefficient between moderate to vigorous PA (MVPA) derived by the PAU-7S and by accelerometer. Concordance between both methods was analyzed by absolute agreement, weighted kappa, and Bland-Altman statistics. Multiple linear regression models were fitted for construct validity and predictive validity was determined by leave-one-out cross-validation. Results The PAU-7S overestimated MVPA by 18%, compared to accelerometers (106.5 ± 77.0 vs 95.2 ± 33.2 min/day, respectively). A Cronbach alpha of 0.76 showed an acceptable internal consistency of the PAU-7S. Test-retest reliability was good (ICC 0.71 p < 0.001). Spearman correlation and ICC coefficients of MVPA derived by the PAU-7S and accelerometers increased from 0.31 to 0.62 and 0.20 to 0.62, respectively, after calibration of the PAU-7S. Between-methods concordance improved from a weighted kappa of 0.24 to 0.50 after calibration. A slight reduction in ICC, from 0.62 to 0.60, yielded good predictive validity. Multiple linear regression models showed an inverse association of MVPA with standardized body mass index (β − 0.162; p < 0.077) and waist to height ratio (β − 0.010; p < 0.014). All validity dimensions were somewhat stronger in boys compared to girls. Conclusion The PAU-7S shows a good test-retest reliability and acceptable internal consistency. All dimensions of validity increased from poor/fair to moderate/good after calibration. The PAU-7S is a valid instrument for measuring MVPA in children and adolescents. Trial registration Trial registration numberISRCTN34251612.

scholarly journals AB0882 RELIABILITY OF THE 3-M BACKWARDS WALK TEST IN PATIENTS WITH REVISION TOTAL KNEE ARTHROPLASTY

2020 ◽  
Vol 79 (Suppl 1) ◽  
pp. 1746.2-1746
Author(s):  
B. Unver ◽  
K. Sevik ◽  
V. Karatosun
Keyword(s):  
Total Knee Arthroplasty ◽  
Diagnostic Accuracy ◽  
Knee Arthroplasty ◽  
Fall Risk ◽  
Dynamic Balance ◽  
Fracture Dislocation ◽  
Walk Test ◽  
Retest Reliability ◽  
Total Knee ◽  
Test Retest Reliability

Background:Total knee arthroplasty (TKA) is an effective treatment for patients suffering from end-stage osteoarthritis with 10- to 15-year implant survivorship rates exceeding 90%. Infection, osteolysis due to polyethylene wear, loosening, stiffness and instability may cause to implant failure and revision of the TKA (rTKA). However, up to 20% of patients continue to have postoperative pain, functional limitations and low treatment satisfaction and 24% of patients were not able to walk unaided with no limp or a slight limp after TKA [1].Falls and related traumas can produce “fracture, dislocation, crushing, and other injuries” [2]. Falls often occur due to impaired physical function which includes changes in lower knee joint angle, weakened lower limb muscles, peripheral nerve blockade, deformity of the foot limited balance and gait.Several measures of fall risk have been previously developed however, recent research has demonstrated that backwards walking is more sensitive at identifying changes in mobility and balance compared to forward walking. Backwards walking is necessary to perform such tasks as backing up to a chair, opening up a door or getting out of the way of a sudden obstacle.3-M Backwards Walk Test (3MBWT) is used to evaluate walking skills, fall risk and dynamic balance. The 3MBWT demonstrated similar or better diagnostic accuracy for falls in the past year than the most commonly used measures and found to be reliable in healthy subjects. [3] However, its reliability in rTKA has not been investigated.Objectives:The purposes of this study were to determine the test-retest reliability and the minimal clinically important difference (MCID) of the 3MBWT in patients with rTKAMethods:Twenty-two patients with rTKA, operated on by the same surgeon, were included. For the 3MBWT, a distance of 3 meters was marked with tape and participants were asked to align their heels with the black tape. They were instructed to walk backwards as quickly. Patients performed trials for 3MBWT twice on the same day. Between the trials, patients waited for an hour on sitting position to prevent fatigue.Results:The 3MBWT showed an excellent test-retest reliability. Intraclass correlation coefficient ICC for 3MBWT was 0.97. The standard error of measurement and MCID at the 95% confidence level for 3MBWT were 1,08 and 2,99 respectively.Conclusion:The 3MBWT has an excellent test-retest reliability in patients with rTKA. It is an effective and reliable tool for measuring fall risk, dynamic balance and walking skills. As a clinical test, the 3MBWT is easy to score, has no cost, needs no special equipment and can be applied in a short time as part of the routine medical examination.References:[1]Shan L, Shan B, Suzuki A et al. Intermediate and long-term quality of life after total knee replacement: a systematic review and meta-analysis. JBJS 2015; 97: 156-168.[2]Johnson RL, Duncan CM, Ahn KS et al. Fall-Prevention Strategies and Patient Characteristics That Impact Fall Rates After Total Knee Arthroplasty. Anesthesia & Analgesia 2014; 119: 1113-1118.[3]Carter V, Jain T, James J et al. The 3-m Backwards Walk and Retrospective Falls: Diagnostic Accuracy of a Novel Clinical Measure. J Geriatr Phys Ther 2017.Disclosure of Interests:None declared

scholarly journals Psychometric properties of gross motor assessment tools for children: a systematic review

BMJ Open ◽  
2018 ◽  
Vol 8 (10) ◽  
pp. e021734 ◽  
Author(s):  
Alison Griffiths ◽  
Rachel Toovey ◽  
Prue E Morgan ◽  
Alicia J Spittle
Keyword(s):  
Psychometric Properties ◽  
Predictive Validity ◽  
Methodological Quality ◽  
Clinical Utility ◽  
Assessment Tools ◽  
Motor Assessment ◽  
Gross Motor ◽  
Retest Reliability ◽  
Validity Test ◽  
Test Retest Reliability

ObjectiveGross motor assessment tools have a critical role in identifying, diagnosing and evaluating motor difficulties in childhood. The objective of this review was to systematically evaluate the psychometric properties and clinical utility of gross motor assessment tools for children aged 2–12 years.MethodA systematic search of MEDLINE, Embase, CINAHL and AMED was performed between May and July 2017. Methodological quality was assessed with the COnsensus-based Standards for the selection of health status Measurement INstruments checklist and an outcome measures rating form was used to evaluate reliability, validity and clinical utility of assessment tools.ResultsSeven assessment tools from 37 studies/manuals met the inclusion criteria: Bayley Scale of Infant and Toddler Development-III (Bayley-III), Bruininks-Oseretsky Test of Motor Proficiency-2 (BOT-2), Movement Assessment Battery for Children-2 (MABC-2), McCarron Assessment of Neuromuscular Development (MAND), Neurological Sensory Motor Developmental Assessment (NSMDA), Peabody Developmental Motor Scales-2 (PDMS-2) and Test of Gross Motor Development-2 (TGMD-2). Methodological quality varied from poor to excellent. Validity and internal consistency varied from fair to excellent (α=0.5–0.99). The Bayley-III, NSMDA and MABC-2 have evidence of predictive validity. Test–retest reliability is excellent in the BOT-2 (intraclass correlation coefficient (ICC)=0.80–0.99), PDMS-2 (ICC=0.97), MABC-2 (ICC=0.83–0.96) and TGMD-2 (ICC=0.81–0.92). TGMD-2 has the highest inter-rater (ICC=0.88–0.93) and intrarater reliability (ICC=0.92–0.99).ConclusionsThe majority of gross motor assessments for children have good-excellent validity. Test–retest reliability is highest in the BOT-2, MABC-2, PDMS-2 and TGMD-2. The Bayley-III has the best predictive validity at 2 years of age for later motor outcome. None of the assessment tools demonstrate good evaluative validity. Further research on evaluative gross motor assessment tools are urgently needed.

The TAPS Project. 9: The Reliability of the Patient Attitude Questionnaire

1993 ◽  
Vol 162 (S19) ◽  
pp. 25-29 ◽  
Author(s):  
Graham Thornicroft ◽  
Christopher Gooch ◽  
Catherine O'Driscoll ◽  
Sawsan Reda
Keyword(s):  
Living Arrangements ◽  
Psychiatric Patients ◽  
Kappa Coefficient ◽  
Attitudinal Change ◽  
Attitude Questionnaire ◽  
Retest Reliability ◽  
Patient Attitude ◽  
The Mean ◽  
Test Retest Reliability

The development of the hospital and community versions of the Patient Attitude Questionnaire is described. The instrument rates the attitudes of psychiatric patients towards their treatment settings and staff, and is framed specifically to assess attitudinal change during the transfer of patients from hospital. For the items rated using the kappa coefficient of agreement, the mean test-retest reliability value was 0.51, and the average inter-rater value was 0.82. This study shows that long-term psychiatric patients are able to give clear and consistent views about their living arrangements - views that should be sought and respected by staff.

scholarly journals The Reliability, Validity and Normative Scores of the Bene-Anthony Family Relations Test for Use With Arab Children

2021 ◽  
Vol 12 ◽  
Author(s):  
Abdrabo Soliman ◽  
Abdel-Salam G. Abdel-Salam ◽  
Mervat Ahmed
Keyword(s):  
Family Relations ◽  
Clinical Status ◽  
Psychological Disorder ◽  
Normative Values ◽  
Future Research ◽  
Retest Reliability ◽  
Arab Children ◽  
Starting Point ◽  
Test Retest Reliability ◽  
The Impact

Background: The Bene-Anthony Family Relations Test (BAFRT) is one of the most widely used measures of family dynamics seen from a child’s perspective. However, the most common issue surrounding this test is the lack of accurate normative scores for use with non-white ethnic groups. The purpose of this study was to examine the BAFRT’s reliability and validity for use with Arab children, as well as to provide normative data for this group. Methods: The BAFRT was translated into Arabic and back-translated to ensure accuracy. The test was administered to a cohort of 394 Arab children, consisting of both cognitively normal children (n = 269) and children diagnosed with a psychological disorder (n = 125), all aged 5–8 years old. Test-retest reliability was assessed using a sub-set of children and validity was tested against clinical status as well as CBCL and SDQ measures. Normative measures were calculated after examining the impact of influencing variables such as age and gender. Results: Statistical analyses showed that in our cohort of Arab children the BAFRT has good test-retest reliability, correlates well with measures of emotional and behavioral adjustment, and discriminates accurately between clinical and non-clinical children. Age, gender, and clinical status all significantly impacted upon BAFRT scores and therefore normative values are presented from our cohort when considering these variables. Conclusion: The normative scores we present will provide researchers and clinicians an appropriate reference point for the comparison of scores from Arab children and a starting point for future research into this area.

scholarly journals State-of-the-art assessment allows for improved vestibular evoked myogenic potential test-retest reliability

2018 ◽  
Vol 8 (2) ◽  
Author(s):  
Lydia Behtani ◽  
Maxime Maheu ◽  
Audrey Delcenserie ◽  
Mujda Nooristani ◽  
François Champoux
Keyword(s):  
State Of The Art ◽  
Vestibular Evoked Myogenic Potentials ◽  
Vestibular Evoked Myogenic Potential ◽  
Retest Reliability ◽  
Vestibular Assessment ◽  
Myogenic Responses ◽  
Neurologically Normal ◽  
Test Retest Reliability ◽  
The Impact ◽  
Potential Test

The goal of the present study was to evaluate the test-retest reliability values of myogenic responses using the latest guidelines for vestibular assessment. Twenty-two otologically and neurologically normal adults were assessed twice, on two different days. The analyses were carried out using interclass correlations. The results showed that the latest recommendations for vestibular assessment lead to test-retest reliability values that are as high, or greater, than those reported in previous studies. The results suggest that state-of-the-art testing, using the latest recommendations as well as electromyography control, improves reliability values of myogenic responses, more specifically for the cervical vestibular evoked myogenic potentials. The impact of small differences in experimental procedures on the reliability values of myogenic responses is also addressed.

Sign in / Sign up

Export Citation Format

Share Document