scholarly journals Validity and Reliability of Two Field-Based Leg Stiffness Devices: Implications for Practical Use

2016 ◽  
Vol 32 (4) ◽  
pp. 415-419 ◽  
Author(s):  
Luca Ruggiero ◽  
Susan Dewhurst ◽  
Theodoros M. Bampouras

Leg stiffness is an important performance determinant in several sporting activities. This study evaluated the criterion-related validity and reliability of 2 field-based leg stiffness devices, Optojump Next® (Optojump) and Myotest Pro® (Myotest) in different testing approaches. Thirty-four males performed, on 2 separate sessions, 3 trials of 7 maximal hops, synchronously recorded from a force platform (FP), Optojump and Myotest. Validity (Pearson’s correlation coefficient, r; relative mean bias; 95% limits of agreement, 95%LoA) and reliability (coefficient of variation, CV; intraclass correlation coefficient, ICC; standard error of measurement, SEM) were calculated for first attempt, maximal attempt, and average across 3 trials. For all 3 methods, Optojump correlated highly to the FP (range r = .98–.99) with small bias (range 0.91–0.92, 95%LoA 0.86–0.98). Myotest demonstrated high correlation to FP (range r = .81–.86) with larger bias (range 1.92–1.93, 95%LoA 1.63–2.23). Optojump yielded a low CV (range 5.9% to 6.8%), high ICC (range 0.82–0.86), and SEM ranging 1.8–2.1 kN/m. Myotest had a larger CV (range 8.9% to 13.0%), moderate ICC (range 0.64–0.79), and SEM ranging from 6.3 to 8.9 kN/m. The findings present important information for these devices and support the use of a time-efficient single trial to assess leg stiffness in the field.

2019 ◽  
Vol 126 (5) ◽  
pp. 1006-1023 ◽  
Author(s):  
Alexis Padrón-Cabo ◽  
Ezequiel Rey ◽  
Alexandra Pérez-Ferreirós ◽  
Anton Kalén

This study aimed to evaluate the test–retest reliability of soccer skill tests belonging to the F-MARC test battery. To avoid bias during talent identification and development, coaches and scouts should be using reliable tests for assessing soccer-specific skills in young male players. Fifty-two U-14 outfield male soccer players performed F-MARC soccer skill tests on two occasions, separated by 7 days. After familiarization, we administered two trial sessions of five skill tests: speed dribbling, juggling, shooting, passing, and heading. We assessed absolute reliability by expressing the standard error of measurement as a coefficient of variation with 95% limits of agreement, and we assessed relative reliability with the intraclass correlation coefficient and with Pearson’s correlation ( r). The results demonstrated satisfactory relative and absolute reliability for speed dribbling, right foot juggling, short passing, shooting a dead ball right, shooting from a pass, heading in front, and heading right. However, reliability values for left foot juggling, chest-head-foot juggling, head-left-foot-right foot-chest-head juggling, long pass, and shooting a dead ball left tests were not strong enough to suggest their usage by coaches in training or sport scientists in research.


2014 ◽  
Vol 49 (3) ◽  
pp. 373-380 ◽  
Author(s):  
Mark R. Lafave ◽  
Larry Katz

Context: Health care professions have replaced traditional multiple choice tests or essays with structured and practical, performance-based examinations with the hope of eliminating rater bias and measuring clinical competence. Objective: To establish the validity and reliability of the Standardized Orthopedic Assessment Tool (SOAT) as a measure of clinical competence of orthopaedic injury evaluation. Design: Descriptive laboratory study. Setting: University. Patients or Other Participants: A total of 60 undergraduate students and 11 raters from 3 Canadian universities and 1 standardized patient. Intervention(s): Students were required to complete a 30-minute musculoskeletal evaluation in 1 of 2 randomly assigned mock scenarios involving the knee (second-degree medial collateral ligament sprain) or the shoulder (third-degree supraspinatus muscle strain). Main Outcome Measure(s): We measured interreliability with an intraclass correlation coefficient (ICC) (2,k) and stability of the tool with standard error of measurement and confidence intervals. Agreement was measured using Bland-Altman plots. Concurrent validity was measured using a Pearson product moment correlation coefficient whereby the raters' global rating of a student was matched to the cumulative mean grade score. Results: The ICCs were 0.75 and 0.82 for the shoulder and knee cases, respectively. Bland-Altman plots indicated no systematic bias between raters. In addition, Pearson product moment correlation analysis demonstrated a strong relationship between the overall cumulative mean grade score and the global rating score of the examinees' performances. Conclusions: This study demonstrated good interrater reliability of the SOAT with a standard error of measurement that indicated very modest stability, strong agreement between raters, and correlation indicative of concurrent validity.


2014 ◽  
Vol 94 (1) ◽  
pp. 129-138 ◽  
Author(s):  
Li-ling Chuang ◽  
Ching-yi Wu ◽  
Keh-chung Lin ◽  
Ching-ju Hsieh

BackgroundPain is a serious adverse complication after stroke. The combination of a vertical numerical pain rating scale (NPRS) and a faces pain scale (FPS) has been advocated to measure pain after stroke.ObjectiveThis study was conducted to investigate whether an NPRS supplemented with an FPS (NPRS-FPS) would show good test-retest reliability in people with stroke. The relative and absolute reliability of the NPRS-FPS were examined.DesignA test-retest design was used for this study.MethodsFifty people (>3 months after stroke) participating in an outpatient occupational therapy program were recruited through medical centers to rate current pain intensity twice, at a 1-week interval, with the NPRS-FPS (on a scale from 0 to 10). The relative reliability of the NPRS-FPS was analyzed with the intraclass correlation coefficient for determining the degree of consistency and agreement between 2 measures. The standard error of measurement, the smallest real difference, and Bland-Altman limits of agreement were the absolute reliability indexes used to quantify measurement errors and determine systematic biases of repeated measurements.ResultsThe relative reliability of the NPRS-FPS was substantial (intraclass correlation coefficient=.82). The standard error of measurement and the smallest real difference at the 90% confidence interval of the NPRS-FPS were 0.81 and 1.87, respectively. The Bland-Altman analyses revealed no significant systematic bias between repeated measurements for the NPRS-FPS. The range of the limits of agreement for the NPRS-FPS was narrow (−2.50 to 1.90), indicating a high level of stability and little variation over time.LimitationsThe pain intensity of the participants ranged from no pain to a moderate level of pain.ConclusionsThese findings suggest that the NPRS-FPS is a reliable measure of pain in people with stroke, with good relative and absolute reliability.


2016 ◽  
Vol 14 (4) ◽  
pp. 486-493 ◽  
Author(s):  
Hítalo Andrade da Silva ◽  
◽  
Muana Hiandra Pereira dos Passos ◽  
Valéria Mayaly Alves de Oliveira ◽  
Aline Cabral Palmeira ◽  
...  

ABSTRACT Objective To evaluate the interday reproducibility, agreement and validity of the construct of short version of the Depression Anxiety Stress Scale-21 applied to adolescents. Methods The sample consisted of adolescents of both sexes, aged between 10 and 19 years, who were recruited from schools and sports centers. The validity of the construct was performed by exploratory factor analysis, and reliability was calculated for each construct using the intraclass correlation coefficient, standard error of measurement and the minimum detectable change. Results The factor analysis combining the items corresponding to anxiety and stress in a single factor, and depression in a second factor, showed a better match of all 21 items, with higher factor loadings in their respective constructs. The reproducibility values for depression were intraclass correlation coefficient with 0.86, standard error of measurement with 0.80, and minimum detectable change with 2.22; and, for anxiety/stress: intraclass correlation coefficient with 0.82, standard error of measurement with 1.80, and minimum detectable change with 4.99. Conclusion The short version of the Depression Anxiety Stress Scale-21 showed excellent values of reliability, and strong internal consistency. The two-factor model with condensation of the constructs anxiety and stress in a single factor was the most acceptable for the adolescent population.


1970 ◽  
Vol 2 (01) ◽  
pp. 65-76
Author(s):  
Sumarni ◽  
Amendi Nasution ◽  
Luh K Wahyuni ◽  
Trevino Pakasi

Objectives: To investigate the validity and reliability of Modified Picture Vocabulary Test IV (PPVTIV) in 48-59 months old child. Methods 228 items in 19 sets of PPVT IV were translated in Indonesian language and revised according to Indonesian culture. One hundred and five 48-59 months old children were tested. The results wereanalyzed for its construct validity and reliability. The construct validity was valued by the correlation coefficient between the set score and the total score and the correlation coefficient between the itemscore and the set score. The reliability was valued by intra-class correlation coefficient, standard error of measurement (SEM) and Cronbach alpha.Results: The construct validity of Modified PPVT IV was good (r>0.256; α=0.01 n=100) and the reliability was high (internal consistency with Cronbach alpha= 0.938, inter-rater reliability= 0.957-0,985 and standard error of measurement (SEM) = 6.4).Conclusions: Modified PPVT IV was a valid instrument with satisfactory reliability. To increase the construct validity, there were 36 items that should be substituted.Key Words: Modified PPVT IV, construct validity, internal consistency reliability, inter-rater reliability, standard error of measurement Received in


Cephalalgia ◽  
2020 ◽  
pp. 033310242094986
Author(s):  
Juliana Pradela ◽  
Débora Bevilaqua-Grossi ◽  
Thais Cristina Chaves ◽  
Fabiola Dach ◽  
Gabriela Ferreira Carvalho

Background The Headache Disability Inventory assesses the dimensions of headache disability, but it is not available in Brazilian Portuguese yet. We aimed to translate the Headache Disability Inventory into Brazilian Portuguese and analyze its measurement properties. Methods Consecutive patients with headaches diagnosed by expert neurologists as per the International Classification of Headache Disorders were included. For the cross-cultural adaptation, 30 individuals answered the translated Headache Disability Inventory version. The internal consistency was evaluated, and the structural validity was assessed through exploratory factor analysis. For the construct validity assessment, 132 individuals answered the Headache Disability Inventory-Brazil, 12-item Short Form Survey (SF-12), and Headache Impact Test (HIT-6). After 1–3 weeks, 67 individuals again answered the Headache Disability Inventory-Brazil for the reliability assessment. The Pearson's correlation test, the intraclass correlation coefficient and the standard error of measurement were analyzed. Results The pre-stage version of the questionnaire was considered as the final version. The Headache Disability Inventory-Brazil had an internal consistency of 0.84 and consisted of a functional, emotional and social participation domain (factor loads > 0.3). The internal consistency ranged from 0.81 to 0.93 for each of the three domains. For the construct validity, the Headache Disability Inventory-Brazil presented moderate correlation with the SF-12 (r = −0.70, p < 0.05) and with the HIT-6 (r = 0.67, p ≤ 0.05). Its test-retest reliability was considered to be excellent (intraclass correlation coefficient = 0.95) and the standard error of measurement was 2.26 points. Conclusion The Headache Disability Inventory-Brazil was successfully translated and culturally adapted to the Brazilian population. It can be used for the impact assessment of primary and secondary headaches with validity and reliability equivalent to its original version.


2020 ◽  
pp. 1-4
Author(s):  
Emilie N. Miley ◽  
Ashley J. Reeves ◽  
Madeline P. Casanova ◽  
Nickolai J.P. Martonick ◽  
Jayme Baker ◽  
...  

Context: Total Motion Release® (TMR®) is a novel treatment paradigm used to restore asymmetries in the body (eg, pain, tightness, limited range of motion). Six primary movements, known as the Fab 6, are performed by the patient and scored using a 0 to 100 scale. Clinicians currently utilize the TMR® scale to modify treatment, assess patient progress, and measure treatment effectiveness; however, the reliability of the TMR® scale has not been determined. It is imperative to assess scale reliability and establish minimal detectable change (MDC) values to guide clinical practice. Objective: To assess the reliability of the TMR® scale and establish MDC values for each motion in healthy individuals in a group setting. Design: Retrospective analysis of group TMR® assessments. Setting: University classroom. Participants: A convenience sample of 61 students (23 males and 38 females; 25.48 [5.73] y), with (n = 31) and without (n = 30) previous exposure to TMR®. Intervention: The TMR® Fab 6 movements were tested at 2 time points, 2 hours apart. A clinician with previous training in TMR® led participant groups through both sessions while participants recorded individual motion scores using the 0 to 100 TMR® scale. Test–retest reliability was calculated using an intraclass correlation coefficient (2,1) for inexperienced, experienced, and combined student groups. Standard error of measurement and MDC values were also assessed for each intraclass correlation coefficient. Outcome Measure: Self-reported scores on the TMR® scale. Results: Test–retest reliability ranged from 0.57 to 0.95 across the Fab 6 movements, standard error of measurement values ranged from 4.85 to 11.77, and MDC values ranged from 13.45 to 32.62. Conclusion: The results indicate moderate to excellent reliability across the Fab 6 movements and a range of MDC values. Although this study is the first step in assessing the reliability of the TMR® scale for clinical practice, caution is warranted until further research is completed to establish reliability and MDC values of the TMR® scale in various settings to better guide patient care.


2006 ◽  
pp. 077-087
Author(s):  
Evgeny Arkadyevich Cherepanov ◽  
Aleksandr Vjacheslavovich Gladkov ◽  
Yaroslav Sergeyevich Titarenko

Objective. The assessment of reliability of data obtained using a firmware domestic complex Spine Scaner. Material and Methods. Fifty four healthy volunteers have been examined. Criteria for inclusion in the study were the absence of orthopedic pathology, and the Roland-Morris Back Pain Questionnaire and the Oswestry Disability Questionnaire scores being 0. Two independent observers with a different skill level performed the study. Intraobserver and interobserver data repeatability was assessed by the analysis of intraclass correlation coefficient (ICC), standard error of measurement (SEM), and reliability coefficient for each of 31 tested parameters. Results. The observation without fixation of a patient exhibited a low repeatability, with a correlation coefficient being 0.39. Other observation stages showed the acceptable ICC mean values. The best repeatability was achieved in the study performed by the same observer, with the ICC value beiing 0.86. The interobserver repeatability had the lesser values: 0.61 for independent identification of anatomic references and 0.77 for the references identified by one of the observers. Conclusion. The Spine Scaner can be used in clinical practice for defining a shape and spatial orientation of the spine under the following conditions: a reliable fixation of the patient’s trunk, wide experience of the observer, and a strict adherence to the study protocol.


2021 ◽  
pp. 026010602098235 ◽  
Author(s):  
Panchali Moitra ◽  
Preeti Verma ◽  
Jagmeet Madan

Background: Development of culturally appropriate and psychometrically sound instruments that measure knowledge and health behaviors of children will help to inform appropriate interventions. Aim: To develop and test the validity and reliability of a questionnaire measuring knowledge, attitudes, and practices to healthy eating and activity patterns in school children in India. Methods: Review of literature, focus-group discussions, and theoretical constructs of the Health Belief Model guided the development of an item pool. Face and content validity were assessed by children and a panel of experts and the item content validity, item difficulty, and discrimination indices were calculated. Construct validity was determined using the principal axis method of exploratory factor analysis among a cross-sectional sample of children ( n=252). Internal consistency (Cronbach α values >0.7) and test-retest reliability (intraclass correlation coefficient values >0.75) were estimated. Results: Item content validity index for clarity and relevance were satisfactory (>0.80) and internal consistency for knowledge (Kuder-Richardson 20 = 0.832), attitude (Cronbach’s α = 0.912), and practice items (Cronbach’s α = 0.769) were good. Four factors (children’s eating habits, family dietary practices, and consumption of healthy and unhealthy foods) and two factors (moderate to vigorous activities and sedentary activities) explained 67.7% and 48.2% of the total variance in practice items. Intraclass correlation coefficient estimates ranged from good to excellent (0.72–0.99). Conclusions: The results of the validity and reliability of the 84-item knowledge, attitudes, and practices to healthy eating and activity patterns in schoolchildren questionnaire were promising. The detailed description of the methodology employed may prove useful to researchers conducting similar studies in children.


2009 ◽  
Vol 9 (3) ◽  
pp. 331-338 ◽  
Author(s):  
Maria Aparecida Conti ◽  
Táki Athanássios Cordás ◽  
Maria do Rosário Dias de Oliveira Latorre

OBJECTIVES: to produce evidence of the validity and reliability of the Body Shape Questionnaire (BSQ) - a tool for measuring an individual's attitude towards his or her body image. METHODS: the study covered 386 young people of both sexes aged between 10 and 18 from a private school and used self-applied questionnaires and anthropometric evaluation. It evaluated the internal consistency, the discriminant validity for differences from the means, according to nutritional status (underweight, eutrophic, overweight and obese), the concurrent validity by way of Spearman's correlation coefficient between the scale and the Body Mass Index (BMI), the waist-hip circumference ratio (WHR) and the waist circumference (WC). Reliability was tested using Wilcoxon's Test, the intraclass correlation coefficient and the Bland-Altman figures. RESULTS: the BSQ displayed good internal consistency (±=0.96) and was capable of discriminating among the total population, boys and girls, according to nutritional status (p<0.001). It correlated with the BMI (r=0.41; p<0.001), WHR (r=-0.10; p=0.043) and WC (r=0.24; p<0.001) and its reliability was confirmed by intraclass correlation (r=0.91; p<0.001) for the total population. The questionnaire was easy to understand and could be completed quickly. CONCLUSIONS: the BSQ presented good results, thereby providing evidence of its validity and reliability. It is therefore recommended for evaluation of body image attitudes among adolescents.


Sign in / Sign up

Export Citation Format

Share Document