Convergent validity and reliability of a novel repeated agility protocol in junior rugby league players

Background: Rugby league involves repeated, complex, change-of-direction movements, although there are no test protocols that specifically assesses these physical fitness profiles. Thus, the current study examined the convergent validity and reliability of a repeated Illinois Agility (RIA) protocol in adolescent Rugby League players. Methods: Twenty-two junior Rugby League players completed 4 sessions with each separated by 7 days. Initially, physical fitness characteristics at baseline (i.e., multi-stage fitness, countermovement jump, 30-m sprint, single-effort agility and repeated sprint ability [RSA]) were assessed. The second session involved a familiarisation of RIA and repeated T-agility test (RTT) protocols. During the third and fourth sessions, participants completed the RIA and RTT protocols in a randomised, counterbalanced design to examine the validity and test-retest reliability of these protocols. Results: For convergent validity, significant correlations were identified between RIA and RTT performances (r= >0.80; p<0.05). For contributors to RIA performance, significant correlations were identified between all baseline fitness characteristics and RIA (r = >0.71; p < 0.05). Reliability of the RIA protocol was near perfect with excellent intra-class correlation coefficient (0.87-0.97), good ratio limits of agreement (×/÷ 1.05-1.06) and low coefficient of variations (1.77-1.97%). Conclusions: The current study has demonstrated the RIA to be a simple, valid and reliable field test that can provide coaches with information about their athlete’s ability to sustain high intensity, multi-directional running efforts.

Download Full-text

Convergent validity and reliability of a novel repeated agility protocol in junior rugby league players

F1000Research ◽

10.12688/f1000research.23129.2 ◽

2021 ◽

Vol 9 ◽

pp. 624

Author(s):

Anthony Nicholls ◽

Anthony Leicht ◽

Jonathan Connor ◽

Aaron Halliday ◽

Kenji Doma

Keyword(s):

Physical Fitness ◽

High Intensity ◽

Convergent Validity ◽

Rugby League ◽

Intensity Change ◽

Validity And Reliability ◽

Intra Class Correlation ◽

Change Of Direction ◽

Test Retest Reliability ◽

Intra Class Correlation Coefficient

Background: : Rugby league involves repeated, complex, and high intensity change-of-direction (COD) movements with no existing test protocols that specifically assesses these multiple physical fitness components simultaneously. Thus, the current study examined the convergent validity of a repeated Illinois Agility (RIA) protocol with the repeated T-agility protocol, and the repeatability of the RIA protocol in adolescent Rugby League players. Furthermore, aerobic capacity and anaerobic and COD performance were assessed to determine whether these physical qualities were important contributors to the RIA protocol. Methods: Twenty-two junior Rugby League players completed 4 sessions with each separated by 7 days. Initially, physical fitness characteristics at baseline (i.e., Beep test,, countermovement jump, 30-m sprint, single-effort COD and repeated sprint ability [RSA]) were assessed. The second session involved a familiarisation of RIA and repeated T-agility test (RTT) protocols. During the third and fourth sessions, participants completed the RIA and RTT protocols in a randomised, counterbalanced design to examine the validity and test-retest reliability of these protocols. Results: For convergent validity, significant correlations were identified between RIA and RTT performances (r= >0.80; p<0.05). For contributors to RIA performance, significant correlations were identified between all baseline fitness characteristics and RIA (r = >0.71; p < 0.05). Reliability of the RIA protocol was near perfect with excellent intra-class correlation coefficient (0.87-0.97), good ratio limits of agreement (×/÷ 1.05-1.06) and low coefficient of variations (1.8-2.0%). Conclusions: The current study has demonstrated the RIA to be a simple, valid and reliable field test for RL athletes that can provide coaches with information about their team’s ability to sustain high intensity, multi-directional running efforts.

Download Full-text

Convergent validity and reliability of a novel repeated agility protocol in junior rugby league players

F1000Research ◽

10.12688/f1000research.23129.3 ◽

2021 ◽

Vol 9 ◽

pp. 624

Author(s):

Anthony Nicholls ◽

Anthony Leicht ◽

Jonathan Connor ◽

Aaron Halliday ◽

Kenji Doma

Keyword(s):

Physical Fitness ◽

High Intensity ◽

Convergent Validity ◽

Rugby League ◽

Intensity Change ◽

Validity And Reliability ◽

Change Of Direction ◽

Multi Stage ◽

Test Retest Reliability ◽

Intra Class Correlation Coefficient

Background: : Rugby league involves repeated, complex, and high intensity change-of-direction (COD) movements with no existing test protocols that specifically assesses these multiple physical fitness components simultaneously. Thus, the current study examined the convergent validity of a repeated Illinois Agility (RIA) protocol with the repeated T-agility protocol, and the repeatability of the RIA protocol in adolescent Rugby League players. Furthermore, aerobic capacity and anaerobic and COD performance were assessed to determine whether these physical qualities were important contributors to the RIA protocol. Methods: Twenty-two junior Rugby League players completed 4 sessions with each separated by 7 days. Initially, physical fitness characteristics at baseline (i.e., Multi-stage Shuttle test, countermovement jump, 30-m sprint, single-effort COD and repeated sprint ability [RSA]) were assessed. The second session involved a familiarisation of RIA and repeated T-agility test (RTT) protocols. During the third and fourth sessions, participants completed the RIA and RTT protocols in a randomised, counterbalanced design to examine the validity and test-retest reliability of these protocols. Results: For convergent validity, significant correlations were identified between RIA and RTT performances (r= >0.80; p<0.05). For contributors to RIA performance, significant correlations were identified between all baseline fitness characteristics and RIA (r = >0.71; p < 0.05). Reliability of the RIA protocol was near perfect with excellent intra-class correlation coefficient (0.87-0.97), good ratio limits of agreement (×/÷ 1.05-1.06) and low coefficient of variations (1.8-2.0%). Conclusions: The current study has demonstrated the RIA to be a simple, valid and reliable field test for RL athletes that can provide coaches with information about their team’s ability to sustain high intensity, multi-directional running efforts.

Download Full-text

Validity and reliability of the English and translated Chinese versions of the Integrated Palliative care Outcome Scale (IPOS) in Singapore

10.21203/rs.3.rs-120229/v1 ◽

2020 ◽

Author(s):

Victoria Long ◽

Yin Bun Cheung ◽

Debra Qu ◽

Katherine Lim ◽

Guozhang Lee ◽

...

Keyword(s):

Correlation Coefficient ◽

Internal Consistency ◽

Validity And Reliability ◽

Cronbach’S Alpha ◽

Rater Reliability ◽

Intra Class Correlation ◽

Retest Reliability ◽

Cronbach's Alpha ◽

Test Retest Reliability ◽

Intra Class Correlation Coefficient

Abstract Context: Measurement of patient-centred outcomes enables clinicians to focus on patient and family priorities and enables quality of palliative care to be assessed.Objectives: This study aimed to evaluate the validity and reliability of the English and translated Chinese IPOS among advanced cancer patients in Singapore.Methods: IPOS was forward and backward translated from English into Chinese. Structural validity was assessed by confirmatory factor analysis; known-group validity by comparing inpatients and community patients; construct validity by correlating IPOS with Edmonton Symptom Assessment System-revised (ESAS-r) and Functional Assessment of Cancer Therapy–General (FACT-G); internal consistency by Cronbach’s alpha; inter-rater reliability between patient and staff responses; test-retest reliability of patient responses between two timepoints.Results: 111 English-responding and 109 Chinese-responding patients participated. The three-factor structure (Physical Symptoms, Emotional Symptoms and Communication and Practical Issues) was confirmed with Comparative Fit Index and Tucker-Lewis-Index > 0.9 and Root Mean Square Error of Approximation < 0.08. Inpatients scored higher than outpatients as hypothesised. Construct validity (Pearson’s correlation coefficient, r≥|0.608|) was shown between the related subscales of IPOS and FACT-G and ESAS-r. Internal consistency was confirmed for total and subscale scores (Cronbach's alpha ≥ 0.84), except for the Communication and Practical Issues subscale (Cronbach’s alpha = 0.29–0.65). Inter-rater reliability (Intra-class correlation coefficient [ICC] ≤ 0.43) between patient and staff responses was insufficient. Test-retest reliability was confirmed with Intra-class correlation coefficient ICC = 0.80 (English) and 0.88 (Chinese) for IPOS Total.Conclusion: IPOS in English and Chinese showed good validity, good internal consistency, and good test-retest reliability, except for the Communication and Practical Issues subscale. There was poor inter-rater reliability between patients and staff.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Development of the Teaching Interpersonal Skills for Telehealth Checklist

Evaluation & the Health Professions ◽

10.1177/0163278721992831 ◽

2021 ◽

pp. 016327872199283

Author(s):

Beverly W. Henry ◽

Danica Billingsly ◽

Derryl E. Block ◽

Joseph Ehrmann

Keyword(s):

Interpersonal Skills ◽

Intraclass Correlation ◽

Test Validity ◽

Kappa Statistic ◽

Order Effects ◽

Response Patterns ◽

Validity And Reliability ◽

Communication Behaviors ◽

Multi Stage ◽

Test Retest Reliability

While interpersonal skills in telehealth may positively impact clinical practice, patient engagement and outcomes, assessment strategies are lacking. We conducted a multi-stage iterative approach to develop and test validity and reliability of the Teaching Interpersonal Skills in Telehealth checklist (TIPS-TC). First, we identified observable communication behaviors from the literature. Second, we surveyed telehealth managers and researchers (N = 11) to rate appropriateness of potential checklist items. Level of agreement (35%–91%) and Kappa statistic (0.18–0.89) confirmed items to be retained and identified items to modify. Based on response patterns and comments, we reduced 44 items to 12 critical checklist behaviors. Third, student clinicians used the checklist with video telehealth consultations and provided feedback. Fourth, we conducted reliability testing with practitioners and administrators (N = 68) who completed the TIPS-TC for two versions of a telehealth scenario. Strong interrater reliability intraclass correlation coefficient (ICC) and test-retest reliability ICC (both p < .001), along with non-significant findings of order effects supported the checklist as an acceptable instrument to differentiate high skill from low skill telehealth sessions. The TIPS-TC offers an evidence-based approach to assessing interpersonal skills in telehealth to help evaluate clinician competence and tailor learning activities across disciplinary roles.

Download Full-text

The Influence of Maximal Strength and Knee Angle on the Reliability of Peak Force in the Isometric Squat

Sports ◽

10.3390/sports9100140 ◽

2021 ◽

Vol 9 (10) ◽

pp. 140

Author(s):

Arthur E. Lynch ◽

Robert W. Davies ◽

Philip M. Jakeman ◽

Tim Locke ◽

Joanna M. Allardyce ◽

...

Keyword(s):

Peak Force ◽

Knee Angle ◽

Force Output ◽

Reliable Measure ◽

Intra Class Correlation ◽

Retest Reliability ◽

Test Retest Reliability ◽

Intra Class Correlation Coefficient ◽

Acceptable Reliability ◽

Maximal Effort

This study aimed to investigate the test-retest reliability of peak force in the isometric squat across the strength spectrum using coefficient of variation (CV) and intra-class correlation coefficient (ICC). On two separate days, 59 healthy men (mean (SD) age 23.0 (4.1) years; height 1.79 (0.7) m; body mass 84.0 (15.2) kg) performed three maximal effort isometric squats in two positions (at a 120° and a 90° knee angle). Acceptable reliability was observed at both the 120° (CV = 7.5 (6.7), ICC = 0.960 [0.933, 0.977]) and 90° positions (CV = 9.2 (8.8), ICC = 0.920 [0.865, 0.953]). There was no relationship between peak force in the isometric squat and the test-retest reliability at either the 120° (r = 0.052, p = 0.327) or 90° (r = 0.014, p = 0.613) positions. A subgroup of subjects (n = 17) also completed the isometric squat test at a 65° knee angle. Acceptable reliability was observed in this position (CV = 9.6 (9.3), ICC = 0.916 [0.766, 0.970]) and reliability was comparable to the 120° and 90° positions. Therefore, we deem isometric squat peak force output to be a valid and reliable measure across the strength spectrum and in different isometric squat positions.

Download Full-text

Validity and Reliability of Socio-Cognitive Determinants of Water Intake Questionnaire in Kidney Stones Patients

10.21203/rs.2.12175/v2 ◽

2020 ◽

Author(s):

Mehdi Mirzaei-Alavijeh ◽

Farzad Jalilian ◽

Halimeh Fatahi ◽

Laleh Solaimanizadeh ◽

Abdollah Saadatfar ◽

...

Keyword(s):

Internal Consistency ◽

Water Intake ◽

Kidney Stones ◽

Psychometric Evaluation ◽

Field Studies ◽

Validity And Reliability ◽

Intra Class Correlation ◽

Theoretical Assumptions ◽

Cognitive Determinants ◽

Intra Class Correlation Coefficient

Abstract Background Developing a valid and reliable questionnaire is an important step in field studies. This study aimed to evaluate the psychometric propertiesof the socio-cognitive determinants of water intake questionnaire behaviors among patients with kidney stones in the west of Iran.Methods Construct items were elicited from interviews with kidney stones patients, experts and socio-cognitive items pool-related similar questionnaires. Internal consistency, face, content, and construct validity were evaluated. Data were analyzed by SPSS (ver. 20.0).Results Based on Eigenvalues of ≥ 1.00 and factor loadings of ≥ 0.40, five determinants were extracted. The calculated Kaiser–Meyer–Olkin (KMO) value was 0.697. The socio-cognitive determinants of water intake questionnaires were found to have acceptable internal consistency (Cronbach alpha of determinants between 0.65-0.85) and the theoretical assumptions for face, content, and construct validities were confirmed. The Intra-class Correlation Coefficient (ICC) of socio-cognitive determinants was high (ICC between 0.810 - 0.911). Overall, the five studied socio-cognitive determinants explained 73.83% of the variance in the proposed model.Conclusions The socio-cognitive determinants of water intake questionnaire were revealed to have an acceptable psychometric evaluation. The questionnaire could be used to predict or explain water intake behavior in order to develop programs to increase water intake behavior among kidney stones patients.

Download Full-text

The Neuropsychiatric Inventory-Diary Rating Scale (NPI-Diary): A Method for Improving Stability in Assessing Neuropsychiatric Symptoms in Dementia

Dementia and Geriatric Cognitive Disorders Extra ◽

10.1159/000490380 ◽

2018 ◽

Vol 8 (3) ◽

pp. 306-320 ◽

Cited By ~ 5

Author(s):

Francesca Morganti ◽

Alex Soli ◽

Paola Savoldelli ◽

Gloria Belotti

Keyword(s):

Health Care ◽

Internal Consistency ◽

Convergent Validity ◽

Care Setting ◽

Rating Scale ◽

Neuropsychiatric Symptoms ◽

Validity And Reliability ◽

Neuropsychiatric Inventory ◽

Test Retest Reliability ◽

Adequate Internal Consistency

Background: In health-care settings, the use of the Neuropsychiatric Inventory-Nursing Home (NPI-NH) may not always be consistent with the authors’ guidelines, which affects its reliability. To avoid this bias, a diary version of the NPI (NPI-Diary) was developed. Aims: This study aimed to evaluate the psychometric properties (internal consistency and reliability) of the NPI-Diary, and examined its convergence with the NPI-NH. Methods: Two raters administered the NPI-NH and NPI-Diary to 40 participants with Alzheimer’s disease, selected randomly from a hospital’s weekly turnover. Results: The NPI-Diary exhibited adequate internal consistency (total: α = 0.581) and test-retest reliability (total: ρ = 0.711; p < 0.01). The interrater reliability values (ICC) for the NPI-NH and NPI-Diary differed significantly (Total: NPI-NH ICC = 0.506, NPI-Diary ICC = 0.879; Frequency: NPI-NH ICC = 0.51, NPI-Diary ICC = 0.798; Severity: NPI-NH ICC = 0.491, NPI-Diary ICC = 0.809). The convergent validity between the two inventories was also significant (total: ρ = 0.48; p < 0.01). Conclusions: The NPI-Diary showed more appropriate validity and reliability compared to the NPI-NH, when administered in a highly variable sample, as is generally the case in the current health-care setting.

Download Full-text

The adaption and evaluation of a Latvian version of the National Institutes of Health Stroke Scale

Journal of International Medical Research ◽

10.1177/0300060516664636 ◽

2016 ◽

Vol 45 (6) ◽

pp. 1861-1869 ◽

Cited By ~ 1

Author(s):

Kristaps Jurjāns ◽

Iļja Noviks ◽

Diāna Volčeka ◽

Linda Zandersone ◽

Kristīne Meilerte ◽

...

Keyword(s):

National Institutes Of Health ◽

Assessment Tools ◽

Rater Agreement ◽

Validity And Reliability ◽

Stroke Patients ◽

Intra Class Correlation ◽

Scale Validity ◽

Study Population ◽

The Mean ◽

Intra Class Correlation Coefficient

Objectives To determine the validity and reliability of a Latvian version of the National Institutes of Health Stroke Scale (LV-NIHSS) for evaluating Latvian stroke patients. Methods The adaption of the LV-NIHSS followed standard methods used for the adaption and validation of clinical assessment tools. The scale validity was tested by comparison with the Glasgow Coma Scale (GCS) and the modified Rankin scale (mRs). The reliability of the LV-NIHSS was evaluated by intra-rater and inter-rater agreement using intra-class correlation coefficient (ICC) analysis. Results A total of 296 stroke patients and 101 control subjects were evaluated. The mean age of the overall study population was 73.6 years (range, 37 – 94 years; 227 [57.2%] were female). The mean LV-NIHSS score of the patients with stroke was 8.4 ± 6.2. In terms of construct validity of the LV-NIHSS, it correlated with the GCS ( r = −0.571) and mRs ( r = 0.755). In terms of the reliability of the LV-NIHSS, the inter-rater agreement had an ICC of 0.99 and the intra-rater agreement had an ICC of 0.99. Conclusion The adaption of LV-NIHSS was successful and the evaluation showed that the scale was valid and reliable for evaluating Latvian stroke patients.

Download Full-text

P.111 Initial validation of symptom scores derived from the Orthostatic Discriminant and Severity Scale

Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques ◽

10.1017/cjn.2018.213 ◽

2018 ◽

Vol 45 (s2) ◽

pp. S45-S45

Author(s):

J Baker ◽

JR Paturel ◽

K Kimpinski

Keyword(s):

Convergent Validity ◽

Orthostatic Intolerance ◽

Clinical Validity ◽

Severity Scale ◽

Validity And Reliability ◽

Retest Reliability ◽

Initial Validation ◽

Symptom Profile ◽

Symptom Scores ◽

Test Retest Reliability

Background: To develop a scale to quantify and discriminate orthostatic from non-orthostatic symptoms. We present initial validation and reliability of orthostatic and non-orthostatic symptom scores taken from the Orthostatic Discriminate and Severity Scale (ODSS). Methods: Validity and reliability were assessed in participants with and without orthostatic intolerance. Convergent validity was assessed by correlating symptoms scores with previously validated tools (Autonomic Symptom Profile (ASP) and the Orthostatic Hypotension Questionnaire (OHQ)). Clinical validity was assessed by correlating scores against standardized autonomic testing. Test-retest reliability was calculated using an intra-class correlation coefficient. Results:Convergent Validity: Orthostatic (OS) and Non-Orthostatic (NS) Symptom Scores from 77 controls and 67 patients with orthostatic intolerance were highly correlated with both the Orthostatic Intolerance index of the ASP (OS:r=0.903;NS:r=0.651; p<0.001) and the OHQ: (OS:r=0.800;NS:r=0.574; p<0.001). Clinical Validity: Symptom Scores were significantly correlated with the blood pressure change during head-up tilt (OS:r=-0.445;NS:r=-0.354; p<0.001). Patients with orthostatic intolerance had significantly higher symptom scores compared to controls (OS:66.5±18.1 vs. 17.4±12.9; NS:19.9±11.3 vs. 10.2±6.8; p<0.001, respectively). Test-retest reliability: Both symptom scores were highly reliable (OS:r=0.956;NS:r=0.574, respectively; p<0.001) with an internal consistency of 0.978 and 0.729, respectively. Conclusions: Our initial results demonstrate that the ODSS is capable of producing valid and reliable Orthostatic and Non-Orthostatic Symptom Scores.

Download Full-text