scholarly journals Convergent validity and reliability of a novel repeated agility protocol in junior rugby league players

F1000Research ◽  
2021 ◽  
Vol 9 ◽  
pp. 624
Author(s):  
Anthony Nicholls ◽  
Anthony Leicht ◽  
Jonathan Connor ◽  
Aaron Halliday ◽  
Kenji Doma

Background: : Rugby league involves repeated, complex, and high intensity change-of-direction (COD) movements with no existing test protocols that specifically assesses these multiple physical fitness components simultaneously. Thus, the current study examined the convergent validity of a repeated Illinois Agility (RIA) protocol with the repeated T-agility protocol, and the repeatability of the RIA protocol in adolescent Rugby League players. Furthermore, aerobic capacity and anaerobic and COD performance were assessed to determine whether these physical qualities were important contributors to the RIA protocol. Methods: Twenty-two junior Rugby League players completed 4 sessions with each separated by 7 days. Initially, physical fitness characteristics at baseline (i.e., Multi-stage Shuttle test, countermovement jump, 30-m sprint, single-effort COD and repeated sprint ability [RSA]) were assessed. The second session involved a familiarisation of RIA and repeated T-agility test (RTT) protocols. During the third and fourth sessions, participants completed the RIA and RTT protocols in a randomised, counterbalanced design to examine the validity and test-retest reliability of these protocols. Results: For convergent validity, significant correlations were identified between RIA and RTT performances (r= >0.80; p<0.05). For contributors to RIA performance, significant correlations were identified between all baseline fitness characteristics and RIA (r = >0.71; p < 0.05). Reliability of the RIA protocol was near perfect with excellent intra-class correlation coefficient (0.87-0.97), good ratio limits of agreement (×/÷ 1.05-1.06) and low coefficient of variations (1.8-2.0%). Conclusions: The current study has demonstrated the RIA to be a simple, valid and reliable field test for RL athletes that can provide coaches with information about their team’s ability to sustain high intensity, multi-directional running efforts.

F1000Research ◽  
2021 ◽  
Vol 9 ◽  
pp. 624
Author(s):  
Anthony Nicholls ◽  
Anthony Leicht ◽  
Jonathan Connor ◽  
Aaron Halliday ◽  
Kenji Doma

Background: : Rugby league involves repeated, complex, and high intensity change-of-direction (COD) movements with no existing test protocols that specifically assesses these multiple physical fitness components simultaneously. Thus, the current study examined the convergent validity of a repeated Illinois Agility (RIA) protocol with the repeated T-agility protocol, and the repeatability of the RIA protocol in adolescent Rugby League players. Furthermore, aerobic capacity and anaerobic and COD performance were assessed to determine whether these physical qualities were important contributors to the RIA protocol. Methods: Twenty-two junior Rugby League players completed 4 sessions with each separated by 7 days. Initially, physical fitness characteristics at baseline (i.e., Beep test,, countermovement jump, 30-m sprint, single-effort COD and repeated sprint ability [RSA]) were assessed. The second session involved a familiarisation of RIA and repeated T-agility test (RTT) protocols. During the third and fourth sessions, participants completed the RIA and RTT protocols in a randomised, counterbalanced design to examine the validity and test-retest reliability of these protocols. Results: For convergent validity, significant correlations were identified between RIA and RTT performances (r= >0.80; p<0.05). For contributors to RIA performance, significant correlations were identified between all baseline fitness characteristics and RIA (r = >0.71; p < 0.05). Reliability of the RIA protocol was near perfect with excellent intra-class correlation coefficient (0.87-0.97), good ratio limits of agreement (×/÷ 1.05-1.06) and low coefficient of variations (1.8-2.0%). Conclusions: The current study has demonstrated the RIA to be a simple, valid and reliable field test for RL athletes that can provide coaches with information about their team’s ability to sustain high intensity, multi-directional running efforts.


F1000Research ◽  
2020 ◽  
Vol 9 ◽  
pp. 624
Author(s):  
Anthony Nicholls ◽  
Anthony Leicht ◽  
Jonathan Connor ◽  
Aaron Halliday ◽  
Kenji Doma

Background: Rugby league involves repeated, complex, change-of-direction movements, although there are no test protocols that specifically assesses these physical fitness profiles. Thus, the current study examined the convergent validity and reliability of a repeated Illinois Agility (RIA) protocol in adolescent Rugby League players. Methods: Twenty-two junior Rugby League players completed 4 sessions with each separated by 7 days. Initially, physical fitness characteristics at baseline (i.e., multi-stage fitness, countermovement jump, 30-m sprint, single-effort agility and repeated sprint ability [RSA]) were assessed. The second session involved a familiarisation of RIA and repeated T-agility test (RTT) protocols. During the third and fourth sessions, participants completed the RIA and RTT protocols in a randomised, counterbalanced design to examine the validity and test-retest reliability of these protocols. Results: For convergent validity, significant correlations were identified between RIA and RTT performances (r= >0.80; p<0.05). For contributors to RIA performance, significant correlations were identified between all baseline fitness characteristics and RIA (r = >0.71; p < 0.05). Reliability of the RIA protocol was near perfect with excellent intra-class correlation coefficient (0.87-0.97), good ratio limits of agreement (×/÷ 1.05-1.06) and low coefficient of variations (1.77-1.97%). Conclusions: The current study has demonstrated the RIA to be a simple, valid and reliable field test that can provide coaches with information about their athlete’s ability to sustain high intensity, multi-directional running efforts.


2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.


2021 ◽  
pp. 016327872199283
Author(s):  
Beverly W. Henry ◽  
Danica Billingsly ◽  
Derryl E. Block ◽  
Joseph Ehrmann

While interpersonal skills in telehealth may positively impact clinical practice, patient engagement and outcomes, assessment strategies are lacking. We conducted a multi-stage iterative approach to develop and test validity and reliability of the Teaching Interpersonal Skills in Telehealth checklist (TIPS-TC). First, we identified observable communication behaviors from the literature. Second, we surveyed telehealth managers and researchers (N = 11) to rate appropriateness of potential checklist items. Level of agreement (35%–91%) and Kappa statistic (0.18–0.89) confirmed items to be retained and identified items to modify. Based on response patterns and comments, we reduced 44 items to 12 critical checklist behaviors. Third, student clinicians used the checklist with video telehealth consultations and provided feedback. Fourth, we conducted reliability testing with practitioners and administrators (N = 68) who completed the TIPS-TC for two versions of a telehealth scenario. Strong interrater reliability intraclass correlation coefficient (ICC) and test-retest reliability ICC (both p < .001), along with non-significant findings of order effects supported the checklist as an acceptable instrument to differentiate high skill from low skill telehealth sessions. The TIPS-TC offers an evidence-based approach to assessing interpersonal skills in telehealth to help evaluate clinician competence and tailor learning activities across disciplinary roles.


2018 ◽  
Vol 8 (3) ◽  
pp. 306-320 ◽  
Author(s):  
Francesca Morganti ◽  
Alex Soli ◽  
Paola Savoldelli ◽  
Gloria Belotti

Background: In health-care settings, the use of the Neuropsychiatric Inventory-Nursing Home (NPI-NH) may not always be consistent with the authors’ guidelines, which affects its reliability. To avoid this bias, a diary version of the NPI (NPI-Diary) was developed. Aims: This study aimed to evaluate the psychometric properties (internal consistency and reliability) of the NPI-Diary, and examined its convergence with the NPI-NH. Methods: Two raters administered the NPI-NH and NPI-Diary to 40 participants with Alzheimer’s disease, selected randomly from a hospital’s weekly turnover. Results: The NPI-Diary exhibited adequate internal consistency (total: α = 0.581) and test-retest reliability (total: ρ = 0.711; p < 0.01). The interrater reliability values (ICC) for the NPI-NH and NPI-Diary differed significantly (Total: NPI-NH ICC = 0.506, NPI-Diary ICC = 0.879; Frequency: NPI-NH ICC = 0.51, NPI-Diary ICC = 0.798; Severity: NPI-NH ICC = 0.491, NPI-Diary ICC = 0.809). The convergent validity between the two inventories was also significant (total: ρ = 0.48; p < 0.01). Conclusions: The NPI-Diary showed more appropriate validity and reliability compared to the NPI-NH, when administered in a highly variable sample, as is generally the case in the current health-care setting.


2020 ◽  
Author(s):  
Victoria Long ◽  
Yin Bun Cheung ◽  
Debra Qu ◽  
Katherine Lim ◽  
Guozhang Lee ◽  
...  

Abstract Context: Measurement of patient-centred outcomes enables clinicians to focus on patient and family priorities and enables quality of palliative care to be assessed.Objectives: This study aimed to evaluate the validity and reliability of the English and translated Chinese IPOS among advanced cancer patients in Singapore.Methods: IPOS was forward and backward translated from English into Chinese. Structural validity was assessed by confirmatory factor analysis; known-group validity by comparing inpatients and community patients; construct validity by correlating IPOS with Edmonton Symptom Assessment System-revised (ESAS-r) and Functional Assessment of Cancer Therapy–General (FACT-G); internal consistency by Cronbach’s alpha; inter-rater reliability between patient and staff responses; test-retest reliability of patient responses between two timepoints.Results: 111 English-responding and 109 Chinese-responding patients participated. The three-factor structure (Physical Symptoms, Emotional Symptoms and Communication and Practical Issues) was confirmed with Comparative Fit Index and Tucker-Lewis-Index > 0.9 and Root Mean Square Error of Approximation < 0.08. Inpatients scored higher than outpatients as hypothesised. Construct validity (Pearson’s correlation coefficient, r≥|0.608|) was shown between the related subscales of IPOS and FACT-G and ESAS-r. Internal consistency was confirmed for total and subscale scores (Cronbach's alpha ≥ 0.84), except for the Communication and Practical Issues subscale (Cronbach’s alpha = 0.29–0.65). Inter-rater reliability (Intra-class correlation coefficient [ICC] ≤ 0.43) between patient and staff responses was insufficient. Test-retest reliability was confirmed with Intra-class correlation coefficient ICC = 0.80 (English) and 0.88 (Chinese) for IPOS Total.Conclusion: IPOS in English and Chinese showed good validity, good internal consistency, and good test-retest reliability, except for the Communication and Practical Issues subscale. There was poor inter-rater reliability between patients and staff.


Author(s):  
J Baker ◽  
JR Paturel ◽  
K Kimpinski

Background: To develop a scale to quantify and discriminate orthostatic from non-orthostatic symptoms. We present initial validation and reliability of orthostatic and non-orthostatic symptom scores taken from the Orthostatic Discriminate and Severity Scale (ODSS). Methods: Validity and reliability were assessed in participants with and without orthostatic intolerance. Convergent validity was assessed by correlating symptoms scores with previously validated tools (Autonomic Symptom Profile (ASP) and the Orthostatic Hypotension Questionnaire (OHQ)). Clinical validity was assessed by correlating scores against standardized autonomic testing. Test-retest reliability was calculated using an intra-class correlation coefficient. Results:Convergent Validity: Orthostatic (OS) and Non-Orthostatic (NS) Symptom Scores from 77 controls and 67 patients with orthostatic intolerance were highly correlated with both the Orthostatic Intolerance index of the ASP (OS:r=0.903;NS:r=0.651; p<0.001) and the OHQ: (OS:r=0.800;NS:r=0.574; p<0.001). Clinical Validity: Symptom Scores were significantly correlated with the blood pressure change during head-up tilt (OS:r=-0.445;NS:r=-0.354; p<0.001). Patients with orthostatic intolerance had significantly higher symptom scores compared to controls (OS:66.5±18.1 vs. 17.4±12.9; NS:19.9±11.3 vs. 10.2±6.8; p<0.001, respectively). Test-retest reliability: Both symptom scores were highly reliable (OS:r=0.956;NS:r=0.574, respectively; p<0.001) with an internal consistency of 0.978 and 0.729, respectively. Conclusions: Our initial results demonstrate that the ODSS is capable of producing valid and reliable Orthostatic and Non-Orthostatic Symptom Scores.


Author(s):  
Susi Ari Kristina ◽  
Dwi Endarti ◽  
Tri Murti Andayani ◽  
M. Rifqi Rokhman

Objective: To estimate validity and reliability of WTP questionnaire which WTP value can be taken as an indication of the monetary value of health gains, which may carry information regarding the appropriate height of the cost-effectiveness threshold.Methods: Three hundred respondents, in Yogyakarta province, Indonesia, were interviewed during June 2017. We examine a value of WTP associated with the following scenarios: 1) improving moderate condition; 2) extending life during terminal illness, and 3) lifesaving. The interview ascertained maximum hypothetical WTP for one QALY using a dichotomous bidding format with an open-ended final question, along with questions about the socio-economic factors. Concerning validity, the WTP of the 3 versions of hypothetical scenarios were compared as known-group validity and analysis of the sensitivity and specificity was performed. Test-retest reliability and alpha Cronbach were employed to measure internal consistency.Results: Analysis generally confirmed the validity and reliability of the WTP hypothetical scenarios. In terms of known group validity, there was significant difference across two scenarios (treatment v. s lifesaving), but no significant difference between mean WTP for treatment and terminal illness was found. Mean WTP for terminal illness (38 Million IDR) and lifesaving scenario (16 Million IDR) was significantly higher than that of treatment scenario (14 Million IDR). The WTP instrument showed good convergent validity (r=0.784), when comparing correlation between WTP value and utility score. Estimation of scenario’s sensitivity and specificity in deriving expected WTP were 70.33 % and 38.98 %, respectively. The positive and negative predictive values were 64 % and 46 %. The test-retest reliability of WTP values indices excellent stability and reliability of the instrument with Spearman’s rank correlation coefficient of 0.816 (p<0.001)Conclusion: This study demonstrated that the WTP instrument is feasible and relatively reliable for measuring the WTP values in Indonesia. For wider application of the instrument, its validity should be investigated further. Meanwhile, adoption of WTP as an empirical evidence of societal values is encouraged. 


2020 ◽  
Vol 41 (3) ◽  
pp. e61-e66
Author(s):  
Sérgio Duarte Dortas Junior ◽  
Solange Oliveira Rodrigues Valle ◽  
Karsten Weller ◽  
Marcus Maurer ◽  
Omar Lupi

Background: The urticaria control test (UCT) is a patient-reported outcome measure designed to determine the current level of disease control in patients with chronic urticaria (CU). Recently, a Brazilian UCT was developed, but its validity and reliability are unknown. Method: The clinimetric properties of the Brazilian UCT short form (UCTsh) and its long form (UCTlg) were determined in 130 patients with CU. In parallel, the urticaria activity scores (UAS) that covers 7 days (UAS7) and 28 days (UAS28) were used to assess disease activity. Subsequently, the results were analyzed statistically to determine the validity, reliability, and interpretability of the Brazilian UCT versions. Results: A total of 107 female (82%) and 23 male patients with CU completed both versions of the Brazilian UCT. Both of the Brazilian UCT versions showed excellent internal consistency reliability. In addition, the Brazilian UCT results showed strong correlations with UAS7 and UAS28 results, which indicated high levels of convergent validity. The test-retest reliability was examined in a subsample of 27 patients with CU and was found to be excellent. Notably, the results of both Brazilian UCT versions correlated extensively, which suggested that the UCTsh can replace the UCTlg without changing the UCT results. Conclusion: The Brazilian UCT is a valid and reliable tool for assessing disease control. To facilitate the use of the Brazilian UCT in global studies and to put a stronger focus on the specificity, we propose that the same cutoff values for well-controlled disease should be used as identified in the original publication of the UCT, i.e., ≥12 points for the UCTsh.


Author(s):  
Morteza Khazaei ◽  
Mark D. Holder ◽  
Fuschia M. Sirois ◽  
Lindsay G. Oades ◽  
Benedicte Gendron

(1) Background: The present study developed and evaluated a personal emotional capital questionnaire (PECQ) for adults that assessed 10 domains of personal emotional capital. (2) Method: Initially, 100 items were created and then administered to students attending Semnan University and Semnan University of Medical Sciences in Iran. Of the 700 questionnaires distributed, 527 were completed in full. Students were sampledusing the multi-stage random cluster method. Exploratory factor analyses, Cronbach’s alpha, and test–retest reliability were used to evaluate the scale. (3) Results: The ten components ofthe PECQ were confirmed. Test–retest correlations after 30 days were high, as was Cronbach’s alpha (0.94). Thecomponents highly correlatedwith overall emotional capital. The PECQ displayed convergent validity as it positively correlated with the Keyes’s Mental Health Continuum—Short Form and students’GPAs. The PECQ displayed divergent validity as it negatively correlated with measures of depression, anxiety and stress (Depression Anxiety and Stress Scale (DASS21)). Differences in overall PECQ scores and its components were examined for several variables including gender, age, marital and employment status, academic program, and field of study. PECQ scores were not sensitive to the order of administering questionnaires. (4) Conclusion: The results suggest that the PECQ is a valid and reliable measure of personal emotional capital and supports its use in adults.


Sign in / Sign up

Export Citation Format

Share Document