scholarly journals Test-Retest Reliability of a Visual-Cognitive Technology (BlazePod™) to Measure Response Time

2021 ◽  
pp. 179-180
Author(s):  
Levy A. de-Oliveira ◽  
Matheus V. Matos ◽  
Iohanna G. S. Fernandes ◽  
Diêgo A. Nascimento ◽  
Marzo E. da Silva-Grigoletto
Keyword(s):  
Young Adults ◽  
Response Time ◽  
Moderate Increase ◽  
Systematic Bias ◽  
Physically Active ◽  
Retest Reliability ◽  
New Device ◽  
Smallest Detectable Change ◽  
Test Retest Reliability ◽  
Level Of Agreement

A new technology (BlazePod™) that measures response time (RT) is currently on the market and has been used by strength and conditioning professionals. Nevertheless, to trust in the measurement, before the use of a new device to measure any outcome in the research or clinical setting, a reliability analysis of its measurement must be established (Koo and Li, 2016). Hence, we assessed the test-retest reliability (repeatability) of the BlazePod™ (Play Coyotta Ltd., Aviv, Israel) technology during a pre-defined activity to provide information about the level of agreement and the magnitude of errors incurred when using the technology. This information can assist practitioners and researchers in the use of BlazePod™ technology. We recruited 24 physically active young adults (age = 23.9 ± 4.0 years; height = 1.67 ± 0.09 m; body mass = 68.2 ± 13.1 kg), who were free of injuries, and any orthopedic, or cardiorespiratory diseases. Participants reported to the laboratory on two occasions, separated by one week. One week before, participants performed a familiarization session with the instrument. During the first session, the one-leg balance activity (OLBA) was performed. This activity was chosen randomly among all BlazePod™ pre-defined activities. We conducted all sessions in a physiology laboratory at the same time for each participant and under similar environmental conditions (~23° C; ~60% humidity). The OLBA consisted of a unipedal balance activity performed with four pods arranged in a square on the floor. Participants stood up in the center of the square, and the OLBA aim was to tap out as many lights as possible with the dominant foot during 30 seconds. The system lighted up in a random order not known by the participants neither the researchers. The distance between the Pods was the individual lower limb length. Three trials were performed. The best value obtained was recorded. A one-minute rest interval between all trials was given. The total number of taps and average RT of all taps in the OLBA were recorded for further analysis. Data are presented as mean ± SD or 95% confidence interval (CI). We confirmed the normal data distribution using the Shapiro-Wilk test. A paired t-test, Cohen’s d effect size (ES) and its 95% CI were calculated to assess the magnitude of the mean difference between sessions. The interpretation of the ES was: trivial (<0.20), small (0.20-0.59), moderate (0.60-1.19), large (1.2-2.0) and very large (>2.0) effect (Hopkins et al., 2009). The intraclass correlation coefficient (ICC) and its 95% CI was used to assess the reliability based on a single measurement, absolute-agreement, two-way mixed-effects model. The ICC value was interpreted as follows: poor (<0.5), moderate (0.5-0.75), good (0.75-0.9), and excellent (>0.9) reliability (Koo and Li, 2016). We also calculated the standard error of measurement (SEM), the coefficient of variation (CV), the smallest detectable change (SDC), the level of agreement between sessions by a Bland-Altman plot, the systematic bias, and its 95% limits of agreement (LoA = bias ± 1.96 SD) (Bland and Altman, 1986). We observed a small to moderate increase between sessions for the number of taps (Day 1 = 20 ± 3 taps, Day 2 = 22 ± 4 taps; t(23) = -4.121; p < 0.001; ES = 0.55, 95% CI = 0.43 to 0.67) and a trivial to small decrease for the RT (Day 1 = 1418 ± 193 ms, Day 2 = 1358 ± 248 ms; t(23) = 1.721; p = 0.099; ES = -0.27, 95% CI = -0.15 to -0.38 CI). All reliability indexes for both outcome measures are shown in Table 1. Moderate to excellent levels of reliability were found by the ICC (95% CI) values and acceptable reliability by the CV for both measures. Bland-Altman plots are depicted in Figure 1. The systematic bias that we found showed that on average in the second day, participants achieved two taps more than the first day and were 59 ms faster than the first day. The LoA showed that the number of taps measured in the first day might be 7 units below or 3 units above Day 2. Besides, the RT measured in Day 1 might be 272 ms below or 391 ms above Day 2. In conclusion, the BlazePod™ technology provides reliable information during its OLBA in physically active young adults. We considered the measurement error as acceptable for practical use since low systematic biases and errors of measurement were reported in this study, besides a moderate ICC and excellent CV. These results suggest that practitioners can use the information provided by the BlazePod™ technology to monitor performance changes during cognitive training and to evaluate the effects of a training intervention.

Validity and Reliability of a New Device (WIMU®) for Measuring Hamstring Muscle Extensibility

2017 ◽  
Vol 38 (09) ◽  
pp. 691-695 ◽  
Author(s):  
José Muyor
Keyword(s):  
Standard Error ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Systematic Bias ◽  
Hamstring Muscle ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
New Device ◽  
Test Retest Reliability ◽  
Straight Leg Raise

AbstractThe aims of the current study were 1) to evaluate the validity of the WIMU® system for measuring hamstring muscle extensibility in the passive straight leg raise (PSLR) test using an inclinometer for the criterion and 2) to determine the test-retest reliability of the WIMU® system to measure hamstring muscle extensibility during the PSLR test. 55 subjects were evaluated on 2 separate occasions. Data from a Unilever inclinometer and WIMU® system were collected simultaneously. Intraclass correlation coefficients (ICCs) for the validity were very high (0.983–1); a very low systematic bias (−0.21°–−0.42°), random error (0.05°–0.04°) and standard error of the estimate (0.43°–0.34°) were observed (left–right leg, respectively) between the 2 devices (inclinometer and the WIMU® system). The R2 between the devices was 0.999 (p<0.001) in both the left and right legs. The test-retest reliability of the WIMU® system was excellent, with ICCs ranging from 0.972–0.995, low coefficients of variation (0.01%), and a low standard error of the estimate (0.19–0.31°). The WIMU® system showed strong concurrent validity and excellent test-retest reliability for the evaluation of hamstring muscle extensibility in the PSLR test.

scholarly journals Validity and Reliability of an Electronic Contact Mat for Drop Jump Assessment in Physically Active Adults

Sports ◽  
2019 ◽  
Vol 7 (5) ◽  
pp. 114 ◽  
Author(s):  
Florian Tenelsen ◽  
Dennis Brueckner ◽  
Thomas Muehlbauer ◽  
Marco Hagen
Keyword(s):  
Force Plate ◽  
Jump Condition ◽  
Systematic Bias ◽  
Drop Height ◽  
Drop Jump ◽  
Physically Active ◽  
Retest Reliability ◽  
Drop Jumps ◽  
Test Retest Reliability ◽  
Active Adults

The aim of the present study was to investigate the concurrent validity and the test–retest reliability of an electronic contact mat for drop jump assessment in physically active adults. Seventy-nine young, physically active adults participated in the validity study, and 49 subjects were recruited for the reliability study. The motor task required subjects to perform two-legged drop jumps using drop heights of 24, 43, and 62 cm as well as one-legged drop jumps with the left and right leg using a drop height of 24 cm. Ground contact times were simultaneously quantified with an electronic contact mat, a force plate (i.e., gold standard), and a light-barrier system (another criterion device). Concurrent validity was assessed using intraclass correlation coefficient (ICC), systematic bias, limits of agreement, and linear regression analysis. Test–retest reliability (one week apart) was determined by calculating the ICC, the standard error of measurement (SEM), the coefficient of variation (CV), and Lin´s concordance correlation coefficient (рc). Further, we determined the minimal detectable change (MDC95%). Irrespective of drop height and jump condition, good agreements between testing devices (ICC ≥ 0.95) were shown. Compared to the force plate (−0.6 to 3.1 ms) but not to the light-barrier system (31.4 to 41.7 ms), the contact mat showed low systematic bias values. In terms of test–retest reliability, our analyses showed that the measuring devices are in agreement (ICC: 0.70–0.92; SEM: 8.5–18.4 ms; CV: 3.6–6.4%). Depending on the measurement device, drop height, and jump condition, a MDC95% value ranging from 23.6 to 50.9 ms represents the minimum amount of change needed to identify practical relevant effects in repeated measurements of drop jump performance. Our findings indicate that the electronic contact mat is a valid and reliable testing device for drop jump assessment from different drop heights in young physically active adults.

scholarly journals Reliability and validity of a Mediterranean diet and culinary index (MediCul) tool in an older population with mild cognitive impairment

2018 ◽  
Vol 120 (10) ◽  
pp. 1189-1200 ◽  
Author(s):  
Sue Radd-Vagenas ◽  
Maria A. Fiatarone Singh ◽  
Michael Inskip ◽  
Yorgi Mavros ◽  
Nicola Gates ◽  
...  
Keyword(s):  
Cognitive Impairment ◽  
Mild Cognitive Impairment ◽  
Mediterranean Diet ◽  
Reliability And Validity ◽  
Community Dwelling ◽  
Systematic Bias ◽  
Older Individuals ◽  
Retest Reliability ◽  
The Mean ◽  
Test Retest Reliability

AbstractDementia is a leading cause of morbidity and mortality without pharmacologic prevention or cure. Mounting evidence suggests that adherence to a Mediterranean dietary pattern may slow cognitive decline, and is important to characterise in at-risk cohorts. Thus, we determined the reliability and validity of the Mediterranean Diet and Culinary Index (MediCul), a new tool, among community-dwelling individuals with mild cognitive impairment (MCI). A total of sixty-eight participants (66 % female) aged 75·9 (sd 6·6) years, from the Study of Mental and Resistance Training study MCI cohort, completed the fifty-item MediCul at two time points, followed by a 3-d food record (FR). MediCul test–retest reliability was assessed using intra-class correlation coefficients (ICC), Bland–Altman plots and κ agreement within seventeen dietary element categories. Validity was assessed against the FR using the Bland–Altman method and nutrient trends across MediCul score tertiles. The mean MediCul score was 54·6/100·0, with few participants reaching thresholds for key Mediterranean foods. MediCul had very good test–retest reliability (ICC=0·93, 95 % CI 0·884, 0·954, P<0·0001) with fair-to-almost-perfect agreement for classifying elements within the same category. Validity was moderate with no systematic bias between methods of measurement, according to the regression coefficient (y=−2·30+0·17x) (95 % CI −0·027, 0·358; P=0·091). MediCul over-estimated the mean FR score by 6 %, with limits of agreement being under- and over-estimated by 11 and 23 %, respectively. Nutrient trends were significantly associated with increased MediCul scoring, consistent with a Mediterranean pattern. MediCul provides reliable and moderately valid information about Mediterranean diet adherence among older individuals with MCI, with potential application in future studies assessing relationships between diet and cognitive function.

Novel Ultrasonographic Thickness and Strength Assessments of the Flexor Digitorum: A Reliability Analysis

2021 ◽  
Vol 36 (4) ◽  
pp. 269-278
Author(s):  
Christos I Ioannou ◽  
Franziska L Hodde-Chriske ◽  
Marios N Avraamides ◽  
Eckart Altenmüller
Keyword(s):  
High Sensitivity ◽  
Extensor Digitorum ◽  
Retest Reliability ◽  
Custom Made ◽  
Smallest Detectable Change ◽  
The Mean ◽  
The Right ◽  
Flexor Digitorum ◽  
Clinical Conditions ◽  
Test Retest Reliability

OBJECTIVES: Clinical conditions such as focal dystonia often require the assessment of atrophy and weakness of the finger muscles. However, due to a lack of well-established protocols, the current investigation focused on assessing the reliability of thickness and strength assessments of the flexor digitorum (FD) muscle, including both the superficialis and profundus components. As a secondary assessment, the reliability of the strength measurement of the extensor digitorum muscle was examined as well. METHODS: Different thickness measurements of the FD were taken via ultrasonography and averaged to estimate the mean thickness of the FD. Likewise, individual finger strength measurements taken by a custom-made finger pressure device were averaged to compute the mean strength of the flexor and extensor digitorum muscles. Test-retest reliability of the above measurements performed at two different time points (about 6 months apart) were examined on the right and left hands of 10 participants. RESULTS: Findings indicated excellent test-retest reliability (ICC > 0.92) for the mean thickness assessment of the FD and mean strength of the flexor and extensor digitorum for both dominant and non-dominant hands. The standard error of measurement was ≤4.3% for all three mean assessments, indicating high sensitivity. Likewise, the smallest detectable change was also sufficiently small for the mean thickness and mean strength of the flexor digitorum (≤5.1%) and moderately small (≤12%) for the strength of the extensor digitorum. CONCLUSIONS: Results indicated an excellent relative and absolute reliability, for both hands, for the mean thickness and strength assessments of the flexor digitorum muscle and for the mean strength of the extensor digitorum (measured for both hands). These measurements can be used for future investigations and can contribute to the establishment of more precise methods for assessing the muscles in the forearms which serve the hand.

scholarly journals Test−Retest Reliability of the ‘Welfare Quality® Animal Welfare Assessment Protocol for Sows and Piglets’. Part 1. Assessment of the Welfare Principle of ‘Appropriate Behavior’

Animals ◽  
2019 ◽  
Vol 9 (7) ◽  
pp. 398 ◽  
Author(s):  
Friedrich ◽  
Krieter ◽  
Kemper ◽  
Czycholl
Keyword(s):  
Animal Welfare ◽  
Correlation Coefficient ◽  
Retest Reliability ◽  
Welfare Assessment ◽  
Appropriate Behavior ◽  
Assessment Protocol ◽  
Smallest Detectable Change ◽  
Welfare Quality ◽  
Animal Welfare Assessment ◽  
Test Retest Reliability

The present study’s aim was to assess the test−retest reliability (TRR) of the ‘Welfare Quality® animal welfare assessment protocol for sows and piglets’ focusing on the welfare principle ‘appropriate behavior’. TRR was calculated using Spearman’s rank correlation coefficient (RS), intraclass correlation coefficient (ICC), smallest detectable change (SDC), and limits of agreement (LoA). Principal component analysis (PCA) was used for deeper analysis of the Qualitative Behavior Assessment (QBA). The study was conducted on thirteen farms in Northern Germany, which were visited five times by the same observer. Farm visits 1 (F1; day 0) were compared to farm visits 2 to 5 (F2–F5). The QBA indicated no TRR when applying the statistical parameters introduced above (e.g., ‘playful‘ (F1–F4) RS 0.08 ICC 0.00 SDC 0.50 LoA [−0.62, 0.38]). The PCA detected contradictory TRR. Acceptable TRR could be found for parts of the instantaneous scan sampling (e.g., negative social behavior (F1–F3) RS 0.45 ICC 0.37 SDC 0.02 LoA [−0.03, 0.02]). The human−animal relationship test solely achieved poor TRR, whereas scans for stereotypies showed sufficient TRR (e.g., floor licking (F1–F4) RS 0.63 ICC 0.52 SDC 0.05 LoA [−0.08, 0.04]). Concluding, the principle ‘appropriate behavior’ does not represent TRR and further investigation is needed before implementation on-farm.

Test–Retest Reliability and the Effects of Walking Speed on Stride Time Variability During Continuous, Overground Walking in Healthy Young Adults

2020 ◽  
pp. 1-7
Author(s):  
Nicholas S. Ryan ◽  
Paul A. Bruno ◽  
John M. Barden
Keyword(s):  
Young Adults ◽  
Walking Speed ◽  
Time Variability ◽  
Clinical Settings ◽  
Stride Time ◽  
Real Difference ◽  
Overground Walking ◽  
Retest Reliability ◽  
Intraclass Correlations ◽  
Test Retest Reliability

Studies have investigated the reliability and effect of walking speed on stride time variability during walking trials performed on a treadmill. The objective of this study was to investigate the reliability of stride time variability and the effect of walking speed on stride time variability, during continuous, overground walking in healthy young adults. Participants completed: (1) 2 walking trials at their preferred walking speed on 1 day and another trial 2 to 4 days later and (2) 1 trial at their preferred walking speed, 1 trial approximately 20% to 25% faster than their preferred walking speed, and 1 trial approximately 20% to 25% slower than their preferred walking speed on a separate day. Data from a waist-mounted accelerometer were used to determine the consecutive stride times for each trial. The reliability of stride time variability outcomes was generally poor (intraclass correlations: .167–.487). Although some significant differences in stride time variability were found between the preferred walking speed, fast, and slow trials, individual between-trial differences were generally below the estimated minimum difference considered to be a real difference. The development of a protocol to improve the reliability of stride time variability outcomes during continuous, overground walking would be beneficial to improve their application in research and clinical settings.

scholarly journals Psychometric Validity, Reliability, and Responsiveness of the Tinnitus Functional Index

2018 ◽  
Vol 29 (07) ◽  
pp. 609-625 ◽  
Author(s):  
Navshika Chandra ◽  
Kevin Chang ◽  
Arier Lee ◽  
Giriraj S. Shekhawat ◽  
Grant D. Searchfield
Keyword(s):  
Clinical Trial ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Divergent Validity ◽  
Valid Measure ◽  
Functional Index ◽  
Retest Reliability ◽  
Smallest Detectable Change ◽  
Different Populations ◽  
Test Retest Reliability

AbstractThe effects of treatments on tinnitus have been difficult to quantify. The Tinnitus Functional Index (TFI) has been proposed as a standard questionnaire for measurement of tinnitus treatment outcomes. For a questionnaire to achieve wide acceptance, its psychometric properties need to be confirmed in different populations.To determine if the TFI is a reliable and valid measure of tinnitus, and if its psychometric properties are suitable for use as an outcome measure.A psychometric evaluation of the TFI from secondary data obtained from a cross-sectional clinic survey and a clinical trial undertaken in New Zealand.Confirmatory factor analysis and evaluation of internal consistency reliability were undertaken on a sample of 318 patients with the primary complaint of tinnitus. In a separate sample of 40 research volunteers, test–retest reliability, convergent and divergent validity were evaluated. Both samples consisted of predominantly older Caucasian male patients with tinnitus.The internal structure of the original US TFI was confirmed. The Cronbach’s Alpha and Intraclass correlation coefficients were >0.7 for the TFI overall and each of its subscales, indicating high internal consistency and test–retest reliability. Strong Pearson correlations with the Tinnitus Handicap Questionnaire and tinnitus numerical rating scales indicated excellent convergent validity, and a moderate correlation with the Hearing Handicap Inventory, indicated moderate divergent validity. Evaluation of the clinical trial showed good test–retest reliability and agreement between no-treatment baselines with a smallest detectable change of 4.8 points.The TFI is a reliable and valid measure of tinnitus severity in the population tested and is responsive to treatment-related change. Further research as to the TFI’s responsiveness to treatment is needed across different populations.

Sign in / Sign up

Export Citation Format

Share Document