Proof-of-Concept and Test-Retest Reliability Study of Psychological and Physiological Variables of the Mental Fatigue Paradigm

This study provided a proof-of-concept and test–retest reliability of measures frequently used to assess a mental fatigue paradigm. After familiarization, 28 healthy men performed (40-min) the Rapid Visual Information Processing (RVP) test in a test–retest design, having mental fatigue sensation, motivation, emotional arousal, total mood disturbance, and electroencephalography (EEG) in the prefrontal cortex measured before and after the test. EEG was recorded during a 3-min rest so that the power spectral density of theta (3–7 Hz) and alpha (8–13 Hz) bands was calculated. Pre-to-post RVP test changes in psychological and physiological domains were compared (paired-T tests), and absolute (standard error of measurement (SEM) and minimal difference (MD)) and relative reliability (intraclass correlation coefficient (ICC)) were calculated. The RVP test induced an increase (p < 0.05) in mental fatigue sensation (120.9% (109.4; 132.4)) and total mood disturbance (3.5% (−6.3; 13.3)), and a decrease in motivation (−7.1% (−9.2; −5.1)) and emotional arousal (−16.2% (−19.1; −13.2)). Likewise, EEG theta (59.1% (33.2; 85.0); p < 0.05), but not alpha band, increased due to RVP test. All psychophysiological responses showed poor-to-moderate relative reliability. Changes in mental fatigue sensation and motivation were higher than SEM and MD, but changes in EEG theta band were higher only than SEM. Mental fatigue sensation, motivation, and EEG theta band were sensitive to distinguish a mental fatigue paradigm despite true mental fatigue effects on theta activity may be trivial.

Download Full-text

Test–Retest Reliability of Physiological Variables During Submaximal Seated Upper-Body Poling in Able-Bodied Participants

Frontiers in Physiology ◽

10.3389/fphys.2021.749356 ◽

2021 ◽

Vol 12 ◽

Author(s):

Marlou Ettema ◽

Berit Brurok ◽

Julia Kathrin Baumgart

Keyword(s):

Blood Lactate ◽

Exercise Intensity ◽

Rating Of Perceived Exertion ◽

Upper Body ◽

Retest Reliability ◽

Relative Reliability ◽

Physiological Variables ◽

Smallest Detectable Change ◽

Test Retest Reliability ◽

Absolute Reliability

Purpose: To investigate the test–retest reliability of physiological variables across four different test days and four different submaximal exercise intensities during seated upper-body poling (UBP).Methods: Thirteen abled-bodied, upper-body trained men (age 29±3years; body mass 84±12kg; height 183±5cm) performed four submaximal 4-min stages of seated UBP on four separate test days. The four submaximal stages were set at individual power outputs corresponding to a rating of perceived exertion of 9, 11, 13, and 15. The absolute reliability for pairwise test-day comparisons of the physiological variables was investigated with the smallest detectable change percentage (%SDC) and the relative reliability with the interclass correlation coefficient (ICC).Results: Absolute and relative reliability across test-day comparisons and submaximal stages were moderate to excellent for all variables investigated (V̇O2 – %SDC range: 5–13%, ICC range: 0.93–0.99; HR – %SDC range: 6–9%, ICC range: 0.91–0.97) other than blood lactate, for which absolute reliability was poor and relative reliability highly variable (%SDC range: 26–69%, ICC range: 0.44–0.92). Furthermore, absolute and relative reliability were consistent across the low-to-moderate exercise intensity spectrum and across test days.Conclusion: Absolute and relative test–retest reliability were acceptable for all investigated physiological variables but blood lactate. The consistent test–retest reliability across the exercise intensity spectrum and across test days indicates that a familiarization period to the specific exercise modality may not be necessary. For generalizability, these findings need to be confirmed in athletes with a disability by future large-scale studies.

Download Full-text

A new visual feedback-based system for the assessment of pinch force, endurance, accuracy and precision. A test-retest reliability study

Hand Therapy ◽

10.1177/17589983211002550 ◽

2021 ◽

pp. 175899832110025

Author(s):

Alberto Dottor ◽

Eleonora Camerone ◽

Mirko Job ◽

Diletta Barbiani ◽

Elisa Frisaldi ◽

...

Keyword(s):

Visual Feedback ◽

Intraclass Correlation ◽

Precision Grip ◽

Voluntary Contraction ◽

Good Reliability ◽

Retest Reliability ◽

Relative Reliability ◽

Time Accuracy ◽

In The Beginning ◽

Test Retest Reliability

Introduction Given that pinch is a precision grip involved in sustained submaximal activities, a Sustained Contraction (SC) task could be associated to Maximal Voluntary Contraction (MVC). To better evaluate the thumb-index system, the test-retest reliability of pinch MVC and SC, measured by a visual feedback-based pinch gauge was assessed. Methods 26 healthy participants performed MVC and SC in two separate sessions. SC required to maintain 40%MVC as long as possible and it was evaluated in terms of time, accuracy (Mean Distance between force trace and target force, MD), precision (Coefficient of Variability of force trace, CV). MD and CV analyses were conducted dividing the SC task into three equivalent time stages (beginning, middle, exhaustion). Relative Reliability (RR) was measured by Intraclass Correlation Coefficient, and Absolute Reliability (AR) was measured by Standard Error of Measurement and by Bland-Altman plot. Results MVC and Time showed high RR and AR in both hands. RR of MD and CV in right hand was excellent in the beginning and middle stages, and fair in the exhaustion one, showing decreasing reliability as fatigue increases. In the left hand RR of MD and CV was generally lower. MD showed excellent reliability in the beginning stage and good reliability in the other stages. CV showed fair relative reliability at both beginning and middle stages, excellent in the last one. Conversely, it was observed high AR of MD and CV in all stages in both hands. Conclusions All indices are reliable to assess motor control of thumb-index pinch in both hands.

Download Full-text

Within-session test-retest reliability of pressure pain threshold and mechanical temporal summation in healthy subjects

PLoS ONE ◽

10.1371/journal.pone.0245278 ◽

2021 ◽

Vol 16 (1) ◽

pp. e0245278

Author(s):

Catherine Mailloux ◽

Louis-David Beaulieu ◽

Timothy H. Wideman ◽

Hugo Massé-Alarie

Keyword(s):

Measurement Error ◽

Temporal Summation ◽

Pain Threshold ◽

Pressure Pain Threshold ◽

Low Back ◽

Measurement Variability ◽

Retest Reliability ◽

Pressure Pain ◽

Relative Reliability ◽

Test Retest Reliability

Objective To determine the absolute and relative intra-rater within-session test-retest reliability of pressure pain threshold (PPT) and mechanical temporal summation of pain (TSP) at the low back and the forearm in healthy participants and to test the influence of the number and sequence of measurements on reliability metrics. Methods In 24 participants, three PPT and TSP measures were assessed at four sites (2 at the low back, 2 at the forearm) in two blocks of measurements separated by 20 minutes. The standard error of measurement, the minimal detectable change (MDC) and the intraclass correlation coefficient (ICC) were investigated for five different sequences of measurements (e.g. measurement 1, 1–2, 1-2-3). Results The MDC for the group (MDCgr) for PPT ranged from 28.71 to 50.56 kPa across the sites tested, whereas MDCgr for TSP varied from 0.33 to 0.57 out of 10 (numeric scale). Almost all ICC showed an excellent relative reliability (between 0.80 and 0.97), except when only the first measurement was considered (moderate). Although minimal differences in absolute PPT reliability were present between the different sequences, in general, using only the first measurement increase measurement error. Three TSP measures reduced the measurement error. Discussion We established that two measurements of PPT and three of TSP reduced the measurement error and demonstrated an excellent relative reliability. Our results could be used in future pain research to confirm the presence of true hypo/hyperalgesia for paradigms such as conditioned pain modulation or exercise-induced hypoalgesia, indicated by a change exceeding the measurement variability.

Download Full-text

Test–Retest Reliability and Temporal Agreement of Direct and Indirect Sexual Interest Measures

Sexual Abuse ◽

10.1177/1079063220904354 ◽

2020 ◽

pp. 107906322090435

Author(s):

Robin Welsch ◽

Alexander F. Schmidt ◽

Daniel Turner ◽

Martin Rettenberger

Keyword(s):

Sexual Interest ◽

Intraclass Correlation ◽

Temporal Stability ◽

Self Report ◽

Viewing Time ◽

Individual Change ◽

Retest Reliability ◽

Relative Reliability ◽

Standardized Effect Sizes ◽

Test Retest Reliability

The Explicit and Implicit Sexual Interest Profile (EISIP) is a multimethod measure of sexual interest in children and adults. It combines indirect latency-based measures such as the Implicit Association Test (IAT), Viewing Time (VT), and explicit self-report measures. This study examined test–retest reliability and absolute temporal agreement of the EISIP over a 2-week interval in persons who were convicted of sexual offenses against children ( n = 33) and nonoffending controls ( n = 48). Test–retest reliability of the aggregated EISIP measures was high across the whole sample ( rtt = .90, intraclass correlation coefficient [ICC] = .90) with the IAT yielding the lowest retest correlations ( rtt = .66, ICC = .66). However, these indicators of relative reliability only quantify the temporal stability of individual differences within the group, not the detectability of individual change. Absolute temporal agreement as assessed via Bland–Altman plots ranged from one fourth to three thirds of a standardized unit in the sexual preference scores. This implies that individual change has to exceed medium to large standardized effect sizes to be distinguishable from spontaneous temporal variation in the EISIP measures. Overall, scores of combined measures were largely superior to single measures in terms of both absolute and relative reliability.

Download Full-text

Test-Retest Reliability and Physiological Responses Associated with the Steep Ramp Anaerobic Test in Patients with COPD

Pulmonary Medicine ◽

10.1155/2012/653831 ◽

2012 ◽

Vol 2012 ◽

pp. 1-6 ◽

Cited By ~ 7

Author(s):

Robyn L. Chura ◽

Darcy D. Marciniuk ◽

Ron Clemens ◽

Scotty J. Butcher

Keyword(s):

Anaerobic Power ◽

Cardiopulmonary Exercise Test ◽

Chronic Obstructive ◽

Clinical Test ◽

Wingate Anaerobic Test ◽

Obstructive Pulmonary Disease ◽

Retest Reliability ◽

Physiological Variables ◽

Test Retest Reliability ◽

Anaerobic Test

The Steep Ramp Anaerobic Test (SRAT) was developed as a clinical test of anaerobic leg muscle function for use in determining anaerobic power and in prescribing high-intensity interval exercise in patients with chronic heart failure and Chronic Obstructive Pulmonary Disease (COPD); however, neither the test-retest reliability nor the physiological qualities of this test have been reported. We therefore, assessed test-retest reliability of the SRAT and the physiological characteristics associated with the test in patients with COPD. 11 COPD patients (mean FEV143% predicted) performed a cardiopulmonary exercise test (CPET) on Day 1, and an SRAT and a 30-second Wingate anaerobic test (WAT) on each of Days 2 and 3. The SRAT showed a high degree of test-retest reliability (ICC=0.99;CV=3.8%, and bias 4.5 W, error −15.3–24.4 W). Power output on the SRAT was 157 W compared to 66 W on the CPET and 231 W on the WAT. Despite the differences in workload, patients exhibited similar metabolic and ventilatory responses between the three tests. Measures of ventilatory constraint correlated more strongly with the CPET than the WAT; however, physiological variables correlated more strongly with the WAT. The SRAT is a highly reliable test that better reflects physiological performance on a WAT power test despite a similar level of ventilatory constraint compared to CPET.

Download Full-text

Measuring “Language Access Profiles” in Deaf and Hard-of-Hearing Children With the DHH Language Exposure Assessment Tool

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-20-00439 ◽

2020 ◽

pp. 1-25

Author(s):

Matthew L. Hall ◽

Stephanie De Anda

Keyword(s):

Cluster Analysis ◽

Exposure Assessment ◽

Hard Of Hearing ◽

Assessment Tool ◽

Communication Mode ◽

Developmental Potential ◽

Language Access ◽

Retest Reliability ◽

Language Exposure ◽

Test Retest Reliability

Purpose The purposes of this study were (a) to introduce “language access profiles” as a viable alternative construct to “communication mode” for describing experience with language input during early childhood for deaf and hard-of-hearing (DHH) children; (b) to describe the development of a new tool for measuring DHH children's language access profiles during infancy and toddlerhood; and (c) to evaluate the novelty, reliability, and validity of this tool. Method We adapted an existing retrospective parent report measure of early language experience (the Language Exposure Assessment Tool) to make it suitable for use with DHH populations. We administered the adapted instrument (DHH Language Exposure Assessment Tool [D-LEAT]) to the caregivers of 105 DHH children aged 12 years and younger. To measure convergent validity, we also administered another novel instrument: the Language Access Profile Tool. To measure test–retest reliability, half of the participants were interviewed again after 1 month. We identified groups of children with similar language access profiles by using hierarchical cluster analysis. Results The D-LEAT revealed DHH children's diverse experiences with access to language during infancy and toddlerhood. Cluster analysis groupings were markedly different from those derived from more traditional grouping rules (e.g., communication modes). Test–retest reliability was good, especially for the same-interviewer condition. Content, convergent, and face validity were strong. Conclusions To optimize DHH children's developmental potential, stakeholders who work at the individual and population levels would benefit from replacing communication mode with language access profiles. The D-LEAT is the first tool that aims to measure this novel construct. Despite limitations that future work aims to address, the present results demonstrate that the D-LEAT represents progress over the status quo.

Download Full-text

Visual-Neural Correlate of Speechreading Ability in Normal-Hearing Adults

Journal of Speech Language and Hearing Research ◽

10.1044/jshr.2504.521 ◽

1982 ◽

Vol 25 (4) ◽

pp. 521-527 ◽

Cited By ~ 7

Author(s):

David C. Shepherd

Keyword(s):

Normal Hearing ◽

Wave Form ◽

Firing Time ◽

Neural Firing ◽

Neural Correlate ◽

Retest Reliability ◽

Repeated Word ◽

Negative Peak ◽

The Stability ◽

Test Retest Reliability

In 1977, Shepherd and colleagues reported significant correlations (–.90, –.91) between speechreading scores and the latency of a selected negative peak (VN 130 measure) on the averaged visual electroencephalic wave form. The primary purpose of this current study was to examine the stability, or repeatability, of this relation between these cognitive and neurophysiologic measures over a period of several months and thus support its test-retest reliability. Repeated speechreading word and sentence scores were gathered during three test-retest sessions from each of 20 normal-hearing adults. An average of 56 days occurred from the end of one to the beginning of another speechreading sessions. During each of four other test-retest sessions, averaged visual electroencephalic responses (AVER s ) were evoked from each subject. An average of 49 clays intervened between AVER sessions. Product-moment correlations computed among repeated word scores and VN l30 measures ranged from –.61 to –.89. Based on these findings, it was concluded that the VN l30 measure of visual neural firing time is a reliable correlate of speech-reading in normal-hearing adults.

Download Full-text

Test-Retest Reliability of a Self-Report Questionnaire for DSM-IV and ICD-10 Personality Disorders

European Journal of Psychological Assessment ◽

10.1027//1015-5759.16.1.53 ◽

2000 ◽

Vol 16 (1) ◽

pp. 53-58 ◽

Cited By ~ 11

Author(s):

Hans Ottosson ◽

Martin Grann ◽

Gunnar Kullgren

Keyword(s):

Personality Disorder ◽

Anxiety Disorders ◽

Personality Disorders ◽

Clinical Sample ◽

Self Report ◽

Anxiety State ◽

Short Term ◽

Retest Reliability ◽

Axis I ◽

Test Retest Reliability

Summary: Short-term stability or test-retest reliability of self-reported personality traits is likely to be biased if the respondent is affected by a depressive or anxiety state. However, in some studies, DSM-oriented self-reported instruments have proved to be reasonably stable in the short term, regardless of co-occurring depressive or anxiety disorders. In the present study, we examined the short-term test-retest reliability of a new self-report questionnaire for personality disorder diagnosis (DIP-Q) on a clinical sample of 30 individuals, having either a depressive, an anxiety, or no axis-I disorder. Test-retest scorings from subjects with depressive disorders were mostly unstable, with a significant change in fulfilled criteria between entry and retest for three out of ten personality disorders: borderline, avoidant and obsessive-compulsive personality disorder. Scorings from subjects with anxiety disorders were unstable only for cluster C and dependent personality disorder items. In the absence of co-morbid depressive or anxiety disorders, mean dimensional scores of DIP-Q showed no significant differences between entry and retest. Overall, the effect from state on trait scorings was moderate, and it is concluded that test-retest reliability for DIP-Q is acceptable.

Download Full-text