Short-term test-retest reliability of the human intrinsic functional connectome

ABSTRACTFunctional connectivity is frequently used to quantify the complex synchronous distributed fluctuations in neuronal activity derived from functional Magnetic Resonance Imaging and to generate network representations of human brain function. Such “functional connectomes” have great promise for mechanistic studies and for clinical translation. However, we do not know to what extent a functional connectome is stable over time for an individual. In the present work, we evaluate the short-term test-retest reliability of functional connectomes in a large publicly available sample of healthy participants (N=833) scanned on two consecutive days. We also assess the consequences on reliability of three methodological procedures for which a clear guideline in the community is lacking: atlas choice, global signal regression and thresholding. By adopting the intraclass correlation coefficient as a reliability metric, we demonstrate that a relatively small portion of the intrinsic functional connectome is characterized by good (4-6%) to excellent (0.08-1%) stability over time. In particular, connectivity between prefrontal, parietal and temporal areas appears to be especially stable over short timescales. Also, while unreliable edges of the functional connectome are generally weak in terms of average functional connectivity, reliable edges are not necessarily strong. Methodologically, we demonstrate that multimodal parcellation and averaging of connections within known networks are practices that improve reliability. Harnessing this knowledge, for example by honing in on the reliable portion of the connectome, offers one way forward for studies of trait-like features within the normative connectome and for discovery of biomarkers in clinical cohorts.

Download Full-text

Short-Term Test-Retest Reliability of an Experimental Version of the Basic Attributes Test Battery

10.21236/ada237484 ◽

1991 ◽

Author(s):

Thomas R. Carretta

Keyword(s):

Test Battery ◽

Short Term ◽

Retest Reliability ◽

Short Term Test ◽

Test Retest Reliability

Download Full-text

Short-Term Test–Retest Reliability of Contralateral Suppression of Click-Evoked Otoacoustic Emissions in Normal-Hearing Subjects

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-20-00393 ◽

2021 ◽

pp. 1-11

Author(s):

Hannah Keppler ◽

Sofie Degeest ◽

Bart Vinck

Keyword(s):

Repeated Measures ◽

Otoacoustic Emissions ◽

Otoacoustic Emission ◽

Normal Hearing ◽

Short Term ◽

Retest Reliability ◽

Reliability Parameters ◽

Contralateral Suppression ◽

Short Term Test ◽

Test Retest Reliability

Purpose The objective of the current study was to investigate the short-term test–retest reliability of contralateral suppression (CS) of click-evoked otoacoustic emissions (CEOAEs) using commercially available otoacoustic emission equipment. Method Twenty-three young normal-hearing subjects were tested. An otoscopic evaluation, admittance measures, pure-tone audiometry, measurements of CEOAEs without and with contralateral acoustic stimulation (CAS) to determine CS were performed at baseline ( n = 23), an immediate retest without and with refitting of the probe (only CS of CEOAEs; n = 11), and a retest after 1 week ( n = 23) were performed. Test–retest reliability parameters were determined on CEOAE response amplitudes without and with CAS, and on raw and normalized CS indices between baseline and the other test moments. Results Repeated-measures analysis of variance indicated no random or systematic changes in CEOAE response amplitudes without and with CAS, and in raw and normalized CS indices between the test moments. Moderate-to-high intraclass correlation coefficients with mostly high significant between-subjects variability between baseline and each consecutive test moment were found for CEOAE response amplitude without and with CAS, and for the raw and normalized CS indices. Other reliability parameters deteriorated between CEOAE response amplitudes with CAS as compared to without CAS, between baseline and retest with probe refitting, and after 1 week, as well as for frequency-specific raw and normalized CS indices as compared to global CS indices. Conclusions There was considerable variability in raw and normalized CS indices as measured using CEOAEs with CAS using commercially available otoacoustic emission equipment. More research is needed to optimize the measurement of CS of CEOAEs and to reduce influencing factors, as well as to make generalization of test–retest reliability data possible.

Download Full-text

Short-term test–retest reliability of the ImPACT in healthy young athletes

Applied Neuropsychology Child ◽

10.1080/21622965.2017.1290529 ◽

2017 ◽

Vol 7 (3) ◽

pp. 208-216 ◽

Cited By ~ 1

Author(s):

Amanda M. O’Brien ◽

Joseph E. Casey ◽

Rachel M. Salmon

Keyword(s):

Young Athletes ◽

Short Term ◽

Retest Reliability ◽

Short Term Test ◽

Test Retest Reliability ◽

The Impact

Download Full-text

Short-term test-retest-reliability of conditioned pain modulation using the cold-heat-pain method in healthy subjects and its correlation to parameters of standardized quantitative sensory testing

BMC Neurology ◽

10.1186/s12883-016-0650-z ◽

2016 ◽

Vol 16 (1) ◽

Cited By ~ 19

Author(s):

Julia Gehling ◽

Tina Mainka ◽

Jan Vollert ◽

Esther M. Pogatzki-Zahn ◽

Christoph Maier ◽

...

Keyword(s):

Healthy Subjects ◽

Quantitative Sensory Testing ◽

Pain Modulation ◽

Conditioned Pain Modulation ◽

Heat Pain ◽

Sensory Testing ◽

Short Term ◽

Retest Reliability ◽

Short Term Test ◽

Test Retest Reliability

Download Full-text

A Dutch version of a dual-task paradigm for measuring listening effort: a pilot study regarding its short-term test-retest reliability

B-ENT ◽

10.5152/b-ent.2021.20160 ◽

2021 ◽

Vol 17 (3) ◽

pp. 135-144

Author(s):

Sofie Degeest ◽

◽

Paul Corthals ◽

Hannah Keppler ◽

◽

...

Keyword(s):

Pilot Study ◽

Dual Task ◽

Short Term ◽

Dutch Version ◽

Listening Effort ◽

Retest Reliability ◽

Short Term Test ◽

Dual Task Paradigm ◽

Test Retest Reliability

Download Full-text

Test-retest reliability of the human functional connectome over consecutive days: identifying highly reliable portions and assessing the impact of methodological choices

Network Neuroscience ◽

10.1162/netn_a_00148 ◽

2020 ◽

Vol 4 (3) ◽

pp. 925-945

Author(s):

Leonardo Tozzi ◽

Scott L. Fleming ◽

Zachary D. Taylor ◽

Cooper D. Raterink ◽

Leanne M. Williams

Keyword(s):

Human Brain ◽

Functional Neuroimaging ◽

Intraclass Correlation ◽

Good Reliability ◽

Retest Reliability ◽

Methodological Choices ◽

Functional Connectome ◽

Global Signal ◽

Test Retest Reliability ◽

The Impact

Countless studies have advanced our understanding of the human brain and its organization by using functional magnetic resonance imaging (fMRI) to derive network representations of human brain function. However, we do not know to what extent these “functional connectomes” are reliable over time. In a large public sample of healthy participants ( N = 833) scanned on two consecutive days, we assessed the test-retest reliability of fMRI functional connectivity and the consequences on reliability of three common sources of variation in analysis workflows: atlas choice, global signal regression, and thresholding. By adopting the intraclass correlation coefficient as a metric, we demonstrate that only a small portion of the functional connectome is characterized by good (6–8%) to excellent (0.08–0.14%) reliability. Connectivity between prefrontal, parietal, and temporal areas is especially reliable, but also average connectivity within known networks has good reliability. In general, while unreliable edges are weak, reliable edges are not necessarily strong. Methodologically, reliability of edges varies between atlases, global signal regression decreases reliability for networks and most edges (but increases it for some), and thresholding based on connection strength reduces reliability. Focusing on the reliable portion of the connectome could help quantify brain trait-like features and investigate individual differences using functional neuroimaging.

Download Full-text

TEMPORAL STABILITY OF THE FRANCIS SCALE OF ATTITUDE TOWARD CHRISTIANITY AMONG 9- TO 11-YEAR-OLD ENGLISH CHILDREN: TEST-RETEST DATA OVER SIX WEEKS

Social Behavior and Personality An International Journal ◽

10.2224/sbp.2006.34.9.1081 ◽

2006 ◽

Vol 34 (9) ◽

pp. 1081-1086 ◽

Cited By ~ 8

Author(s):

Christopher Alan Lewis ◽

Sharon Mary Cruise ◽

Conor Mc Guckin ◽

Leslie J. Francis

Keyword(s):

University Students ◽

Old English ◽

Temporal Stability ◽

Short Term ◽

Retest Reliability ◽

Short Term Test ◽

Test Retest Reliability ◽

Attitude Toward Christianity ◽

Very High ◽

Francis Scale

Recently two studies have reported on the test-retest reliability of the Francis Scale of Attitude toward Christianity; however, these studies were limited to samples of university students. This study examined the temporal stability of both the 24- and 7-item versions of the junior version of the Francis Scale of Attitude toward Christianity (Francis, 1978; Francis, Greer, & Gibson, 1991) over a six-week period among a sample of 58 English children aged between 9 and 11 years old. Data demonstrated that stability across the two administrations was very high for both the 24- (r=.74) and 7-item (r=.67) versions, and there was no significant change between Time 1 and Time 2 for either version. These data support the short-term test-retest reliability of both the 24- and 7-item versions of the junior version of the Francis Scale of Attitude toward Christianity among children.

Download Full-text