Modeling [11C]yohimbine PET human brain kinetics with test-retest reliability, competition sensitivity studies and search for a suitable reference region

Countless studies have advanced our understanding of the human brain and its organization by using functional magnetic resonance imaging (fMRI) to derive network representations of human brain function. However, we do not know to what extent these “functional connectomes” are reliable over time. In a large public sample of healthy participants ( N = 833) scanned on two consecutive days, we assessed the test-retest reliability of fMRI functional connectivity and the consequences on reliability of three common sources of variation in analysis workflows: atlas choice, global signal regression, and thresholding. By adopting the intraclass correlation coefficient as a metric, we demonstrate that only a small portion of the functional connectome is characterized by good (6–8%) to excellent (0.08–0.14%) reliability. Connectivity between prefrontal, parietal, and temporal areas is especially reliable, but also average connectivity within known networks has good reliability. In general, while unreliable edges are weak, reliable edges are not necessarily strong. Methodologically, reliability of edges varies between atlases, global signal regression decreases reliability for networks and most edges (but increases it for some), and thresholding based on connection strength reduces reliability. Focusing on the reliable portion of the connectome could help quantify brain trait-like features and investigate individual differences using functional neuroimaging.

Download Full-text

Test-retest reliability and convergent validity of (R)-[11C]PK11195 outcome measures without arterial input function

10.1101/298992 ◽

2018 ◽

Cited By ~ 1

Author(s):

Pontus Plavén-Sigray ◽

Granville James Matheson ◽

Zsolt Cselényi ◽

Aurelija Jučaite ◽

Lars Farde ◽

...

Keyword(s):

Outcome Measures ◽

Convergent Validity ◽

Arterial Input Function ◽

Input Function ◽

Distribution Volume ◽

Alternative Methods ◽

Reference Region ◽

Retest Reliability ◽

Test Retest Reliability ◽

Reference Input

BackgroundThe positron emission tomography radioligand (R)-[11C]PK11195 can be used to quantify the expression of translocator protein (TSPO), which is considered a marker for activation of glial cells. TSPO is expressed throughout the brain, and for this reason no true reference region exists. When a radioligand does not have a reference region, an arterial input function (AIF) is usually required in order to quantify binding. However, obtaining an AIF can be difficult as well as uncomfortable for participants. Alternative methods have therefore been proposed with the aim of estimating (R)-[11C]PK11195 binding without arterial measurements, such as standardized uptake values (SUVs), supervised-cluster analysis (SVCA), or the use of a pseudo-reference region. The objective of this study was to evaluate the test-retest reliability and convergent validity of these techniques.MethodsData from a previously published (R)-[11C]PK11195 test-retest study in six healthy male subjects were reanalysed. Non-displaceable binding potential (BPND) was calculated for a set of cortical and subcortical brain regions using the simplified reference tissue model, with either cerebellum as reference region or a reference input derived using SVCA. SUVs were estimated for the time interval of 40-60 minutes. For comparison, total distribution volume (VT), specific distribution volume (VS) and BPND were estimated from the two-tissue-compartment model (2TCM) using AIF. Test-retest reliability was then assessed for all outcome measures. Convergent validity was examined by correlating all measures derived without an AIF to those derived using 2TCM.ResultsTest-retest reliability for BPND estimates were poor (80% of all regional ICCs<0.5). SUVs showed, on average, moderate reliability. BPND estimates derived without an AIF were not correlated with VT, VS or BPND from the 2TCM (all R2<12%). SUVs were not correlated with any other outcome (all R2<9%).DiscussionBPND estimated using cerebellum or SVCA as reference input showed poor reliability and little to no convergent validity with outcomes derived using an AIF. SUVs showed moderate reliability but no convergent validity with any other outcome. Caution is warranted for interpreting patient-control comparisons employing (R)-[11C]PK11195 outcome measures obtained without an AIF.

Download Full-text

Test–Retest Reliability of Computational Network Measurements Derived from the Structural Connectome of the Human Brain

Brain Connectivity ◽

10.1089/brain.2012.0121 ◽

2013 ◽

Vol 3 (2) ◽

pp. 160-176 ◽

Cited By ~ 58

Author(s):

Julia P. Owen ◽

Etay Ziv ◽

Polina Bukshpun ◽

Nicholas Pojman ◽

Mari Wakahiro ◽

...

Keyword(s):

Human Brain ◽

Network Measurements ◽

Retest Reliability ◽

Structural Connectome ◽

Test Retest Reliability

Download Full-text

Test-retest reliability and reproducibility of short-echo-time spectroscopic imaging of human brain at 3T

Magnetic Resonance in Medicine ◽

10.1002/mrm.22858 ◽

2011 ◽

Vol 66 (2) ◽

pp. 324-332 ◽

Cited By ~ 38

Author(s):

Charles Gasparovic ◽

Edward J. Bedrick ◽

Andrew R. Mayer ◽

Ronald A. Yeo ◽

HongJi Chen ◽

...

Keyword(s):

Human Brain ◽

Spectroscopic Imaging ◽

Retest Reliability ◽

Echo Time ◽

Short Echo Time ◽

Test Retest Reliability

Download Full-text

Evaluating the reliability of human brain white matter tractometry

10.1101/2021.02.24.432740 ◽

2021 ◽

Author(s):

John Kruper ◽

Jason D. Yeatman ◽

Adam Richie-Halford ◽

David Bloom ◽

Mareike Grotheer ◽

...

Keyword(s):

White Matter ◽

Human Brain ◽

High Reliability ◽

Assessment Tools ◽

Three Dimensions ◽

Retest Reliability ◽

Brain White Matter ◽

Analysis Methods ◽

Human Connectome Project ◽

Test Retest Reliability

The validity of research results depends on the reliability of analysis methods. In recent years, there have been concerns about the validity of research that uses diffusion-weighted MRI (dMRI) to understand human brain white matter connections in vivo, in part based on reliability of the analysis methods used in this field. We defined and assessed three dimensions of reliability in dMRI-based tractometry, an analysis technique that assesses the physical properties of white matter pathways: (1) reproducibility, (2) test-retest reliability and (3) robustness. To facilitate reproducibility, we provide software that automates tractometry (https://yeatmanlab.github.io/pyAFQ). In measurements from the Human Connectome Project, as well as clinical-grade measurements, we find that tractometry has high test-retest reliability that is comparable to most standardized clinical assessment tools. We find that tractometry is also robust: showing high reliability with different choices of analysis algorithms. Taken together, our results suggest that tractometry is a reliable approach to analysis of white matter connections. The overall approach taken here both demonstrates the specific trustworthiness of tractometry analysis and outlines what researchers can do to demonstrate the reliability of computational analysis pipelines in neuroimaging.

Download Full-text

Evaluating the Reliability of Human Brain White Matter Tractometry

10.52294/e6198273-b8e3-4b63-babb-6e6b0da10669 ◽

2021 ◽

Vol 2021 (1) ◽

Author(s):

John Kruper ◽

Jason D. Yeatman ◽

Adam Richie-Halford ◽

David Bloom ◽

Mareike Grotheer ◽

...

Keyword(s):

White Matter ◽

Human Brain ◽

High Reliability ◽

Assessment Tools ◽

Three Dimensions ◽

Retest Reliability ◽

Brain White Matter ◽

Analysis Methods ◽

Human Connectome Project ◽

Test Retest Reliability

The validity of research results depends on the reliability of analysis methods. In recent years, there have been concerns about the validity of research that uses diffusion-weighted MRI (dMRI) to understand human brain white matter connections in vivo, in part based on the reliability of analysis methods used in this field. We defined and assessed three dimensions of reliability in dMRI-based tractometry, an analysis technique that assesses the physical properties of white matter pathways: (1) reproducibility, (2) test-retest reliability, and (3) robustness. To facilitate reproducibility, we provide software that automates tractometry (https://yeatmanlab.github.io/pyAFQ). In measurements from the Human Connectome Project, as well as clinical-grade measurements, we find that tractometry has high test-retest reliability that is comparable to most standardized clinical assessment tools. We find that tractometry is also robust: showing high reliability with different choices of analysis algorithms. Taken together, our results suggest that tractometry is a reliable approach to analysis of white matter connections. The overall approach taken here both demonstrates the specific trustworthiness of tractometry analysis and outlines what researchers can do to establish the reliability of computational analysis pipelines in neuroimaging.

Download Full-text

Test–retest reliability of [11C]AZ10419369 binding to 5-HT1B receptors in human brain

European Journal of Nuclear Medicine and Molecular Imaging ◽

10.1007/s00259-013-2529-1 ◽

2013 ◽

Vol 41 (2) ◽

pp. 301-307 ◽

Cited By ~ 20

Author(s):

Magdalena Nord ◽

Sjoerd J. Finnema ◽

Martin Schain ◽

Christer Halldin ◽

Lars Farde

Keyword(s):

Human Brain ◽

Retest Reliability ◽

Test Retest Reliability

Download Full-text

Measuring “Language Access Profiles” in Deaf and Hard-of-Hearing Children With the DHH Language Exposure Assessment Tool

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-20-00439 ◽

2020 ◽

pp. 1-25

Author(s):

Matthew L. Hall ◽

Stephanie De Anda

Keyword(s):

Cluster Analysis ◽

Exposure Assessment ◽

Hard Of Hearing ◽

Assessment Tool ◽

Communication Mode ◽

Developmental Potential ◽

Language Access ◽

Retest Reliability ◽

Language Exposure ◽

Test Retest Reliability

Purpose The purposes of this study were (a) to introduce “language access profiles” as a viable alternative construct to “communication mode” for describing experience with language input during early childhood for deaf and hard-of-hearing (DHH) children; (b) to describe the development of a new tool for measuring DHH children's language access profiles during infancy and toddlerhood; and (c) to evaluate the novelty, reliability, and validity of this tool. Method We adapted an existing retrospective parent report measure of early language experience (the Language Exposure Assessment Tool) to make it suitable for use with DHH populations. We administered the adapted instrument (DHH Language Exposure Assessment Tool [D-LEAT]) to the caregivers of 105 DHH children aged 12 years and younger. To measure convergent validity, we also administered another novel instrument: the Language Access Profile Tool. To measure test–retest reliability, half of the participants were interviewed again after 1 month. We identified groups of children with similar language access profiles by using hierarchical cluster analysis. Results The D-LEAT revealed DHH children's diverse experiences with access to language during infancy and toddlerhood. Cluster analysis groupings were markedly different from those derived from more traditional grouping rules (e.g., communication modes). Test–retest reliability was good, especially for the same-interviewer condition. Content, convergent, and face validity were strong. Conclusions To optimize DHH children's developmental potential, stakeholders who work at the individual and population levels would benefit from replacing communication mode with language access profiles. The D-LEAT is the first tool that aims to measure this novel construct. Despite limitations that future work aims to address, the present results demonstrate that the D-LEAT represents progress over the status quo.

Download Full-text

Visual-Neural Correlate of Speechreading Ability in Normal-Hearing Adults

Journal of Speech Language and Hearing Research ◽

10.1044/jshr.2504.521 ◽

1982 ◽

Vol 25 (4) ◽

pp. 521-527 ◽

Cited By ~ 7

Author(s):

David C. Shepherd

Keyword(s):

Normal Hearing ◽

Wave Form ◽

Firing Time ◽

Neural Firing ◽

Neural Correlate ◽

Retest Reliability ◽

Repeated Word ◽

Negative Peak ◽

The Stability ◽

Test Retest Reliability

In 1977, Shepherd and colleagues reported significant correlations (–.90, –.91) between speechreading scores and the latency of a selected negative peak (VN 130 measure) on the averaged visual electroencephalic wave form. The primary purpose of this current study was to examine the stability, or repeatability, of this relation between these cognitive and neurophysiologic measures over a period of several months and thus support its test-retest reliability. Repeated speechreading word and sentence scores were gathered during three test-retest sessions from each of 20 normal-hearing adults. An average of 56 days occurred from the end of one to the beginning of another speechreading sessions. During each of four other test-retest sessions, averaged visual electroencephalic responses (AVER s ) were evoked from each subject. An average of 49 clays intervened between AVER sessions. Product-moment correlations computed among repeated word scores and VN l30 measures ranged from –.61 to –.89. Based on these findings, it was concluded that the VN l30 measure of visual neural firing time is a reliable correlate of speech-reading in normal-hearing adults.

Download Full-text