scholarly journals Effect sizes and test-retest reliability of the fMRI-based Neurologic Pain Signature

NeuroImage ◽  
2021 ◽  
pp. 118844
Author(s):  
Xiaochun Han ◽  
Yoni K. Ashar ◽  
Philip Kragel ◽  
Bogdan Petre ◽  
Victoria Schelkun ◽  
...  
Keyword(s):  
Effect Sizes ◽  
Retest Reliability ◽  
Test Retest Reliability

scholarly journals Effect sizes and test-retest reliability of the fMRI-based Neurologic Pain Signature

2021 ◽  
Author(s):  
Xiaochun Han ◽  
Yoni K. Ashar ◽  
Philip Kragel ◽  
Bogdan Petre ◽  
Victoria Schelkun ◽  
...  
Keyword(s):  
Individual Differences ◽  
Effect Size ◽  
Mental States ◽  
Effect Sizes ◽  
Medium Effect ◽  
Retest Reliability ◽  
Medium Effect Size ◽  
Pain Reports ◽  
Nociceptive Input ◽  
Test Retest Reliability

Identifying biomarkers that predict mental states with large effect sizes and high test-retest reliability is a growing priority for fMRI research. We examined a well-established multivariate brain measure that tracks pain induced by nociceptive input, the Neurologic Pain Signature (NPS). In N = 295 participants across eight studies, NPS responses showed a very large effect size in predicting within-person single-trial pain reports (d = 1.45) and medium effect size in predicting individual differences in pain reports (d = 0.49, average r = 0.20). The NPS showed excellent short-term (within-day) test-retest reliability (ICC = 0.84, with average 69.5 trials/person). Reliability scaled with the number of trials within-person, with ≥60 trials required for excellent test-retest reliability. Reliability was comparable in two additional studies across 5-day (N = 29, ICC = 0.74, 30 trials/person) and 1-month (N = 40, ICC = 0.46, 5 trials/person) test-retest intervals. The combination of strong within-person correlations and only modest between-person correlations between the NPS and pain reports indicates that the two measures have different sources of between-person variance. The NPS is not a surrogate for individual differences in pain reports, but can serve as a reliable measure of pain-related physiology and mechanistic target for interventions.

scholarly journals Recommended motor assessments based on psychometric properties in individuals with dementia: a systematic review

2019 ◽  
Vol 16 (1) ◽  
Author(s):  
Sandra Trautwein ◽  
Philipp Maurus ◽  
Bettina Barisch-Fritz ◽  
Anela Hadzic ◽  
Alexander Woll
Keyword(s):  
Physical Activity ◽  
Systematic Review ◽  
Psychometric Properties ◽  
Randomised Controlled Trials ◽  
Effect Sizes ◽  
Controlled Trials ◽  
Retest Reliability ◽  
Frequency Of Use ◽  
Randomised Controlled ◽  
Test Retest Reliability

Abstract Background Motor assessments are important to determine effectiveness of physical activity in individuals with dementia (IWD). However, inappropriate and non-standardised assessments without sound psychometric properties have been used. This systematic review aims to examine psychometric properties of motor assessments in IWD combined with frequency of use and effect sizes and to provide recommendations based on observed findings. We performed a two-stage systematic literature search using Pubmed, Web of Science, Cochrane Library, ALOIS, and Scopus (inception - July/September 2018, English and German). The first search purposed to identify motor assessments used in randomised controlled trials assessing effectiveness of physical activity in IWD and to display their frequency of use and effect sizes. The second search focused on psychometric properties considering influence of severity and aetiology of dementia and cueing on test-retest reliability. Two reviewers independently extracted and analysed findings of eligible studies in a narrative synthesis. Results Literature searches identified 46 randomised controlled trials and 21 psychometric property studies. While insufficient information was available for validity, we observed sufficient inter-rater and relative test-retest reliability but unacceptable absolute test-retest reliability for most assessments. Combining these findings with frequency of use and effect sizes, we recommend Functional Reach Test, Groningen Meander Walking Test (time), Berg Balance Scale, Performance Oriented Mobility Assessment, Timed Up & Go Test, instrumented gait analysis (spatiotemporal parameters), Sit-to-Stand assessments (repetitions> 1), and 6-min walk test. It is important to consider that severity and aetiology of dementia and cueing influenced test-retest reliability of some assessments. Conclusion This review establishes an important foundation for future investigations. Sufficient relative reliability supports the conclusiveness of recommended assessments at group level, while unacceptable absolute reliability advices caution in assessing intra-individual changes. Moreover, influences on test-retest reliability suggest tailoring assessments and instructions to IWD and applying cueing only where it is inevitable. Considering heterogeneity of included studies and insufficient examination in various areas, these recommendations are not comprehensive. Further research, especially on validity and influences on test-retest reliability, as well as standardisation and development of tailored assessments for IWD is crucial. This systematic review was registered in PROSPERO (CRD42018105399).

scholarly journals Quantification of the pace of biological aging in humans through a blood test: the DunedinPACE DNA methylation algorithm

2021 ◽  
Author(s):  
Daniel W Belsky ◽  
Avshalom Caspi ◽  
David L Corcoran ◽  
Karen Sugden ◽  
Richie Poulton ◽  
...  
Keyword(s):  
Dna Methylation ◽  
Blood Test ◽  
Functional Decline ◽  
Childhood Adversity ◽  
Original Method ◽  
Effect Sizes ◽  
Biological Aging ◽  
Retest Reliability ◽  
System Integrity ◽  
Test Retest Reliability

Measures to quantify changes in the pace of biological aging in response to intervention are needed to evaluate geroprotective interventions for humans. Here, we report an advance on our original method (Belsky et al. 2020). We used data from the Dunedin Study 1972-3 birth cohort tracking within-individual decline in 19 organ-system integrity indicators across four timepoints spanning two decades to model Pace of Aging. We distilled two-decade Pace of Aging into a single-time-point DNA-methylation blood-test using elastic-net regression and DNA-methylation data restricted to exclude probes with low test-retest reliability. The resulting measure, DunedinPACE, showed high test-retest reliability, was associated with functional decline, morbidity, and mortality, and indicated accelerated Pace of Aging in young adults with childhood adversity across five datasets. DunedinPACE effect-sizes were similar to GrimAge-clock effect-sizes and larger than those for other benchmark DNA-methylation-clocks. DunedinPACE is a novel blood biomarker of the pace of aging for gerontology and geroscience

scholarly journals Reliability, and Convergent and Discriminant Validity of Gaming Disorder Scales: A Meta-Analysis

2021 ◽  
Vol 12 ◽  
Author(s):  
Seowon Yoon ◽  
Yeji Yang ◽  
Eunbin Ro ◽  
Woo-Young Ahn ◽  
Jueun Kim ◽  
...  
Keyword(s):  
Systematic Review ◽  
Internet Addiction ◽  
Discriminant Validity ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Gaming Disorder ◽  
Reliability Generalization ◽  
Retest Reliability ◽  
Convergent And Discriminant Validity ◽  
Test Retest Reliability

Background: An association between gaming disorder (GD) and the symptoms of common mental disorders is unraveled yet. In this preregistered study, we quantitatively synthesized reliability, convergent and discriminant validity of GD scales to examine association between GD and other constructs.Methods: Five representative GD instruments (GAS-7, AICA, IGDT-10, Lemmens IGD-9, and IGDS9-SF) were chosen based on recommendations by the previous systematic review study to conduct correlation meta-analyses and reliability generalization. A systematic literature search was conducted through Pubmed, Proquest, Embase, and Google Scholar to identify studies that reported information on either reliability or correlation with related variables. 2,124 studies were full-text assessed as of October 2020, and 184 were quantitatively synthesized. Conventional Hedges two-level meta-analytic method was utilized.Results: The result of reliability generalization reported a mean coefficient alpha of 0.86 (95% CI = 0.85–0.87) and a mean test-retest estimate of 0.86 (95% CI = 0.81–0.89). Estimated effect sizes of correlation between GD and the variables were as follows: 0.33 with depression (k = 45; number of effect sizes), 0.29 with anxiety (k = 37), 0.30 with aggression (k = 19), –0.22 with quality of life (k = 18), 0.29 with loneliness (k = 18), 0.56 with internet addiction (k = 20), and 0.40 with game playtime (k = 53), respectively. The result of moderator analyses, funnel and forest plots, and publication bias analyses were also presented.Discussion and Conclusion: All five GD instruments have good internal consistency and test-retest reliability. Relatively few studies reported the test-retest reliability. The result of correlation meta-analysis revealed that GD scores were only moderately associated with game playtime. Common psychological problems such as depression and anxiety were found to have a slightly smaller association with GD than the gaming behavior. GD scores were strongly correlated with internet addiction. Further studies should adopt a rigorous methodological procedure to unravel the bidirectional relationship between GD and other psychopathologies.Limitations: The current study did not include gray literature. The representativeness of the five tools included in the current study could be questioned. High heterogeneity is another limitation of the study.Systematic Review Registration: [https://www.crd.york.ac.uk/PROSPERO/], identifier [CRD42020219781].

scholarly journals DunedinPACE, a DNA methylation biomarker of the pace of aging

eLife ◽  
2022 ◽  
Vol 11 ◽  
Author(s):  
Daniel W Belsky ◽  
Avshalom Caspi ◽  
David L Corcoran ◽  
Karen Sugden ◽  
Richie Poulton ◽  
...  
Keyword(s):  
Dna Methylation ◽  
Blood Test ◽  
Childhood Adversity ◽  
Effect Sizes ◽  
Biological Aging ◽  
Retest Reliability ◽  
Blood Biomarker ◽  
System Integrity ◽  
Test Retest Reliability ◽  
Single Time Point

Background: Measures to quantify changes in the pace of biological aging in response to intervention are needed to evaluate geroprotective interventions for humans. Previously we showed that quantification of the pace of biological aging from a DNA-methylation blood test was possible (Belsky et al. 2020). Here we report a next-generation DNA-methylation biomarker of Pace of Aging, DunedinPACE (for Pace of Aging Calculated from the Epigenome).Methods: We used data from the Dunedin Study 1972-3 birth cohort tracking within-individual decline in 19 indicators of organ-system integrity across four time points spanning two decades to model Pace of Aging. We distilled this two-decade Pace of Aging into a single-time-point DNA-methylation blood-test using elastic-net regression and a DNA-methylation dataset restricted to exclude probes with low test-retest reliability. We evaluated the resulting measure, named DunedinPACE, in five additional datasets.Results: DunedinPACE showed high test-retest reliability, was associated with morbidity, disability, and mortality, and indicated faster aging in young adults with childhood adversity. DunedinPACE effect-sizes were similar to GrimAge Clock effect-sizes. In analysis of incident morbidity, disability, and mortality, DunedinPACE and added incremental prediction beyond GrimAge.Conclusions: DunedinPACE is a novel blood biomarker of the pace of aging for gerontology and geroscience.Funding: This research was supported by US-National Institute on Aging grants AG032282, AG061378, AG066887, and UK Medical Research Council grant MR/P005918/1.

Measuring “Language Access Profiles” in Deaf and Hard-of-Hearing Children With the DHH Language Exposure Assessment Tool

2020 ◽  
pp. 1-25
Author(s):  
Matthew L. Hall ◽  
Stephanie De Anda
Keyword(s):  
Cluster Analysis ◽  
Exposure Assessment ◽  
Hard Of Hearing ◽  
Assessment Tool ◽  
Communication Mode ◽  
Developmental Potential ◽  
Language Access ◽  
Retest Reliability ◽  
Language Exposure ◽  
Test Retest Reliability

Purpose The purposes of this study were (a) to introduce “language access profiles” as a viable alternative construct to “communication mode” for describing experience with language input during early childhood for deaf and hard-of-hearing (DHH) children; (b) to describe the development of a new tool for measuring DHH children's language access profiles during infancy and toddlerhood; and (c) to evaluate the novelty, reliability, and validity of this tool. Method We adapted an existing retrospective parent report measure of early language experience (the Language Exposure Assessment Tool) to make it suitable for use with DHH populations. We administered the adapted instrument (DHH Language Exposure Assessment Tool [D-LEAT]) to the caregivers of 105 DHH children aged 12 years and younger. To measure convergent validity, we also administered another novel instrument: the Language Access Profile Tool. To measure test–retest reliability, half of the participants were interviewed again after 1 month. We identified groups of children with similar language access profiles by using hierarchical cluster analysis. Results The D-LEAT revealed DHH children's diverse experiences with access to language during infancy and toddlerhood. Cluster analysis groupings were markedly different from those derived from more traditional grouping rules (e.g., communication modes). Test–retest reliability was good, especially for the same-interviewer condition. Content, convergent, and face validity were strong. Conclusions To optimize DHH children's developmental potential, stakeholders who work at the individual and population levels would benefit from replacing communication mode with language access profiles. The D-LEAT is the first tool that aims to measure this novel construct. Despite limitations that future work aims to address, the present results demonstrate that the D-LEAT represents progress over the status quo.

Visual-Neural Correlate of Speechreading Ability in Normal-Hearing Adults

1982 ◽  
Vol 25 (4) ◽  
pp. 521-527 ◽  
Author(s):  
David C. Shepherd
Keyword(s):  
Normal Hearing ◽  
Wave Form ◽  
Firing Time ◽  
Neural Firing ◽  
Neural Correlate ◽  
Retest Reliability ◽  
Repeated Word ◽  
Negative Peak ◽  
The Stability ◽  
Test Retest Reliability

In 1977, Shepherd and colleagues reported significant correlations (–.90, –.91) between speechreading scores and the latency of a selected negative peak (VN 130 measure) on the averaged visual electroencephalic wave form. The primary purpose of this current study was to examine the stability, or repeatability, of this relation between these cognitive and neurophysiologic measures over a period of several months and thus support its test-retest reliability. Repeated speechreading word and sentence scores were gathered during three test-retest sessions from each of 20 normal-hearing adults. An average of 56 days occurred from the end of one to the beginning of another speechreading sessions. During each of four other test-retest sessions, averaged visual electroencephalic responses (AVER s ) were evoked from each subject. An average of 49 clays intervened between AVER sessions. Product-moment correlations computed among repeated word scores and VN l30 measures ranged from –.61 to –.89. Based on these findings, it was concluded that the VN l30 measure of visual neural firing time is a reliable correlate of speech-reading in normal-hearing adults.

Test-Retest Reliability of a Self-Report Questionnaire for DSM-IV and ICD-10 Personality Disorders

2000 ◽  
Vol 16 (1) ◽  
pp. 53-58 ◽  
Author(s):  
Hans Ottosson ◽  
Martin Grann ◽  
Gunnar Kullgren
Keyword(s):  
Personality Disorder ◽  
Anxiety Disorders ◽  
Personality Disorders ◽  
Clinical Sample ◽  
Self Report ◽  
Anxiety State ◽  
Short Term ◽  
Retest Reliability ◽  
Axis I ◽  
Test Retest Reliability

Summary: Short-term stability or test-retest reliability of self-reported personality traits is likely to be biased if the respondent is affected by a depressive or anxiety state. However, in some studies, DSM-oriented self-reported instruments have proved to be reasonably stable in the short term, regardless of co-occurring depressive or anxiety disorders. In the present study, we examined the short-term test-retest reliability of a new self-report questionnaire for personality disorder diagnosis (DIP-Q) on a clinical sample of 30 individuals, having either a depressive, an anxiety, or no axis-I disorder. Test-retest scorings from subjects with depressive disorders were mostly unstable, with a significant change in fulfilled criteria between entry and retest for three out of ten personality disorders: borderline, avoidant and obsessive-compulsive personality disorder. Scorings from subjects with anxiety disorders were unstable only for cluster C and dependent personality disorder items. In the absence of co-morbid depressive or anxiety disorders, mean dimensional scores of DIP-Q showed no significant differences between entry and retest. Overall, the effect from state on trait scorings was moderate, and it is concluded that test-retest reliability for DIP-Q is acceptable.

The Psychometrics of Three Dissociation Scales: Test-Retest, Reliability, and Relationship to Trauma

2013 ◽  
Author(s):  
Kristen M. Dahlin-James ◽  
Emily J. Hennrich ◽  
E. Grace Verbeck-Priest ◽  
Jan E. Estrellado ◽  
Jessica M. Stevens ◽  
...  
Keyword(s):  
Retest Reliability ◽  
Test Retest Reliability
Sign in / Sign up

Export Citation Format

Share Document