scholarly journals Reproducibility Assessment of Neuromelanin-Sensitive Magnetic Resonance Imaging Protocols for Region-of-Interest and Voxelwise Analyses

2019 ◽  
Author(s):  
Kenneth Wengler ◽  
Xiang He ◽  
Anissa Abi-Dargham ◽  
Guillermo Horga

AbstractNeuromelanin-sensitive MRI (NM-MRI) provides a noninvasive measure of the content of neuromelanin (NM), a product of dopamine metabolism that accumulates with age in dopamine neurons of the substantia nigra (SN). NM-MRI has been validated as a measure of both dopamine neuron loss, with applications in neurodegenerative disease, and dopamine function, with applications in psychiatric disease. Furthermore, a voxelwise-analysis approach has been validated to resolve substructures, such as the ventral tegmental area (VTA), within midbrain dopaminergic nuclei thought to have distinct anatomical targets and functional roles. NM-MRI is thus a promising tool that could have diverse research and clinical applications to noninvasively interrogate in vivo the dopamine system in neuropsychiatric illness. Although a test-retest reliability study by Langley et al. using the standard NM-MRI protocol recently reported high reliability, a systematic and comprehensive investigation of the performance of the method for various acquisition parameters and preprocessing methods has not been conducted. In particular, most previous studies used relatively thick MRI slices (∼3 mm), compared to the typical in-plane resolution (∼0.5 mm) and to the height of the SN (∼15 mm), to overcome technical limitations such as specific absorption rate and signal-to-noise ratio, at the cost of partial-volume effects. Here, we evaluated the effect of various acquisition and preprocessing parameters on the strength and test-retest reliability of the NM-MRI signal to determine optimized protocols for both region-of-interest (including whole SN/VTA-complex and atlas-defined dopaminergic nuclei) and voxelwise measures. Namely, we determined a combination of parameters that optimizes the strength and reliability of the NM-MRI signal, including acquisition time, slice-thickness, spatial-normalization software, and degree of spatial smoothing. Using a newly developed, detailed acquisition protocol, across two scans separated by 13 days on average, we obtained intra-class correlation values indicating excellent reliability and high contrast-to-noise, which could be achieved with a different set of parameters depending on the measures of interest and experimental constraints such as acquisition time. Based on this, we provide detailed guidelines covering acquisition through analysis and recommendations for performing NM-MRI experiments with high quality and reproducibility. This work provides a foundation for the optimization and standardization of NM-MRI, a promising MRI approach with growing applications throughout clinical and basic neuroscience.HighlightsA detailed NM-MRI volume placement protocol is described.Guidelines covering acquisition through analysis for NM-MRI are given.A test-retest study in 10 healthy subjects shows high reproducibility for region-of-interest (ROI) and voxelwise analyses.∼3 minutes of NM-MRI data is needed for high-quality ROI-analysis.∼6 minutes of NM-MRI data is needed for high-quality voxelwise-analysis.


2021 ◽  
Vol 12 ◽  
Author(s):  
Céline Hochstrasser ◽  
Sarah Rieder ◽  
Ursina Jufer-Riedi ◽  
Marie-Noëlle Klein ◽  
Anthony Feinstein ◽  
...  

ObjectiveThe objective of this study was to validate the computerized Symbol Digit Modalities Test (c-SDMT) in a Swiss pediatric cohort, in comparing the Swiss sample to the Canadian norms. Secondly, we evaluated sex effects, age-effects, and test–retest reliability of the c-SDMT in comparison to values obtained for the paper and pencil version of the Symbol Digit Modalities Test (SDMT).MethodsThis longitudinal observational study was conducted in a single-center setting at the University Children’s Hospital of Bern. Our cohort consisted of 86 children (45 male and 41 female) aged from 8 to 16 years. The cohort included both healthy participants (n = 38) and patients (n = 48) hospitalized for a non-neurological disease. Forty eight participants were assessed during two testing sessions with the SDMT and the c-SDMT.ResultsTest–retest reliability was high in both tests (SDMT: ICC = 0.89, c-SDMT: ICC = 0.90). A reliable change index was calculated for the SDMT (RCIp = −3.18, 14.01) and the c-SDMT (RCIp = −5.45, 1.46) corrected for practice effects. While a significant age effect on information processing speed was observed, no such effect was found for sex. When data on the c-SDMT performance of the Swiss cohort was compared with that from a Canadian cohort, no significant difference was found for the mean time per trial in any age group. Norm values for age groups between 8 and 16 years in the Swiss cohort were established.ConclusionNorms for the c-SDMT between the Swiss and the Canadian cohort were comparable. The c-SDMT is a valid alternative to the SDMT. It is a feasible and easy to administer bedside tool due to high reliability and the lack of motor demands.



2020 ◽  
Author(s):  
Yun Wang ◽  
Walter Hinds ◽  
Cristiane S Duarte ◽  
Seonjoo Lee ◽  
Catherine Monk ◽  
...  

AbstractResting functional MRI studies of the infant brain are increasingly becoming an important tool in developmental neuroscience. Whereas the test-retest reliability of functional connectivity (FC) measures derived from resting fMRI data have been characterized in the adult and child brain, similar assessments have not been conducted in infants. In this study, we examined the intra-session test-retest reliability of FC measures from 119 infant brain MRI scans from four neurodevelopmental studies. We investigated edge-level and subject-level reliability within one MRI session (between and within runs) measured by the Intraclass correlation coefficient (ICC). First, using an atlas-based approach, we examined whole-brain connectivity as well as connectivity within two common resting fMRI networks – the default mode network (DMN) and the sensorimotor network (SMN). Second, we examined the influence of run duration, study site, and scanning manufacturer (e.g., Philips and General Electric) on ICCs. Lastly, we tested spatial similarity using the Jaccard Index from networks derived from independent component analysis (ICA). Consistent with resting fMRI studies from adults, our findings indicated poor edge-level reliability (ICC = 0.14 - 0.18), but moderate-to-good subject-level intra-session reliability for whole-brain, DMN, and SMN connectivity (ICC = 0.40 - 0.78). We also found significant effects of run duration, site, and scanning manufacturer on reliability estimates. Some ICA-derived networks showed strong spatial reproducibility (e.g., DMN, SMN, and Visual Network), and were labelled based on their spatial similarity to analogous networks measured in adults. These networks were reproducibly found across different study studies. However, other ICA-networks (e.g. Executive Control Network) did not show strong spatial reproducibility, suggesting that the reliability and/or maturational course of functional connectivity may vary by network. In sum, our findings suggest that developmental scientist may be on safe ground examining the functional organization of some major neural networks (e.g. DMN and SMN), but judicious interpretation of functional connectivity is essential to its ongoing success.HighlightsInfant functional connectivity (FC) shows poor edge-level reliability (ICCs)However, subject-level infant FC estimates show good-to-excellent ICCsSpatial reproducibility is better for some resting networks (DMN, SMN) than others (ECN)Reliability estimates differ across study site and MRI scannerConclusion - Infant FC can be a reliable measurement, but judicious use is needed



2019 ◽  
Author(s):  
Stephanie Long ◽  
Tibor Schuster ◽  
Russell Steele ◽  
Suzanne Leclerc ◽  
Ian Shrier

AbstractBackgroundTests of binocular vision (BVTs) and ocular motility are used in concussion assessment and management.PurposeTo determine the one-week test-retest reliability of 9 binocular vision tests (BVTs) and a test of saccades proposed for use in concussion management.Study DesignProspective test-retest.MethodsWe examined the one-week test-retest reliability of 9 BVTs in healthy participants: 3D vision (gross stereoscopic acuity), phoria at 30cm and 3m, ability of eyes to move/fixate in-sync (positive and negative fusional vergence at 30cm and 3m, near point of convergence and near point of convergence – break [i.e. double vision]) and 1 ocular motor test, saccades.ResultsWe tested 10 males and 10 females without concussion and a mean age of 25.5 (4.1) years. The intraclass correlations suggest good reliability for phoria 3m (0.88) and gross stereoscopic acuity (0.86), and moderate reliability for phoria 30cm (0.69), near point of convergence (0.54), positive fusional vergence (0.54) and negative fusional vergence (0.66) at 30cm, and near point of convergence - break (0.64). There was poor reliability for saccades (0.34), and both positive and negative fusional vergence (0.49 and 0.43, respectively) at 3m. Limits of agreement (LoA) were best for saccade (±34%) and worst for phoria 30 cm (±121%) and ranged from ±58% to ±70% for 7 of the 8 other tests. The LoA for phoria at 3m were uninformative because measurements for 18 of 20 participants were identical.ConclusionWe found test-retest reliability of the BVTs and saccades ranging from poor to good in healthy participants, with the majority being moderate.Clinical RelevanceFor these vision tests to be clinically useful, the effect of concussion must have a moderate to large effect on the scores of most of the tests.What is known about the subjectConcussions may affect some parts of visual function1-week test-retest reliability for most visual tests is under-studiedWhat this study adds to existing knowledgeWe provide intra-class coefficients and limits of agreement for 10 different visual function tests commonly conducted by clinicians in patients with concussion.



2019 ◽  
Vol 32 (1) ◽  
pp. 69-74
Author(s):  
Seul Gi Koo ◽  
Hae Yean Park ◽  
Jongbae Kim ◽  
Areum Han

Objective The purpose of this study is to introduce a standardised assessment tool by verifying the reliability of the translated Korean version of the Feeding Abilities Assessment (K-FAA), which was developed to suit Korean culture. Methods The research subjects were 65 patients with dementia living in nursing homes. The K-FAA was completed by verifying the suitability of translation and reverse translation. The validity of the K-FAA was established through content validity, while its reliability was analysed based on internal consistency reliability for the items, test–retest reliability and inter-rater reliability. Results The content validity index determined, based on the assessment of professors, occupational therapists, and nurses, was more than .70. Cronbach’s α was more than .929, showing good internal consistency. A test–retest reliability of .884 was derived using Pearson’s correlation coefficient (p < .01), and an inter-rater reliability of .800 was derived using the kappa coefficients; intraclass correlation coefficient was .897, which also indicated good reliability. Conclusion The K-FAA was modified to fit the Korean domestic situation, and this assessment had high reliability. Therefore, K-FAA can evaluate the feeding ability of patients with dementia. Future studies should focus on providing evidence-based data to maintain or supplement the feeding ability of patients with dementia in Korea.



1987 ◽  
Vol 61 (2) ◽  
pp. 675-678 ◽  
Author(s):  
Douglas L. Grimsley

The test-retest reliability of the Stanton Survey honesty test was examined. Data were collected in two rounds of testing of 51 and 35 college students with at least 6 mo. work experience. Each student took the Stanton Survey on 2 occasions separated by 6 wk. The over-all test-retest reliability of the combined groups was .90. This high reliability is also reflected in subscore correlations of .89 and .86, indicating that test takers respond very consistently in both their attitudes and admissions of past dishonesty and drug usage.



2013 ◽  
Vol 10 (1) ◽  
pp. 51-56 ◽  
Author(s):  
Marie-Thérèse Forster ◽  
Moritz Limbart ◽  
Volker Seifert ◽  
Christian Senft

Abstract BACKGROUND: Because navigated transcranial magnetic stimulation (nTMS) is increasingly used in neurosurgical research, interpretation of its results is of utmost importance. OBJECTIVE: To evaluate the test-retest reliability of nTMS. METHODS: Twelve healthy participants underwent nTMS at 2 different sessions separated by 10.3 ± 9.6 days. Investigated parameters included resting motor thresholds, hotspots, and centers of gravity calculated for the first dorsal interosseous, abductor pollicis brevis, extensor digitorum, tibial anterior, and abductor hallucis muscles. RESULTS: Excellent reliability of resting motor thresholds was observed. Hotspots and centers of gravity showed moderate to excellent repeatability along the anteroposterior axis (intraclass correlation coefficient, 0.54-0.89), whereas the x coordinate presented mainly poor to moderate stability (intraclass correlation coefficient, 0.11-0.89). Movement of centers of gravity over sessions was 0.57 ± 0.32 cm, and hotspots laid 0.79 ± 0.47 cm apart. Calculation of coefficient of variation revealed high reliability of investigated parameters in upper extremities; in lower extremity muscles, high variation across sessions was observed. CONCLUSION: nTMS can be considered a reliable tool, thus opening new fields of noninvasive investigations in neurosurgery. The results presented here should be considered in the interpretation of individual nTMS results.



Author(s):  
Jonathan Mak ◽  
Neil Rens ◽  
Dasha Savage ◽  
Helle Nielsen-Bowles ◽  
Doran Triggs ◽  
...  

Abstract Aims  The 6-min-walk test (6MWT) is a validated proxy for frailty and a predictor of clinical outcomes, yet is not widely used due to implementation challenges. This comparative effectiveness study assesses the reliability and repeatability of a home-based 6MWT compared to in-clinic 6MWTs in patients with cardiovascular disease. Methods and results  One hundred and ten (110) patients scheduled for cardiac or vascular surgery were enrolled during a study period from June 2018 to December 2019 at the Palo Alto VA Hospital. Subjects were provided with an Apple iPhone 7 and Apple Watch Series 3 loaded with the VascTrac research study application and performed a supervised in-clinic 6MWT during enrolment, at 2 weeks, 1, 3, and 6 months post-operatively. Subjects also received notifications to perform at-home smartphone-based 6MWTs once a week for a duration of 6 months. Test–retest reliability of in-clinic measurements and at-home measurements was assessed with an industry standard Cronbach’s alpha reliability test. Test–retest reliability for in-clinic ground truth 6MWT steps vs. in-clinic iPhone 6MWT steps was 0·99, showing high reliability between the two tested measurements. When comparing for in-clinic ground truth 6MWT steps vs. neighbouring at-home iPhone 6MWT steps, reliability was 0·74. Conclusion  Running the test–reliability test on both measurements shows that an iPhone 6MWT test is reliable compared to an in-clinic ground truth measurement in patients with cardiovascular disease.



2013 ◽  
Vol 23 (2) ◽  
pp. 43-51
Author(s):  
Sarah A. Cordingley ◽  
Karen F. Muñoz ◽  
K. Todd Houston

Purpose: The aims of this study were to assess the test-retest, intra-rater, and inter-rater reliability of the Auditory Perception Test for the Hearing Impaired-Revised (APT/HI-R) for children with hearing loss. Method: This study used a cross-sectional design. Sixteen children between the ages of 3 and 10 years with bilateral hearing loss who wear amplification and use spoken language to communicate were included in this study. Results: Test-retest reliability was high (r = 0.98) for the complete test, and for all subsections of the test with the exception of the Linguistic Perception subsection. Reliability was also high for intra-rater (r = 0.99) and inter-rater (84%–92% rater agreement) reliability. Conclusion: The APT-HI/R showed high reliability in this study, comparable to results from the original pilot study.



1997 ◽  
Vol 85 (3_suppl) ◽  
pp. 1344-1346 ◽  
Author(s):  
Michael Reiss ◽  
Gilfe Reiss

The test-retest reliability of the asymmetry of the Unterberger stepping test was obtained over a 3-mo. period. This stepping test is a test examining the labyrinthine deviation when testing the lower extremities. Also, self-report items were validated against individual measures of the stepping test. The investigations show high reliability of the asymmetry of the stepping test. The data indicate further that a questionnaire is a valid method for the assessment of the asymmetry of the stepping test.



Author(s):  
Xu Tian ◽  
Yanfei Jin ◽  
Hui Chen ◽  
María F. Jiménez-Herrera

Moral distress (MD) has become a seriously negative problem experienced by healthcare professionals, especially clinical nurses. Early and accurate detection of MD by the validated and reliable instrument is critically important to further develop an effective intervention strategy. We performed the current systematic review to comprehensively summarize the evidence of instruments for the detection of MD in clinical nurses. The research design was a systematic literature review. We assigned 2 investigators to independently search potential studies in PubMed, EMBASE, and China National Knowledge Infrastructure (CNKI) from their inception to June 2020. We used data extraction table extracting essential information, and the modified critical appraisal tool evaluating the reliability and validity of eligible instruments. Finally, we qualitatively summarized results of all included instruments. No ethical approval was required because this systematic review was performed based on published studies. We included 16 eligible studies covering 10 original and 6 revised or modified instruments for the final analysis. The overall quality of all instruments was moderate because test-retest reliability was inadequately examined in most instruments. Of 16 instruments, MDS-revised (MDS-R) was broadly validated and employed in different working or cultural settings. Meanwhile, it also extensively expands to specifically detect MD. Moreover, other instruments including moral distress risk scale (MDSR) and moral distress thermometer (MDT) should be further validated and utilized because it covered the gap missed by most instruments. Although several instruments have been made available for clinical nurses, some of them have inadequate psychometric properties test, especially test-retest reliability evaluation. Meanwhile, most of them have not be validated and employed in other working or cultural settings. We therefore suggested further studies to validate the psychometric properties of existing instruments and then employed instruments with high reliability and validity to detect MD in clinical nurses.



Sign in / Sign up

Export Citation Format

Share Document