scholarly journals Characterizing Individual Differences in Sweet Taste Hedonics: Test Methods, Locations, and Stimuli

Nutrients ◽  
2022 ◽  
Vol 14 (2) ◽  
pp. 370
Author(s):  
May M. Cheung ◽  
Matthew Kramer ◽  
Gary K. Beauchamp ◽  
Sari Puputti ◽  
Paul M. Wise
Keyword(s):  
Individual Differences ◽  
Aqueous Solutions ◽  
Convergent Validity ◽  
Paired Comparison ◽  
Sucrose Concentration ◽  
Sweet Taste ◽  
Test Methods ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
At Home

Sweetness drives the consumption of added sugars, so understanding how to best measure sweet hedonics is important for developing strategies to lower sugar intake. However, methods to assess hedonic response to sweetness vary, making results across studies difficult to integrate. We compared methods to measure optimal sucrose concentration in 21 healthy adults (1) using paired-comparison preference tracking vs. ratings of liking, (2) with participants in the laboratory vs. at home, and (3) using aqueous solutions vs. vanilla milk. Tests were replicated on separate days to assess test-retest reliability. Test-retest reliability was similar between laboratory and home testing, but tended to be better for vanilla milk and preference tracking. Optimal sucrose concentration was virtually identical between laboratory and home, slightly lower when estimated via preference tracking, and about 50% lower in vanilla milk. However, optimal sucrose concentration correlated strongly between methods, locations, and stimuli. More than 50% of the variability in optimal sucrose concentration could be attributed to consistent differences among individuals, while much less variability was attributable to differences between methods. These results demonstrate convergent validity between methods, support testing at home, and suggest that aqueous solutions can be useful proxies for some commonly consumed beverages for measuring individual differences.

scholarly journals Characterizing Individual Differences in Sweet Taste Hedonics: Test Methods, Locations, and Stimuli

2021 ◽  
Author(s):  
May Cheung ◽  
Matthew Kramer ◽  
Gary Beauchamp ◽  
Paul Wise
Keyword(s):  
Individual Differences ◽  
Aqueous Solutions ◽  
Convergent Validity ◽  
Paired Comparison ◽  
Sucrose Concentration ◽  
Sweet Taste ◽  
Test Methods ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
At Home

Sweetness drives consumption of added sugars, so understanding how individuals differ is important for developing strategies to lower sugar intake. However, methods to assess hedonic response to sweetness vary, making results across studies difficult to integrate. We compared methods to measure optimal sucrose concentration in 21 healthy adults (1) using paired-comparison preference tracking vs. ratings of liking, (2) with participants in the laboratory vs. at home, and (3) using aqueous solutions vs. vanilla milk. Tests were replicated on separate days to assess test-retest reliability. Test-retest reliability was similar between laboratory and home testing, but tended to be better for vanilla milk and preference tracking. Optimal sucrose concentration was virtually identical between laboratory and home, slightly lower when estimated via preference tracking, and about 50% lower in vanilla milk. However, individual optimal sucrose concentration correlated strongly between Methods, test Locations, and Stimuli. More than 50% of the variability in optimal sucrose concentration could be attributed to consistent differences among individuals while much less variability was attributable to differences in Methods, test Locations or Stimuli. These results demonstrate convergent validity between measures of preference and liking, support testing at home to lower participant burden, and suggest that aqueous solutions can be useful proxies for some commonly consumed beverages for measuring individual differences.

scholarly journals Test–retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Fluid Intelligence ◽  
Stable Condition ◽  
Practice Effect ◽  
Minimal Detectable Change ◽  
Nonverbal Intelligence ◽  
Fourth Edition ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1 and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = − 0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good. Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Therapeutic Interventions ◽  
Treatment Burden ◽  
Validity And Reliability ◽  
Stroke Patients ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Validation of the NARCOMS Registry: pain assessment

2005 ◽  
Vol 11 (3) ◽  
pp. 338-342 ◽  
Author(s):  
Ruth Ann Marrie ◽  
Gary Cutter ◽  
Tuula Tyry ◽  
Olympia Hadjimichael ◽  
Timothy Vollmer
Keyword(s):  
Multiple Sclerosis ◽  
Convergent Validity ◽  
Disease Duration ◽  
Self Report ◽  
Research Committee ◽  
Retest Reliability ◽  
The North ◽  
Disability Status ◽  
Pain Question ◽  
Test Retest Reliability

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

scholarly journals Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Psychometric Evaluation ◽  
Counseling Competencies ◽  
Counselors In Training ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

scholarly journals Effect sizes and test-retest reliability of the fMRI-based Neurologic Pain Signature

2021 ◽  
Author(s):  
Xiaochun Han ◽  
Yoni K. Ashar ◽  
Philip Kragel ◽  
Bogdan Petre ◽  
Victoria Schelkun ◽  
...  
Keyword(s):  
Individual Differences ◽  
Effect Size ◽  
Mental States ◽  
Effect Sizes ◽  
Medium Effect ◽  
Retest Reliability ◽  
Medium Effect Size ◽  
Pain Reports ◽  
Nociceptive Input ◽  
Test Retest Reliability

Identifying biomarkers that predict mental states with large effect sizes and high test-retest reliability is a growing priority for fMRI research. We examined a well-established multivariate brain measure that tracks pain induced by nociceptive input, the Neurologic Pain Signature (NPS). In N = 295 participants across eight studies, NPS responses showed a very large effect size in predicting within-person single-trial pain reports (d = 1.45) and medium effect size in predicting individual differences in pain reports (d = 0.49, average r = 0.20). The NPS showed excellent short-term (within-day) test-retest reliability (ICC = 0.84, with average 69.5 trials/person). Reliability scaled with the number of trials within-person, with ≥60 trials required for excellent test-retest reliability. Reliability was comparable in two additional studies across 5-day (N = 29, ICC = 0.74, 30 trials/person) and 1-month (N = 40, ICC = 0.46, 5 trials/person) test-retest intervals. The combination of strong within-person correlations and only modest between-person correlations between the NPS and pain reports indicates that the two measures have different sources of between-person variance. The NPS is not a surrogate for individual differences in pain reports, but can serve as a reliable measure of pain-related physiology and mechanistic target for interventions.

scholarly journals Learning from the Reliability Paradox: How Theoretically Informed Generative Models Can Advance the Social, Behavioral, and Brain Sciences

2020 ◽  
Author(s):  
Nathaniel Haines ◽  
Peter D. Kvam ◽  
Louis H. Irving ◽  
Colin Smith ◽  
Theodore P. Beauchaine ◽  
...  
Keyword(s):  
Individual Differences ◽  
Theory Development ◽  
Generative Models ◽  
Parameter Estimates ◽  
Group Level ◽  
Retest Reliability ◽  
Individual Level ◽  
Generative Modeling ◽  
Behavioral Tasks ◽  
Test Retest Reliability

Behavioral tasks (e.g., Stroop task) that produce replicable group-level effects (e.g., Stroop effect) often fail to reliably capture individual differences between participants (e.g., low test-retest reliability). This “reliability paradox” has led many researchers to conclude that most behavioral tasks cannot be used to develop and advance theories of individual differences. However, these conclusions are derived from statistical models that provide only superficial summary descriptions of behavioral data, thereby ignoring theoretically-relevant data-generating mechanisms that underly individual-level behavior. More generally, such descriptive methods lack the flexibility to test and develop increasingly complex theories of individual differences. To resolve this theory-description gap, we present generative modeling approaches, which involve using background knowledge to specify how behavior is generated at the individual level, and in turn how the distributions of individual-level mechanisms are characterized at the group level—all in a single joint model. Generative modeling shifts our focus away from estimating descriptive statistical “effects” toward estimating psychologically meaningful parameters, while simultaneously accounting for measurement error that would otherwise attenuate individual difference correlations. Using simulations and empirical data from the Implicit Association Test and Stroop, Flanker, Posner Cueing, and Delay Discounting tasks, we demonstrate how generative models yield (1) higher test-retest reliability estimates, and (2) more theoretically informative parameter estimates relative to traditional statistical approaches. Our results reclaim optimism regarding the utility of behavioral paradigms for testing and advancing theories of individual differences, and emphasize the importance of formally specifying and checking model assumptions to reduce theory-description gaps and facilitate principled theory development.

scholarly journals Test-Retest Reliability, Convergent Validity and Practice Effects of the RBANS in a Memory Clinic Setting: A Pilot Study

2013 ◽  
Vol 02 (04) ◽  
pp. 11-16 ◽  
Author(s):  
Yanhong Dong ◽  
Claire L. Thompson ◽  
Shi Huey Joanne Tan ◽  
Leon Ben Swie Lim ◽  
Wanshin Pang ◽  
...  
Keyword(s):  
Pilot Study ◽  
Convergent Validity ◽  
Practice Effects ◽  
Memory Clinic ◽  
Retest Reliability ◽  
Clinic Setting ◽  
Test Retest Reliability

scholarly journals The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

2021 ◽  
Vol 18 (23) ◽  
pp. 12507
Author(s):  
Lavinia De Chiara ◽  
Cristina Mazza ◽  
Eleonora Ricci ◽  
Alexia Emilia Koukopoulos ◽  
Georgios D. Kotzalidis ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Predictive Power ◽  
Discriminant Validity ◽  
Late Pregnancy ◽  
Italian Version ◽  
Retest Reliability ◽  
Dsm 5 ◽  
Insomnia Symptom ◽  
Symptom Questionnaire ◽  
Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

scholarly journals European Portuguese Version of the Clinical Frailty Scale: Translation, Cultural Adaptation and Validation Study

2021 ◽  
Vol 34 (13) ◽  
Author(s):  
Mário Pereira Pinto ◽  
Sónia Martins ◽  
Edgar Mesquita ◽  
Lia Fernandes
Keyword(s):  
Sensitivity And Specificity ◽  
Validation Study ◽  
Convergent Validity ◽  
Outpatient Clinics ◽  
Clinical Frailty Scale ◽  
Retest Reliability ◽  
European Portuguese ◽  
Tilburg Frailty Indicator ◽  
Test Retest Reliability ◽  
Frailty Indicator

Introduction: This study aims to describe the translation and adaptation of the European Portuguese Clinical Frailty Scale and assess its convergent validity and test-retest reliability.Material and Methods: This validation study included a sample of elderly people admitted in two convalescence units from the National Network of Integrated Continuous Care in Northern Portugal and followed in two outpatient clinics of social solidarity institutions. Convergent validity of the scale was evaluated, against Tilburg Frailty Indicator. Test-retest reliability, sensitivity and specificity were assessed.Results: Overall, 51 patients were included (mean age = 78 years old). The Clinical Frailty Scale identified 43.1% patients with frailty. Kappa values for test-retest reliability (non-frail/frail) was 1.00. The intraclass correlation coefficient for the 9-point total scale was 0.999. A correlation between Clinical Frailty Scale and Tilburg Frailty Indicator was also found (rs = 0.683; p < 0.001). The Cohen’s kappa coefficient was 0.423 in the agreement analysis between these scales. The results for sensitivity and specificity defined that 62.0% of patients were true positives and 81.8% true negatives. The scale accuracy determined by the receiver operating characteristics curve analysis was 0.782.Discussion: This scale showed an excellent test-retest reliability. Robust results on convergent validity were also achieved, with a moderate correlation and agreement with the Tilburg Frailty Indicator, showing good sensitivity and accuracy, as well as high specificity.Conclusion: This version has an excellent test-retest reliability and good convergent validity, and is both a reliable and valid test for application in clinical practice for assessing Portuguese elderly population admitted in convalescence units and outpatient clinics.

Sign in / Sign up

Export Citation Format

Share Document