Healthy decisions in the cued-attribute food choice paradigm have high test-retest reliability

AbstractFood choice paradigms are commonly used to study decision mechanisms, individual differences, and intervention efficacy. Here, we measured behavior from twenty-three healthy young adults who completed five repetitions of a cued-attribute food choice paradigm over two weeks. This task includes cues prompting participants to explicitly consider the healthiness of the food items before making a selection, or to choose naturally based on whatever freely comes to mind. We found that the average patterns of food choices following both cue types and ratings about the palatability (i.e. taste) and healthiness of the food items were similar across all five repetitions. At the individual level, the test-retest reliability for choices in both conditions and healthiness ratings was excellent. However, test-retest reliability for taste ratings was only fair, suggesting that estimates about palatability may vary more from day to day for the same individual.

Download Full-text

Healthier decisions in the cued-attribute food choice paradigm have high test-retest reliability across five task repetitions over 14 days

10.1101/2021.03.25.437001 ◽

2021 ◽

Author(s):

Zahra Barakchian ◽

Anjali Raja Beharelle ◽

Todd A. Hare

Keyword(s):

Food Choice ◽

Food Choices ◽

Retest Reliability ◽

Individual Level ◽

Food Items ◽

Intervention Efficacy ◽

The Individual ◽

Test Retest Reliability ◽

Decision Mechanisms ◽

High Test

ABSTRACTFood choice paradigms are commonly used to study decision mechanisms, individual differences, and intervention efficacy. Here, we measured behavior from twenty-three healthy young adults who completed five repetitions of a cued-attribute food choice paradigm over two weeks. This task includes cues prompting participants to explicitly consider the healthiness of the food items before making a selection, or to choose naturally based on whatever freely comes to mind. We found that the average patterns of food choices following both cue types and ratings about the palatability (i.e. taste) and healthiness of the food items were similar across all five repetitions. At the individual level, the test-retest reliability for choices in both conditions and healthiness ratings was excellent. However, test-retest reliability for taste ratings was only fair, suggesting that estimates about palatability may vary more from day to day for the same individual.

Download Full-text

The forward testing effect is reliable and independent of learners’ working memory capacity

10.31234/osf.io/dw4fy ◽

2019 ◽

Author(s):

Bernhard Pastötter ◽

Christian Frings

Keyword(s):

Working Memory ◽

Testing Effect ◽

Retrieval Practice ◽

Working Memory Capacity ◽

Memory Capacity ◽

Retest Reliability ◽

Individual Level ◽

Wide Range ◽

The Individual ◽

Test Retest Reliability

The forward testing effect refers to the finding that retrieval practice of previously studied information enhances learning and retention of subsequently studied other information. While most of the previous research on the forward testing effect examined group differences, the present study took an individual differences approach to investigate this effect. Experiment 1 examined whether the forward effect has test-retest reliability between two experimental sessions. Experiment 2 investigated whether the effect is related to participants’ working memory capacity. In both experiments (and each session of Experiment 1), participants studied three lists of items in anticipation of a final cumulative recall test. In the testing condition, participants were tested immediately on lists 1 and 2, whereas in the restudy condition, they restudied lists 1 and 2. In both conditions, participants were tested immediately on list 3. On the group level, the results of both experiments demonstrated a forward testing effect, with interim testing of lists 1 and 2 enhancing immediate recall of list 3. On the individual level, the results of Experiment 1 showed that the forward effect on list 3 recall has moderate test-retest reliability between two experimental sessions. In addition, the results of Experiment 2 showed that the forward effect on list 3 recall does not depend on participants’ working memory capacity. These findings suggest that the forward testing effect is reliable at the individual level and affects learners at a wide range of working memory capacities alike. The theoretical and practical implications of the findings are discussed.

Download Full-text

Neuromuscular Plasticity: Disentangling Stable and Variable Motor Maps in the Human Sensorimotor Cortex

Neural Plasticity ◽

10.1155/2016/7365609 ◽

2016 ◽

Vol 2016 ◽

pp. 1-13 ◽

Cited By ~ 20

Author(s):

Dominic Kraus ◽

Alireza Gharabaghi

Keyword(s):

Sensorimotor Cortex ◽

Intraclass Correlation ◽

Therapeutic Interventions ◽

Retest Reliability ◽

Resting Motor Threshold ◽

Motor Maps ◽

The Individual ◽

Test Retest Reliability ◽

High Test

Motor maps acquired with transcranial magnetic stimulation (TMS) are evolving as a biomarker for monitoring disease progression or the effects of therapeutic interventions. High test-retest reliability of this technique for long observation periods is therefore required to differentiate daily or weekly fluctuations from stable plastic reorganization of corticospinal connectivity. In this study, a novel projection, interpolation, and coregistration technique, which considers the individual gyral anatomy, was applied in healthy subjects for biweekly acquired TMS motor maps over a period of twelve weeks. The intraclass correlation coefficient revealed long-term reliability of motor maps with relevant interhemispheric differences. The sensorimotor cortex and nonprimary motor areas of the dominant hemisphere showed more extended and more stable corticospinal connectivity. Long-term correlations of the MEP amplitudes at each stimulation site revealed mosaic-like clusters of consistent corticospinal excitability. The resting motor threshold, centre of gravity, and mean MEPs across all TMS sites, as highly reliable cortical map parameters, could be disentangled from more variable parameters such as MEP area and volume. Cortical TMS motor maps provide high test-retest reliability for long-term monitoring when analyzed with refined techniques. They may guide restorative interventions which target dormant corticospinal connectivity for neurorehabilitation.

Download Full-text

Oral Sensitivity to Flowability and Food Neophobia Drive Food Preferences and Choice

Foods ◽

10.3390/foods10051024 ◽

2021 ◽

Vol 10 (5) ◽

pp. 1024

Author(s):

Sharon Puleo ◽

Paolo Masi ◽

Silvana Cavella ◽

Rossella Di Monaco

Keyword(s):

Food Choice ◽

Food Preferences ◽

Food Neophobia ◽

Individual Level ◽

Choice Preference ◽

Food Liking ◽

Texture Sensitivity ◽

The Individual ◽

Oral Sensitivity

The study aimed to investigate the role of sensitivity to flowability on food liking and choice, the relationship between sensitivity to flowability and food neophobia, and its role in food liking. Five chocolate creams were prepared with different levels of flowability, and rheological measurements were performed to characterise them. One hundred seventy-six subjects filled in the Food Neophobia Scale and a food choice questionnaire (FCq). The FCq was developed to evaluate preferences within a pair of food items similar in flavour but different in texture. Secondly, the subjects evaluated their liking for creams (labelled affective magnitude (LAM) scale) and the flowability intensity (generalised labelled magnitude (gLM) scale). The subjects were clustered into three groups of sensitivity and two groups of choice preference. The effect of individual flowability sensitivity on food choice was investigated. Finally, the subjects were clustered into two groups according to their food neophobia level. The sensitivity to flowability significantly affected the liking of chocolate creams and the solid food choice. The liking of chocolate creams was also affected by the individual level of neophobia (p = 0.01), which, in turn, was not correlated to flowability sensitivity. These results confirm that texture sensitivity and food neophobia affect what a person likes and drives what a person chooses to eat.

Download Full-text

Perceived Causal Problem Networks: Reliability, Central Problems, and Clinical Utility for Depression

Assessment ◽

10.1177/10731911211039281 ◽

2021 ◽

pp. 107319112110392

Author(s):

Lars Klintwall ◽

Martin Bellander ◽

Matti Cervin

Keyword(s):

Clinical Utility ◽

Treatment Success ◽

Centrality Measures ◽

Retest Reliability ◽

Causal Relations ◽

Future Studies ◽

Causal Networks ◽

Novel Method ◽

The Individual ◽

Test Retest Reliability

Personalized case conceptualization is often regarded as a prerequisite for treatment success in psychotherapy for patients with comorbidity. This article presents Perceived Causal Networks, a novel method in which patients rate perceived causal relations among behavioral and emotional problems. First, 231 respondents screening positive for depression completed an online Perceived Causal Networks questionnaire. Median completion time (including repeat items to assess immediate test–retest reliability) was 22.7 minutes, and centrality measures showed excellent immediate test–retest reliability. Networks were highly idiosyncratic, but worrying and ruminating were the most central items for a third of respondents. Second, 50 psychotherapists rated the clinical utility of Perceived Causal Networks visualizations. Ninety-six percent rated the networks as clinically useful, and the information in the individual visualizations was judged to contain 47% of the information typically collected during a psychotherapy assessment phase. Future studies should individualize networks further and evaluate the validity of perceived causal relations.

Download Full-text

Cardio-ventilatory coupling in young healthy resting subjects

Journal of Applied Physiology ◽

10.1152/japplphysiol.01424.2010 ◽

2012 ◽

Vol 112 (8) ◽

pp. 1248-1257 ◽

Cited By ~ 11

Author(s):

Lee Friedman ◽

Thomas E. Dick ◽

Frank J. Jacono ◽

Kenneth A. Loparo ◽

Amir Yeganeh ◽

...

Keyword(s):

Body Surface ◽

Relative Importance ◽

Statistical Relationship ◽

Sinus Arrhythmia ◽

Retest Reliability ◽

Respiratory Events ◽

Before And After ◽

Test Retest Reliability ◽

Degree Of Coupling ◽

High Test

In this work, cardio-ventilatory coupling (CVC) refers to the statistical relationship between the onset of either inspiration (I) or expiration (E) and the timing of heartbeats (R-waves) before and after these respiratory events. CVC was assessed in healthy, young (<45 yr), resting, supine subjects ( n = 19). Four intervals were analyzed: time from I-onset to both the prior R-wave (R-to-I) and the following R-wave (I-to-R), as well as time from E-onset to both the prior R-wave (R-to-E) and following R-wave (E-to-R). The degree of coupling was quantified in terms of transformed relative Shannon entropy (tRSE), and χ2 tests based on histograms of interval times from 200 breaths. Subjects were studied twice, from 5 to 27 days apart, and the test-retest reliability of CVC measures was computed. Several factors pointed to the relative importance of the R-to-I interval compared with other intervals. Coupling was significantly stronger for the R-to-I interval, coupling reliability was largest for the R-to-I interval, and only tRSE for the R-to-I interval was correlated with height, weight, and body surface area. The high test-retest reliability for CVC in the R-to-I interval provides support for the hypothesis that CVC strength is a subject trait. Across subjects, a peak ∼138 ms prior to I-onset was characteristic of CVC in the R-to-I interval, although individual subjects also had earlier peaks (longer R-to-I intervals). CVC for the R-to-I interval was unrelated to two separate measures of respiratory sinus arrhythmia (RSA), suggesting that these two forms of coupling (CVC and RSA) are independent.

Download Full-text

ShareDisk: A novel visual tool to assess perceptions about who should be responsible for supporting persons with mental health problems

International Journal of Social Psychiatry ◽

10.1177/0020764020913580 ◽

2020 ◽

Vol 66 (4) ◽

pp. 411-418

Author(s):

Srividya N Iyer ◽

Megan A Pope ◽

Gerald Jordan ◽

Greeshma Mohan ◽

Heleen Loohuis ◽

...

Keyword(s):

Mental Health ◽

Psychometric Properties ◽

Clinical Utility ◽

Mental Health Problems ◽

Health Problems ◽

Language And Literacy ◽

Retest Reliability ◽

Visual Tool ◽

Test Retest Reliability ◽

High Test

Objectives: Views on who bears how much responsibility for supporting individuals with mental health problems may vary across stakeholders (patients, families, clinicians) and cultures. Perceptions about responsibility may influence the extent to which stakeholders get involved in treatment. Our objective was to report on the development, psychometric properties and usability of a first-ever tool of this construct. Methods: We created a visual weighting disk called ‘ShareDisk’, measuring perceived extent of responsibility for supporting persons with mental health problems. It was administered (twice, 2 weeks apart) to patients, family members and clinicians in Chennai, India ( N = 30, 30 and 15, respectively) and Montreal, Canada ( N = 30, 32 and 15, respectively). Feedback regarding its usability was also collected. Results: The English, French and Tamil versions of the ShareDisk demonstrated high test–retest reliability ( rs = .69–.98) and were deemed easy to understand and use. Conclusion: The ShareDisk is a promising measure of a hitherto unmeasured construct that is easily deployable in settings varying in language and literacy levels. Its clinical utility lies in clarifying stakeholder roles. It can help researchers investigate how stakeholders’ roles are perceived and how these perceptions may be shaped by and shape the organization and experience of healthcare across settings.

Download Full-text

A Reliability Analysis of the Revised Competitiveness Index

Psychological Reports ◽

10.2466/pr0.106.3.870-874 ◽

2010 ◽

Vol 106 (3) ◽

pp. 870-874 ◽

Cited By ~ 35

Author(s):

Paul B. Harris ◽

John M. Houston

Keyword(s):

Reliability Analysis ◽

Factor Structure ◽

Dynamic State ◽

Retest Reliability ◽

Stable Factor ◽

Competitiveness Index ◽

Test Retest Reliability ◽

High Test

This study examined the reliability of the Revised Competitiveness Index by investigating the test-retest reliability, interitem reliability, and factor structure of the measure based on a sample of 280 undergraduates (200 women, 80 men) ranging in age from 18 to 28 years ( M = 20.1, SD = 2.1). The findings indicate that the Revised Competitiveness Index has high test-retest reliability, high interitem reliability, and a stable factor structure. The results support the assertion that the Revised Competitiveness Index assesses competitiveness as a stable trait rather than a dynamic state.

Download Full-text

Learning from the Reliability Paradox: How Theoretically Informed Generative Models Can Advance the Social, Behavioral, and Brain Sciences

10.31234/osf.io/xr7y3 ◽

2020 ◽

Cited By ~ 4

Author(s):

Nathaniel Haines ◽

Peter D. Kvam ◽

Louis H. Irving ◽

Colin Smith ◽

Theodore P. Beauchaine ◽

...

Keyword(s):

Individual Differences ◽

Theory Development ◽

Generative Models ◽

Parameter Estimates ◽

Group Level ◽

Retest Reliability ◽

Individual Level ◽

Generative Modeling ◽

Behavioral Tasks ◽

Test Retest Reliability

Behavioral tasks (e.g., Stroop task) that produce replicable group-level effects (e.g., Stroop effect) often fail to reliably capture individual differences between participants (e.g., low test-retest reliability). This “reliability paradox” has led many researchers to conclude that most behavioral tasks cannot be used to develop and advance theories of individual differences. However, these conclusions are derived from statistical models that provide only superficial summary descriptions of behavioral data, thereby ignoring theoretically-relevant data-generating mechanisms that underly individual-level behavior. More generally, such descriptive methods lack the flexibility to test and develop increasingly complex theories of individual differences. To resolve this theory-description gap, we present generative modeling approaches, which involve using background knowledge to specify how behavior is generated at the individual level, and in turn how the distributions of individual-level mechanisms are characterized at the group level—all in a single joint model. Generative modeling shifts our focus away from estimating descriptive statistical “effects” toward estimating psychologically meaningful parameters, while simultaneously accounting for measurement error that would otherwise attenuate individual difference correlations. Using simulations and empirical data from the Implicit Association Test and Stroop, Flanker, Posner Cueing, and Delay Discounting tasks, we demonstrate how generative models yield (1) higher test-retest reliability estimates, and (2) more theoretically informative parameter estimates relative to traditional statistical approaches. Our results reclaim optimism regarding the utility of behavioral paradigms for testing and advancing theories of individual differences, and emphasize the importance of formally specifying and checking model assumptions to reduce theory-description gaps and facilitate principled theory development.

Download Full-text