scholarly journals A New Perspective on Individual Reliability beyond Group Effects for Event-related Potentials: A Multisensory Investigation and Computational Modeling

2021 ◽  
Author(s):  
Zhenxing Hu ◽  
Zhiguo Zhang ◽  
Zhen Liang ◽  
Li Zhang ◽  
Linling Li ◽  
...  

AbstractThe dominant approach in investigating the individual reliability for event-related potentials (ERPs) is to extract peak-related features at electrodes showing the strongest group effects. Such a peak-based approach implicitly assumes ERP components showing a stronger group effect are also more reliable, but this assumption has not been substantially validated and few studies have investigated the reliability of ERPs beyond peaks. In this study, we performed a rigorous evaluation of the test-retest reliability of ERPs collected in a multisensory and cognitive experiment from 82 healthy adolescents, each having two sessions. By comparing group effects and individual reliability, we found that a stronger group-level response in ERPs did not guarantee a higher reliability. Further, by simulating ERPs with a computational model, we found that the consistency between group-level ERP responses and individual reliability was modulated by inter-subject latency jitter and inter-trial variability. The current findings suggest that the conventional peak-based approach may underestimate the individual reliability in ERPs. Hence, a comprehensive evaluation of the reliability of ERP measurements should be considered in individual-level neurophysiological trait evaluation and psychiatric disorder diagnosis.


2021 ◽  
Vol 15 ◽  
pp. 183449092110347
Author(s):  
Yu Luo ◽  
Jiarong Zhou ◽  
Wei Bao ◽  
Jing Qiu ◽  
Jingqing Nian ◽  
...  

Previous studies showed that working memory (WM) content can guide attention; however, whether working memory capacity (WMC) and state anxiety could affect this remains unclear. This study aimed to examine the effect of WMC and state anxiety on attention guided by WM content. Participants with high and low WMC were assigned to either a neutral or an anxiety condition. They were asked to perform a modified change detection task with irrelevant singletons while their event-related potentials were recorded. N2pc and Pd were observed in the low-WMC and anxiety group, and Pd was observed in both the high-WMC and anxiety and the high-WMC and control groups, whereas neither N2pc nor Pd was found in the low-WMC and control group. These findings suggest that attention is guided or suppressed by WM content, depending on the WMC and anxiety level of the individual. This study provides a new perspective on WM content-guided attention.



2020 ◽  
Author(s):  
S.E.P. Bruzzone ◽  
N. T. Haumann ◽  
M. Kliuchko ◽  
P. Vuust ◽  
E. Brattico

AbstractOverlapping neurophysiological signals are the main obstacle preventing from using cortical event-related potentials (ERPs) in clinical settings. Children ERPs are particularly affected by this problem, as their cerebral cortex is still maturing. To overcome this problem, we applied a new version of Spike-density Component Analysis (SCA), an analysis method recently introduced, to isolate with high accuracy the neural components of auditory ERP responses (AEPs) in 8-year-old children. Electroencephalography was used with 33 children to record AEPs to auditory stimuli varying in spectrotemporal features. Three different analysis approaches were adopted: the standard ERP analysis procedure, SCA with template-match (SCA-TM), and SCA with half-split average consistency (SCA-HSAC). SCA-HSAC most successfully allowed the extraction of AEPs for each child, revealing that the most consistent components were P1 and N2. An immature N1 component was also detected.Superior accuracy in isolating neural components at the individual level even in children was demonstrated for SCA-HSAC over other SCA approaches. Reliable methods of extraction of neurophysiological signals at the individual level are crucial for the application of cortical AEPs for routine diagnostic exams in clinical settings both in children and adults.HighlightsSpike-density component analysis (SCA) was validated on children ERPsSCA extracted overlapping neural components from auditory ERPs (AEPs)Child AEPs were modelled at the individual level



2020 ◽  
Author(s):  
Keith Payne ◽  
Heidi A. Vuletich ◽  
Kristjen B. Lundberg

The Bias of Crowds model (Payne, Vuletich, & Lundberg, 2017) argues that implicit bias varies across individuals and across contexts. It is unreliable and weakly associated with behavior at the individual level. But when aggregated to measure context-level effects, the scores become stable and predictive of group-level outcomes. We concluded that the statistical benefits of aggregation are so powerful that researchers should reconceptualize implicit bias as a feature of contexts, and ask new questions about how implicit biases relate to systemic racism. Connor and Evers (2020) critiqued the model, but their critique simply restates the core claims of the model. They agreed that implicit bias varies across individuals and across contexts; that it is unreliable and weakly associated with behavior at the individual level; and that aggregating scores to measure context-level effects makes them more stable and predictive of group-level outcomes. Connor and Evers concluded that implicit bias should be considered to really be noisily measured individual construct because the effects of aggregation are merely statistical. We respond to their specific arguments and then discuss what it means to really be a feature of persons versus situations, and multilevel measurement and theory in psychological science more broadly.



2021 ◽  
pp. 073563312110308
Author(s):  
Fan Ouyang ◽  
Si Chen ◽  
Yuqin Yang ◽  
Yunqing Chen

Group-level metacognitive scaffolding is critical for productive knowledge building. However, previous research mainly focuses on the individual-level metacognitive scaffoldings in helping learners improve knowledge building, and little effort has been made to develop group-level metacognitive scaffolding (GMS) for knowledge building. This research designed three group-level metacognitive scaffoldings of general, task-oriented, and idea-oriented scaffoldings to facilitate in-service teachers’ knowledge building in small groups. A mixed method is used to examine the effects of the GMSs on groups’ knowledge building processes, performances, and perceptions. Results indicate a complication of the effects of GMSs on knowledge building. The idea-oriented scaffolding has potential to facilitate question-asking and perspective-proposing inquiry through peer interactions; the general scaffolding does not necessarily lessen teachers’ idea-centered explanation and elaboration on the individual level; the task-oriented scaffolding has the worst effect. Pedagogical and research implications are discussed to foster knowledge building with the support of GMSs.



2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Zahra Barakchian ◽  
Anjali Raja Beharelle ◽  
Todd A. Hare

AbstractFood choice paradigms are commonly used to study decision mechanisms, individual differences, and intervention efficacy. Here, we measured behavior from twenty-three healthy young adults who completed five repetitions of a cued-attribute food choice paradigm over two weeks. This task includes cues prompting participants to explicitly consider the healthiness of the food items before making a selection, or to choose naturally based on whatever freely comes to mind. We found that the average patterns of food choices following both cue types and ratings about the palatability (i.e. taste) and healthiness of the food items were similar across all five repetitions. At the individual level, the test-retest reliability for choices in both conditions and healthiness ratings was excellent. However, test-retest reliability for taste ratings was only fair, suggesting that estimates about palatability may vary more from day to day for the same individual.



2018 ◽  
Author(s):  
Mariano Calvo Martín ◽  
Stamatios C. Nicolis ◽  
Isaac Planas-Sitjà ◽  
Jean-Christophe de Biseau ◽  
Jean-Louis Deneubourg

AbstractCockroaches, like most social arthropods, are led to choose collectively among different alternative resting places. These decisions are modulated by different factors, such as environmental conditions (temperature, relative humidity) and sociality (groups size, nature of communications). The aim of this study is to establish the interplay between environmental conditions and the modulation of the interactions between individuals within a group leading to an inversion of preferences. We show that the preferences of isolated cockroaches and groups of 16 individuals, on the selection of the relative humidity of a shelter are inversed and shed light on the mechanisms involved. We suggest that the relative humidity has a multi-level influence on cockroaches, manifested as an attractant effect at the individual level and as a negative effect at the group level, modulating the interactions.



2022 ◽  
Vol 7 ◽  
pp. 14
Author(s):  
Paul Schneider ◽  
Ben van Hout ◽  
Marike Heisen ◽  
John Brazier ◽  
Nancy Devlin

Introduction Standard valuation methods, such as TTO and DCE are inefficient. They require data from hundreds if not thousands of participants to generate value sets. Here, we present the Online elicitation of Personal Utility Functions (OPUF) tool; a new type of online survey for valuing EQ-5D-5L health states using more efficient, compositional elicitation methods, which even allow estimating value sets on the individual level. The aims of this study are to report on the development of the tool, and to test the feasibility of using it to obtain individual-level value sets for the EQ-5D-5L. Methods We applied an iterative design approach to adapt the PUF method, previously developed by Devlin et al., for use as a standalone online tool. Five rounds of qualitative interviews, and one quantitative pre-pilot were conducted to get feedback on the different tasks. After each round, the tool was refined and re-evaluated. The final version was piloted in a sample of 50 participants from the UK. A demo of the EQ-5D-5L OPUF survey is available at: https://eq5d5l.me Results On average, it took participants about seven minutes to complete the OPUF Tool. Based on the responses, we were able to construct a personal EQ-5D-5L value set for each of the 50 participants. These value sets predicted a participants' choices in a discrete choice experiment with an accuracy of 80%. Overall, the results revealed that health state preferences vary considerably on the individual-level. Nevertheless, we were able to estimate a group-level value set for all 50 participants with reasonable precision. Discussion We successfully piloted the OPUF Tool and showed that it can be used to derive a group-level as well as personal value sets for the EQ-5D-5L. Although the development of the online tool is still in an early stage, there are multiple potential avenues for further research.



2020 ◽  
Author(s):  
Nathaniel Haines ◽  
Peter D. Kvam ◽  
Louis H. Irving ◽  
Colin Smith ◽  
Theodore P. Beauchaine ◽  
...  

Behavioral tasks (e.g., Stroop task) that produce replicable group-level effects (e.g., Stroop effect) often fail to reliably capture individual differences between participants (e.g., low test-retest reliability). This “reliability paradox” has led many researchers to conclude that most behavioral tasks cannot be used to develop and advance theories of individual differences. However, these conclusions are derived from statistical models that provide only superficial summary descriptions of behavioral data, thereby ignoring theoretically-relevant data-generating mechanisms that underly individual-level behavior. More generally, such descriptive methods lack the flexibility to test and develop increasingly complex theories of individual differences. To resolve this theory-description gap, we present generative modeling approaches, which involve using background knowledge to specify how behavior is generated at the individual level, and in turn how the distributions of individual-level mechanisms are characterized at the group level—all in a single joint model. Generative modeling shifts our focus away from estimating descriptive statistical “effects” toward estimating psychologically meaningful parameters, while simultaneously accounting for measurement error that would otherwise attenuate individual difference correlations. Using simulations and empirical data from the Implicit Association Test and Stroop, Flanker, Posner Cueing, and Delay Discounting tasks, we demonstrate how generative models yield (1) higher test-retest reliability estimates, and (2) more theoretically informative parameter estimates relative to traditional statistical approaches. Our results reclaim optimism regarding the utility of behavioral paradigms for testing and advancing theories of individual differences, and emphasize the importance of formally specifying and checking model assumptions to reduce theory-description gaps and facilitate principled theory development.



2012 ◽  
Vol 114 (2) ◽  
pp. 621-637 ◽  
Author(s):  
Edsel L. Beja ◽  
David B. Yap


2019 ◽  
Vol 46 (10) ◽  
pp. 1385-1404 ◽  
Author(s):  
Esther F. J. C. van Ginneken ◽  
Hanneke Palmen ◽  
Anouk Q. Bosma ◽  
Miranda Sentse

Little is known about the relative influence of shared and individual perceptions of prison climate on adjustment to incarceration. This study investigated the relationship between prison climate and well-being among a sample of 4,538 adults incarcerated in the Netherlands. Prison climate dimensions were considered both as prison unit-level variables and as individual-level perceptions. Multilevel analysis results showed that most variance for well-being is found at the individual rather than the unit level. This implies that it does not make much of a difference for well-being in which prison unit someone resides. Positive effects of prison climate on well-being were primarily found for individual perceptions of prison climate, rather than for the aggregate unit measures. More research is needed to determine whether this finding holds true in other countries. The findings confirm the importance of disentangling the contribution of prison climate at the individual and group level.



Sign in / Sign up

Export Citation Format

Share Document