scholarly journals Best-worst scaling improves measurement of first impressions

2019 ◽  
Vol 4 (1) ◽  
Author(s):  
Nichola Burton ◽  
Michael Burton ◽  
Dan Rigby ◽  
Clare A. M. Sutherland ◽  
Gillian Rhodes
Keyword(s):  
Psychological Research ◽  
First Impressions ◽  
Group Level ◽  
Common Goal ◽  
Best Worst Scaling ◽  
Individual Participant ◽  
Potential Alternative ◽  
The Individual ◽  
Test Retest Reliability ◽  
Choice Method

Abstract A common goal in psychological research is the measurement of subjective impressions, such as first impressions of faces. These impressions are commonly measured using Likert ratings. Although these ratings are simple to administer, they are associated with response issues that can limit reliability. Here we examine best-worst scaling (BWS), a forced-choice method, as a potential alternative to Likert ratings for measuring participants’ facial first impressions. We find that at the group level, BWS scores correlated almost perfectly with Likert scores, indicating that the two methods measure the same impressions. However, at the individual participant level BWS outperforms Likert ratings, both in terms of ability to predict preferences in a third task, and in terms of test-retest reliability. These benefits highlight the power of BWS, particularly for use in individual differences research.

scholarly journals Professional improvising musicians couple more closely in timing and tonality when simultaneously rather than successively recording

2020 ◽  
Author(s):  
Matt Setzler ◽  
Robert Goldstone
Keyword(s):  
Joint Action ◽  
Subjective Experience ◽  
Music Technology ◽  
Musical Structure ◽  
Group Level ◽  
Common Goal ◽  
Mutual Adaptation ◽  
Jazz Music ◽  
The Individual ◽  
Adaptive Condition

Joint action (JA) is ubiquitous in our cognitive lives. From basketball teams to teams of surgeons, humans often coordinate with one another to achieve some common goal. Despite this ubiquity, the individual mechanisms and group-level dynamics of complex, sophisticated JA are poorly understood. We examine coordination in a paragon domain for creative joint expression: improvising jazz musicians. Coordination in jazz music is improvised and subserves an aesthetic goal: the generation of a collective musical expression comprising coherent, highly nuanced musical structure (e.g. rhythm, harmony). In this study, dyads of professional jazz pianists improvised in a "coupled", mutually adaptive condition, and an "overdubbed" condition which precluded mutual adaptation, as occurs in common studio recording practices. Using a model of musical tonality, we quantify the flow of rhythmic and harmonic information between musicians as a function of interaction condition, and show that mutually responsive dyads produce more consonant harmonies, an ability which increases throughout the course of improvised performance. These musical signatures of coordination were paralleled in the subjective experience of improvisers, who preferred coupled trials despite being blind to condition. We present these results and discuss their implications for music technology and JA research more generally.

scholarly journals A New Perspective on Individual Reliability beyond Group Effects for Event-related Potentials: A Multisensory Investigation and Computational Modeling

2021 ◽  
Author(s):  
Zhenxing Hu ◽  
Zhiguo Zhang ◽  
Zhen Liang ◽  
Li Zhang ◽  
Linling Li ◽  
...  
Keyword(s):  
Comprehensive Evaluation ◽  
Event Related Potentials ◽  
Group Level ◽  
Individual Level ◽  
Latency Jitter ◽  
Related Potentials ◽  
New Perspective ◽  
The Individual ◽  
Test Retest Reliability ◽  
Group Effects

AbstractThe dominant approach in investigating the individual reliability for event-related potentials (ERPs) is to extract peak-related features at electrodes showing the strongest group effects. Such a peak-based approach implicitly assumes ERP components showing a stronger group effect are also more reliable, but this assumption has not been substantially validated and few studies have investigated the reliability of ERPs beyond peaks. In this study, we performed a rigorous evaluation of the test-retest reliability of ERPs collected in a multisensory and cognitive experiment from 82 healthy adolescents, each having two sessions. By comparing group effects and individual reliability, we found that a stronger group-level response in ERPs did not guarantee a higher reliability. Further, by simulating ERPs with a computational model, we found that the consistency between group-level ERP responses and individual reliability was modulated by inter-subject latency jitter and inter-trial variability. The current findings suggest that the conventional peak-based approach may underestimate the individual reliability in ERPs. Hence, a comprehensive evaluation of the reliability of ERP measurements should be considered in individual-level neurophysiological trait evaluation and psychiatric disorder diagnosis.

scholarly journals Gaze Bias Differences Capture Individual Choice Behavior

2017 ◽  
Author(s):  
Armin W. Thomas ◽  
Felix Molter ◽  
Ian Krajbich ◽  
Hauke R. Heekeren ◽  
Peter N. C. Mohr
Keyword(s):  
Choice Experiment ◽  
Choice Behavior ◽  
Individual Choice ◽  
Group Level ◽  
Gaze Behavior ◽  
Close Link ◽  
Individual Participant ◽  
Gaze Bias ◽  
The Individual ◽  
Choice Probabilities

AbstractHow do we make simple consumer choices (e.g., deciding between an apple, an orange, and a banana)? Recent empirical evidence suggests a close link between choice behavior and eye movements at the group level, with generally higher choice probabilities for items that were looked at longer during the decision process. However, it is unclear how variable this effect is across individuals. Here, we investigate this question in a multialternative forced-choice experiment using a novel computational model that can be easily applied to the individual participant level. We show that a link between gaze and choice is present for most individuals, but differs considerably in strength, namely, the choices of some individuals are almost independent of gaze allocation, while the choices of others are strongly associated with gaze behavior. Accounting for this variability in our model allows us to explain and accurately predict individual differences in observed choice behavior.

scholarly journals Testing and Extending Schwartz Refined Value Theory Using a Best–Worst Scaling Approach

Assessment ◽  
2016 ◽  
Vol 26 (2) ◽  
pp. 166-180 ◽  
Author(s):  
Julie A. Lee ◽  
Joanne N. Sneddon ◽  
Timothy M. Daly ◽  
Shalom H. Schwartz ◽  
Geoffrey N. Soutar ◽  
...  
Keyword(s):  
Animal Welfare ◽  
Discriminant Validity ◽  
Value Theory ◽  
Human Values ◽  
Refined Theory ◽  
Convergent And Discriminant Validity ◽  
Best Worst Scaling ◽  
Method Of Measurement ◽  
Test Retest Reliability ◽  
Choice Method

The theory of human values discriminated 10 basic values arrayed in a quasicircular structure. Analyses with several instruments in numerous samples supported this structure. The refined theory of human values discriminates 19 values in the same circle. Its support depends on one instrument, the revised Portrait Values Questionnaire. We introduce a forced choice method, the Best–Worst Refined Values scale (BWVr), to assess the robustness of the refined theory to method of measurement and also assess the distinctiveness and validity of a new animal welfare value. Three studies ( N = 784, 439, and 383) support the theory and the new value. Study 3 also demonstrates the convergent and discriminant validity of the 19 values by comparing the BWVr, the revised Portrait Values Questionnaire, and value-expressive behaviors and confirms the test–retest reliability of BWVr responses. These studies provide further information about the order of values in the value circle.

On the Individual

1999 ◽  
Vol 4 (4) ◽  
pp. 205-218 ◽  
Author(s):  
David Magnusson
Keyword(s):  
School Psychologist ◽  
Real Life ◽  
Psychological Research ◽  
Developmental Research ◽  
Future Directions ◽  
The 1950S ◽  
The Individual ◽  
Over Time

A description of two cases from my time as a school psychologist in the middle of the 1950s forms the background to the following question: Has anything important happened since then in psychological research to help us to a better understanding of how and why individuals think, feel, act, and react as they do in real life and how they develop over time? The studies serve as a background for some general propositions about the nature of the phenomena that concerns us in developmental research, for a summary description of the developments in psychological research over the last 40 years as I see them, and for some suggestions about future directions.

QUALITY OF INDIVIDUAL AND GROUP LEVEL INTERVENTIONS FOR FIRST EPISODE PSYCHOSIS AT THE TERTIARY PSYCHIATRIC HOSPITAL IN UGANDA.

2020 ◽  
Author(s):  
Emmanuel Kiiza Mwesiga ◽  
Noeline Nakasujja ◽  
Lawrence Nankaba ◽  
Juliet Nakku ◽  
Seggane Musisi
Keyword(s):  
Psychiatric Hospital ◽  
Psychotic Disorders ◽  
First Episode Psychosis ◽  
First Episode ◽  
Group Level ◽  
Group Interventions ◽  
Episode Psychosis ◽  
Essential Components ◽  
The Individual

Introduction: Individual and group level interventions have the largest effect on outcomes in patients with the first episode of psychosis. The quality of these individual and group level interventions provided to first-episode psychosis patients in Uganda is unclear.Methods: The study was performed at Butabika National Psychiatric Teaching and referral hospital in Uganda. A retrospective chart review of recently discharged adult in-patients with the first episode of psychosis was first performed to determine the proportion of participants who received the different essential components for individual and group level interventions. From the different proportions, the quality of the services across the individual and group interventions was determined using the first-Episode Psychosis Services Fidelity Scale (FEPS-FS). The FEPS-FS assigns a grade of 1-5 on a Likert scale depending on the proportion of patients received the different components of the intervention. Results: The final sample included 156 first-episode psychosis patients. The median age was 27 years [IOR (24-36)] with 55% of participants of the female gender. 13 essential components across the individual and group interventions were assessed and their quality quantified. All 13 essential components had poor quality with the range of scores on the FEPS-FS of 1-3. Only one essential component assessed (use of single antipsychotics) had moderate quality.Discussion: Among current services at the National psychiatric hospital of Uganda, the essential for individual and group level interventions for psychotic disorders are of low quality. Further studies are required on how the quality of these interventions can be improved.

Reply to Connor and Evers (2020): Critique of the Bias of Crowds Model Simply Restates the Model

2020 ◽  
Author(s):  
Keith Payne ◽  
Heidi A. Vuletich ◽  
Kristjen B. Lundberg
Keyword(s):  
Implicit Bias ◽  
Group Level ◽  
Systemic Racism ◽  
Individual Level ◽  
The Core ◽  
Psychological Science ◽  
Implicit Biases ◽  
The Individual

The Bias of Crowds model (Payne, Vuletich, & Lundberg, 2017) argues that implicit bias varies across individuals and across contexts. It is unreliable and weakly associated with behavior at the individual level. But when aggregated to measure context-level effects, the scores become stable and predictive of group-level outcomes. We concluded that the statistical benefits of aggregation are so powerful that researchers should reconceptualize implicit bias as a feature of contexts, and ask new questions about how implicit biases relate to systemic racism. Connor and Evers (2020) critiqued the model, but their critique simply restates the core claims of the model. They agreed that implicit bias varies across individuals and across contexts; that it is unreliable and weakly associated with behavior at the individual level; and that aggregating scores to measure context-level effects makes them more stable and predictive of group-level outcomes. Connor and Evers concluded that implicit bias should be considered to really be noisily measured individual construct because the effects of aggregation are merely statistical. We respond to their specific arguments and then discuss what it means to really be a feature of persons versus situations, and multilevel measurement and theory in psychological science more broadly.

The Epistemology of Groups

2020 ◽  
Author(s):  
Jennifer Lackey
Keyword(s):  
Group Level ◽  
Social Significance ◽  
Individual Group ◽  
Key Concepts ◽  
Normative Requirements ◽  
Group Members ◽  
The Individual ◽  
Belief Justification ◽  
In Virtue Of ◽  
Trump Administration

Groups are often said to bear responsibility for their actions, many of which have enormous moral, legal, and social significance. The Trump Administration, for instance, is said to be responsible for the U.S.’s inept and deceptive handling of COVID-19 and the harms that American citizens have suffered as a result. But are groups subject to normative assessment simply in virtue of their individual members being so, or are they somehow agents in their own right? Answering this question depends on understanding key concepts in the epistemology of groups, as we cannot hold the Trump Administration responsible without first determining what it believed, knew, and said. Deflationary theorists hold that group phenomena can be understood entirely in terms of individual members and their states. Inflationary theorists maintain that group phenomena are importantly over and above, or otherwise distinct from, individual members and their states. It is argued that neither approach is satisfactory. Groups are more than their members, but not because they have “minds of their own,” as the inflationists hold. Instead, this book shows how group phenomena—like belief, justification, and knowledge—depend on what the individual group members do or are capable of doing while being subject to group-level normative requirements. This framework, it is argued, allows for the correct distribution of responsibility across groups and their individual members.

scholarly journals Examining the Effects of Three Group-Level Metacognitive Scaffoldings on In-Service Teachers’ Knowledge Building

2021 ◽  
pp. 073563312110308
Author(s):  
Fan Ouyang ◽  
Si Chen ◽  
Yuqin Yang ◽  
Yunqing Chen
Keyword(s):  
Small Groups ◽  
Mixed Method ◽  
Peer Interactions ◽  
Knowledge Building ◽  
Group Level ◽  
Question Asking ◽  
Individual Level ◽  
The Individual ◽  
Task Oriented ◽  
Metacognitive Scaffolding

Group-level metacognitive scaffolding is critical for productive knowledge building. However, previous research mainly focuses on the individual-level metacognitive scaffoldings in helping learners improve knowledge building, and little effort has been made to develop group-level metacognitive scaffolding (GMS) for knowledge building. This research designed three group-level metacognitive scaffoldings of general, task-oriented, and idea-oriented scaffoldings to facilitate in-service teachers’ knowledge building in small groups. A mixed method is used to examine the effects of the GMSs on groups’ knowledge building processes, performances, and perceptions. Results indicate a complication of the effects of GMSs on knowledge building. The idea-oriented scaffolding has potential to facilitate question-asking and perspective-proposing inquiry through peer interactions; the general scaffolding does not necessarily lessen teachers’ idea-centered explanation and elaboration on the individual level; the task-oriented scaffolding has the worst effect. Pedagogical and research implications are discussed to foster knowledge building with the support of GMSs.

scholarly journals Healthy decisions in the cued-attribute food choice paradigm have high test-retest reliability

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Zahra Barakchian ◽  
Anjali Raja Beharelle ◽  
Todd A. Hare
Keyword(s):  
Food Choice ◽  
Food Choices ◽  
Retest Reliability ◽  
Individual Level ◽  
Food Items ◽  
Intervention Efficacy ◽  
The Individual ◽  
Test Retest Reliability ◽  
Decision Mechanisms ◽  
High Test

AbstractFood choice paradigms are commonly used to study decision mechanisms, individual differences, and intervention efficacy. Here, we measured behavior from twenty-three healthy young adults who completed five repetitions of a cued-attribute food choice paradigm over two weeks. This task includes cues prompting participants to explicitly consider the healthiness of the food items before making a selection, or to choose naturally based on whatever freely comes to mind. We found that the average patterns of food choices following both cue types and ratings about the palatability (i.e. taste) and healthiness of the food items were similar across all five repetitions. At the individual level, the test-retest reliability for choices in both conditions and healthiness ratings was excellent. However, test-retest reliability for taste ratings was only fair, suggesting that estimates about palatability may vary more from day to day for the same individual.

Sign in / Sign up

Export Citation Format

Share Document