Diversity promotes abstraction and cognitive flexibility in collective problem solving

Social interaction plays an important role in many contexts of human reasoning and problem solving, and groups are often found to outperform individuals. We suggest that this benefit is associated with the dialogical sharing and integration of diverse perspectives and strategies. Here, we investigated whether diversity in prior experience affects groups’ problem representations and performance. In a game-like experiment, participants categorized aliens based on combinations of their features. Whenever a specific feature combination was learned, the rule changed and a new feature combination had to be learned. However, unbeknown to participants, rule changes were governed by an abstract meta-rule and awareness of this provided an advantage when rules changed. We compared categorization performance between individuals, groups composed of members trained on the same rule, and groups composed of members trained on different rules before entering the collaborative test phase. Following preregistered predictions, groups with diverse task experience outperformed groups with similar task experience, which in turn outperformed individuals. These findings were unaffected diversity in personality (Big Five) and motivational factors, suggesting that diversity in experience plays the key role. We conclude that cognitive diversity impact problem solving by stimulating processes of abstraction and flexibility at the level of the group.

Detecting a Single Automation Failure: The Impact of Expected (But Not Experienced) Automation Reliability

Objective Examine the impact of expected automation reliability on trust, workload, task disengagement, nonautomated task performance, and the detection of a single automation failure in simulated air traffic control. Background Prior research has focused on the impact of experienced automation reliability. However, many operational settings feature automation that is reliable to the extent that operators will seldom experience automation failures. Despite this, operators must remain aware of when automation is at greater risk of failing. Method Participants performed the task with or without conflict detection/resolution automation. Automation failed to detect/resolve one conflict (i.e., an automation miss). Expected reliability was manipulated via instructions such that the expected level of reliability was (a) constant or variable, and (b) the single automation failure occurred when expected reliability was high or low. Results Trust in automation increased with time on task prior to the automation failure. Trust was higher when expecting high relative to low reliability. Automation failure detection was improved when the failure occurred under low compared with high expected reliability. Subjective workload decreased with automation, but there was no improvement to nonautomated task performance. Automation increased perceived task disengagement. Conclusions Both automation reliability expectations and task experience played a role in determining trust. Automation failure detection was improved when the failure occurred at a time it was expected to be more likely. Participants did not effectively allocate any spared capacity to nonautomated tasks. Applications The outcomes are applicable because operators in field settings likely form contextual expectations regarding the reliability of automation.

An algorithmic approach to determine expertise development using object-related gaze pattern sequences

Eye tracking (ET) technology is increasingly utilized to quantify visual behavior in the study of the development of domain-specific expertise. However, the identification and measurement of distinct gaze patterns using traditional ET metrics has been challenging, and the insights gained shown to be inconclusive about the nature of expert gaze behavior. In this article, we introduce an algorithmic approach for the extraction of object-related gaze sequences and determine task-related expertise by investigating the development of gaze sequence patterns during a multi-trial study of a simplified airplane assembly task. We demonstrate the algorithm in a study where novice (n = 28) and expert (n = 2) eye movements were recorded in successive trials (n = 8), allowing us to verify whether similar patterns develop with increasing expertise. In the proposed approach, AOI sequences were transformed to string representation and processed using the k-mer method, a well-known method from the field of computational biology. Our results for expertise development suggest that basic tendencies are visible in traditional ET metrics, such as the fixation duration, but are much more evident for k-mers of k > 2. With increased on-task experience, the appearance of expert k-mer patterns in novice gaze sequences was shown to increase significantly (p < 0.001). The results illustrate that the multi-trial k-mer approach is suitable for revealing specific cognitive processes and can quantify learning progress using gaze patterns that include both spatial and temporal information, which could provide a valuable tool for novice training and expert assessment.

Carry-over effects of tool functionality and previous unsuccessfulness increase overimitation in children

Children ‘overimitate’ causally irrelevant actions in experiments where both irrelevant and relevant actions involve a single common tool. This study design may make it harder for children to recognize the irrelevant actions, as the perceived functionality of the tool during the demonstration of the relevant action may be carried over to the irrelevant action, potentially increasing overimitation. Moreover, little is known how overimitation is affected by the demonstrator's expressed emotions and the child's prior success with the task. Here, 131 nine- to ten-year-old French and German children first engaged in a tool-based task, being successful or unsuccessful, and then watched an adult demonstrating the solution involving one irrelevant and one relevant action before smiling or remaining neutral. These actions were performed with the same tool or with two separate tools, testing potential carry-over effects of the functionality of the relevant action on the irrelevant action. We show that overimitation was higher when the same tool was used for both actions and when children were previously unsuccessful, but was not affected by the demonstrator's displayed emotion. Our results suggest that future overimitation research should account for the number of tools used in a demonstration and participants' previous task experience.

How Diverse Task Experience Affects Both Group and Subsequent Individual Performance

Task demonstrability defines the criteria that, when met, facilitate the effective exchange of knowledge within a problem-solving group. The extent to which those criteria are met should vary as a consequence of the relevant experiences that members have prior to entering the group. We investigate whether group members’ ability to coordinate with one another is facilitated by their prior task-related experiences. Participants worked individually, then in groups, and then individually again to complete a series of circuit board assembly tasks. Groups in which all members had pre-task experience performed significantly better than groups with even a single member lacking task experience, or individuals. Mediation analysis showed that prior task experience helps group members coordinate by improving task demonstrability. Group experience composition also affected post-group individual performance. Groups with diverse task experience produced individuals who performed better solo but only after working on an unstructured task that allowed for greater exploration.

Limited evidence for executive function load impairing selective copying in a win-stay lose-shift task

The use of ‘explicitly metacognitive’ learning strategies has been proposed as an explanation for uniquely human capacities for cumulative culture. Such strategies are proposed to rely on explicit, system-2 cognitive processes, to enable advantageous selective copying. To investigate the plausibility of this theory, we investigated participants’ ability to make flexible learning decisions, and their metacognitive monitoring efficiency, under executive function (EF) load. Adult participants completed a simple win-stay lose-shift (WSLS) paradigm task, intended to model a situation where presented information can be used to inform response choice, by copying rewarded responses and avoiding those that are unrewarded. This was completed alongside a concurrent switching task. Participants were split into three conditions: those that needed to use a selective copying, WSLS strategy, those that should always copy observed information, and those that should always do the opposite (Expt 1). Participants also completed a metacognitive monitoring task alongside the concurrent switching task (Expt 2). Conditions demanding selective strategies were more challenging than those requiring the use of one rule consistently. In addition, consistently copying was less challenging than consistently avoiding observed stimuli. Differences between selectively copying and always copying were hypothesised to stem from working memory requirements rather than the concurrent EF load. No impact of EF load was found on participants’ metacognitive monitoring ability. These results suggest that copying decisions are underpinned by the use of executive functions even at a very basic level, and that selective copying strategies are more challenging than a combination of their component parts. We found minimal evidence that selective copying strategies relied on executive functions any more than consistent copying or deviation. However, task experience effects suggested that ceiling effects could have been masking differences between conditions which might be apparent in other contexts, such as when observed information must be retained in memory.

Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System

This research assessed how the performance and team skills of three-person teams working with an Intelligent Team Tutoring System (ITTS) on a virtual military surveillance task were affected by feedback privacy, participant role, task experience, prior team experience, and teammate familiarity. Previous work in Intelligent Tutoring Systems (ITSs) has focused on outcomes for task skill training for individual learners. As research extends into intelligent tutoring for teams, both task skills and team skills are necessary for good team performance. This work includes a brief review of previous research on ITTSs, feedback, teams, and teamwork, including the recounting of two categories of a framework of teamwork performance, Communication and Cognition, which are relevant to the present study. This research examines the effects of an intelligent agent, as well as features of the team, its members, and the task being undertaken, on team communication (measured by relevant key-presses) and team situation awareness (as measured by scores on a quiz). Thirty-seven teams of three participants, each at their own computer running a multiplayer surveillance simulation, were given just-in-time private (individually delivered) or public (team-delivered) performance feedback during four 5-min trials. In the fourth trial, two of the three participants switched roles. Feedback type, teamwork experience, and teammate familiarity had no statistically significant effect on communication or team situation awareness. However, higher levels of role experience and task experience showed significant and medium-sized effects on communication performance. Results, based on performance data and structured interview responses, also revealed areas of improvement in future feedback design and a potential benchmark for feedback frequency in an action-oriented serious game-based ITTS. Among the conclusions are six design objectives for future ITTSs, establishing a foundation for future research on designing effective ITTSs that train interpersonal skills to nascent teams.

Anchoring effect of performance feedback on accuracy of metacognitive monitoring in preschool children

Preschool children are generally inaccurate at evaluating past and predicting future performance. The present study examines the effect of performance feedback on the accuracy of preschoolers’ predictive judgments and tests whether performance feedback acts as an anchor for postdictive judgments. In Experiment 1, preschool children (n = 40) solved number patterns, and in Experiment 2 they solved object patterns (n = 59). The results in both experiments revealed, firstly, that children receiving performance feedback made more accurate predictive judgments and lowered their certainty after their incorrect answer. Secondly, the children relied on performance feedback more than on actual task experience when making postdictive judgments, indicating that performance feedback was used as an anchor for subsequent postdictive judgments.