Let's Think Together! Assessing Shared Mental Models, Performance, and Trust in Human-Agent Teams

An emerging research agenda in Computer-Supported Cooperative Work focuses on human-agent teaming and AI agent's roles and effects in modern teamwork. In particular, one understudied key question centers around the construct of team cognition within human-agent teams. This study explores the unique nature of team dynamics in human-agent teams compared to human-human teams and the impact of team composition on perceived team cognition, team performance, and trust. In doing so, a mixed-method approach, including three team composition conditions (all human, human-human-agent, human-agent-agent), completed the team simulation NeoCITIES and completed shared mental model, trust, and perception measures. Results found that human-agent teams are similar to human-only teams in the iterative development of team cognition and the importance of communication to accelerating its development; however, human-agent teams are different in that action-related communication and explicitly shared goals are beneficial to developing team cognition. Additionally, human-agent teams trusted agent teammates less when working with only agents and no other humans, perceived less team cognition with agent teammates than human ones, and had significantly inconsistent levels of team mental model similarity when compared to human-only teams. This study contributes to Computer-Supported Cooperative Work in three significant ways: 1) advancing the existing research on human-agent teaming by shedding light on the relationship between humans and agents operating in collaborative environments, 2) characterizing team cognition development in human-agent teams; and 3) advancing real-world design recommendations that promote human-centered teaming agents and better integrate the two.

A Review of Design-Related Literature Concerning Cognitive Processes, Prototyping Strategies, and Modeling Processes

In industry and academia, designers and engineers use prototyping at various stages in the design process to evaluate progress, archive process, assess viability, and communicate mental models to a team. Cognitive processes not only play a huge role during the design process, but also have causal relationships with various prototyping strategies. However, these causal relationships are not well understood in the design field. This paper presents a review of design-field literature related to cognitive processes, prototyping strategies, and modeling processes to identify literature consensus, consolidate experimental results, and expose gaps in the literature. After analysis of the literature, Fixation, Team Cognition, Iterative Prototyping, and Rapid Prototyping are the most well researched areas, especially when compared to their effects on cognitive processes. Sunk Cost, Requirement Relaxation, and Expertise are areas that could be better understood. The relationships between relevant cognitive processes, prototyping strategies, and modeling processes are consolidated into a data visualization that invites researchers and novices alike to explore the field of design in a fresh way that could spark new research endeavors or provoke interest in the field. This literature review and analysis reveals trends in design research through a novel approach with an emphasis on cognition, as well as provides a consolidated cannon of work that gives a sense of what has already been done on these topics and what is still left to explore.

Conversations across the table: shared cognition in top management teams

Purpose This paper aims to examine the shared mental models (SMMs) of a top management team (TMT) using an emergent perspective in conditions of uncertainty. The paper examines how a TMT conversation represents an emergent cognitive process to reach an action for future planning. Design/methodology/approach The design uses an emergent SMM approach based on a TMT discussion in an uncertain context. Cognitive mapping techniques illustrate how concepts emerge and are structured. This approach addresses the need for an alternative to aggregate mapping methods and supports the notion of team cognition as an emergent and dynamic process. Findings Findings showed that the emergence of a SMM could be elicited and represented using cognitive mapping techniques. Domain knowledge and social relationships supported the emergence of shared knowledge relevant for action on team tasks. A SMM based on team contribution and concept connectivity was identified. Research limitations/implications The study is based on data collected from a recorded discussion in a quarterly company meeting, ten days before the UK’s original planned exit date, March 2019. Originality/value This research study contributes to the SMM and team cognition literature streams by examining the TMT’s shared understanding as an emergent process. Empirical studies using cognitive mapping techniques in this context are rare.

EXPLORING THE ROLE OF TRANSACTIVE MEMORY SYSTEMS IN TEAM DECISION-MAKING DURING IDEATION PHASE

Team collaboration is a critical necessity of the modern-day engineering design profession. This is no surprise given that teams typically possess more task-relevant skills and knowledge than individuals (Levine & Choi, 2004). Advancements in digital media provide new opportunities for collaboration across the design lifecycle. However, early stages of the design process still pose challenges to digitally mediated design collaboration due to greater representational abstraction and the presence of multiple modalities for design ideation. Usually, design teams spend a substantial amount of time generating a broad set of ideas that can lead them to a wide range of design solutions during the ideation phase. However, sooner or later, teams should narrow down their vision for a final solution. What factors influence team members to eliminate or select an idea? Our study is an attempt to demonstrate some examples of this challenge. By drawing on research in team cognition, particularly the concept of transactive memory system (TMS) we studied a design teams' communication and media use during the ideation phase. The goal was to see if media type and communication modes can predict a team's decisions on selecting and eliminating ideas.

Toward a better understanding of team decision processes: combining laboratory experiments with agent-based modeling

Despite advances in the field, we still know little about the socio-cognitive processes of team decisions, particularly their emergence from an individual level and transition to a team level. This study investigates team decision processes by using an agent-based model to conceptualize team decisions as an emergent property. It uses a mixed-method research design with a laboratory experiment providing qualitative and quantitative input for the model’s construction, as well as data for an output validation of the model. First, the laboratory experiment generates data about individual and team cognition structures. Then, the agent-based model is used as a computational testbed to contrast several processes of team decision making, representing potential, simplified mechanisms of how a team decision emerges. The increasing overall fit of the simulation and empirical results indicates that the modeled decision processes can at least partly explain the observed team decisions. Overall, we contribute to the current literature by presenting an innovative mixed-method approach that opens and exposes the black box of team decision processes beyond well-known static attributes.

Learning about stress from building, drilling and flying: a scoping review on team performance and stress in non-medical fields

Background Teamwork is essential in healthcare, but team performance tends to deteriorate in stressful situations. Further development of training and education for healthcare teams requires a more complete understanding of team performance in stressful situations. We wanted to learn from others, by looking beyond the field of medicine, aiming to learn about a) sources of stress, b) effects of stress on team performance and c) concepts on dealing with stress. Methods A scoping literature review was undertaken. The three largest interdisciplinary databases outside of healthcare, Scopus, Web of Science and PsycINFO, were searched for articles published in English between 2008 and 2020. Eligible articles focused on team performance in stressful situations with outcome measures at a team level. Studies were selected, and data were extracted and analysed by at least two researchers. Results In total, 15 articles were included in the review (4 non-comparative, 6 multi- or mixed methods, 5 experimental studies). Three sources of stress were identified: performance pressure, role pressure and time pressure. Potential effects of stress on the team were: a narrow focus on task execution, unclear responsibilities within the team and diminished understanding of the situation. Communication, shared knowledge and situational awareness were identified as potentially helpful team processes. Cross training was suggested as a promising intervention to develop a shared mental model within a team. Conclusion Stress can have a significant impact on team performance. Developing strategies to prevent and manage stress and its impact has the potential to significantly increase performance of teams in stressful situations. Further research into the development and use of team cognition in stress in healthcare teams is needed, in order to be able to integrate this ‘team brain’ in training and education with the specific goal of preparing professionals for team performance in stressful situations.