Let's Think Together! Assessing Shared Mental Models, Performance, and Trust in Human-Agent Teams

2022 ◽  
Vol 6 (GROUP) ◽  
pp. 1-29
Author(s):  
Beau G. Schelble ◽  
Christopher Flathmann ◽  
Nathan J. McNeese ◽  
Guo Freeman ◽  
Rohit Mallick
Keyword(s):  
Mental Model ◽  
Cooperative Work ◽  
Computer Supported Cooperative Work ◽  
Team Composition ◽  
Team Cognition ◽  
Human Agent ◽  
Unique Nature ◽  
Agent Teams ◽  
Team Mental Model ◽  
The Impact

An emerging research agenda in Computer-Supported Cooperative Work focuses on human-agent teaming and AI agent's roles and effects in modern teamwork. In particular, one understudied key question centers around the construct of team cognition within human-agent teams. This study explores the unique nature of team dynamics in human-agent teams compared to human-human teams and the impact of team composition on perceived team cognition, team performance, and trust. In doing so, a mixed-method approach, including three team composition conditions (all human, human-human-agent, human-agent-agent), completed the team simulation NeoCITIES and completed shared mental model, trust, and perception measures. Results found that human-agent teams are similar to human-only teams in the iterative development of team cognition and the importance of communication to accelerating its development; however, human-agent teams are different in that action-related communication and explicitly shared goals are beneficial to developing team cognition. Additionally, human-agent teams trusted agent teammates less when working with only agents and no other humans, perceived less team cognition with agent teammates than human ones, and had significantly inconsistent levels of team mental model similarity when compared to human-only teams. This study contributes to Computer-Supported Cooperative Work in three significant ways: 1) advancing the existing research on human-agent teaming by shedding light on the relationship between humans and agents operating in collaborative environments, 2) characterizing team cognition development in human-agent teams; and 3) advancing real-world design recommendations that promote human-centered teaming agents and better integrate the two.

Post(-)Modern Organizations: Understanding how Cscw Affects Organizations

1994 ◽  
Vol 9 (2) ◽  
pp. 129-136 ◽  
Author(s):  
Frank Blackler
Keyword(s):  
Cooperative Work ◽  
Learning Processes ◽  
Computer Supported Cooperative Work ◽  
Theory Of Knowledge ◽  
Technological Changes ◽  
Collective Activity ◽  
The Impact ◽  
Organizational Problems

The paper reviews the ways organizations are thought to be changing as a result of Computer Supported Cooperative Work (CSCW). While claims which exaggerate the impact of technological changes should not be taken seriously, within the context of current developments in world capitalism CSCW assumes particular importance raising cultural and organizational problems at least as much as economic and technological ones. The flexibility, variety and disorder associated with ‘post-modern’ organizations (i.e. organizations characteristic of the epoch after modernism) necessitate the adoption of ‘postmodern’ approaches to understanding (i.e. approaches to the theory of knowledge developed in linguistics and philosophy) which emphasise the significance of communication, interpretation, improvization, negotiation and learning processes. The suggestion is that, for the impact of CSCW to be understood, conventional theories of organization should be replaced by theories of collective activity.

Collaborative Technology and Dimensions of Team Cognition

2013 ◽  
Vol 4 (3) ◽  
pp. 22-37 ◽  
Author(s):  
Hayward P. Andres
Keyword(s):  
Mental Model ◽  
Team Learning ◽  
Second Order ◽  
Team Cognition ◽  
First Order ◽  
Interaction Quality ◽  
Order Construct ◽  
Team Mental Model ◽  
Learning Team ◽  
Collaboration Mode

The purpose of this study was to explore team cognition as a multidimensional activity comprised of team learning, team reflexivity, and team mental model during project teamwork. A laboratory experiment was conducted to examine the effects of two different modes of collaboration – face-to-face and technology-mediated collaboration on team cognition and its subsequent impact on task outcomes. Team cognition was represented as a second-order construct comprised of three first-order dimensions. A direct-observation rating scale used to derive measures of the first-order dimensions was shown to have strong psychometric properties. The partial least squares method was used to test a structural equation model where the second-order construct was presented as a mediator between collaboration mode and task outcomes (productivity and interaction quality). As hypothesized, team cognition significantly influenced productivity and interaction quality outcomes. Further, collaboration mode significantly improved team cognition through its specific effects on the team learning, team reflexivity, and team mental model development. The main contribution of the study lies in its finding that team cognition can be viewed as a hierarchical construct that accounts for distinct yet cognition-related behaviors. This finding offers an extension to current related research models and identifies behavioral indicators that can be monitored by project managers in developing prescriptive measures aimed at promoting project success.

Cognition, Teams, and Augmenting Team Cognition: Understanding Memory Failures in Distributed Human-Agent Teams

2005 ◽  
Author(s):  
Stephen M. Fiore ◽  
Florian Jentsch ◽  
Eduardo Salas ◽  
Neal Finkelstein
Keyword(s):  
Team Cognition ◽  
Human Agent ◽  
Agent Teams

CSCW Anecdotes and Directions

1989 ◽  
Vol 33 (13) ◽  
pp. 867-871 ◽  
Author(s):  
Paul Cornell ◽  
Robert Luchetii ◽  
Lisbeth A. Mack ◽  
Gary M. Olson
Keyword(s):  
Group Dynamics ◽  
Research Agenda ◽  
Group Performance ◽  
Cooperative Work ◽  
Computer Supported Cooperative Work ◽  
New Developments ◽  
Fields Of Study ◽  
The Impact

This paper reviews the impact that computer-supported cooperative work (CSCW) has had on groups meeting in the same time and place. As is typical with new fields of study, there are few rigorous studies evaluating the merits of CSCW. Nonetheless, researchers have repeatedly observed events that, while not statistically verified, are worth sharing. These observations can aid development and help establish a research agenda. Among the major findings are that groups appear to reach consensus more quickly, are able to handle larger amounts of information more accurately, and are generally satisfied with the results. There is need for caution, however, about the effect on group dynamics and the need to tradeoff individual ergonomics and group needs. The results to date are very encouraging. New developments and research currently underway will add significant value, enhancing group performance and viability. If these developments come to fruition, CSCW could radically change existing notions of work collaboration.

Exploring the Impact of Coordination in Human–Agent Teams

2021 ◽  
pp. 155534342110105
Author(s):  
Michael Schneider ◽  
Michael Miller ◽  
David Jacques ◽  
Gilbert Peterson ◽  
Thomas Ford
Keyword(s):  
Artificial Agents ◽  
Effective Teams ◽  
Human Agent ◽  
Cognitive Work ◽  
Tightly Coupled ◽  
Agent Teams ◽  
The Impact ◽  
Critical Process

Teaming permits cognitively complex work to be rapidly executed by multiple entities. As artificial agents (AAs) participate in increasingly complex cognitive work, they hold the promise of moving beyond tools to becoming effective members of human–agent teams. Coordination has been identified as the critical process that enables effective teams and is required to achieve the vision of tightly coupled teams of humans and AAs. This paper characterizes coordination on the axes of types, content, and cost. This characterization is grounded in the human and AA literature and is evaluated to extract design implications for human–agent teams. These design implications are the mechanisms, moderators, and models employed within human–agent teams, which illuminate potential AA design improvements to support coordination.

Technological Support for Group Work: The Merits and Limitations of Computer-Supported Cooperative Work

1989 ◽  
Vol 33 (8) ◽  
pp. 546-549
Author(s):  
Paul Cornell ◽  
Robert Luchetti ◽  
Lisbeth A. Mack ◽  
Gary M. Olson ◽  
Phil Stone ◽  
...  
Keyword(s):  
Research Agenda ◽  
Group Performance ◽  
Cooperative Work ◽  
Computer Supported Cooperative Work ◽  
American Business ◽  
Research Attention ◽  
Technological Support ◽  
Strong Trend ◽  
Work Style ◽  
The Impact

There is a strong trend in American business towards the use of teams and groups. New products are being introduced to support this emerging work style. A new field of study, commonly known as computer-supported cooperative work (CSCW), has emerged which focuses on provided electronic support for group activities. One particularly active area is the electronic meeting room, where computers support teams meeting in the same time and place. These facilities typically provide meeting participants with a terminal, keyboard and mouse and link them to a large public display. Existing rooms, some of which have been in operation for several years, accommodate anywhere from two to 48 people. To date, most of the research attention has been devoted to developing the hardware and software for these facilities. This focus is shifting and research is now underway addressing the impact of CSCW on group performance and viability. This panel has three objectives: to discuss the merits and limitations of CSCW in the context of organizational, environmental and technological factors, to predict its potential impact now and in the future, and to discuss a research agenda. The opinions of the panelists are mixed. Some feel CSCW has already proven its value, even though the technology is in its infancy and the data are anecdotal–its worth will only improve with time. Others are concerned about trying to design and provide tools for a process that is not well defined or measured–other more important issues need to be addressed first. Consensus exists on the need for more empirical research, but the nature and priorities of that research agenda is a subject of debate.

scholarly journals Non-verbal Aspects of Collaboration in Virtual Worlds: a CSCW Taxonomy-development Proposal Integrating the Presence Dimension

2021 ◽  
Vol 27 (9) ◽  
pp. 913-954
Author(s):  
Armando Cruz ◽  
Hugo Paredes ◽  
Leonel Morgado ◽  
Paulo Martins
Keyword(s):  
Virtual Worlds ◽  
Three Dimensional ◽  
Physical Space ◽  
Cooperative Work ◽  
Verbal Communication ◽  
Computer Supported Cooperative Work ◽  
Distinctive Features ◽  
Collaborative Activities ◽  
The Impact ◽  
Taxonomy Development

Virtual worlds, particularly those able to provide a three-dimensional physical space, have features that make them suitable to support collaborative activities. These features distinguish virtual worlds from other collaboration tools, but current taxonomies of the field of Computer-Supported Cooperative Work do not account for several distinctive features of virtual worlds, namely those related with non-verbal communication. We intended to find out how the use of an avatar, gestures, spatial sounds, etc., influence collaboration in order to be able to include non-verbal communication in taxonomies of the field Computer-Supported Cooperative Work. Several cases of collaboration in virtual worlds are analysed, to find the impact of these non-verbal characteristics of virtual worlds. We proposed adding the concept of Presence to taxonomies of Computer-Supported Cooperative Work and contribute with guidance for future taxonomy development that includes it as a new dimension. This new dimension of Presence is subdivided into "avatar" and "physical space" subdimensions. In turn, these are divided into "physical appearance", "gestures, sounds and animations" and "focus, nimbus and aura"; "environment" and "objects / artefacts". This new taxonomy-development proposal may contribute to inform better design of virtual worlds in support of cooperative work.

Institutionalizing University—Industry Collaboration for the Diffusion of Intangible Innovations

1998 ◽  
Vol 12 (4) ◽  
pp. 243-250
Author(s):  
Lorna Heaton
Keyword(s):  
Cooperative Work ◽  
Computer Supported Cooperative Work ◽  
Disciplinary Knowledge ◽  
The Past ◽  
Institutional Structures ◽  
Industry Collaboration ◽  
Micro Level ◽  
The Impact ◽  
The Relationship ◽  
University Industry

This paper describes the shifting evolution of the relationship between one Swedish laboratory involved in the design of systems for computer-supported cooperative work (CSCW) and its industrial and government partners over the past decade. It explores the impact of increasing intersection and new configurations of relationships between these previously distinct sectors on the development of CSCW both in terms of disciplinary knowledge and institutional structures to cope with this hybrid object. It finds that a micro-level, Latourian analysis suitably explains choices at a laboratory level, but that these specific issues take on their full significance in the context of changes in the broader social and policy spheres.

scholarly journals The Impact of Multimodal Communication on a Shared Mental Model, Trust, and Commitment in Human–Intelligent Virtual Agent Teams

2018 ◽  
Vol 2 (3) ◽  
pp. 48 ◽  
Author(s):  
Nader Hanna ◽  
Deborah Richards
Keyword(s):  
Mental Model ◽  
Significant Positive Correlation ◽  
Social Trust ◽  
Multimodal Communication ◽  
Social Aspect ◽  
Virtual Agents ◽  
Shared Mental Model ◽  
Positive Correlation ◽  
Human Agent ◽  
The Impact

There is an increasing interest in the use of intelligent virtual agents (IVAs) to work in teams with humans. To achieve successful outcomes for these heterogeneous teams, many of the aspects found in successful human teams will need to be supported. These aspects include behavioural (i.e., multimodal communication), cognitive (i.e., a shared mental model (SMM)), and social (trust and commitment). Novelly, this paper aims to investigate the impact of IVA’s multimodal communication on the development of a SMM between humans and IVAs. Moreover, this paper aims to explore the impact of the developed SMM on a human’s trust in an IVA’s decisions and a human’s commitment to honour his/her promises to an IVA. The results from two studies involving a collaborative activity showed a significant positive correlation between team multimodal communication (i.e., behavioural aspect) and a SMM between teammates (i.e., cognitive aspect). Moreover, the result showed that there is a significant positive correlation between the developed SMM and a human’s trust in the IVA’s decision and the human’s commitment to honour his/her promises (the establishment of the social aspect of teamwork). Additionally, the results showed a cumulative effect of all of these aspects on human–agent team performance. These results can guide the design of human–agent teamwork multimodal communication models.

Sign in / Sign up

Export Citation Format

Share Document