Let's Think Together! Assessing Shared Mental Models, Performance, and Trust in Human-Agent Teams

An emerging research agenda in Computer-Supported Cooperative Work focuses on human-agent teaming and AI agent's roles and effects in modern teamwork. In particular, one understudied key question centers around the construct of team cognition within human-agent teams. This study explores the unique nature of team dynamics in human-agent teams compared to human-human teams and the impact of team composition on perceived team cognition, team performance, and trust. In doing so, a mixed-method approach, including three team composition conditions (all human, human-human-agent, human-agent-agent), completed the team simulation NeoCITIES and completed shared mental model, trust, and perception measures. Results found that human-agent teams are similar to human-only teams in the iterative development of team cognition and the importance of communication to accelerating its development; however, human-agent teams are different in that action-related communication and explicitly shared goals are beneficial to developing team cognition. Additionally, human-agent teams trusted agent teammates less when working with only agents and no other humans, perceived less team cognition with agent teammates than human ones, and had significantly inconsistent levels of team mental model similarity when compared to human-only teams. This study contributes to Computer-Supported Cooperative Work in three significant ways: 1) advancing the existing research on human-agent teaming by shedding light on the relationship between humans and agents operating in collaborative environments, 2) characterizing team cognition development in human-agent teams; and 3) advancing real-world design recommendations that promote human-centered teaming agents and better integrate the two.

The Five-Factor Perceived Shared Mental Model Scale: A Consolidation of Items Across the Contemporary Literature

Literature on Shared Mental Models (SMMs) has been burgeoning in recent years and this has provided increasingly detailed insight and evidence into the importance of SMMs within specific contexts. However, because past research predominantly focused on SMM structure as measured by diverse, context-dependent measures, a consolidated multi-dimensional measure of perceived SMMs that can be used across diverse team contexts is currently lacking. Furthermore, different conceptualizations of the dimensionality of SMMs exist, which further impedes the comparison between studies. These key limitations might hinder future development in the SMM literature. We argue that the field of SMMs has now matured enough that it is possible to take a deductive approach and evaluate the prior studies in order to refine the key SMMs dimensions, operationalizations, and measurement. Hence, we take a three-stage approach to consolidate existing literature scale-based measures of SMMs, using four samples. Ultimately, this leads to a 20-item five-dimensional scale (i.e., equipment, execution, interaction, composition, and temporal SMMs) – the Five Factor Perceived Shared Mental Model Scale (5-PSMMS). Our scale provides scholars with a tool which enables the measurement, and comparison, of SMMs across diverse team contexts. It offers practitioners the option to more straightforwardly assess perceived SMMs in their teams, allowing the identification of challenges in their teams and facilitating the design of appropriate interventions.

Symmetry and asymmetry between inferences between disjunctions and conditionals

How people make inferences between disjunctions and conditionals is a current important question that can test existing main psychological accounts (mental logic, the probabilistic approach, the original and revised mental model theory) for propositional reasoning. In order to test these accounts, one experiment investigated how relations (material implication, subcontrariety, contradiction, and contrariety) between two basic components (A and C) in disjunctions (e.g., A or C; not-A or C) and conditionals (e.g., if not-A then C; if A then C) and inference directions (disjunction-to-conditional versus conditional-to-disjunction) between disjunctions and their corresponding conditionals affect human inferences between both. It was found that participants’ inferences were symmetric between the two inference directions in compatible relations and incompatible relations where two basic components were on different dimensions, but not in the other relations. Which of the two inference directions was easier depended on relations between two basic components, because some relations tended to elicit particular interpretations of premises and conclusions, or belief biases. The present overall response pattern is beyond all the existing accounts for inferences between disjunctions and conditionals. Inferences between disjunctions and conditionals are complex and so there may not be a unified account for them.

Crowdsourced Knowledge in Organizational Decision Making

Inefficiencies naturally form as organizations grow in size and complexity. The knowledge required to address these inefficiencies is often stove-piped across different organizational silos, geographic locations, and professional disciplines. Crowdsourcing provides a way to tap into the knowledge and experiences of diverse groups of people to rapidly identify and more effectively solve inefficiencies. We developed a prototype crowdsourcing system based on design thinking practices to allow employees to build a shared mental model and work collaboratively to identify, characterize, and rank inefficiencies, as well as to develop possible solutions. We conducted a study to assess how presenting crowdsourced knowledge (votes/preferences, supporting argumentation, etc.) from employees affected organizational Decision Makers (DMs). In spite of predictions that crowdsourced knowledge would influence their decisions, presenting this knowledge to DMs had no significant effect on their voting for various solutions. We found significant differences in the mental models of employees and DMs. We offer various explanations for this behavior based on rhetorical analysis and other survey responses from DMs and contributors. We further discuss different theoretical explanations, including the effects of various biases and decision inertia, and potential issues with the types of knowledge elicited and presented to DMs.

The Analysis of Students’ Mental Models Using Macromedia Flash-Based Learning Media on Molecular Shapes Lesson

The profile of students’ mental model was very needed to know student successes and difficulties in describing macroscopic, submicroscopic, symbolic representation as the characteristics of chemistry. This research aimed at analyzing the profile of students’ mental model of experimental and control groups, and knowing the effect of Macromedia Flash based learning media toward students’ mental model at the tenth grade of MIA. This research was conducted in the Academic Year of 2019/2020 at State Senior High School 1 Pekanbaru on Molecular Shapes lesson. It was Mixed Method Research integrating qualitative and quantitative researches with explanatory design. There were 20 students as the samples selected by using Simple Random sampling technique. Instruments used in this research were two-tier diagnostic test and interview to strengthen the data obtained. The results of analyzing the data showed that the profile of students’ mental model of experimental group using Macromedia Flash based learning media overall had 70% intact mental model and 30% alternative mental model, the control group students had 37% intact mental model and 63% alternative mental model. The research findings also showed that there was an effect of Macromedia Flash based learning media toward students’ mental model. The result of hypothesis testing that SPSS was used to help showed sig. (2-tailed) 0.000, it meant that Ha was accepted and H0 was rejected. Â

Literasi Learning Organization pada Pengurus Persaudaraan Muslimah (Salimah) Kota Bandar Lampung

Literasi learning organization pada pengurus Persaudaraan Muslimah (Salimah) Kota Bandar Lampung bertujuan untuk 1) Meningkatkan partisipasi/ keaktifan pengurus daerah dan anggota Salimah Kota Bandar Lampung. 2) Meningkatkan efektivitas program kerja sehingga dapat berjalan dengan baik. 3) Membentuk sinergitas program antara pengurus cabang dan pengurus daerah. Metode yang dilakukan terdiri dari tiga tahapan: 1) Analisis situasi dilakukan melalui penelusuran penelitian dan kajian tema yang berkaitan. 2) Intervensi Objek: dengan ceramah -tema ceramah: a) Mental model dan personal mastery; b) Shared vision, team learning; dan c) Komunikasi efektif-, focus group discussion, dan pendampingan. 3) Evaluasi dan Refleksi. Secara kuantitatif nilai rata-rata peserta sebelum dilaksanakan kegiatan adalah 70,19 dan mengalami kenaikan menjadi 80,31 setelah dilaksanakan kegiatan pelatihan. Kenaikan rata-rata sebesar 10,12 poin.

Penerapan Pembelajaran Berbasis Inquiry pada Materi Elektrokimia terhadap Pemahaman Konseptual, Model Mental dan Sikap Siswa

The purpose of this article review is to know the effect of applying inquiry-based learning on electrochemistry material to conceptual understanding, mental model and student attitudes. Based on some articles that have been reviewed, it can be concluded that the application of inquiry-based learning can improve conceptual understanding, mental model and positive attitude of students on electrochemistry material. The 5E inquiry (Engagement, Exploration, Explanation, Elaboration, and Evaluation) can be combined with the galvanic cell kit model to improve students' understanding of electrochemistry at the submicroscopic (molecular) level. Inquiry-based learning can be applied in both laboratory activities and classroom learning processes. The students' understanding of chemistry will be intact if students are able to connect the three levels of chemical representation.