Evaluating Mental Model Elicitation Methods

1994 ◽  
Vol 38 (4) ◽  
pp. 261-265 ◽  
Author(s):  
Nancy J. Cooke ◽  
Anna L. Rowe
Keyword(s):  
Mental Models ◽  
Task Performance ◽  
Mental Model ◽  
Comparative Evaluation ◽  
Basic Research ◽  
User Acceptance ◽  
Elicitation Methods ◽  
The Relationship ◽  
Evaluation Of Methods ◽  
Selection Of

Researchers have developed and applied a number of methods for measuring mental models. Unfortunately not only is the mental model construct ill-defined, but the basic research associated with it offers little guidance concerning the selection of a method for a particular application. In this paper a program of research is presented that is designed address this shortcoming. Specifically, the research involves a comparative evaluation of methods to measure mental models on the basis of the relationship between the method's output (i.e., the mental model) and the criterion of primary importance to the problem (e.g., task performance, user acceptance). It is assumed that a method should be selected on the basis of its ability to generate output that is predictive of the criterion of interest. It is likely that because the methods tap different aspects of a mental model, they will predict performance well on some tasks and criteria, but not others. As an example of this approach, data are presented that help to select the best method for measuring technicians' mental models of an electronics troubleshooting task.

scholarly journals A Context-Driven Framework for Selecting Mental Model Elicitation Methods

2019 ◽  
Vol 63 (1) ◽  
pp. 367-371 ◽  
Author(s):  
Samantha Harper ◽  
Stephen Dorton
Keyword(s):  
Mental Models ◽  
Mental Model ◽  
Internal Representation ◽  
Elicitation Method ◽  
Elicitation Methods ◽  
Different Types ◽  
Insight Into ◽  
Selection Of ◽  
Representation Of Knowledge ◽  
Model Elicitation

Mental models describe an internal representation of knowledge of an individual or group, which can be used to interpret interactions with their environment and provide insight into decision-making strategies and prediction of performance. There are several ways to elicit mental models and analyze them; however, there is little guidance for selecting an appropriate elicitation method. Depending on different constraints of research and desired outcomes, different elicitation methods are more appropriate than others. Three criteria were identified as useful for selecting an appropriate elicitation method. These were the interaction level with participants, the number of participants being evaluated, and the resulting level of analytical detail that is required. A process for selecting the most appropriate mental model elicitation method is herein presented. Additionally, an overview of the factors that affect the selection of the mental models, and the different types of mental models are also presented.

scholarly journals How Influential Are Mental Models on Interaction Performance? Exploring the Gap between Users’ and Designers’ Mental Models through a New Quantitative Method

2017 ◽  
Vol 2017 ◽  
pp. 1-14 ◽  
Author(s):  
Bingjun Xie ◽  
Jia Zhou ◽  
Huilin Wang
Keyword(s):  
Mental Models ◽  
Mental Model ◽  
Quantitative Method ◽  
User Performance ◽  
Card Sorting ◽  
Information Structures ◽  
Path Diagram ◽  
New Perspective ◽  
Model Similarity ◽  
The Relationship

The objective of this study is to investigate the effect of the gap between two different mental models on interaction performance through a quantitative way. To achieve that, an index called mental model similarity and a new method called path diagram to elicit mental models were introduced. There are two kinds of similarity: directionless similarity calculated from card sorting and directional similarity calculated from path diagram. An experiment was designed to test their influence. A total of 32 college students participated and their performance was recorded. Through mathematical analysis of the results, three findings were derived. Frist, the more complex the information structures, the lower the directional similarity. Second, directional similarity (rather than directionless similarity) had significant influence on user performance, indicating that it is more effective in eliciting mental models using path diagram than card sorting. Third, the relationship between information structures and user performance was partially mediated by directional similarity. Our findings provide practitioners with a new perspective of bridging the gap between users’ and designers’ mental models.

Mental models, humorous texts and humour evaluation

2018 ◽  
Vol 16 (1) ◽  
pp. 97-127 ◽  
Author(s):  
Henri de Jongste
Keyword(s):  
Mental Models ◽  
Model Theory ◽  
Mental Model ◽  
Model Construction ◽  
Mental Model Theory ◽  
The Relationship ◽  
Manipulation Process ◽  
The Way

Abstract This paper investigates how a mental-model theory of communication can explain differences in humorous texts and how aesthetic criteria to evaluate humour are dependent on the way mental models are exploited. Humour is defined as the deliberate manipulation by speakers of their private mental models of situations in order to create public mental models which contain one or more incongruities. Recipients can re-construct this manipulation process and thereby evaluate its nature and its quality. Humorous texts can be distinguished in terms of ownership of the manipulated mental model, the relationship between the speakers’ private and their public (humorous) mental model, as well as the speed required in the humorous mental model construction. Possible aesthetic criteria are the quality of the mental model manipulation, the pressure under which the humorously manipulated mental models have been constructed and the quality of the presentation of humorous mental models.

Novice-Expert Differences in the Cognitive Representation of System Features: Mental Models and Verbalizable Knowledge

1988 ◽  
Vol 32 (4) ◽  
pp. 219-223 ◽  
Author(s):  
Kathy A. Hanisch ◽  
Arthur F. Kramer ◽  
Charles L. Hulin ◽  
Robert Schumacher
Keyword(s):  
Cluster Analysis ◽  
Mental Models ◽  
Hierarchical Cluster Analysis ◽  
Mental Model ◽  
Training Programs ◽  
Hierarchical Cluster ◽  
Cognitive Representation ◽  
Knowledge Test ◽  
Scaling Technique ◽  
The Relationship

The relationship between users' mental models and their verbalizable knowledge of a system were investigated in a field study. Trained and untrained users of a new phone system rated the similarity of use of nine phone features. Their ratings of the features were used in a multidimensional scaling technique and hierarchical cluster analysis to obtain their mental models of the system. Individuals' ratings of features on unidimensional scales about the use of the features and scores obtained on a knowledge test were reflected in their mental models. Mental models of the two novice groups' were very similar except for the perception of one feature; it was more accurately depicted in the mental model of users who attended than those who did not attend a training program. Trainers' and system designers' mental models of the phone system were evaluated to determine an “appropriate” expert mental model. A comparison of the “expert” mental model to the novices' mental models suggested that several features were inaccurately perceived by the novices. Using the discrepancies between the expert and novices' mental models to design training programs for systems is discussed. A novel way to design or redesign systems based on novices' mental models of systems is proposed.

Team mental model characteristics and performance in a simulation experiment

2016 ◽  
Vol 39 (8) ◽  
pp. 899-924 ◽  
Author(s):  
Yi Yang ◽  
V.K. Narayanan ◽  
Yamuna Baburaj ◽  
Srinivasan Swaminathan
Keyword(s):  
Mental Models ◽  
Performance Feedback ◽  
Mental Model ◽  
Simulation Experiment ◽  
Strategic Decision ◽  
Content Type ◽  
Team Mental Models ◽  
And Performance ◽  
Team Mental Model ◽  
The Relationship

Purpose This paper aims to examine the relationship between the characteristics of strategic decision-making team’s mental model and its performance. The authors propose that the relationship between mental models and performance is two-way, rather than one-way. Thus, performance feedback should, in turn, influence strategic behavior and future performance by either triggering or hindering the learning process. Design/methodology/approach The authors conduct the research in the setting of a simulation experiment. A longitudinal data set was collected from 36 teams functioning as strategic decision makers over three periods. Findings This study provides support for the positive impacts of both the complexity and centrality of a team’s mental model on its performance. The authors also find that positive performance feedback reduces changes in complexity and centrality of team mental models due to cognitive inertia. Originality/value The study contributes to the literature by investigating the specific mechanisms that underlie mental model evolution. Different from the existing studies on team mental models that mainly focus on similarity of these shared cognitive structures, this study examines another two characteristics of team mental model, complexity and centrality, that are more relevant to the strategic decision-making process but has not been extensively studied in the team literature. In addition, this study reveals that performance feedback has different effects on team mental models depending on the referents – past performance or social comparison – which advances the understanding of the learning effects of performance feedback.

scholarly journals MODEL MENTAL SISWA TENTANG TERMOKIMIA

2018 ◽  
Vol 2 (2) ◽  
pp. 45
Author(s):  
Komang Melina Dewi ◽  
I Wayan Suja ◽  
I Dewa Ketut Sastrawidana
Keyword(s):  
High School ◽  
Mixed Methods ◽  
Data Analysis ◽  
Mental Models ◽  
Learning Outcomes ◽  
Teaching Methods ◽  
Mental Model ◽  
Student Understanding ◽  
Data Presentation ◽  
The Relationship

AbstrakPenelitian ini bertujuan mendeskripsikan dan menjelaskan profil model mental dan faktor-faktor penyebab terbentuknya model mental alternatif siswa kelas XI tentang termokimia di SMA Negeri Bali Mandara. Penelitian ini menggunakan mixed methods jenis sekuensial. Pengumpulan data dilakukan dengan observasi, pemberian tes hasil belajar dua tingkat, dan wawancara. Analisis data dilakukan secara deskriptif berdasarkan hubungan antara jawaban siswa dan argumentasinya dengan melibatkan tiga level kimia. Teknik analisis data hasil wawancara meliputi tahap reduksi data, penyajian data, dan penarikan kesimpulan. Hasil penelitian ini menunjukkan bahwa profil model mental siswa kelas  XI tentang termokimia, meliputi 1,94 % model mental ilmiah dan 98,05% model mental alternatif, yang terdiri atas 28,19% miskonsepsi khusus dan 69,86% benar sebagian. Faktor-faktor penyebab terbentuknya model mental alternatif pada pikiran siswa, meliputi rendahnya minat belajar siswa, kurangnya pemahaman siswa tentang termokimia, kurangnya perhatian siswa ketika pembelajaran, metode mengajar yang diterapkan guru tidak mencankup tiga level kimia dan padatnya kegiatan sekolah.Kata-kata kunci : termokimia, model mental, model mental alternatif.AbstractThis research was aimed describe and explain the profile of the mental models and the factors that cause the formation of alternative mental models of class XI students about thermochemistry at Bali Mandara High School. This research uses a sequential type mixed methods. Data collection was carried out by observation, giving two-level learning outcomes tests, and interviews. Data analysis is carried out descriptively, based on the relationship between student answers and their arguments involving three chemical levels. The technique of analyzing data from interviews includes the stages of data reduction, data presentation, and conclusion drawing. The results of this research indicate that the profile of the mental model of class XI students about thermochemistry includes 1.94% of the scientific mental model and 98.05% of the alternative mental models, which consist of 28.19% special misconceptions and 69.86% are partly correct. Factors that cause the formation of alternative mental models on the minds of students, including the low interest in student learning, lack of student understanding of thermochemistry, lack of attention of students when learning, teaching methods applied by teachers do not cover three chemical levels and the density of school activities.Key words: thermochemistry, mental models, alternative mental models.

Comparison of In-the-Ear and Over-the-Ear Hearing Aid Fittings

1986 ◽  
Vol 51 (4) ◽  
pp. 362-369 ◽  
Author(s):  
Donna M. Risberg ◽  
Robyn M. Cox
Keyword(s):  
Hearing Aids ◽  
High Frequency ◽  
Comparative Evaluation ◽  
Speech Intelligibility ◽  
Hearing Aid ◽  
Hearing Aid Fitting ◽  
The Difference ◽  
Functional Gain ◽  
The Relationship

A custom in-the-ear (ITE) hearing aid fitting was compared to two over-the-ear (OTE) hearing aid fittings for each of 9 subjects with mild to moderately severe hearing losses. Speech intelligibility via the three instruments was compared using the Speech Intelligibility Rating (SIR) test. The relationship between functional gain and coupler gain was compared for the ITE and the higher rated OTE instruments. The difference in input received at the microphone locations of the two types of hearing aids was measured for 10 different subjects and compared to the functional gain data. It was concluded that (a) for persons with mild to moderately severe hearing losses, appropriately adjusted custom ITE fittings typically yield speech intelligibility that is equal to the better OTE fitting identified in a comparative evaluation; and (b) gain prescriptions for ITE hearing aids should be adjusted to account for the high-frequency emphasis associated with in-the-concha microphone placement.

Use of photodynamic therapy for photodamage skin (review of literature)

2019 ◽  
Vol 1 (7) ◽  
pp. 19-23
Author(s):  
S. I. Surkichin ◽  
N. V. Gryazeva ◽  
L. S. Kholupova ◽  
N. V. Bochkova
Keyword(s):  
Photodynamic Therapy ◽  
Comparative Evaluation ◽  
Clinical Manifestations ◽  
Light Sources ◽  
Review Of Literature ◽  
Photosensitizing Agents ◽  
Selection Of

The article provides an overview of the use of photodynamic therapy for photodamage of the skin. The causes, pathogenesis and clinical manifestations of skin photodamage are considered. The definition, principle of action of photodynamic therapy, including the sources of light used, the classification of photosensitizers and their main characteristics are given. Analyzed studies that show the effectiveness and comparative evaluation in the selection of various light sources and photosensitizing agents for photodynamic therapy in patients with clinical manifestations of photodamage.

Hope and Necessity

2019 ◽  
Vol 11 (3) ◽  
pp. 49
Author(s):  
Sarah Pawlett-Jackson
Keyword(s):  
Comparative Evaluation ◽  
Final Word ◽  
Way Of Thinking ◽  
The Relationship

In this paper I offer a comparative evaluation of two types of “fundamental hope”, drawn from the writing of Rebecca Solnit and Rowan Williams respectively. Arguments can be found in both, I argue, for the foundations of a dispositional existential hope. Examining and comparing the differences between these accounts, I focus on the consequences implied for hope’s freedom and stability. I focus specifically on how these two accounts differ in their claims about the relationship between hope and (two types of) necessity. I argue that both Solnit and Williams base their claims for warranted fundamental hope on a sense of how reality is structured, taking this structure to provide grounds for a basic existential orientation that absolute despair is never the final word. For Solnit this structure is one of unpredictability; for Williams it is one of excess. While this investigation finds both accounts of fundamental hope to be plausible and insightful, I argue that Williams’s account is ultimately more satisfying on the grounds that it offers a realistic way of thinking about a hope necessitated by what it is responsive to, and more substantial in responding to what is necessary.

Sign in / Sign up

Export Citation Format

Share Document