scholarly journals Studying Human Design Teams through Computational Teams of Simulated Annealing Agents

2018 ◽  
Author(s):  
Christopher McComb ◽  
Kenneth Kotovsky ◽  
Jonathan Cagan

Novel design methodologies are often evaluated through empirical studies involving human designers. However, such empirical studies can incur a high personnel cost. Further, it can be difficult to isolate the effects of specific team or individual characteristics. These limitations could be bypassed by employing a computational model of design teams. This work introduces the Cognitively-Inspired Simulated Annealing Teams (CISAT) modeling framework, an agent-based platform that provides a means for efficiently simulating human design teams. A number of empirically demonstrated cognitive phenomena are modeled within the platform, striking a balance between model simplicity and direct applicability to engineering design problems. This paper discusses the composition of the CISAT modeling framework and demonstrates how it can be used to simulate the performance of human design teams in a cognitive study. Results simulated with CISAT are compared directly to the results derived from human designers. Finally, the CISAT model is also used to investigate the characteristics that were most and least helpful to teams during the cognitive study.

Author(s):  
Christopher McComb ◽  
Jonathan Cagan ◽  
Kenneth Kotovsky

Novel design methodologies are often evaluated through empirical studies involving human designers. However, such empirical studies can incur a high personnel cost. Further, it can be difficult to isolate the effects of specific team or individual characteristics. These limitations could be bypassed by employing a computational model of design teams. This work introduces the Cognitively-Inspired Simulated Annealing Teams (CISAT) modeling framework, an agent-based platform that provides a means for efficiently simulating human design teams. A number of empirically demonstrated cognitive phenomena are modeled within the platform, striking a balance between model simplicity and direct applicability to engineering design problems. This paper discusses the composition of the CISAT modeling framework and demonstrates how it can be used to simulate the performance of human design teams in a cognitive study. Results simulated with CISAT are compared directly to the results derived from human designers. Finally, the CISAT model is also used to investigate the characteristics that were most and least helpful to teams during the cognitive study.


2018 ◽  
Author(s):  
Christopher McComb ◽  
Kenneth Kotovsky ◽  
Jonathan Cagan

Novel design methodologies are often evaluated through studies involving human designers, but such studies can incur a high personnel cost. It can also be difficult to isolate the effects of specific team or individual characteristics. This work introduces the Cognitively-Inspired Simulated Annealing Teams (CISAT) modeling framework, a platform for efficiently simulating and analyzing human design teams. The framework models a number of empirically demonstrated cognitive phenomena, thus balancing simplicity and direct applicability. This paper discusses the model's composition, and demonstrates its utility through simulating human design teams in a cognitive study. Simulation results are compared directly to the results from human designers. The CISAT model is also used to identify the most beneficial characteristics in the cognitive study.


2018 ◽  
Author(s):  
Christopher McComb

Teams are a ubiquitous part of the design process and a great deal of time and effort is devoted to managing them effectively. Although teams have the potential to search effectively for solutions, they are also prone to a number of pitfalls. Thus, a greater understanding of teams is necessary to ensure that they can function optimally across a variety of tasks. Teams are typically studied through controlled laboratory experiments or through longitudinal studies that observe teams in situ. However, both of these study types can be costly and time-consuming. Months, if not years, pass between the initial conception of a study and the final analysis of results. This work creates a computational framework that efficiently emulates human design teams, thus facilitating the derivation of a theory linking the properties of design problems to optimized team characteristics, effectively making it possible to design design teams.This dissertation first introduces and validates the Cognitively-Inspired Simulated Annealing Teams (CISAT) modeling framework. The central structure of CISAT is modeled after simulated annealing, a global optimization algorithm that has been shown to effectively mimic the problem-solving process of individuals. Specifically, a multi-agent analog of simulated annealing is used in CISAT to mimic the behavior of teams. Several additional components, drawn from the psychology and problem-solving literature, are then included in the framework to enable a more accurate description of individual activity and interaction within the team. CISAT is then used to investigate the relationship between design problem properties, team characteristics, and task performance. Multiple computational simulations are conducted in which simulated teams with various characteristics solve a variety of different configuration problems. These simulations are then post-processed to produce a set of equations that make it possible to predict optimal team characteristics based on problem properties, thus enabling the optimal design of design teams. To validate these equations a behavioral study is designed and conducted in which teams of engineering students interact at different frequencies while designing a complex system. Results of the study offer a limited validation of the predictive equations.This dissertation further highlights the resource efficiency and versatility of CISAT by demonstrating its use in two additional applications. In the first, a new numerical optimization algorithm is derived directly from CISAT by stripping away all but the most quintessential team-based characteristics. The team-based characteristics of this algorithm allow it to achieve high performance across a variety of objective function with diverse topographies. In the second application, CISAT is used in conjunction with Markov concepts to examine the order in which designers make changes to their solutions. Although it has been demonstrated that humans apply changes in a specific order (called a sequence) when solving puzzles, such patterns have not been examined for engineers solving design problems. It is shown that operation sequences are used by designers, and improve solution quality. This dissertation demonstrates how characteristics of individual designers and design teams can be captured and accurately reproduced within a computational model to advance our knowledge of design methodology. Future extensions of this work have the potential to inform a deeper and more holistic understanding of the search process.


2018 ◽  
Author(s):  
Christopher McComb ◽  
Kenneth Kotovsky ◽  
Jonathan Cagan

The performance of a team with the right characteristics can exceed the mere sum of the constituent members’ individual efforts. However, a team having the wrong characteristics may perform more poorly than the sum of its individuals. Therefore, it is vital that teams are assembled and managed properly in order to maximize performance. This work examines how the properties of configuration design problems can be leveraged to select the best values for team characteristics (specifically team size and interaction frequency). A computational model of design teams which has been shown to effectively emulate human team behavior is employed to pinpoint optimized team characteristics for solving a variety of configuration design problems. These configuration design problems are characterized with respect to the local and global structure of the design space, the alignment between objectives, and the resources allotted for solving the problem. Regression analysis is then used to create equations for predicting optimized values for team characteristics based on problem properties. These equations achieve moderate to high accuracy, making it possible to design teams based on those problem properties. Further analysis reveals hypotheses about how the problem properties can influence a team’s search for solutions. This work also conducts a cognitive study on a different problem to test the predictive equations. For a configuration problem of moderate size, the model predicts that zero interaction between team members should lead to the best outcome. A cognitive study of human teams verifies this surprising prediction, offering partial validation of the predictive theory.


2020 ◽  
Vol 143 (1) ◽  
Author(s):  
P. G. Tucker ◽  
Z. N. Wang

Abstract The successful application of eddy resolving simulations to most areas of a modern gas turbine aeroengine is considered. A coherent modeling framework is presented to address coupling challenges. A flow classification is also given. The extensive results presented are shown to be promising but many challenges remain. In the short term, the use of eddy resolving simulations should see greater use in Reynolds-averaged Navier–Stokes (RANS) and lower-order model calibration/development—this is starting to happen already. Ideally, in the near future, RANS, large eddy simulation (LES), and test should work in harmony. It is advocated that currently, certain costly engineering design problems can be avoided or understood using scale resolving simulations.


2017 ◽  
Vol 139 (4) ◽  
Author(s):  
Christopher McComb ◽  
Jonathan Cagan ◽  
Kenneth Kotovsky

The performance of a team with the right characteristics can exceed the mere sum of the constituent members' individual efforts. However, a team having the wrong characteristics may perform more poorly than the sum of its individuals. Therefore, it is vital that teams are assembled and managed properly in order to maximize performance. This work examines how the properties of configuration design problems can be leveraged to select the best values for team characteristics (specifically team size and interaction frequency). A computational model of design teams which has been shown to effectively emulate human team behavior is employed to pinpoint optimized team characteristics for solving a variety of configuration design problems. These configuration design problems are characterized with respect to the local and global structure of the design space, the alignment between objectives, and the resources allotted for solving the problem. Regression analysis is then used to create equations for predicting optimized values for team characteristics based on problem properties. These equations achieve moderate to high accuracy, making it possible to design teams based on those problem properties. Further analysis reveals hypotheses about how the problem properties can influence a team's search for solutions. This work also conducts a cognitive study on a different problem to test the predictive equations. For a configuration problem of moderate size, the model predicts that zero interaction between team members should lead to the best outcome. A cognitive study of human teams verifies this surprising prediction, offering partial validation of the predictive theory.


2019 ◽  
Vol 32 (9) ◽  
pp. 5147-5161 ◽  
Author(s):  
Hussein Samma ◽  
Junita Mohamad-Saleh ◽  
Shahrel Azmin Suandi ◽  
Badr Lahasan

Author(s):  
Jaryn A. Studer ◽  
Seda Yilmaz ◽  
Shanna R. Daly ◽  
Colleen M. Seifert

This paper explores “problem exploration heuristics,” or cognitive strategies used to identify and reframe design problem descriptions. The way a design problem is structured influences the types of ideas a designer generates; in particular, some framings may lead to more creative solutions and using multiple framings can support diverse solutions. Most existing problem exploration strategies have not been derived from empirical studies of engineering design practice. Thus, in our work, we drew upon a sample of engineering design problems and analyzed how the problem descriptions evolved during design. Examining iterations on the problem description allowed us to identify heuristics evident in designers’ recrafting of problem descriptions. Heuristics were defined based on the elements in each problem description and their perceived role in transforming the problem. We present a systematic methodology for identifying problem exploration heuristics, and describe five unique Problem Exploration Heuristics commonly observed in structuring design briefs.


2019 ◽  
Vol 24 (4) ◽  
pp. 312-321 ◽  
Author(s):  
Diana Moreira ◽  
Fernando Barbosa

Abstract. Delay discounting (DD) is the process of devaluing results that happen in the future. With this review, we intend to identify specificities in the processes of DD in impulsive behavior. Studies were retrieved from multiple literature databases, through rigorous criteria (we included systematic reviews and empirical studies with adult human subjects), following the procedures of the Cochrane Collaboration initiative. Of the 174 documents obtained, 19 were considered eligible for inclusion and were retained for in-depth analysis. In addition, 13 studies from the manual search were included. Thus, a total of 32 studies were selected for review. The objectives/hypotheses, results, and the main conclusion(s) were extracted from each study. Results show that people with pronounced traits of impulsivity discount rewards more markedly, that is, they prefer immediate rewards, though of less value, or postponed losses, even though they worsen in the future. Taken together, the existing data suggest the importance of inserting DD as a tool for initial assessment in conjunction with measures of addiction and stress level, as well as the consideration of new therapies.


Sign in / Sign up

Export Citation Format

Share Document