Gaming the System: An Agent-Based Model of Estimation Strategies and their Effects on System Performance

2018 ◽  
Vol 140 (12) ◽  
Author(s):  
John Meluso ◽  
Jesse Austin-Breneman

Parameter estimates in large-scale complex engineered systems (LaCES) affect system evolution, yet can be difficult and expensive to test. Systems engineering uses analytical methods to reduce uncertainty, but a growing body of work from other disciplines indicates that cognitive heuristics also affect decision-making. Results from interviews with expert aerospace practitioners suggest that engineers bias estimation strategies. Practitioners reaffirmed known system features and posited that engineers may bias estimation methods as a negotiation and resource conservation strategy. Specifically, participants reported that some systems engineers “game the system” by biasing requirements to counteract subsystem estimation biases. An agent-based model (ABM) simulation which recreates these characteristics is presented. Model results suggest that system-level estimate accuracy and uncertainty depend on subsystem behavior and are not significantly affected by systems engineers' “gaming” strategy.

Author(s):  
John Meluso ◽  
Jesse Austin-Breneman

Parameter estimates in large-scale complex engineered systems affect system evolution yet can be difficult and expensive to test. Systems engineering uses analytical methods to reduce uncertainty, but a growing body of work from other disciplines indicates that cognitive heuristics also affect decision-making. Interviews with several expert aerospace practitioners suggest that engineers bias estimation strategies. Practitioners reaffirmed known system features and posited that engineers may bias estimation methods as a negotiation and resource conservation strategy. Specifically, participants reported that some systems engineers “game the system” by biasing requirements to counteract subsystem estimation biases. An agent-based model simulation which recreates these characteristics is presented. Model results suggest that the systems engineers’ “gaming” strategy of counteracting subsystem bias may decrease system-level estimate accuracy and increase uncertainty.


2020 ◽  
Vol 6 ◽  
Author(s):  
Arianne X. Collopy ◽  
Eytan Adar ◽  
Panos Y. Papalambros

Abstract Coordination of distributed design work is an important activity in large-scale and complex engineered systems (LSCES) design projects. Coordination strategies have been studied formally in system design optimization and organizational science. This article reports on a study to identify what strategies are used in coordination practice. While the literature primarily offers prescriptive coordination strategies, this study focussed on the contribution of individuals’ behaviours to system-level coordination. Thus, a coordination strategy is seen as a particular set of individual actions and behaviours. We interviewed professionals with expertise in systems engineering, project management and technical leadership at two large aerospace design organizations. Through qualitative thematic analysis, we identified two strategies used to facilitate coordination. The first we call authority-based and is enabled by technical know-how and the use of organizational authority; the second we call empathetic leadership and includes interpersonal skills, leadership traits and empathy. These strategies emerged as complementary and, together, enabled individuals to coordinate complex design tasks. We found that skills identified in competency models enable these coordination strategies, which in turn support management of interdependent work in the organization. Studying the role of individuals contributes an expanded view on how coordination facilitates LSCES design practice.


2021 ◽  
Author(s):  
Jiaqi Ge ◽  
Andrea Scalco ◽  
Tony Craig

Humans are social animals. Even the very personal decision of what someone eats is influenced by others around them. In this study, we propose four social interaction mechanisms driven by social identity that affect a person’s decision to eat or not eat meat. Using data from the British Social Attitude Survey in 2014, we operationalise social identity in an agent-based model to study the effect of social interactions on the spread of meat-eating behaviour in the British population. We find that social interactions are crucial in determining the spread of meat-eating behaviour. In order to bring about large-scale behavioural changes at the system level, people need to 1) have a strong openness to influences from both in-group and out-group members who have a different dietary behaviour, and 2) have a weak tendency to reinforce their current behaviour after seeing in-group members sharing the same behaviour. The agent-based model is shown to be a useful tool to operationalise social theories in a well-defined context, and to upscale the system to study its dynamic evolutions under different scenarios.


2017 ◽  
Vol 23 (3) ◽  
pp. 524-546 ◽  
Author(s):  
Lorella Cannavacciuolo ◽  
Luca Iandoli ◽  
Cristina Ponsiglione ◽  
Giuseppe Zollo

Purpose The purpose of this paper is to explain the emergence of collaboration networks in entrepreneurial clusters as determined by the way entrepreneurs exchange knowledge and learn through business transactions needed to implement temporary supply chains in networks of co-located firms. Design/methodology/approach A socio-computational approach is adopted to model business transactions and supply chain formation in Marshallian industrial districts (IDs). An agent-based model is presented and used as a virtual lab to test the hypotheses between the firms’ behaviour and the emergence of structural properties at the system level. Findings The simulation findings and their validation based on the comparison with a real world cluster show that the topological properties of the emerging network are influenced by the learning strategies and decision-making criteria firms use when choosing partners. With reference to the specific case of Marshallian IDs it is shown that inertial learning based on history and past collaboration represents in the long term a major impediment for the emergence of hubs and of a network topology that is more conducive to innovation and growth. Research limitations/implications The paper offers an alternative view of entrepreneurial learning (EL) as opposed to the dominant view in which learning occurs as a result of exceptional circumstances (e.g. failure). The results presented in this work show that adaptive, situated, and day-by-day learning has a profound impact on the performance of entrepreneurial clusters. These results are encouraging to motivate additional research in areas such as in modelling learning or in the application of the proposed approach to the analysis of other types of entrepreneurial ecosystems, such as start-up networks and makers’ communities. Practical implications Agent-based model can support policymakers in identifying situated factors that can be leveraged to produce changes at the macro-level through the identification of suitable incentives and social networks re-engineering. Originality/value The paper presents a novel perspective on EL and offers evidence that micro-learning strategies adopted and developed in routine business transactions do have an impact on firms’ performances (survival and growth) as well as on systemic performances related to the creation and diffusion of innovation in firms networks.


2021 ◽  
Author(s):  
Maria Coto-Sarmiento ◽  
Simon Carrignon

The goal of this study is to analyse the transmission of technical skills among potters within the Roman Empire. Specifically, our case study has been focused on the production processes based on Baetica province (currently Andalusia) from 1st to 3rd century AD. Variability of material culture allows observing different production patterns that can explain how social learning evolves. Some differences can be detected in the making techniques processes through time and space that might explain different degrees of specialization. Unfortunately, it is extremely difficult to identify some evidence of social learning strategies in the archaeological record. In Archaeology, this process has been analysed by the study of the production of handmade pottery. In our case, we want to know if the modes of transmission could be similar with a more standardized production as Roman Age. We propose here an Agent-Based Model to compare different cultural processes of learning transmission. Archaeological evidence will be used to design the model. In this model, we implement a simple mechanism of pottery production with different social learning processes under different scenarios. In particular, the aim of this study is to quantify which one of those processes explain better the copying mechanisms among potters revealed in our dataset. We believe that the model presented here can provide a strong baseline for the exploration of transmission processes related to large-scale production.


2020 ◽  
Author(s):  
Junjiang Li ◽  
Philippe J. Giabbanelli

AbstractThere is a range of public health tools and interventions to address the global pandemic of COVID-19. Although it is essential for public health efforts to comprehensively identify which interventions have the largest impact on preventing new cases, most of the modeling studies that support such decision-making efforts have only considered a very small set of interventions. In addition, previous studies predominantly considered interventions as independent or examined a single scenario in which every possible intervention was applied. Reality has been more nuanced, as a subset of all possible interventions may be in effect for a given time period, in a given place. In this paper, we use cloud-based simulations and a previously published Agent-Based Model of COVID-19 (Covasim) to measure the individual and interacting contribution of interventions on reducing new infections in the US over 6 months. Simulated interventions include face masks, working remotely, stay-at-home orders, testing, contact tracing, and quarantining. Through a factorial design of experiments, we find that mask wearing together with transitioning to remote work/schooling has the largest impact. Having sufficient capacity to immediately and effectively perform contact tracing has a smaller contribution, primarily via interacting effects.


2019 ◽  
Vol 142 (7) ◽  
Author(s):  
John Meluso ◽  
Jesse Austin-Breneman ◽  
Jose Uribe

Abstract Communication has been shown to affect the design of large-scale complex engineered systems. Drawing from engineering design, communication, and management literature, this work defines miscommunication as when communication results in a “deficiency” or “problem” that hinders parties from fulfilling their values. This article details a consequential example of miscommunication at a Fortune 500 engineering firm with the potential to affect system performance. In phase 1, interviews with engineering practitioners (n = 82) identified disagreement about what constitutes a parameter “estimate” in the design process. Phase 2 surveyed engineering practitioners (n = 128) about whether estimates communicated for system-level tracking approximate “current” design statuses or “future” design projections. The survey found that both definitions existed throughout the organization and did not correlate with subsystem, position, or design phase. Engineers inadvertently aggregated both current and future estimates into single system-level parameters that informed decision-making, thereby constituting widespread or systemic miscommunication. Thus, even technical concepts may be susceptible to miscommunication and could affect system performance.


2019 ◽  
Vol 271 ◽  
pp. 06007
Author(s):  
Millard McElwee ◽  
Bingyu Zhao ◽  
Kenichi Soga

The primary focus of this research is to develop and implement an agent-based model (ABM) to analyze the New Orleans Metropolitan transportation network near real-time. ABMs have grown in popularity because of their ability to analyze multifaceted community scale resilience with hundreds of thousands of links and millions of agents. Road closures and reduction in capacities are examples of influences on the weights or removal of edges which can affect the travel time, speed, and route of agents in the transportation model. Recent advances in high-performance computing (HPC) have made modeling networks on the city scale much less computationally intensive. We introduce an open-source ABM which utilizes parallel distributed computing to enable faster convergence to large scale problems. We simulate 50,000 agents on the entire southeastern Louisiana road network and part of Mississippi as well. This demonstrates the capability to simulate both city and regional scale transportation networks near real time.


2016 ◽  
Vol 38 (1) ◽  
Author(s):  
Simon Tobias Franzmann ◽  
Johannes Schmitt

AbstractIn politics, we often observe stasis when, at first sight, no reason exists for such policy blockades. In contrast., we sometimes see policy change when one would expect blockades resulting from veto points or countervailing majorities. How can we explain these contradictory results concerning policy stability? In order to solve this theoretical puzzle, we develop an agent-based model (ABM). We combine established models of veto player theory (Tsebelis 2002: Ganghof-Bräuninger 2006) with the findings of political sociology and party competition. By aggregating previous party-level findings, we show that dynamic representation (Stimson et. al. 1995) provides an additional mechanism that can explain these macro-level outcomes. Parties behaving responsively to their electorate do not automatically guarantee perfect responsivity on the party system level. Further, if opposition parties also fear punishment by the electorate for government inaction, the opposition behaves more accommodatingly than previous approaches have predicted.


Sign in / Sign up

Export Citation Format

Share Document