Genetic Algorithms for model refinement and rule discovery in a high-dimensional agent-based model of inflammation

AbstractIntroductionAgent-based modeling frequently used modeling method for multi-scale mechanistic modeling. However, the same properties that make agent-based models (ABMs) well suited to representing biological systems also present significant challenges with respect to their construction and calibration, particularly with respect to the selection of potential mechanistic rules and the large number of free parameters often present in these models. We have proposed that various machine learning approaches (such as genetic algorithms (GAs)) can be used to more effectively and efficiently deal with rule selection and parameter space characterization; the current work applies GAs to the challenge of calibrating a complex ABM to a specific data set, while preserving biological heterogeneity.MethodsThis project uses a GA to augment the rule-set for a previously validated ABM of acute systemic inflammation, the Innate Immune Response ABM (IIRABM) to clinical time series data of systemic cytokine levels from a population of burn patients. The genome for the GA is a vector generated from the IIRABM’s Model Rule Matrix (MRM), which is a matrix representation of not only the constants/parameters associated with the IIRABM’s cytokine interaction rules, but also the existence of rules themselves. Capturing heterogeneity is accomplished by a fitness function that incorporates the sample value range (“error bars”) of the clinical data.ResultsThe GA-enabled parameter space exploration resulted in a set of putative MRM rules and associated parameterizations which closely match the cytokine time course data used to design the fitness function. The number of non-zero elements in the MRM increases significantly as the model parameterizations evolve towards a fitness function minimum, transitioning from a sparse to a dense matrix. This results in a model structure that more closely resembles (at a superficial level) the structure of data generated by a standard differential gene expression experimental study.ConclusionWe present an HPC-enabled evolutionary computing approach to calibrate a complex ABM to clinical data while preserving biological heterogeneity. The integration of machine learning, HPC, and multi-scale mechanistic modeling provides a pathway forward to effectively represent the heterogeneity of clinical populations and their data.Author SummaryIn this work, we utilize genetic algorithms (GA) to operate on the internal rule set of a computational of the human immune response to injury, the Innate Immune Response Agent-Based Model (IIRABM), such that it is iteratively refined to generate cytokine time series that closely match what is seen in a clinical cohort of burn patients. At the termination of the GA, there exists an ensemble of candidate model rule-sets/parameterizations which are validated by the experimental data;

Download Full-text

Utilizing the Heterogeneity of Clinical Data for Model Refinement and Rule Discovery Through the Application of Genetic Algorithms to Calibrate a High-Dimensional Agent-Based Model of Systemic Inflammation

Frontiers in Physiology ◽

10.3389/fphys.2021.662845 ◽

2021 ◽

Vol 12 ◽

Author(s):

Chase Cockrell ◽

Gary An

Keyword(s):

Machine Learning ◽

Genetic Algorithms ◽

Systemic Inflammation ◽

Clinical Data ◽

Fitness Function ◽

Mechanistic Modeling ◽

Data Set ◽

Agent Based ◽

Multi Scale ◽

Biological Heterogeneity

Introduction: Accounting for biological heterogeneity represents one of the greatest challenges in biomedical research. Dynamic computational and mathematical models can be used to enhance the study and understanding of biological systems, but traditional methods for calibration and validation commonly do not account for the heterogeneity of biological data, which may result in overfitting and brittleness of these models. Herein we propose a machine learning approach that utilizes genetic algorithms (GAs) to calibrate and refine an agent-based model (ABM) of acute systemic inflammation, with a focus on accounting for the heterogeneity seen in a clinical data set, thereby avoiding overfitting and increasing the robustness and potential generalizability of the underlying simulation model.Methods: Agent-based modeling is a frequently used modeling method for multi-scale mechanistic modeling. However, the same properties that make ABMs well suited to representing biological systems also present significant challenges with respect to their construction and calibration, particularly with respect to the selection of potential mechanistic rules and the large number of associated free parameters. We have proposed that machine learning approaches (such as GAs) can be used to more effectively and efficiently deal with rule selection and parameter space characterization; the current work applies GAs to the challenge of calibrating a complex ABM to a specific data set, while preserving biological heterogeneity reflected in the range and variance of the data. This project uses a GA to augment the rule-set for a previously validated ABM of acute systemic inflammation, the Innate Immune Response ABM (IIRABM) to clinical time series data of systemic cytokine levels from a population of burn patients. The genome for the GA is a vector generated from the IIRABM’s Model Rule Matrix (MRM), which is a matrix representation of not only the constants/parameters associated with the IIRABM’s cytokine interaction rules, but also the existence of rules themselves. Capturing heterogeneity is accomplished by a fitness function that incorporates the sample value range (“error bars”) of the clinical data.Results: The GA-enabled parameter space exploration resulted in a set of putative MRM rules and associated parameterizations which closely match the cytokine time course data used to design the fitness function. The number of non-zero elements in the MRM increases significantly as the model parameterizations evolve toward a fitness function minimum, transitioning from a sparse to a dense matrix. This results in a model structure that more closely resembles (at a superficial level) the structure of data generated by a standard differential gene expression experimental study.Conclusion: We present an HPC-enabled machine learning/evolutionary computing approach to calibrate a complex ABM to complex clinical data while preserving biological heterogeneity. The integration of machine learning, HPC, and multi-scale mechanistic modeling provides a pathway forward to more effectively representing the heterogeneity of clinical populations and their data.

Download Full-text

Determining controllability of sepsis using genetic algorithms on a proxy agent-based model of systemic inflammation

10.1101/153080 ◽

2017 ◽

Author(s):

Chase Cockrell ◽

Gary An

Keyword(s):

Immune Response ◽

Immune System ◽

Mortality Rate ◽

Inflammatory Response ◽

Disease Process ◽

The United States ◽

Innate Immune ◽

Agent Based ◽

Human Immune ◽

Inflammatory Response To Injury

AbstractSepsis, a manifestation of the body’s inflammatory response to injury and infection, has a mortality rate of between 28%-50% and affects approximately 1 million patients annually in the United States. Currently, there are no therapies targeting the cellular/molecular processes driving sepsis that have demonstrated the ability to control this disease process in the clinical setting. We propose that this is in great part due to the considerable heterogeneity of the clinical trajectories that constitute clinical “sepsis,” and that determining how this system can be controlled back into a state of health requires the application of concepts drawn from the field of dynamical systems. In this work, we consider the human immune system to be a random dynamical system, and investigate its potential controllability using an agent-based model of the innate immune response (the Innate Immune Response ABM or IIRABM) as a surrogate, proxy system. Simulation experiments with the IIRABM provide an explanation as to why single/limited cytokine perturbations at a single, or small number of, time points is unlikely to significantly improve the mortality rate of sepsis. We then use genetic algorithms (GA) to explore and characterize multi-targeted control strategies for the random dynamical immune system that guide it from a persistent, non-recovering inflammatory state (functionally equivalent to the clinical states of systemic inflammatory response syndrome (SIRS) or sepsis) to a state of health. We train the GA on a single parameter set with multiple stochastic replicates, and show that while the calculated results show good generalizability, more advanced strategies are needed to achieve the goal of adaptive personalized medicine. This work evaluating the extent of interventions needed to control a simplified surrogate model of sepsis provides insight into the scope of the clinical challenge, and can serve as a guide on the path towards true “precision control” of sepsis.Author summarySepsis, characterized by the body’s inflammatory response to injury and infection, has a mortality rate of between 28%-50% and affects approximately 1 million patients annually in the United States. Currently, there are no therapies targeting the cellular/molecular processes driving sepsis that have demonstrated the ability to control this disease process. In this work, we utilize a computational model of the human immune response to infectious injury to offer an explanation as to why previously attempted treatment strategies are inadequate and why the current approach to drug/therapy-development is inadequate. We then use evolutionary computation algorithms to explore drug-intervention space using this same computational model. This allows us to characterize the scale and scope of interventions needed to successfully control sepsis, as well as the types of data needed to derive these interventions. We demonstrate that multi-point and time-dependent varying controls are necessary and able to control the cytokine network dynamics of the immune system.

Download Full-text

Oral Immune Activation by Disgust and Disease-Related Pictures

Journal of Psychophysiology ◽

10.1027/0269-8803/a000143 ◽

2015 ◽

Vol 29 (3) ◽

pp. 119-129 ◽

Cited By ~ 4

Author(s):

Richard J. Stevenson ◽

Deborah Hodgson ◽

Megan J. Oaten ◽

Luba Sominsky ◽

Mehmet Mahmut ◽

...

Keyword(s):

Immune Response ◽

Immune Responses ◽

Innate Immune Response ◽

Negative Control ◽

Innate Immune ◽

Innate Immune Responses ◽

Immune Markers ◽

Before And After ◽

Secondary Analyses ◽

Image Set

Abstract. Both disgust and disease-related images appear able to induce an innate immune response but it is unclear whether these effects are independent or rely upon a common shared factor (e.g., disgust or disease-related cognitions). In this study we directly compared these two inductions using specifically generated sets of images. One set was disease-related but evoked little disgust, while the other set was disgust evoking but with less disease-relatedness. These two image sets were then compared to a third set, a negative control condition. Using a wholly within-subject design, participants viewed one image set per week, and provided saliva samples, before and after each viewing occasion, which were later analyzed for innate immune markers. We found that both the disease related and disgust images, relative to the negative control images, were not able to generate an innate immune response. However, secondary analyses revealed innate immune responses in participants with greater propensity to feel disgust following exposure to disease-related and disgusting images. These findings suggest that disgust images relatively free of disease-related themes, and disease-related images relatively free of disgust may be suboptimal cues for generating an innate immune response. Not only may this explain why disgust propensity mediates these effects, it may also imply a common pathway.

Download Full-text