The link between mind, brain, and behavior has mystified philosophers and scientists for millennia. Recent progress has been made by forming statistical associations between manifest variables of the brain (e.g., EEG, fMRI) and manifest variables of behavior (e.g., response times, accuracy) through hierarchical latent variable models (Turner, Forstmann, & Steyvers, 2019). Within this framework, one can make inferences about the mind in a statistically principled way, such that complex patterns of brain-behavior associations drive the inference procedure. However, previous approaches were limited in the flexibility of the linking function, which has proven prohibitive for understanding the complex dynamics exhibited by the brain. In this article, we propose a data-driven, non-parametric approach that allows complex linking functions to emerge from fitting a hierarchical latent representation of the mind to multivariate, multimodal data. Furthermore, to enforce biological plausibility, we impose both spatial and temporal structure so that the types of realizable system dynamics are constrained. To illustrate the benefits of our approach, we investigate the model’s performance in a simulation study and apply it to experimental data. In the simulation study, we verify that the model can be accurately fit to simulated data, and latent dynamics can be well recovered. In an experimental application, we simultaneously fit the model to fMRI and behavioral data from a continuous motion tracking task. We show that the model accurately recovers both neural and behavioral data, and reveals interesting latent cognitive dynamics. Finally, we provide a test of the model’s generalizability by assessing its predictive accuracy in a cross-validation test.
Gaussian Process Linking Functions for Mind, Brain and Behavior