scholarly journals Searching for rewards in graph-structured spaces

2019 ◽  
Author(s):  
Eric Schulz ◽  
Charley M Wu
Keyword(s):  
Reinforcement Learning ◽  
Regression Model ◽  
Gaussian Process ◽  
Predictive Model ◽  
Human Behavior ◽  
Model Comparison ◽  
Gaussian Process Regression ◽  
Diffusion Kernel ◽  
Function Learning ◽  
Psychological Models

How do people generalize and explore structured spaces? We study human behavior on a multi-armed bandit task, where rewards are influenced by the connectivity structure of a graph. A detailed predictive model comparison shows that a Gaussian Process regression model using a diffusion kernel is able to best describe participant choices, and also predict judgments about expected reward and confidence. This model unifies psychological models of function learning with the Successor Representation used in reinforcement learning, thereby building a bridge between different models of generalization.

Anomaly Detection in Video Surveillance via Gaussian Process

2015 ◽  
Vol 29 (06) ◽  
pp. 1555011 ◽  
Author(s):  
Nannan Li ◽  
Xinyu Wu ◽  
Huiwen Guo ◽  
Dan Xu ◽  
Yongsheng Ou ◽  
...  
Keyword(s):  
Anomaly Detection ◽  
Regression Model ◽  
Gaussian Process ◽  
Video Surveillance ◽  
Gaussian Process Regression ◽  
Bayesian Regression ◽  
Current Frame ◽  
Motion Patterns ◽  
Online Clustering ◽  
Efficient Calculation

In this paper, we propose a new approach for anomaly detection in video surveillance. This approach is based on a nonparametric Bayesian regression model built upon Gaussian process priors. It establishes a set of basic vectors describing motion patterns from low-level features via online clustering, and then constructs a Gaussian process regression model to approximate the distribution of motion patterns in kernel space. We analyze different anomaly measure criterions derived from Gaussian process regression model and compare their performances. To reduce false detections caused by crowd occlusion, we utilize supplement information from previous frames to assist in anomaly detection for current frame. In addition, we address the problem of hyperparameter tuning and discuss the method of efficient calculation to reduce computation overhead. The approach is verified on published anomaly detection datasets and compared with other existing methods. The experiment results demonstrate that it can detect various anomalies efficiently and accurately.

Application of Gaussian Process Regression Model to Predict Discharge Coefficient of Gated Piano Key Weir

2019 ◽  
Vol 33 (11) ◽  
pp. 3929-3947 ◽  
Author(s):  
Masood Akbari ◽  
Farzin Salmasi ◽  
Hadi Arvanaghi ◽  
Masoud Karbasi ◽  
Davood Farsadizadeh
Keyword(s):  
Regression Model ◽  
Gaussian Process ◽  
Discharge Coefficient ◽  
Gaussian Process Regression ◽  
Piano Key Weir

Validation of Adaptive Gaussian Process Regression Model Used for SIF Prediction

2018 ◽  
Author(s):  
Arvind Keprate ◽  
R. M. Chandima Ratnayake ◽  
Shankar Sankararaman
Keyword(s):  
Regression Model ◽  
Gaussian Process ◽  
Prediction Accuracy ◽  
Experimental Validation ◽  
Gaussian Process Regression ◽  
Absolute Error ◽  
Coefficient Of Determination ◽  
Data Sets ◽  
Maximum Absolute Error ◽  
Data Points

The main aim of this paper is to perform the validation of the adaptive Gaussian process regression model (AGPRM) developed by the authors for the Stress Intensity Factor (SIF) prediction of a crack propagating in topside piping. For validation purposes, the values of SIF obtained from experiments available in the literature are used. Sixty-six data points (consisting of L, a, c and SIF values obtained by experiments) are used to train the AGPRM, while four independent data sets are used for validation purposes. The experimental validation of the AGPRM also consists of the comparison of the prediction accuracy of AGPRM and Finite Element Method (FEM) relative to the experimentally derived SIF values. Four metrics, namely, Root Mean Square Error (RMSE), Average Absolute Error (AAE), Maximum Absolute Error (MAE), and Coefficient of Determination (R2), are used to compare the accuracy. A case study illustrating the development and experimental validation of the AGPRM is presented. Results indicate that the prediction accuracy of the AGPRM is comparable with and even higher than that of the FEM, provided the training points of the AGPRM are aptly chosen.

scholarly journals An Efficient Radio Map Updating Algorithm based on K-Means and Gaussian Process Regression

2018 ◽  
Vol 71 (5) ◽  
pp. 1055-1068 ◽  
Author(s):  
Jianli Zhao ◽  
Xiang Gao ◽  
Xin Wang ◽  
Chunxiu Li ◽  
Min Song ◽  
...  
Keyword(s):  
Computational Complexity ◽  
Gaussian Process ◽  
Predictive Model ◽  
Gaussian Process Regression ◽  
Environment Changes ◽  
Model Based ◽  
Map Updating ◽  
Mean Function ◽  
Radio Map ◽  
Indoor Localisation

Fingerprint-based indoor localisation suffers from influences such as fingerprint pre-collection, environment changes and expending a lot of manpower and time to update the radio map. To solve the problem, we propose an efficient radio map updating algorithm based on K-Means and Gaussian Process Regression (KMGPR). The algorithm builds a Gaussian Process Regression (GPR) predictive model based on a Gaussian mean function and realises the update of the radio map using K-Means. We have conducted experiments to evaluate the performance of the proposed algorithm and results show that GPR using the Gaussian mean function improves localisation accuracy by about 13·76% compared with other functions and KMGPR can reduce the computational complexity by about 7% to 20% with no obvious effects on accuracy.

scholarly journals A GAUSSIAN PROCESS BASED MULTI-PERSON INTERACTION MODEL

2016 ◽  
Vol III-3 ◽  
pp. 271-277
Author(s):  
T. Klinger ◽  
F. Rottensteiner ◽  
C. Heipke
Keyword(s):  
Gaussian Process ◽  
Predictive Model ◽  
Interaction Model ◽  
Gaussian Process Regression ◽  
Image Sequences ◽  
Missing Measurements ◽  
Recursive Filters ◽  
True Motion ◽  
Multi Person Tracking ◽  
Crowded Scenes

Online multi-person tracking in image sequences is commonly guided by recursive filters, whose predictive models define the expected positions of future states. When a predictive model deviates too much from the true motion of a pedestrian, which is often the case in crowded scenes due to unpredicted accelerations, the data association is prone to fail. In this paper we propose a novel predictive model on the basis of Gaussian Process Regression. The model takes into account the motion of every tracked pedestrian in the scene and the prediction is executed with respect to the velocities of all interrelated persons. As shown by the experiments, the model is capable of yielding more plausible predictions even in the presence of mutual occlusions or missing measurements. The approach is evaluated on a publicly available benchmark and outperforms other state-of-the-art trackers.

Sign in / Sign up

Export Citation Format

Share Document