Moderate deviations-based importance sampling for stochastic recursive equations

2017 ◽  
Vol 49 (4) ◽  
pp. 981-1010 ◽  
Author(s):  
Paul Dupuis ◽  
Dane Johnson
Keyword(s):  
Large Deviations ◽  
Importance Sampling ◽  
Bellman Equation ◽  
Moderate Deviation ◽  
Moderate Deviations ◽  
Asymptotically Optimal ◽  
Hamilton Jacobi Bellman Equation ◽  
Hamilton Jacobi Bellman ◽  
Recursive Equations ◽  
Stochastic Recursive Equations

Abstract Subsolutions to the Hamilton–Jacobi–Bellman equation associated with a moderate deviations approximation are used to design importance sampling changes of measure for stochastic recursive equations. Analogous to what has been done for large deviations subsolution-based importance sampling, these schemes are shown to be asymptotically optimal under the moderate deviations scaling. We present various implementations and numerical results to contrast their performance, and also discuss the circumstances under which a moderate deviation scaling might be appropriate.

Interception of automated adversarial drone swarms in partially observed environments

2021 ◽  
pp. 1-14
Author(s):  
Daniel Saranovic ◽  
Martin Pavlovski ◽  
William Power ◽  
Ivan Stojkovic ◽  
Zoran Obradovic
Keyword(s):  
Bellman Equation ◽  
Pid Controllers ◽  
Partially Observed ◽  
Hamilton Jacobi Bellman Equation ◽  
Partial Feedback ◽  
Point Solution ◽  
Physical Limitations ◽  
Defensive Mechanisms ◽  
Hamilton Jacobi Bellman ◽  
New Framework

As the prevalence of drones increases, understanding and preparing for possible adversarial uses of drones and drone swarms is of paramount importance. Correspondingly, developing defensive mechanisms in which swarms can be used to protect against adversarial Unmanned Aerial Vehicles (UAVs) is a problem that requires further attention. Prior work on intercepting UAVs relies mostly on utilizing additional sensors or uses the Hamilton-Jacobi-Bellman equation, for which strong conditions need to be met to guarantee the existence of a saddle-point solution. To that end, this work proposes a novel interception method that utilizes the swarm’s onboard PID controllers for setting the drones’ states during interception. The drone’s states are constrained only by their physical limitations, and only partial feedback of the adversarial drone’s positions is assumed. The new framework is evaluated in a virtual environment under different environmental and model settings, using random simulations of more than 165,000 swarm flights. For certain environmental settings, our results indicate that the interception performance of larger swarms under partial observation is comparable to that of a one-drone swarm under full observation of the adversarial drone.

Sign in / Sign up

Export Citation Format

Share Document