Weak Bisimulation Metrics in Models with Nondeterminism and Continuous State Spaces

2018 ◽  
pp. 292-312 ◽  
Author(s):  
Ruggero Lanotte ◽  
Simone Tini
Keyword(s):  
State Spaces ◽  
Weak Bisimulation ◽  
Continuous State

scholarly journals A New Improved Penalty Avoiding Rational Policy Making Algorithm for Keepaway with Continuous State Spaces

2009 ◽  
Vol 13 (6) ◽  
pp. 675-682 ◽  
Author(s):  
Takuji Watanabe ◽  
◽  
Kazuteru Miyazaki ◽  
Hiroaki Kobayashi ◽  
◽  
...  
Keyword(s):  
Basis Function ◽  
Function Approximation ◽  
Policy Making ◽  
Basis Functions ◽  
State Spaces ◽  
Soccer Game ◽  
Continuous State ◽  
Current Input ◽  
Multiagent Environments ◽  
Parp 1

The penalty avoiding rational policy making algorithm (PARP) [1] previously improved to save memory and cope with uncertainty, i.e., IPARP [2], requires that states be discretized in real environments with continuous state spaces, using function approximation or some other method. Especially, in PARP, a method that discretizes state using a basis functions is known [3]. Because this creates a new basis function based on the current input and its next observation, however, an unsuitable basis function may be generated in some asynchronous multiagent environments. We therefore propose a uniform basis function and range extent of the basis function is estimated before learning. We show the effectiveness of our proposal using a soccer game task called “Keepaway.”

Stable running of a planar underactuated biped robot

Robotica ◽  
2010 ◽  
Vol 29 (5) ◽  
pp. 657-665 ◽  
Author(s):  
Yong Hu ◽  
Gangfeng Yan ◽  
Zhiyun Lin
Keyword(s):  
Limit Cycle ◽  
Stance Phase ◽  
Control Strategies ◽  
Basin Of Attraction ◽  
Biped Robot ◽  
State Spaces ◽  
Continuous State ◽  
Event Based ◽  
Telescopic Legs ◽  
The Basin Of Attraction

SUMMARYThis paper investigates the stable-running problem of a planar underactuated biped robot, which has two springy telescopic legs and one actuated joint in the hip. After modeling the robot as a hybrid system with multiple continuous state spaces, a natural passive limit cycle, which preserves the system energy at touchdown, is found using the method of Poincaré shooting. It is then checked that the passive limit cycle is not stable. To stabilize the passive limit cycle, an event-based feedback control law is proposed, and also to enlarge the basin of attraction, an additive passivity-based control term is introduced only in the stance phase. The validity of our control strategies is illustrated by a series of numerical simulations.

scholarly journals An Extension of the Rational Policy Making algorithm to Continuous State Spaces

2007 ◽  
Vol 22 ◽  
pp. 332-341 ◽  
Author(s):  
Kazuteru Miyazaki ◽  
Hajime Kimura ◽  
Shigenobu Kobayashi
Keyword(s):  
Policy Making ◽  
State Spaces ◽  
Continuous State

scholarly journals COVID-19: A Data-Driven Mean-Field-Type Game Perspective

2020 ◽  
Author(s):  
Hamidou Tembine
Keyword(s):  
Mean Field ◽  
Decision Makers ◽  
Data Driven ◽  
Feedback Form ◽  
State Spaces ◽  
Hospital Capacity ◽  
Field Type ◽  
Adjoint Systems ◽  
Continuous State ◽  
Reported Data

In this article, a class of mean-field-type games with discrete-continuous state spaces is considered. We establish Bellman systems which provide sufficiency conditions for mean-field-type equilibria in state-and-mean-field-type feedback form. We then derive unnormalized master adjoint systems (MASS). The methodology is shown to be flexible enough to capture multi-class interaction in epidemic propagation in which multiple authorities are risk-aware atomic decision-makers and individuals are risk-aware non-atomic decision-makers. Based on MASS, we present a data-driven modelling and analytics for mitigating Coronavirus Disease 2019 (COVID-19). The model integrates untested cases, age-structure, decision-making, gender, pre-existing health conditions, location, testing capacity, hospital capacity, mobility map on local areas, in-city, inter-cities, and international. It shown that the data-driven model can capture most of the reported data on COVID-19 on confirmed cases, deaths, recovered, number of testing and number of active cases in 66+ countries. The model also reports non-Gaussianity and non-exponential properties in 15+ countries.

scholarly journals Seven easy lessons introducing non-equilibrium statistical mechanics and (bio)physical chemistry

2020 ◽  
Author(s):  
Daniel Zuckerman
Keyword(s):  
State Spaces ◽  
Chemical Systems ◽  
Markov State Models ◽  
Continuous State ◽  
Modern Physics ◽  
Three State Model ◽  
State Models ◽  
Introductory Discussion ◽  
The Relationship ◽  
Non Equilibrium

The non-equilibrium principles and methods which are fundamental to understanding modern physics, biology, and chemistry can be intimidating. The key to learning them is working through simple, concrete examples. The beginner must do calculations by hand to truly grasp how the equations and ideas work together. Hence, seven sets of homework problems are given -- using two and three-state model chemical systems -- along with introductory discussion, complete solutions, and links to further discussion. The problems use simple math and graphics to introduce equilibrium, relaxation, non-equilibrium steady states and the associated timescales, using discrete and continuous state spaces as well as continuous and discrete time (``Markov state models''). The relationship between these descriptions is explained. The overall aim is to provide a set of easily approachable material that will significantly increase the student's confidence in approaching more advanced material.

scholarly journals COVID-19: Data-Driven Mean-Field-Type Game Perspective

Games ◽  
2020 ◽  
Vol 11 (4) ◽  
pp. 51
Author(s):  
Hamidou Tembine
Keyword(s):  
Mean Field ◽  
Decision Makers ◽  
Data Driven ◽  
Feedback Form ◽  
State Spaces ◽  
Field Type ◽  
Adjoint Systems ◽  
Continuous State ◽  
Non Gaussian ◽  
Reported Data

In this article, a class of mean-field-type games with discrete-continuous state spaces is considered. We establish Bellman systems which provide sufficiency conditions for mean-field-type equilibria in state-and-mean-field-type feedback form. We then derive unnormalized master adjoint systems (MASS). The methodology is shown to be flexible enough to capture multi-class interaction in epidemic propagation in which multiple authorities are risk-aware atomic decision-makers and individuals are risk-aware non-atomic decision-makers. Based on MASS, we present a data-driven modelling and analytics for mitigating Coronavirus Disease 2019 (COVID-19). The model integrates untested cases, age-structure, decision-making, gender, pre-existing health conditions, location, testing capacity, hospital capacity, and a mobility map of local areas, including in-cities, inter-cities, and internationally. It is shown that the data-driven model can capture most of the reported data on COVID-19 on confirmed cases, deaths, recovered, number of testing and number of active cases in 66+ countries. The model also reports non-Gaussian and non-exponential properties in 15+ countries.

Sign in / Sign up

Export Citation Format

Share Document