scholarly journals Multi-agent path topology in support of socially competent navigation planning

2018 ◽  
Vol 38 (2-3) ◽  
pp. 338-356 ◽  
Author(s):  
Christoforos I Mavrogiannis ◽  
Ross A Knepper
Keyword(s):  
Decision Making ◽  
Statistical Significance ◽  
Compact Representation ◽  
Inference Mechanism ◽  
Agent Behavior ◽  
Topological Reasoning ◽  
Planning Framework ◽  
Multi Agent ◽  
Path Topology ◽  
Navigation Planning

We present a navigation planning framework for dynamic, multi-agent environments, where no explicit communication takes place among agents. Inspired by the collaborative nature of human navigation, our approach encodes the concept of coordination into an agent’s decision making through an inference mechanism about collaborative strategies of collision avoidance. Each such strategy represents a distinct avoidance protocol, prescribing a distinct class of navigation behaviors to agents. We model such classes as equivalence classes of multi-agent path topology, using the formalism of topological braids. This formalism may naturally encode any arbitrarily complex, spatiotemporal, multi-agent behavior, in any environment with any number of agents into a compact representation of dual algebraic and geometric nature. This enables us to construct a probabilistic inference mechanism that predicts the collective strategy of avoidance among multiple agents, based on observation of agents’ past behaviors. We incorporate this mechanism into an online planner that enables an agent to understand a multi-agent scene and determine an action that not only contributes progress towards its destination, but also reduction of the uncertainty of other agents regarding the agent’s role in the emerging strategy of avoidance. This is achieved by picking actions that compromise between energy efficiency and compliance with everyone’s inferred avoidance intentions. We evaluate our approach by comparing against a greedy baseline that only maximizes individual efficiency. Simulation results of statistical significance demonstrate that our planner results in a faster uncertainty decrease that facilitates the decision-making process of co-present agents. The algorithm’s performance highlights the importance of topological reasoning in decentralized, multi-agent planning and appears promising for real-world applications in crowded human environments.

scholarly journals Spending Political Capital*

2021 ◽  
Author(s):  
Arthur Campbell
Keyword(s):  
Decision Making ◽  
Incentive Contracts ◽  
Important Task ◽  
Political Capital ◽  
Alternative Mechanism ◽  
Team Size ◽  
Current Period ◽  
Multi Agent ◽  
Participation In Decision Making ◽  
Number Of Individuals

Abstract An important task for organizations is establishing truthful communication between parties with differing interests. This task is made particularly challenging when the accuracy of the information is poorly observed or not at all. In these settings, incentive contracts based on the accuracy of information will not be very effective. This paper considers an alternative mechanism that does not require any signal of the accuracy of any information communicated to provide incentives for truthful communication. Rather, an expert sacrifices future participation in decision-making to influence the current period’s decision in favour of their preferred project. This mechanism captures a notion often described as ‘political capital’ whereby an individual is able to achieve their own preferred decision in the current period at the expense of being able to exert influence in future decisions (‘spending political capital’). When the first-best is not possible in this setting, I show that experts hold more influence than under the first-best and that, in a multi-agent extension, a finite team size is optimal. Together these results suggest that a small number of individuals hold excessive influence in organizations.

scholarly journals A Confrontation Decision-Making Method with Deep Reinforcement Learning and Knowledge Transfer for Multi-Agent System

Symmetry ◽  
2020 ◽  
Vol 12 (4) ◽  
pp. 631
Author(s):  
Chunyang Hu
Keyword(s):  
Decision Making ◽  
Reinforcement Learning ◽  
Knowledge Transfer ◽  
Large Scale ◽  
Effective Control ◽  
Small Scale ◽  
Learning Agent ◽  
Multi Agent ◽  
Transfer Method ◽  
Parameter Sharing

In this paper, deep reinforcement learning (DRL) and knowledge transfer are used to achieve the effective control of the learning agent for the confrontation in the multi-agent systems. Firstly, a multi-agent Deep Deterministic Policy Gradient (DDPG) algorithm with parameter sharing is proposed to achieve confrontation decision-making of multi-agent. In the process of training, the information of other agents is introduced to the critic network to improve the strategy of confrontation. The parameter sharing mechanism can reduce the loss of experience storage. In the DDPG algorithm, we use four neural networks to generate real-time action and Q-value function respectively and use a momentum mechanism to optimize the training process to accelerate the convergence rate for the neural network. Secondly, this paper introduces an auxiliary controller using a policy-based reinforcement learning (RL) method to achieve the assistant decision-making for the game agent. In addition, an effective reward function is used to help agents balance losses of enemies and our side. Furthermore, this paper also uses the knowledge transfer method to extend the learning model to more complex scenes and improve the generalization of the proposed confrontation model. Two confrontation decision-making experiments are designed to verify the effectiveness of the proposed method. In a small-scale task scenario, the trained agent can successfully learn to fight with the competitors and achieve a good winning rate. For large-scale confrontation scenarios, the knowledge transfer method can gradually improve the decision-making level of the learning agent.

Freight Travel Demand Modeling: Synthesis of Approaches and Development of a Framework

2000 ◽  
Vol 1725 (1) ◽  
pp. 9-16 ◽  
Author(s):  
Ram M. Pendyala ◽  
Venky N. Shankar ◽  
Robert G. McCullough
Keyword(s):  
Decision Making ◽  
Transportation Planning ◽  
Travel Demand ◽  
Freight Transportation ◽  
The Body ◽  
Travel Demand Modeling ◽  
Demand Modeling ◽  
Transportation Sector ◽  
Planning Framework ◽  
Freight Data Needs

It is increasingly being recognized at all levels of decision making that freight transportation and economic development are inextricably linked. As a result, many urban entities and states are embarking upon comprehensive freight transportation planning efforts aimed at ensuring safe, efficient, and smooth movement of freight along multimodal and intermodal networks. Over the past few decades there has been considerable published research on (1) freight transportation factors, (2) freight travel demand modeling methods, (3) freight transportation planning issues, and (4) freight data needs, deficiencies, and collection methods. A synthesis of the body of knowledge in these four areas is provided with a view to developing a comprehensive statewide freight transportation planning framework. The proposed framework consists of two interrelated components that facilitate demand estimation and decision making in the freight transportation sector.

Sign in / Sign up

Export Citation Format

Share Document