scholarly journals Coarse Correlation in Extensive-Form Games

2020 ◽  
Vol 34 (02) ◽  
pp. 1934-1941
Author(s):  
Gabriele Farina ◽  
Tommaso Bianchi ◽  
Tuomas Sandholm
Keyword(s):  
Normal Form ◽  
Saddle Points ◽  
Solution Concept ◽  
Correlated Equilibrium ◽  
Extensive Form ◽  
Extensive Form Games ◽  
Rational Agents ◽  
Correlation Models ◽  
Correlated Equilibria ◽  
Special Case

Coarse correlation models strategic interactions of rational agents complemented by a correlation device which is a mediator that can recommend behavior but not enforce it. Despite being a classical concept in the theory of normal-form games since 1978, not much is known about the merits of coarse correlation in extensive-form settings. In this paper, we consider two instantiations of the idea of coarse correlation in extensive-form games: normal-form coarse-correlated equilibrium (NFCCE), already defined in the literature, and extensive-form coarse-correlated equilibrium (EFCCE), a new solution concept that we introduce. We show that EFCCEs are a subset of NFCCEs and a superset of the related extensive-form correlated equilibria. We also show that, in n-player extensive-form games, social-welfare-maximizing EFCCEs and NFCCEs are bilinear saddle points, and give new efficient algorithms for the special case of two-player games with no chance moves. Experimentally, our proposed algorithm for NFCCE is two to four orders of magnitude faster than the prior state of the art.

scholarly journals Decentralized No-regret Learning Algorithms for Extensive-form Correlated Equilibria (Extended Abstract)

2021 ◽  
Author(s):  
Andrea Celli ◽  
Alberto Marchesi ◽  
Gabriele Farina ◽  
Nicola Gatti
Keyword(s):  
Normal Form ◽  
Private Information ◽  
Imperfect Information ◽  
Research Question ◽  
Correlated Equilibrium ◽  
Extensive Form ◽  
Learning Dynamics ◽  
Extensive Form Games ◽  
Normal Form Games ◽  
Correlated Equilibria

The existence of uncoupled no-regret learning dynamics converging to correlated equilibria in normal-form games is a celebrated result in the theory of multi-agent systems. Specifically, it has been known for more than 20 years that when all players seek to minimize their internal regret in a repeated normal-form game, the empirical frequency of play converges to a normal-form correlated equilibrium. Extensive-form games generalize normal-form games by modeling both sequential and simultaneous moves, as well as imperfect information. Because of the sequential nature and the presence of private information, correlation in extensive-form games possesses significantly different properties than in normal-form games. The extensive-form correlated equilibrium (EFCE) is the natural extensive-form counterpart to the classical notion of correlated equilibrium in normal-form games. Compared to the latter, the constraints that define the set of EFCEs are significantly more complex, as the correlation device ({\em a.k.a.} mediator) must take into account the evolution of beliefs of each player as they make observations throughout the game. Due to this additional complexity, the existence of uncoupled learning dynamics leading to an EFCE has remained a challenging open research question for a long time. In this article, we settle that question by giving the first uncoupled no-regret dynamics which provably converge to the set of EFCEs in n-player general-sum extensive-form games with perfect recall. We show that each iterate can be computed in time polynomial in the size of the game tree, and that, when all players play repeatedly according to our learning dynamics, the empirical frequency of play after T game repetitions is guaranteed to be a O(T^-1/2)-approximate EFCE with high probability, and an EFCE almost surely in the limit.

scholarly journals Solving Large Extensive-Form Games with Strategy Constraints

2019 ◽  
Vol 33 ◽  
pp. 1861-1868
Author(s):  
Trevor Davis ◽  
Kevin Waugh ◽  
Michael Bowling
Keyword(s):  
Private Information ◽  
Imperfect Information ◽  
Risk Mitigation ◽  
Solution Concept ◽  
Optimal Strategies ◽  
Linear Constraints ◽  
Convex Constraints ◽  
Extensive Form ◽  
Extensive Form Games ◽  
Large Extensive Form Games

Extensive-form games are a common model for multiagent interactions with imperfect information. In two-player zerosum games, the typical solution concept is a Nash equilibrium over the unconstrained strategy set for each player. In many situations, however, we would like to constrain the set of possible strategies. For example, constraints are a natural way to model limited resources, risk mitigation, safety, consistency with past observations of behavior, or other secondary objectives for an agent. In small games, optimal strategies under linear constraints can be found by solving a linear program; however, state-of-the-art algorithms for solving large games cannot handle general constraints. In this work we introduce a generalized form of Counterfactual Regret Minimization that provably finds optimal strategies under any feasible set of convex constraints. We demonstrate the effectiveness of our algorithm for finding strategies that mitigate risk in security games, and for opponent modeling in poker games when given only partial observations of private information.

scholarly journals Non-altruistic Equilibria

2019 ◽  
Vol 67 (3-4) ◽  
pp. 185-195
Author(s):  
Kazuhiro Ohnishi
Keyword(s):  
Normal Form ◽  
Cooperative Games ◽  
The Other ◽  
Extensive Form ◽  
Extensive Form Games ◽  
Normal Form Games ◽  
Subgame Perfect Equilibria ◽  
Perfect Equilibria ◽  
Non Cooperative Games

Which choice will a player make if he can make one of two choices in which his own payoffs are equal, but his rival’s payoffs are not equal, that is, one with a large payoff for his rival and the other with a small payoff for his rival? This paper introduces non-altruistic equilibria for normal-form games and extensive-form non-altruistic equilibria for extensive-form games as equilibrium concepts of non-cooperative games by discussing such a problem and examines the connections between their equilibrium concepts and Nash and subgame perfect equilibria that are important and frequently encountered equilibrium concepts.

Can quantum entanglement implement classical correlated equilibria?

2014 ◽  
Vol 14 (5&6) ◽  
pp. 493-516
Author(s):  
Alan Deckelbaum
Keyword(s):  
Quantum State ◽  
Complete Information ◽  
Impossibility Result ◽  
Correlated Equilibrium ◽  
Extensive Form ◽  
Initial State ◽  
Equilibrium Distributions ◽  
Pure Quantum State ◽  
Correlated Equilibria ◽  
Classical Game

We ask whether players of a classical game can partition a pure quantum state to implement classical correlated equilibrium distributions. The main contribution of this work is an impossibility result: we provide an example of a classical correlated equilibrium that cannot be securely implemented without useful information leaking outside the system. We study the model where players of a classical complete information game initially share an entangled pure quantum state. Players may perform arbitrary local operations on their subsystems, but no direct communication (either quantum or classical) is allowed. We explain why, for the purpose of implementing classical correlated equilibria, it is desirable to restrict the initial state to be pure and to restrict communication. In this framework, we define the concept of pure quantum correlated equilibrium (PQCE) and show that in a normal form game, any outcome distribution implementable by a PQCE can also be implemented by a classical correlated equilibrium (CE), but that the converse is false. We extend our analysis to extensive form games, and compare the power of PQCE to extensive form classical correlated equilibria (EFCE) and immediate-revelation extensive form correlated equilibria (IR-EFCE).

scholarly journals The Refined Best Reply Correspondence and Backward Induction

2019 ◽  
Vol 20 (1) ◽  
pp. 52-66
Author(s):  
Dieter Balkenborg ◽  
Christoph Kuzmics ◽  
Josef Hofbauer
Keyword(s):  
Normal Form ◽  
Fixed Points ◽  
The Other ◽  
Backward Induction ◽  
Perfect Recall ◽  
Extensive Form ◽  
Remarkable Property ◽  
Extensive Form Games ◽  
Other Hand ◽  
Perfect Equilibria

Abstract Fixed points of the (most) refined best reply correspondence, introduced in Balkenborg et al. (2013), in the agent normal form of extensive form games with perfect recall have a remarkable property. They induce fixed points of the same correspondence in the agent normal form of every subgame. Furthermore, in a well-defined sense, fixed points of this correspondence refine even trembling hand perfect equilibria, while, on the other hand, reasonable equilibria that are not weak perfect Bayesian equilibria are fixed points of this correspondence.

scholarly journals Implementation of Subgame-Perfect Cooperative Agreement in an Extensive-Form Game

2021 ◽  
Vol 14 ◽  
pp. 257-272
Author(s):  
Denis Kuzyutin ◽  
◽  
Yulia Skorodumova ◽  
Nadezhda Smirnova ◽  
◽  
...  
Keyword(s):  
Fishery Management ◽  
Solution Concept ◽  
Extensive Form ◽  
Game Tree ◽  
Extensive Form Games ◽  
Payoff Distribution ◽  
Novel Approach ◽  
Cooperation Incentives ◽  
Subgame Perfection ◽  
The Difference

A novel approach to sustainable cooperation called subgameperfect core (S-P Core) was introduced by P. Chander and M. Wooders in 2020 for n-person extensive-form games with terminal payoffs. This solution concept incorporates both subgame perfection and cooperation incentives and implies certain distribution of the total players' payoff at the terminal node of the cooperative history. We use in the paper an extension of the S-P Core to the class of extensive games with payoffs defined at all nodes of the game tree that is based on designing an appropriate payoff distribution procedure β and its implementation when a game unfolds along the cooperative history. The difference is that in accordance with this so-called β-subgameperfect core the players can redistribute total current payoff at each node in the cooperative path. Moreover, a payoff distribution procedure from the β-S-P Core satisfies a number of good properties such as subgame efficiency, non-negativity and strict balance condition. In the paper, we examine different properties of the β-S-P Core, introduce several refinements of this cooperative solution and provide examples of its implementation in extensive-form games. Finally, we consider an application of the β-S-P Core to the symmetric discrete-time alternating-move model of fishery management.

Extensive Form Rationalizability

2014 ◽  
Author(s):  
Herbert Gintis
Keyword(s):  
Normal Form ◽  
Nash Equilibria ◽  
Common Knowledge ◽  
Backward Induction ◽  
Forward Induction ◽  
Extensive Form ◽  
Extensive Form Games ◽  
Dominated Strategies ◽  
Extensive Form Game ◽  
Common Knowledge Of Rationality

The extensive form of a game is informationally richer than the normal form since players gather information that allows them to update their subjective priors as the game progresses. For this reason, the study of rationalizability in extensive form games is more complex than the corresponding study in normal form games. There are two ways to use the added information to eliminate strategies that would not be chosen by a rational agent: backward induction and forward induction. The latter is relatively exotic (although more defensible). Backward induction, by far the most popular technique, employs the iterated elimination of weakly dominated strategies, arriving at the subgame perfect Nash equilibria—the equilibria that remain Nash equilibria in all subgames. An extensive form game is considered generic if it has a unique subgame perfect Nash equilibrium. This chapter develops the tools of modal logic and presents Robert Aumann's famous proof that common knowledge of rationality (CKR) implies backward induction. It concludes that Aumann is perfectly correct, and the real culprit is CKR itself. CKR is in fact self-contradictory when applied to extensive form games.

Game Theory: Basic Concepts

2014 ◽  
Author(s):  
Herbert Gintis
Keyword(s):  
Game Theory ◽  
Nash Equilibrium ◽  
Normal Form ◽  
Solution Concept ◽  
Correlated Equilibrium ◽  
Suggested Strategy ◽  
Basic Concepts ◽  
Pure Strategies ◽  
Natural Solution ◽  
Classical Game

This chapter deals with the basic concepts of game theory. It presents the formulations for the extensive form, normal form, and Nash equilibrium. It concludes with a brief discussion of correlated equilibrium, a solution concept that has been neglected in classical game theory but is a more natural solution concept than the Nash equilibrium. This is because the correlated equilibrium directly addresses the central weaknesses of the Nash equilibrium concept: its lack of a mechanism for choosing among various equally plausible alternatives, for coordinating the behaviors of players who are indifferent among several pure strategies, and for providing incentives for players to follow the suggested strategy even when they may have private payoffs that would lead self-regarding agents to do otherwise.

Sign in / Sign up

Export Citation Format

Share Document