Quantal response equilibrium

From Wikipedia, the free encyclopedia

Quantal response equilibrium
A solution concept in game theory
Relationships
Superset of	Nash equilibrium, Logit equilibrium
Significance
Proposed by	Richard McKelvey and Thomas Palfrey
Used for	Non-cooperative games
Example	Traveler's dilemma

Quantal response equilibrium (QRE) is a solution concept in game theory. First introduced by Richard McKelvey and Thomas Palfrey, it provides an equilibrium notion with bounded rationality. QRE is not an equilibrium refinement, and it can give significantly different results from Nash equilibrium. QRE is only defined for games with discrete strategies, although there are continuous-strategy analogues.

In a quantal response equilibrium, players are assumed to make errors in choosing which pure strategy to play. The probability of any particular strategy being chosen is positively related to the payoff from that strategy. In other words, very costly errors are unlikely.

The equilibrium arises from the realization of beliefs. A player's payoffs are computed based on beliefs about other players' probability distribution over strategies. In equilibrium, a player's beliefs are correct.

Application to data

When analyzing data from the play of actual games (particularly from laboratory experiments), Nash equilibrium can be unforgiving. Any non-equilibrium move can appear equally "wrong", but realistically should not be used to reject a theory. QRE allows every strategy to be played with non-zero probability, and so any data is possible (though not necessarily reasonable).

Logit equilibrium

By far the most common specification for QRE is logit equilibrium (LQRE). In a logit equilibrium, player's strategies are chosen according to the probability distribution:

$P_{{ij}}={\frac {\exp(\lambda EU_{{ij}}(P_{{-i}}))}{\sum _{k}{\exp(\lambda EU_{{ik}}(P_{{-i}}))}}}$

$P_{{ij}}$ is the probability of player i choosing strategy j. $EU_{{ij}}(P_{{-i}}))$ is the expected utility to player i of choosing strategy j given other players are playing according to the probability distribution $P_{{-i}}$ .

Of particular interest in the logit model is the non-negative parameter λ (sometimes written as 1/μ). λ can be thought of as the rationality parameter. As λ→0, players become "completely irrational", and play each strategy with equal probability. As λ→∞, players become "perfectly rational", and play approaches a Nash equilibrium.

For dynamic games

For dynamic (extensive form) games, McKelvey and Palfrey defined agent quantal response equilibrium (AQRE). AQRE is somewhat analogous to subgame perfection. In an AQRE, each player plays with some error as in QRE. At a given decision node, the player determines the expected payoff of each action by treating their future self as an independent player with a known probability distribution over actions.

As in QRE, in a AQRE every strategy is used with nonzero probability. This provides an additional advantage of AQRE over perfectly rational solution concepts. Since every path is followed with some probability, there is no concern about defining beliefs "off the equilibrium path".

Critiques

Free parameter

LQRE has the free parameter λ. As λ→∞, LQRE→Nash equilibrium, so LQRE will always be at least as good a fit as Nash equilibrium. Changes in the parameter can result in large changes to equilibrium behavior.

However, the theory is incomplete without describing where λ comes from. Estimates of λ from experiments can vary significantly. Sometimes this variance seems to be a result of individual characteristics (for instance, λ sometimes increases with learning). Other times it appears that λ varies from game to game.

References

McKelvey, Richard; Palfrey, Thomas (1995), "Quantal Response Equilibria for Normal Form Games", Games and Economic Behavior 10: 6–38, doi:10.1006/game.1995.1023
McKelvey, Richard; Palfrey, Thomas (1998), "Quantal Response Equilibria for Extensive Form Games", Experimental Economics 1: 9–41, doi:10.1007/BF01426213

v t e Topics in game theory

Definitions	Normal-form game Extensive-form game Graphical game Cooperative game Succinct game Information set Hierarchy of beliefs Preference

Equilibrium concepts	Nash equilibrium Subgame perfection Mertens-stable equilibrium Bayesian-Nash Perfect Bayesian Trembling hand Proper equilibrium Epsilon-equilibrium Correlated equilibrium Sequential equilibrium Quasi-perfect equilibrium Evolutionarily stable strategy Risk dominance Core Shapley value Pareto efficiency Quantal response equilibrium Self-confirming equilibrium Strong Nash equilibrium Markov perfect equilibrium

Strategies	Dominant strategies Pure strategy Mixed strategy Tit for tat Grim trigger Collusion Backward induction Forward induction Markov strategy

Classes of games	Symmetric game Perfect information Simultaneous game Sequential game Repeated game Signaling game Cheap talk Zero-sum game Mechanism design Bargaining problem Stochastic game Large Poisson game Nontransitive game Global games

Games	Prisoner's dilemma Traveler's dilemma Coordination game Chicken Centipede game Volunteer's dilemma Dollar auction Battle of the sexes Stag hunt Matching pennies Ultimatum game Rock-paper-scissors Pirate game Dictator game Public goods game Blotto games War of attrition El Farol Bar problem Cake cutting Cournot game Deadlock Diner's dilemma Guess 2/3 of the average Kuhn poker Nash bargaining game Screening game Prisoners and hats puzzle Trust game Princess and monster game Monty Hall problem

Theorems	Minimax theorem Nash's theorem Purification theorem Folk theorem Revelation principle Arrow's impossibility theorem

Key figures	Kenneth Arrow Robert Aumann Kenneth Binmore Samuel Bowles Melvin Dresher Merrill M. Flood Drew Fudenberg Donald B. Gillies John Harsanyi Leonid Hurwicz David K. Levine Daniel Kahneman Harold W. Kuhn Eric Maskin Jean-François Mertens Paul Milgrom Oskar Morgenstern Roger Myerson John Nash John von Neumann Ariel Rubinstein Thomas Schelling Reinhard Selten Herbert Simon Lloyd Shapley John Maynard Smith Jean Tirole Albert W. Tucker William Vickrey Robert B. Wilson Peyton Young

See also	Tragedy of the commons Tyranny of small decisions All-pay auction List of games in game theory Confrontation analysis List of game theorists Combinatorial game theory

This article is issued from Wikipedia. The text is available under the Creative Commons Attribution/Share Alike; additional terms may apply for the media files.