Evolutionary games and population dynamics: maintenance of cooperation in public goods games.
Explore the source record for details and available documents.
Animals↗
Biomedical subjects
Christoph Hauert
Publications and source records attributed to Christoph Hauert.
Evolutionary games and population dynamics: maintenance of cooperation in public goods games.
The emergence and abundance of cooperation in nature poses a tenacious and challenging puzzle to evolutionary biology. Cooperative behaviour seems to contradict Darwinian evolution because altruistic individuals increase the fitness of other members of the population at a cost to themselves. Thus, in the absence of supporting mechanisms, cooperation should decrease and vanish, as predicted by classical models for cooperation in evolutionary game theory, such as the Prisoner's Dilemma and public goods games. Traditional approaches to studying the problem of cooperation assume constant population sizes and thus neglect the ecology of the interacting individuals. Here, we incorporate ecological dynamics into evolutionary games and reveal a new mechanism for maintaining cooperation. In public goods games, cooperation can gain a foothold if the population density depends on the average population payoff. Decreasing population densities, due to defection leading to small payoffs, results in smaller interaction group sizes in which cooperation can be favoured. This feedback between ecological dynamics and game dynamics can generate stable coexistence of cooperators and defectors in public goods games. However, this mechanism fails for pairwise Prisoner's Dilemma interactions and the population is driven to extinction. Our model represents natural extension of replicator dynamics to populations of varying densities.
Animals↗
Coevolutionary dynamics in large, but finite populations.
Coevolving and competing species or game-theoretic strategies exhibit rich and complex dynamics for which a general theoretical framework based on finite populations is still lacking. Recently, an explicit mean-field description in the form of a Fokker-Planck equation was derived for frequency-dependent selection with two strategies in finite populations based on microscopic processes [A. Traulsen, J. C. Claussen, and C. Hauert, Phys. Rev. Lett. 95, 238701 (2005)]. Here we generalize this approach in a twofold way: First, we extend the framework to an arbitrary number of strategies and second, we allow for mutations in the evolutionary process. The deterministic limit of infinite population size of the frequency-dependent Moran process yields the adjusted replicator-mutator equation, which describes the combined effect of selection and mutation. For finite populations, we provide an extension taking random drift into account. In the limit of neutral selection, i.e., whenever the process is determined by random drift and mutations, the stationary strategy distribution is derived. This distribution forms the background for the coevolutionary process. In particular, a critical mutation rate uc is obtained separating two scenarios: above uc the population predominantly consists of a mixture of strategies whereas below uc the population tends to be in homogeneous states. For one of the fundamental problems in evolutionary biology, the evolution of cooperation under Darwinian selection, we demonstrate that the analytical framework provides excellent approximations to individual based simulations even for rather small population sizes. This approach complements simulation results and provides a deeper, systematic understanding of coevolutionary dynamics.
Animals↗
A simple rule for the evolution of cooperation on graphs and social networks.
A fundamental aspect of all biological systems is cooperation. Cooperative interactions are required for many levels of biological organization ranging from single cells to groups of animals. Human society is based to a large extent on mechanisms that promote cooperation. It is well known that in unstructured populations, natural selection favours defectors over cooperators. There is much current interest, however, in studying evolutionary games in structured populations and on graphs. These efforts recognize the fact that who-meets-whom is not random, but determined by spatial relationships or social networks. Here we describe a surprisingly simple rule that is a good approximation for all graphs that we have analysed, including cycles, spatial lattices, random regular graphs, random graphs and scale-free networks: natural selection favours cooperation, if the benefit of the altruistic act, b, divided by the cost, c, exceeds the average number of neighbours, k, which means b/c > k. In this case, cooperation can evolve as a consequence of 'social viscosity' even in the absence of reputation effects or strategic complexity.
Altruism↗
Punishing and abstaining for public goods.
The evolution of cooperation within sizable groups of nonrelated humans offers many challenges for our understanding. Current research has highlighted two factors boosting cooperation in public goods interactions, namely, costly punishment of defectors and the option to abstain from the joint enterprise. A recent modeling approach has suggested that the autarkic option acts as a catalyzer for the ultimate fixation of altruistic punishment. We present an alternative, more microeconomically based model that yields a bistable outcome instead. Evolutionary dynamics can lead either to a Nash equilibrium of punishing and nonpunishing cooperators or to an oscillating state without punishers.
Altruism↗
Spatial effects in social dilemmas.
Social dilemmas and the evolutionary conundrum of cooperation are traditionally studied through various kinds of game theoretical models such as the prisoner's dilemma, public goods games, snowdrift games or by-product mutualism. All of them exemplify situations which are characterized by different degrees of conflicting interests between the individuals and the community. In groups of interacting individuals, cooperators produce a common good benefitting the entire group at some cost to themselves, whereas defectors attempt to exploit the resource by avoiding the costly contributions. Based on synergistic or discounted accumulation of cooperative benefits a unifying theoretical framework was recently introduced that encompasses all games that have traditionally been studied separately (Hauert, Michor, Nowak, Doebeli, 2005. Synergy and discounting of cooperation in social dilemmas. J. Theor. Biol., in press.). Within this framework we investigate the effects of spatial structure with limited local interactions on the evolutionary fate of cooperators and defectors. The quantitative effects of space turn out to be quite sensitive to the underlying microscopic update mechanisms but, more general, we demonstrate that in prisoner's dilemma type interactions spatial structure benefits cooperation-although the parameter range is quite limited-whereas in snowdrift type interactions spatial structure may be beneficial too, but often turns out to be detrimental to cooperation.
Biological Evolution↗
Coevolutionary dynamics: from finite to infinite populations.
Traditionally, frequency dependent evolutionary dynamics is described by deterministic replicator dynamics assuming implicitly infinite population sizes. Only recently have stochastic processes been introduced to study evolutionary dynamics in finite populations. However, the relationship between deterministic and stochastic approaches remained unclear. Here we solve this problem by explicitly considering large populations. In particular, we identify different microscopic stochastic processes that lead to the standard or the adjusted replicator dynamics. Moreover, differences on the individual level can lead to qualitatively different dynamics in asymmetric conflicts and, depending on the population size, can even invert the direction of the evolutionary process.
Animals↗
Synergy and discounting of cooperation in social dilemmas.
The emergence and maintenance of cooperation by natural selection is an enduring conundrum in evolutionary biology, which has been studied using a variety of game theoretical models inspired by different biological situations. The most widely studied games are the Prisoner's Dilemma, the Snowdrift game and by-product mutualism for pairwise interactions, as well as Public Goods games in larger groups of interacting individuals. Here, we present a general framework for cooperation in social dilemmas in which all the traditional scenarios can be recovered as special cases. In social dilemmas, cooperators provide a benefit to the group at some cost, while defectors exploit the group by reaping the benefits without bearing the costs of cooperation. Using the concepts of discounting and synergy for describing how benefits accumulate when more than one cooperator is present in a group of interacting individuals, we recover the four basic scenarios of evolutionary dynamics given by (i) dominating defection, (ii) coexistence of defectors and cooperators, (iii) dominating cooperation and (iv) bi-stability, in which cooperators and defectors cannot invade each other. Generically, for groups of three or more interacting individuals further, more complex, dynamics can occur. Our framework provides the first unifying approach to model cooperation in different kinds of social dilemmas.
Animals↗
Evolutionary dynamics on graphs.
Evolutionary dynamics have been traditionally studied in the context of homogeneous or spatially extended populations. Here we generalize population structure by arranging individuals on a graph. Each vertex represents an individual. The weighted edges denote reproductive rates which govern how often individuals place offspring into adjacent vertices. The homogeneous population, described by the Moran process, is the special case of a fully connected graph with evenly weighted edges. Spatial structures are described by graphs where vertices are connected with their nearest neighbours. We also explore evolution on random and scale-free networks. We determine the fixation probability of mutants, and characterize those graphs for which fixation behaviour is identical to that of a homogeneous population. Furthermore, some graphs act as suppressors and others as amplifiers of selection. It is even possible to find graphs that guarantee the fixation of any advantageous mutant. We also study frequency-dependent selection and show that the outcome of evolutionary games can depend entirely on the structure of the underlying graph. Evolutionary graph theory has many fascinating applications ranging from ecology to multi-cellular organization and economics.
Biological Evolution↗
The evolutionary origin of cooperators and defectors.
Coexistence of cooperators and defectors is common in nature, yet the evolutionary origin of such social diversification is unclear. Many models have been studied on the basis of the assumption that benefits of cooperative acts only accrue to others. Here, we analyze the continuous snowdrift game, in which cooperative investments are costly but yield benefits to others as well as to the cooperator. Adaptive dynamics of investment levels often result in evolutionary diversification from initially uniform populations to a stable state in which cooperators making large investments coexist with defectors who invest very little. Thus, when individuals benefit from their own actions, large asymmetries in cooperative investments can evolve.
Altruism↗
Spatial structure often inhibits the evolution of cooperation in the snowdrift game.
Understanding the emergence of cooperation is a fundamental problem in evolutionary biology. Evolutionary game theory has become a powerful framework with which to investigate this problem. Two simple games have attracted most attention in theoretical and experimental studies: the Prisoner's Dilemma and the snowdrift game (also known as the hawk-dove or chicken game). In the Prisoner's Dilemma, the non-cooperative state is evolutionarily stable, which has inspired numerous investigations of suitable extensions that enable cooperative behaviour to persist. In particular, on the basis of spatial extensions of the Prisoner's Dilemma, it is widely accepted that spatial structure promotes the evolution of cooperation. Here we show that no such general predictions can be made for the effects of spatial structure in the snowdrift game. In unstructured snowdrift games, intermediate levels of cooperation persist. Unexpectedly, spatial structure reduces the proportion of cooperators for a wide range of parameters. In particular, spatial structure eliminates cooperation if the cost-to-benefit ratio of cooperation is high. Our results caution against the common belief that spatial structure is necessarily beneficial for cooperative behaviour.
Animals↗
Punishment and reputation in spatial public goods games.
The puzzle of the emergence of cooperation between unrelated individuals is shared across diverse fields of behavioural sciences and economics. In this article we combine the public goods game originating in economics with evolutionary approaches traditionally used in biology. Instead of pairwise encounters, we consider the more complex case of groups of three interacting individuals. We show that territoriality is capable of promoting cooperative behaviour, as in the case of the Prisoner's Dilemma. Moreover, by adding punishment opportunities, the readiness to cooperate is greatly enhanced and asocial strategies can be largely suppressed. Finally, as soon as players carry a reputation for being willing or unwilling to punish, highly cooperative and fair outcomes are achieved. This group-beneficial result is obtained, intriguingly, by making individuals more likely to exploit their co-players if they can get away with it. Thus, less-cooperative individuals make more-cooperative societies.
Animals↗
Evolutionary prisoner's dilemma games with voluntary participation.
Voluntary participation in public good games has recently been demonstrated to be a simple yet effective mechanism to avoid deadlocks in states of mutual defection and to promote persistent cooperative behavior. Apart from cooperators and defectors a third strategical type is considered: the risk averse loners who are unwilling to participate in the social enterprise and rather rely on small but fixed earnings. This results in a rock-scissors-paper type of cyclic dominance of the three strategies. In the prisoner's dilemma, the effects of voluntary participation crucially depend on the underlying population structure. While leading to homogeneous states of all loners in well-mixed populations, we demonstrate that cyclic dominance produces self-organizing patterns on square lattices but leads to different types of oscillatory behavior on random regular graphs: the temptation to defect determines whether damped, periodic, or increasing oscillations occur. These Monte Carlo simulations are complemented by predictions from pair approximation reproducing the results for random regular graphs particularly well.
Journal Article↗
Simple adaptive strategy wins the prisoner's dilemma.
The prisoner's dilemma has become the leading paradigm to explain the evolution of cooperation among selfish individuals. Here, we present an adaptive strategy that implements new mechanisms to process information about past encounters. The history of moves is summarized in an internal state which then determines the subsequent move. This enables the strategy to adjust its decisions to the character of the current opponent and to adapt the most promising strategic behavior. For this reason, we call such strategies Adaptor. Through evolutionary simulations, we demonstrate that the concept of Adaptor leads to strategic patterns that are (a) highly cooperative when playing against kin, (b) stable in a sense that goes far beyond the concept of evolutionary stability, (c) robust to environmental changes, i.e. variations of the parameter values and finally (d) superior in performance to the most prominent strategies in the literature.
Adaptation, Psychological↗
Replicator dynamics for optional public good games.
The public goods game represents a straightforward generalization of the prisoner's dilemma to an arbitrary number of players. Since the dominant strategy is to defect, both classical and evolutionary game theory predict the asocial outcome that no player contributes to the public goods. In contrast to the compulsory public goods game, optional participation provides a natural way to avoid deadlocks in the state of mutual defection. The three resulting strategies--collaboration or defection in the public goods game, as well as not joining at all--are studied by means of a replicator dynamics, which can be completely analysed in spite of the fact that the payoff terms are nonlinear. If cooperation is valuable enough, the dynamics exhibits a rock-scissors-paper type of cycling between the three strategies, leading to sizeable average levels of cooperation in the population. Thus, voluntary participation makes cooperation feasible. But for each strategy, the average payoff value remains equal to the earnings of those not participating in the public goods game.
Altruism↗
Phase transitions and volunteering in spatial public goods games.
We present a simple yet effective mechanism promoting cooperation under full anonymity by allowing for voluntary participation in public goods games. This natural extension leads to "rock-scissors-paper"-type cyclic dominance of the three strategies, cooperate, defect, and loner. In spatial settings with players arranged on a regular lattice, this results in interesting dynamical properties and intriguing spatiotemporal patterns. In particular, variations of the value of the public good leads to transitions between one-, two-, and three-strategy states which either are in the class of directed percolation or show interesting analogies to Ising-type models. Although volunteering is incapable of stabilizing cooperation, it efficiently prevents successful spreading of selfish behavior.
Economics↗
Volunteering as Red Queen mechanism for cooperation in public goods games.
The evolution of cooperation among nonrelated individuals is one of the fundamental problems in biology and social sciences. Reciprocal altruism fails to provide a solution if interactions are not repeated often enough or groups are too large. Punishment and reward can be very effective but require that defectors can be traced and identified. Here we present a simple but effective mechanism operating under full anonymity. Optional participation can foil exploiters and overcome the social dilemma. In voluntary public goods interactions, cooperators and defectors will coexist. We show that this result holds under very diverse assumptions on population structure and adaptation mechanisms, leading usually not to an equilibrium but to an unending cycle of adjustments (a Red Queen type of evolution). Thus, voluntary participation offers an escape hatch out of some social traps. Cooperation can subsist in sizable groups even if interactions are not repeated, defectors remain anonymous, players have no memory, and assortment is purely random.
Cooperative Behavior↗