Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
90
result(s) for
"Christian Hilbe"
Sort by:
Reputation effects drive the joint evolution of cooperation and social rewarding
2022
People routinely cooperate with each other, even when cooperation is costly. To further encourage such pro-social behaviors, recipients often respond by providing additional incentives, for example by offering rewards. Although such incentives facilitate cooperation, the question remains how these incentivizing behaviors themselves evolve, and whether they would always be used responsibly. Herein, we consider a simple model to systematically study the co-evolution of cooperation and different rewarding policies. In our model, both social and antisocial behaviors can be rewarded, but individuals gain a reputation for how they reward others. By characterizing the game’s equilibria and by simulating evolutionary learning processes, we find that reputation effects systematically favor cooperation and social rewarding. While our baseline model applies to pairwise interactions in well-mixed populations, we obtain similar conclusions under assortment, or when individuals interact in larger groups. According to our model, rewards are most effective when they sway others to cooperate. This view is consistent with empirical observations suggesting that people reward others to ultimately benefit themselves.
Rewards can motivate people to cooperate, but the evolution of rewarding behavior is itself poorly understood. Here, a game-theoretic analysis shows that reputation effects facilitate the simultaneous evolution of cooperation and social rewarding policies.
Journal Article
Evolution of cooperation in stochastic games
by
Chatterjee, Krishnendu
,
Hilbe, Christian
,
Šimsa, Štěpán
in
631/181/2468
,
631/181/2469
,
Behavioral evolution
2018
Social dilemmas occur when incentives for individuals are misaligned with group interests
1
–
7
. According to the ‘tragedy of the commons’, these misalignments can lead to overexploitation and collapse of public resources. The resulting behaviours can be analysed with the tools of game theory
8
. The theory of direct reciprocity
9
–
15
suggests that repeated interactions can alleviate such dilemmas, but previous work has assumed that the public resource remains constant over time. Here we introduce the idea that the public resource is instead changeable and depends on the strategic choices of individuals. An intuitive scenario is that cooperation increases the public resource, whereas defection decreases it. Thus, cooperation allows the possibility of playing a more valuable game with higher payoffs, whereas defection leads to a less valuable game. We analyse this idea using the theory of stochastic games
16
–
19
and evolutionary game theory. We find that the dependence of the public resource on previous interactions can greatly enhance the propensity for cooperation. For these results, the interaction between reciprocity and payoff feedback is crucial: neither repeated interactions in a constant environment nor single interactions in a changing environment yield similar cooperation rates. Our framework shows which feedbacks between exploitation and environment—either naturally occurring or designed—help to overcome social dilemmas.
Cooperation is more likely to evolve in a public-goods-distribution game when payoffs can change between rounds so that the stakes increase when players cooperate and decrease when players defect.
Journal Article
Quantitative assessment can stabilize indirect reciprocity under imperfect information
by
Chatterjee, Krishnendu
,
Hilbe, Christian
,
Ekbatani, Farbod
in
631/181/2468
,
631/181/2469
,
Assessments
2023
The field of indirect reciprocity investigates how social norms can foster cooperation when individuals continuously monitor and assess each other’s social interactions. By adhering to certain social norms, cooperating individuals can improve their reputation and, in turn, receive benefits from others. Eight social norms, known as the “leading eight,\" have been shown to effectively promote the evolution of cooperation as long as information is public and reliable. These norms categorize group members as either ’good’ or ’bad’. In this study, we examine a scenario where individuals instead assign nuanced reputation scores to each other, and only cooperate with those whose reputation exceeds a certain threshold. We find both analytically and through simulations that such quantitative assessments are error-correcting, thus facilitating cooperation in situations where information is private and unreliable. Moreover, our results identify four specific norms that are robust to such conditions, and may be relevant for helping to sustain cooperation in natural populations.
Indirect reciprocity describes how cooperation arises in a community when its members value their reputation. Here, the authors show that nuanced assessments of observations can mitigate disagreements and errors when the opinions of community members are not synchronized.
Journal Article
Indirect reciprocity with stochastic and dual reputation updates
by
Hilbe, Christian
,
Murase, Yohsuke
in
Analysis
,
Biology and Life Sciences
,
Computer and Information Sciences
2023
Cooperation is a crucial aspect of social life, yet understanding the nature of cooperation and how it can be promoted is an ongoing challenge. One mechanism for cooperation is indirect reciprocity. According to this mechanism, individuals cooperate to maintain a good reputation. This idea is embodied in a set of social norms called the “leading eight”. When all information is publicly available, these norms have two major properties. Populations that employ these norms are fully cooperative, and they are stable against invasion by alternative norms. In this paper, we extend the framework of the leading eight in two directions. First, we include norms with ‘dual’ reputation updates. These norms do not only assign new reputations to an acting donor; they also allow to update the reputation of the passive recipient. Second, we allow social norms to be stochastic. Such norms allow individuals to evaluate others with certain probabilities. Using this framework, we characterize all evolutionarily stable norms that lead to full cooperation in the public information regime. When only the donor’s reputation is updated, and all updates are deterministic, we recover the conventional model. In that case, we find two classes of stable norms: the leading eight and the ‘secondary sixteen’. Stochasticity can further help to stabilize cooperation when the benefit of cooperation is comparably small. Moreover, updating the recipients’ reputations can help populations to recover more quickly from errors. Overall, our study highlights a remarkable trade-off between the evolutionary stability of a norm and its robustness with respect to errors. Norms that correct errors quickly require higher benefits of cooperation to be stable.
Journal Article
Evolution of extortion in Iterated Prisoner's Dilemma games
by
Sigmund, Karl
,
Hilbe, Christian
,
Nowak, Martin A.
in
Biological Evolution
,
Biological Sciences
,
catalysts
2013
Iterated games are a fundamental component of economic and evolutionary game theory. They describe situations where two players interact repeatedly and have the ability to use conditional strategies that depend on the outcome of previous interactions, thus allowing for reciprocation. Recently, a new class of strategies has been proposed, so-called \"zero-determinant\" strategies. These strategies enforce a fixed linear relationship between one's own payoff and that of the other player. A subset of those strategies allows \"extortioners\" to ensure that any increase in one player's own payoff exceeds that of the other player by a fixed percentage. Here, we analyze the evolutionary performance of this new class of strategies. We show that in reasonably large populations, they can act as catalysts for the evolution of cooperation, similar to tit-for-tat, but that they are not the stable outcome of natural selection. In very small populations, however, extortioners hold their ground. Extortion strategies do particularly well in revolutionary arms races between two distinct populations. Significantly, they benefit the population that evolves at the slower rate, an example of the so-called \"Red King\" effect. This may affect the evolution of interactions between host species and their endosymbionts.
Journal Article
The effect of environmental information on evolution of cooperation in stochastic games
by
Kleshnina, Maria
,
Chatterjee, Krishnendu
,
Hilbe, Christian
in
631/181/2468
,
631/181/2469
,
639/705/1041
2023
Many human interactions feature the characteristics of social dilemmas where individual actions have consequences for the group and the environment. The feedback between behavior and environment can be studied with the framework of stochastic games. In stochastic games, the state of the environment can change, depending on the choices made by group members. Past work suggests that such feedback can reinforce cooperative behaviors. In particular, cooperation can evolve in stochastic games even if it is infeasible in each separate repeated game. In stochastic games, participants have an interest in conditioning their strategies on the state of the environment. Yet in many applications, precise information about the state could be scarce. Here, we study how the availability of information (or lack thereof) shapes evolution of cooperation. Already for simple examples of two state games we find surprising effects. In some cases, cooperation is only possible if there is precise information about the state of the environment. In other cases, cooperation is most abundant when there is no information about the state of the environment. We systematically analyze all stochastic games of a given complexity class, to determine when receiving information about the environment is better, neutral, or worse for evolution of cooperation.
In stochastic games, there is a feedback loop between a group’s social behaviors and its environment. Kleshnina
et al
. show that groups are often more cooperative when they know the exact state of their environment, although there are also intriguing cases when ignorance is beneficial.
Journal Article
Incentives and opportunism: from the carrot to the stick
2010
Cooperation in public good games is greatly promoted by positive and negative incentives. In this paper, we use evolutionary game dynamics to study the evolution of opportunism (the readiness to be swayed by incentives) and the evolution of trust (the propensity to cooperate in the absence of information on the co-players). If both positive and negative incentives are available, evolution leads to a population where defectors are punished and players cooperate, except when they can get away with defection. Rewarding behaviour does not become fixed, but can play an essential role in catalysing the emergence of cooperation, especially if the information level is low.
Journal Article
Local Replicator Dynamics: A Simple Link Between Deterministic and Stochastic Models of Evolutionary Game Theory
2011
Classical replicator dynamics assumes that individuals play their games and adopt new strategies on a global level: Each player interacts with a representative sample of the population and if a strategy yields a payoff above the average, then it is expected to spread. In this article, we connect evolutionary models for infinite and finite populations: While the population itself is infinite, interactions and reproduction occurs in random groups of size
N
. Surprisingly, the resulting dynamics simplifies to the traditional replicator system with a slightly modified payoff matrix. The qualitative results, however, mirror the findings for finite populations, in which strategies are selected according to a probabilistic Moran process. In particular, we derive a one-third law that holds for any population size. In this way, we show that the deterministic replicator equation in an infinite population can be used to study the Moran process in a finite population and vice versa. We apply the results to three examples to shed light on the evolution of cooperation in the iterated prisoner’s dilemma, on risk aversion in coordination games and on the maintenance of dominated strategies.
Journal Article
Dynamics of cooperation in concurrent games
by
Hilbe, Christian
,
Rossetti, Charlotte S. L.
,
Hauser, Oliver P.
in
631/477/2811
,
706/689/159
,
Adolescent
2025
People frequently encounter situations where individually optimal decisions conflict with group interests. To navigate such social dilemmas, they often employ simple heuristics based on direct reciprocity: cooperate when others do and cease cooperation when partners defect. However, prior research typically assumes that individuals only interact in one game at a time. In reality, people engage in multiple games concurrently, and the outcome of one interaction can influence behavior in another. Here, we introduce a theoretical framework to study the resulting cross-over and spill-over effects. Participants repeatedly engage in two independent stage games, either with the same or different partners, adapting their strategies over time through an evolutionary learning process. Our findings indicate that individuals often link their behavior across games, particularly under cognitive constraints like imperfect recall. A behavioral experiment with 316 UK-based students suggests that concurrent games negatively affect cooperation, highlighting how strategic motives and spillovers impact reciprocity.
Rossetti and coauthors explore how human cooperation dynamics shift when players engage in multiple economic games at the same time, rather than treating each game as isolated. The authors find that cognitive constraints, strategic motives, and spillover effects can reduce cooperation in such scenarios, challenging traditional models of direct reciprocity.
Journal Article
Direct reciprocity between individuals that use different strategy spaces
by
Chatterjee, Krishnendu
,
Hilbe, Christian
,
Schmid, Laura
in
Biological Evolution
,
Biology and Life Sciences
,
Cooperative Behavior
2022
In repeated interactions, players can use strategies that respond to the outcome of previous rounds. Much of the existing literature on direct reciprocity assumes that all competing individuals use the same strategy space. Here, we study both learning and evolutionary dynamics of players that differ in the strategy space they explore. We focus on the infinitely repeated donation game and compare three natural strategy spaces: memory-1 strategies, which consider the last moves of both players, reactive strategies, which respond to the last move of the co-player, and unconditional strategies. These three strategy spaces differ in the memory capacity that is needed. We compute the long term average payoff that is achieved in a pairwise learning process. We find that smaller strategy spaces can dominate larger ones. For weak selection, unconditional players dominate both reactive and memory-1 players. For intermediate selection, reactive players dominate memory-1 players. Only for strong selection and low cost-to-benefit ratio, memory-1 players dominate the others. We observe that the supergame between strategy spaces can be a social dilemma: maximum payoff is achieved if both players explore a larger strategy space, but smaller strategy spaces dominate.
Journal Article