Economics●●●●●Difficulty 3 of 5

Can selfish players learn to cooperate?

Cooperation needs a future with no known end. And in 2004 one university won a famous tournament by entering 60 programs that worked as a team.

▶ Start the story

In theory, yes, as long as they never know which round is the last. Played once, the prisoner's dilemma rewards betrayal: defecting always pays better than cooperating, whatever the other player does. Repetition alone does not fix that. If both players know the game lasts a fixed number of rounds, defecting in every round is still the dominant strategy: one might as well defect on the last turn, since the opponent will not have a chance to retaliate, and the same reasoning then unravels every earlier round. For cooperation to emerge between rational players, the number of rounds must be unknown or infinite. Robert Aumann showed in 1959 that rational players interacting in indefinitely long games can sustain cooperation.

Robert Axelrod's computer tournament, reported in his 1984 book The Evolution of Cooperation, put the idea to the test with programs that varied widely in complexity, initial hostility and capacity for forgiveness. The simplest, tit for tat, won: it cooperates first, then copies the opponent's previous move. After analysing the top scorers, Axelrod stated conditions for success. Besides being nice and forgiving, a winner must retaliate, because always cooperating is a very bad choice that nasty strategies frequently exploit. And it must not be envious: it does not strive to score more than its opponent.

How tit for tat plays
  1. Step 1: Cooperate first

    Open with a friendly move

  2. Step 2: Copy their last move

    Cooperate if they did, defect if they defected

  3. Step 3: Retaliate once

    A defection is answered right away

  4. Step 4: Forgive

    If they cooperate again, so do you

The rules around the game matter too. In a 2004 tournament, the University of Southampton submitted 60 programs designed to recognise each other during the first five to ten moves. Once they had, one always cooperated and the other always defected, handing the defector the maximum points. Southampton took the first three places, by taking advantage of the fact that multiple entries were allowed.

So tit for tat is not invincible: it is not always the winner of a given tournament, only better than its rivals over a series of them.

Quiz me

0/3

  1. 1.Why can cooperation emerge between rational players in a repeated prisoner's dilemma?
  2. 2.Which trait did Axelrod find among almost all the top-scoring strategies?
  3. 3.What did the Southampton entries in the 2004 tournament show?

Recap

Cooperation among self-interested players survives when the game has no known last round and cheating gets answered.

💡 A trick to remember it · Start friendly, answer in kind, forgive quickly: a mirror that smiles first.

Surprising fact · If both players know exactly when the game ends, backwards induction says to defect in every round, so a known last round kills cooperation.

Sources (3)

No source, no claim. Every fact in this lesson (27 claims) cites at least one of these.

  1. [1]Prisoner's dilemma · Wikipedia
  2. [2]Tit for tat · Wikipedia
  3. [3]Repeated game · Wikipedia
More lessons in 💰 Economics (3) See all economics lessons →

One more light on your map.

Get one lesson like this every day, about the things you love. Free, in two or five minutes.

Get the share card for this lesson ↗