Melioration behaviour in the Harvard game is reduced by simplifying decision outcomes

David J. Stillwell, Richard J. Tunney

Research output: Contribution to journalArticle

Abstract

Self-control experiments have previously been highlighted as examples of suboptimal decision making. In one such experiment, the Harvard game, participants make repeated choices between two alternatives. One alternative has a higher immediate pay-off than the other, but with repeated choices results in a lower overall pay-off. Preference for the alternative with the higher immediate pay-off seems to be impulsive and will result in a failure to maximize pay-offs. We report an experiment that modifies the Harvard game, dividing the pay-off from each choice into two separate consequencesthe immediate and the historic components. Choosing the alternative with the higher immediate pay-off ends the session prematurely, leading to a loss of opportunities to earn further pay-offs and ultimately to a reduced overall pay-off. This makes it easier for participants to learn the outcomes of their actions. It also provides the opportunity for a further test of normative decision making by means of one of its most specific and paradoxical predictionsthat the truly rational agent should switch from self-control to impulsivity toward the end of the experimental sessions. The finding that participants maximize their expected utility by both overcoming impulsivity and learning to switch implies that melioration behaviour is not due to the lure of impulsivity, but due to the difficulty of learning which components are included in the pay-off schedules.

Original languageEnglish
Pages (from-to)2252-2261
Number of pages10
JournalQuarterly Journal of Experimental Psychology
Volume62
Issue number11
DOIs
Publication statusPublished - 1 Apr 2009

Fingerprint

Impulsive Behavior
Decision Making
Learning
Appointments and Schedules
Self-Control

Keywords

  • Decision-making
  • Harvard game
  • Impulsivity
  • Intrapersonal externalities
  • Melioration

Cite this

@article{f5a3636a76fc4a49b782c5de811d10e7,
title = "Melioration behaviour in the Harvard game is reduced by simplifying decision outcomes",
abstract = "Self-control experiments have previously been highlighted as examples of suboptimal decision making. In one such experiment, the Harvard game, participants make repeated choices between two alternatives. One alternative has a higher immediate pay-off than the other, but with repeated choices results in a lower overall pay-off. Preference for the alternative with the higher immediate pay-off seems to be impulsive and will result in a failure to maximize pay-offs. We report an experiment that modifies the Harvard game, dividing the pay-off from each choice into two separate consequencesthe immediate and the historic components. Choosing the alternative with the higher immediate pay-off ends the session prematurely, leading to a loss of opportunities to earn further pay-offs and ultimately to a reduced overall pay-off. This makes it easier for participants to learn the outcomes of their actions. It also provides the opportunity for a further test of normative decision making by means of one of its most specific and paradoxical predictionsthat the truly rational agent should switch from self-control to impulsivity toward the end of the experimental sessions. The finding that participants maximize their expected utility by both overcoming impulsivity and learning to switch implies that melioration behaviour is not due to the lure of impulsivity, but due to the difficulty of learning which components are included in the pay-off schedules.",
keywords = "Decision-making, Harvard game, Impulsivity, Intrapersonal externalities, Melioration",
author = "Stillwell, {David J.} and Tunney, {Richard J.}",
year = "2009",
month = "4",
day = "1",
doi = "10.1080/17470210902765999",
language = "English",
volume = "62",
pages = "2252--2261",
journal = "Quarterly Journal of Experimental Psychology",
issn = "1747-0218",
publisher = "Psychology Press",
number = "11",

}

Melioration behaviour in the Harvard game is reduced by simplifying decision outcomes. / Stillwell, David J.; Tunney, Richard J.

In: Quarterly Journal of Experimental Psychology, Vol. 62, No. 11, 01.04.2009, p. 2252-2261.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Melioration behaviour in the Harvard game is reduced by simplifying decision outcomes

AU - Stillwell, David J.

AU - Tunney, Richard J.

PY - 2009/4/1

Y1 - 2009/4/1

N2 - Self-control experiments have previously been highlighted as examples of suboptimal decision making. In one such experiment, the Harvard game, participants make repeated choices between two alternatives. One alternative has a higher immediate pay-off than the other, but with repeated choices results in a lower overall pay-off. Preference for the alternative with the higher immediate pay-off seems to be impulsive and will result in a failure to maximize pay-offs. We report an experiment that modifies the Harvard game, dividing the pay-off from each choice into two separate consequencesthe immediate and the historic components. Choosing the alternative with the higher immediate pay-off ends the session prematurely, leading to a loss of opportunities to earn further pay-offs and ultimately to a reduced overall pay-off. This makes it easier for participants to learn the outcomes of their actions. It also provides the opportunity for a further test of normative decision making by means of one of its most specific and paradoxical predictionsthat the truly rational agent should switch from self-control to impulsivity toward the end of the experimental sessions. The finding that participants maximize their expected utility by both overcoming impulsivity and learning to switch implies that melioration behaviour is not due to the lure of impulsivity, but due to the difficulty of learning which components are included in the pay-off schedules.

AB - Self-control experiments have previously been highlighted as examples of suboptimal decision making. In one such experiment, the Harvard game, participants make repeated choices between two alternatives. One alternative has a higher immediate pay-off than the other, but with repeated choices results in a lower overall pay-off. Preference for the alternative with the higher immediate pay-off seems to be impulsive and will result in a failure to maximize pay-offs. We report an experiment that modifies the Harvard game, dividing the pay-off from each choice into two separate consequencesthe immediate and the historic components. Choosing the alternative with the higher immediate pay-off ends the session prematurely, leading to a loss of opportunities to earn further pay-offs and ultimately to a reduced overall pay-off. This makes it easier for participants to learn the outcomes of their actions. It also provides the opportunity for a further test of normative decision making by means of one of its most specific and paradoxical predictionsthat the truly rational agent should switch from self-control to impulsivity toward the end of the experimental sessions. The finding that participants maximize their expected utility by both overcoming impulsivity and learning to switch implies that melioration behaviour is not due to the lure of impulsivity, but due to the difficulty of learning which components are included in the pay-off schedules.

KW - Decision-making

KW - Harvard game

KW - Impulsivity

KW - Intrapersonal externalities

KW - Melioration

UR - http://www.scopus.com/inward/record.url?scp=70349533123&partnerID=8YFLogxK

UR - http://journals.sagepub.com/doi/10.1080/17470210902765999

U2 - 10.1080/17470210902765999

DO - 10.1080/17470210902765999

M3 - Article

C2 - 19382008

AN - SCOPUS:70349533123

VL - 62

SP - 2252

EP - 2261

JO - Quarterly Journal of Experimental Psychology

JF - Quarterly Journal of Experimental Psychology

SN - 1747-0218

IS - 11

ER -