Decision-making without a brain: How an amoeboid organism solves the two-armed bandit

Chris R. Reid, Hannelore MacDonald, Richard P. Mann, James A R Marshall, Tanya Latty, Simon Garnier

Research output: Contribution to journalArticle

Abstract

Several recent studies hint at shared patterns in decision-making between taxonomically distant organisms, yet few studies demonstrate and dissect mechanisms of decision-making in simpler organisms. We examine decision-making in the unicellular slime mould Physarum polycephalum using a classical decision problem adapted from human and animal decision-making studies: the two-armed bandit problem. This problem has previously only been used to study organisms with brains, yet here we demonstrate that a brainless unicellular organism compares the relative qualities of multiple options, integrates over repeated samplings to perform well in random environments, and combines information on reward frequency and magnitude in order to make correct and adaptive decisions. We extend our inquiry by using Bayesian model selection to determine the most likely algorithm used by the cell when making decisions. We deduce that this algorithm centres around a tendency to exploit environments in proportion to their reward experienced through past sampling. The algorithm is intermediate in computational complexity between simple, reactionary heuristics and calculation-intensive optimal performance algorithms, yet it has very good relative performance. Our study provides insight into ancestral mechanisms of decision-making and suggests that fundamental principles of decision-making, information processing and even cognition are shared among diverse biological systems.

LanguageEnglish
Article number20160030
Pages1-8
Number of pages8
JournalJournal of the Royal Society Interface
Volume13
Issue number119
DOIs
StatePublished - 1 Jun 2016

Fingerprint

Brain
Decision Making
Decision making
Reward
Physarum polycephalum
Sampling
Biological systems
Automatic Data Processing
Cognition
Computational complexity
Animals
Fungi

Bibliographical note

Copyright the Author(s) 2016. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Cite this

Reid, C. R., MacDonald, H., Mann, R. P., Marshall, J. A. R., Latty, T., & Garnier, S. (2016). Decision-making without a brain: How an amoeboid organism solves the two-armed bandit. Journal of the Royal Society Interface, 13(119), 1-8. [20160030]. DOI: 10.1098/rsif.2016.0030
Reid, Chris R. ; MacDonald, Hannelore ; Mann, Richard P. ; Marshall, James A R ; Latty, Tanya ; Garnier, Simon. / Decision-making without a brain : How an amoeboid organism solves the two-armed bandit. In: Journal of the Royal Society Interface. 2016 ; Vol. 13, No. 119. pp. 1-8
@article{2cce33b1f92c41038c64fe43c990822a,
title = "Decision-making without a brain: How an amoeboid organism solves the two-armed bandit",
abstract = "Several recent studies hint at shared patterns in decision-making between taxonomically distant organisms, yet few studies demonstrate and dissect mechanisms of decision-making in simpler organisms. We examine decision-making in the unicellular slime mould Physarum polycephalum using a classical decision problem adapted from human and animal decision-making studies: the two-armed bandit problem. This problem has previously only been used to study organisms with brains, yet here we demonstrate that a brainless unicellular organism compares the relative qualities of multiple options, integrates over repeated samplings to perform well in random environments, and combines information on reward frequency and magnitude in order to make correct and adaptive decisions. We extend our inquiry by using Bayesian model selection to determine the most likely algorithm used by the cell when making decisions. We deduce that this algorithm centres around a tendency to exploit environments in proportion to their reward experienced through past sampling. The algorithm is intermediate in computational complexity between simple, reactionary heuristics and calculation-intensive optimal performance algorithms, yet it has very good relative performance. Our study provides insight into ancestral mechanisms of decision-making and suggests that fundamental principles of decision-making, information processing and even cognition are shared among diverse biological systems.",
author = "Reid, {Chris R.} and Hannelore MacDonald and Mann, {Richard P.} and Marshall, {James A R} and Tanya Latty and Simon Garnier",
note = "Copyright the Author(s) 2016. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.",
year = "2016",
month = "6",
day = "1",
doi = "10.1098/rsif.2016.0030",
language = "English",
volume = "13",
pages = "1--8",
journal = "Journal of the Royal Society Interface",
issn = "1742-5689",
publisher = "The Royal Society Publishing",
number = "119",

}

Reid, CR, MacDonald, H, Mann, RP, Marshall, JAR, Latty, T & Garnier, S 2016, 'Decision-making without a brain: How an amoeboid organism solves the two-armed bandit' Journal of the Royal Society Interface, vol 13, no. 119, 20160030, pp. 1-8. DOI: 10.1098/rsif.2016.0030

Decision-making without a brain : How an amoeboid organism solves the two-armed bandit. / Reid, Chris R.; MacDonald, Hannelore; Mann, Richard P.; Marshall, James A R; Latty, Tanya; Garnier, Simon.

In: Journal of the Royal Society Interface, Vol. 13, No. 119, 20160030, 01.06.2016, p. 1-8.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Decision-making without a brain

T2 - Journal of the Royal Society Interface

AU - Reid,Chris R.

AU - MacDonald,Hannelore

AU - Mann,Richard P.

AU - Marshall,James A R

AU - Latty,Tanya

AU - Garnier,Simon

N1 - Copyright the Author(s) 2016. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

PY - 2016/6/1

Y1 - 2016/6/1

N2 - Several recent studies hint at shared patterns in decision-making between taxonomically distant organisms, yet few studies demonstrate and dissect mechanisms of decision-making in simpler organisms. We examine decision-making in the unicellular slime mould Physarum polycephalum using a classical decision problem adapted from human and animal decision-making studies: the two-armed bandit problem. This problem has previously only been used to study organisms with brains, yet here we demonstrate that a brainless unicellular organism compares the relative qualities of multiple options, integrates over repeated samplings to perform well in random environments, and combines information on reward frequency and magnitude in order to make correct and adaptive decisions. We extend our inquiry by using Bayesian model selection to determine the most likely algorithm used by the cell when making decisions. We deduce that this algorithm centres around a tendency to exploit environments in proportion to their reward experienced through past sampling. The algorithm is intermediate in computational complexity between simple, reactionary heuristics and calculation-intensive optimal performance algorithms, yet it has very good relative performance. Our study provides insight into ancestral mechanisms of decision-making and suggests that fundamental principles of decision-making, information processing and even cognition are shared among diverse biological systems.

AB - Several recent studies hint at shared patterns in decision-making between taxonomically distant organisms, yet few studies demonstrate and dissect mechanisms of decision-making in simpler organisms. We examine decision-making in the unicellular slime mould Physarum polycephalum using a classical decision problem adapted from human and animal decision-making studies: the two-armed bandit problem. This problem has previously only been used to study organisms with brains, yet here we demonstrate that a brainless unicellular organism compares the relative qualities of multiple options, integrates over repeated samplings to perform well in random environments, and combines information on reward frequency and magnitude in order to make correct and adaptive decisions. We extend our inquiry by using Bayesian model selection to determine the most likely algorithm used by the cell when making decisions. We deduce that this algorithm centres around a tendency to exploit environments in proportion to their reward experienced through past sampling. The algorithm is intermediate in computational complexity between simple, reactionary heuristics and calculation-intensive optimal performance algorithms, yet it has very good relative performance. Our study provides insight into ancestral mechanisms of decision-making and suggests that fundamental principles of decision-making, information processing and even cognition are shared among diverse biological systems.

UR - http://www.scopus.com/inward/record.url?scp=84983020775&partnerID=8YFLogxK

U2 - 10.1098/rsif.2016.0030

DO - 10.1098/rsif.2016.0030

M3 - Article

VL - 13

SP - 1

EP - 8

JO - Journal of the Royal Society Interface

JF - Journal of the Royal Society Interface

SN - 1742-5689

IS - 119

M1 - 20160030

ER -

Reid CR, MacDonald H, Mann RP, Marshall JAR, Latty T, Garnier S. Decision-making without a brain: How an amoeboid organism solves the two-armed bandit. Journal of the Royal Society Interface. 2016 Jun 1;13(119):1-8. 20160030. Available from, DOI: 10.1098/rsif.2016.0030