JournalProceedings of the Royal Society B: Biological Sciences
PublisherRoyal Society Publishing
MetadataShow full item record
AbstractMidbrain dopamine neurons are commonly thought to report a reward prediction error (RPE), as hypothesized by reinforcement learning (RL) theory. While this theory has been highly successful, several lines of evidence suggest that dopamine activity also encodes sensory prediction errors unrelated to reward. Here, we develop a new theory of dopamine function that embraces a broader conceptualization of prediction errors. By signalling errors in both sensory and reward predictions, dopamine supports a form of RL that lies between model-based and model-free algorithms. This account remains consistent with current canon regarding the correspondence between dopamine transients and RPEs, while also accounting for new data suggesting a role for these signals in phenomena such as sensory preconditioning and identity unblocking, which ostensibly draw upon knowledge beyond reward predictions. � 2018 The Author(s) Published by the Royal Society. All rights reserved.
Identifier to cite or link to this itemhttps://www.scopus.com/inward/record.uri?eid=2-s2.0-85056957403&doi=10.1098%2frspb.2018.1645&partnerID=40&md5=790ab4b6e8a27a7e9332e8e2fe3c7748; http://hdl.handle.net/10713/8838
- Optogenetic Blockade of Dopamine Transients Prevents Learning Induced by Changes in Reward Features.
- Authors: Chang CY, Gardner M, Di Tillio MG, Schoenbaum G
- Issue date: 2017 Nov 20
- Belief state representation in the dopamine system.
- Authors: Babayan BM, Uchida N, Gershman SJ
- Issue date: 2018 May 14
- The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons.
- Authors: Tanaka S, O'Doherty JP, Sakagami M
- Issue date: 2019 Aug 15
- Dopamine role in learning and action inference.
- Authors: Bogacz R
- Issue date: 2020 Jul 7
- Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards.
- Authors: Takahashi YK, Batchelor HM, Liu B, Khanna A, Morales M, Schoenbaum G
- Issue date: 2017 Sep 13