• Login
    View Item 
    •   UMB Digital Archive
    • UMB Open Access Articles
    • UMB Open Access Articles 2018
    • View Item
    •   UMB Digital Archive
    • UMB Open Access Articles
    • UMB Open Access Articles 2018
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Browse

    All of UMB Digital ArchiveCommunitiesPublication DateAuthorsTitlesSubjectsThis CollectionPublication DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    Display statistics

    Rethinking dopamine as generalized prediction error

    • CSV
    • RefMan
    • EndNote
    • BibTex
    • RefWorks
    Author
    Gardner, M.P.H.
    Schoenbaum, G.
    Gershman, S.J.
    Date
    2018
    Journal
    Proceedings of the Royal Society B: Biological Sciences
    Publisher
    Royal Society Publishing
    Type
    Article
    
    Metadata
    Show full item record
    See at
    https://dx.doi.org/10.1098/rspb.2018.1645
    Abstract
    Midbrain dopamine neurons are commonly thought to report a reward prediction error (RPE), as hypothesized by reinforcement learning (RL) theory. While this theory has been highly successful, several lines of evidence suggest that dopamine activity also encodes sensory prediction errors unrelated to reward. Here, we develop a new theory of dopamine function that embraces a broader conceptualization of prediction errors. By signalling errors in both sensory and reward predictions, dopamine supports a form of RL that lies between model-based and model-free algorithms. This account remains consistent with current canon regarding the correspondence between dopamine transients and RPEs, while also accounting for new data suggesting a role for these signals in phenomena such as sensory preconditioning and identity unblocking, which ostensibly draw upon knowledge beyond reward predictions. � 2018 The Author(s) Published by the Royal Society. All rights reserved.
    Keyword
    Reinforcement learning
    Successor representation
    Temporal difference learning
    Identifier to cite or link to this item
    https://www.scopus.com/inward/record.uri?eid=2-s2.0-85056957403&doi=10.1098%2frspb.2018.1645&partnerID=40&md5=790ab4b6e8a27a7e9332e8e2fe3c7748; http://hdl.handle.net/10713/8838
    ae974a485f413a2113503eed53cd6c53
    10.1098/rspb.2018.1645
    Scopus Count
    Collections
    UMB Open Access Articles 2018

    entitlement

    Related articles

    • Optogenetic Blockade of Dopamine Transients Prevents Learning Induced by Changes in Reward Features.
    • Authors: Chang CY, Gardner M, Di Tillio MG, Schoenbaum G
    • Issue date: 2017 Nov 20
    • Belief state representation in the dopamine system.
    • Authors: Babayan BM, Uchida N, Gershman SJ
    • Issue date: 2018 May 14
    • The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons.
    • Authors: Tanaka S, O'Doherty JP, Sakagami M
    • Issue date: 2019 Aug 15
    • Dopamine role in learning and action inference.
    • Authors: Bogacz R
    • Issue date: 2020 Jul 7
    • Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards.
    • Authors: Takahashi YK, Batchelor HM, Liu B, Khanna A, Morales M, Schoenbaum G
    • Issue date: 2017 Sep 13
    DSpace software (copyright © 2002 - 2021)  DuraSpace
    Quick Guide | Policies | Contact Us | UMB Health Sciences & Human Services Library
    Open Repository is a service operated by 
    Atmire NV
     

    Export search results

    The export option will allow you to export the current search results of the entered query to a file. Different formats are available for download. To export the items, click on the button corresponding with the preferred download format.

    By default, clicking on the export buttons will result in a download of the allowed maximum amount of items.

    To select a subset of the search results, click "Selective Export" button and make a selection of the items you want to export. The amount of items that can be exported at once is similarly restricted as the full export.

    After making a selection, click one of the export format buttons. The amount of items that will be exported is indicated in the bubble next to export format.