• Chase et al. 2015
    Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis.
    Cognitive, Affective and Behavioral Neuroscience15(2): 435-459.
    Chase HW, Kumar P, Eickhoff SB, Dombrovski AY

    Downloaded 19 times

    ABSTRACT: Reinforcement learning describes motivated behavior in terms of two abstract signals. The representation of discrepancies between expected and actual rewards/punishments-prediction error-is thought to update the expected value of actions and predictive stimuli. Electrophysiological and lesion studies have suggested that mesostriatal prediction error signals control behavior through synaptic modification of cortico-striato-thalamic networks. Signals in the ventromedial prefrontal and orbitofrontal cortex are implicated in representing expected value. To obtain unbiased maps of these representations in the human brain, we performed a meta-analysis of functional magnetic resonance imaging studies that had employed algorithmic reinforcement learning models across a variety of experimental paradigms. We found that the ventral striatum (medial and lateral) and midbrain/thalamus represented reward prediction errors, consistent with animal studies. Prediction error signals were also seen in the frontal operculum/insula, particularly for social rewards. In Pavlovian studies, striatal prediction error signals extended into the amygdala, whereas instrumental tasks engaged the caudate. Prediction error maps were sensitive to the model-fitting procedure (fixed or individually estimated) and to the extent of spatial smoothing. A correlate of expected value was found in a posterior region of the ventromedial prefrontal cortex, caudal and medial to the orbitofrontal regions identified in animal studies. These findings highlight a reproducible motif of reinforcement learning in the cortico-striatal loops and identify methodological dimensions that may influence the reproducibility of activation patterns across studies.
    Keywords: Reinforcement learning -- fMRI -- ALE
    Submitted by: HenryChase
    Current version: 1
    Last modified: 2016-03-16 20:50:36
    Redistributable: true
    ANIMA ID: 466631

    Altmetric info:

  • Please wait, we're fetching the list of elements...

  • To view a study element, click the next to it in the Elements tab.