Impulse control disorders in Parkinson's disease are associated with dysfunction in stimulus valuation but not action valuation.
Identifieur interne : 000734 ( PubMed/Corpus ); précédent : 000733; suivant : 000735Impulse control disorders in Parkinson's disease are associated with dysfunction in stimulus valuation but not action valuation.
Auteurs : Payam Piray ; Yashar Zeighami ; Fariba Bahrami ; Abeer M. Eissa ; Doaa H. Hewedi ; Ahmed A. MoustafaSource :
- The Journal of neuroscience : the official journal of the Society for Neuroscience [ 1529-2401 ] ; 2014.
English descriptors
- KwdEn :
- Aged, Antipsychotic Agents (therapeutic use), Computer Simulation, Disruptive, Impulse Control, and Conduct Disorders (complications), Female, Humans, Male, Middle Aged, Models, Psychological, Parkinson Disease (complications), Parkinson Disease (drug therapy), Probability Learning, Punishment, Reinforcement (Psychology), Reward, Severity of Illness Index.
- MESH :
- chemical , therapeutic use : Antipsychotic Agents.
- complications : Disruptive, Impulse Control, and Conduct Disorders, Parkinson Disease.
- drug therapy : Parkinson Disease.
- Aged, Computer Simulation, Female, Humans, Male, Middle Aged, Models, Psychological, Probability Learning, Punishment, Reinforcement (Psychology), Reward, Severity of Illness Index.
Abstract
A substantial subset of Parkinson's disease (PD) patients suffers from impulse control disorders (ICDs), which are side effects of dopaminergic medication. Dopamine plays a key role in reinforcement learning processes. One class of reinforcement learning models, known as the actor-critic model, suggests that two components are involved in these reinforcement learning processes: a critic, which estimates values of stimuli and calculates prediction errors, and an actor, which estimates values of potential actions. To understand the information processing mechanism underlying impulsive behavior, we investigated stimulus and action value learning from reward and punishment in four groups of participants: on-medication PD patients with ICD, on-medication PD patients without ICD, off-medication PD patients without ICD, and healthy controls. Analysis of responses suggested that participants used an actor-critic learning strategy and computed prediction errors based on stimulus values rather than action values. Quantitative model fits also revealed that an actor-critic model of the basal ganglia with different learning rates for positive and negative prediction errors best matched the choice data. Moreover, whereas ICDs were associated with model parameters related to stimulus valuation (critic), PD was associated with parameters related to action valuation (actor). Specifically, PD patients with ICD exhibited lower learning from negative prediction errors in the critic, resulting in an underestimation of adverse consequences associated with stimuli. These findings offer a specific neurocomputational account of the nature of compulsive behaviors induced by dopaminergic drugs.
DOI: 10.1523/JNEUROSCI.4063-13.2014
PubMed: 24899705
Links to Exploration step
pubmed:24899705Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Impulse control disorders in Parkinson's disease are associated with dysfunction in stimulus valuation but not action valuation.</title><author><name sortKey="Piray, Payam" sort="Piray, Payam" uniqKey="Piray P" first="Payam" last="Piray">Payam Piray</name><affiliation><nlm:affiliation>Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, 6500 HB Nijmegen, the Netherlands, p.piray@donders.ru.nl a.moustafa@uws.edu.au.</nlm:affiliation></affiliation></author><author><name sortKey="Zeighami, Yashar" sort="Zeighami, Yashar" uniqKey="Zeighami Y" first="Yashar" last="Zeighami">Yashar Zeighami</name><affiliation><nlm:affiliation>Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.</nlm:affiliation></affiliation></author><author><name sortKey="Bahrami, Fariba" sort="Bahrami, Fariba" uniqKey="Bahrami F" first="Fariba" last="Bahrami">Fariba Bahrami</name><affiliation><nlm:affiliation>Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, University College of Engineering, University of Tehran, 14395-515 Tehran, Iran.</nlm:affiliation></affiliation></author><author><name sortKey="Eissa, Abeer M" sort="Eissa, Abeer M" uniqKey="Eissa A" first="Abeer M" last="Eissa">Abeer M. Eissa</name><affiliation><nlm:affiliation>Psychogeriatric Research Center, Department of Psychiatry, School of Medicine, Ain Shams University, 11566 Cairo, Egypt, and.</nlm:affiliation></affiliation></author><author><name sortKey="Hewedi, Doaa H" sort="Hewedi, Doaa H" uniqKey="Hewedi D" first="Doaa H" last="Hewedi">Doaa H. Hewedi</name><affiliation><nlm:affiliation>Psychogeriatric Research Center, Department of Psychiatry, School of Medicine, Ain Shams University, 11566 Cairo, Egypt, and.</nlm:affiliation></affiliation></author><author><name sortKey="Moustafa, Ahmed A" sort="Moustafa, Ahmed A" uniqKey="Moustafa A" first="Ahmed A" last="Moustafa">Ahmed A. Moustafa</name><affiliation><nlm:affiliation>School of Social Sciences and Psychology and Marcs Institute for Brain and Behaviour, University of Western Sydney, NSW 2751, Australia p.piray@donders.ru.nl a.moustafa@uws.edu.au.</nlm:affiliation></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PubMed</idno><date when="2014">2014</date><idno type="RBID">pubmed:24899705</idno><idno type="pmid">24899705</idno><idno type="doi">10.1523/JNEUROSCI.4063-13.2014</idno><idno type="wicri:Area/PubMed/Corpus">000734</idno><idno type="wicri:explorRef" wicri:stream="PubMed" wicri:step="Corpus" wicri:corpus="PubMed">000734</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Impulse control disorders in Parkinson's disease are associated with dysfunction in stimulus valuation but not action valuation.</title><author><name sortKey="Piray, Payam" sort="Piray, Payam" uniqKey="Piray P" first="Payam" last="Piray">Payam Piray</name><affiliation><nlm:affiliation>Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, 6500 HB Nijmegen, the Netherlands, p.piray@donders.ru.nl a.moustafa@uws.edu.au.</nlm:affiliation></affiliation></author><author><name sortKey="Zeighami, Yashar" sort="Zeighami, Yashar" uniqKey="Zeighami Y" first="Yashar" last="Zeighami">Yashar Zeighami</name><affiliation><nlm:affiliation>Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.</nlm:affiliation></affiliation></author><author><name sortKey="Bahrami, Fariba" sort="Bahrami, Fariba" uniqKey="Bahrami F" first="Fariba" last="Bahrami">Fariba Bahrami</name><affiliation><nlm:affiliation>Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, University College of Engineering, University of Tehran, 14395-515 Tehran, Iran.</nlm:affiliation></affiliation></author><author><name sortKey="Eissa, Abeer M" sort="Eissa, Abeer M" uniqKey="Eissa A" first="Abeer M" last="Eissa">Abeer M. Eissa</name><affiliation><nlm:affiliation>Psychogeriatric Research Center, Department of Psychiatry, School of Medicine, Ain Shams University, 11566 Cairo, Egypt, and.</nlm:affiliation></affiliation></author><author><name sortKey="Hewedi, Doaa H" sort="Hewedi, Doaa H" uniqKey="Hewedi D" first="Doaa H" last="Hewedi">Doaa H. Hewedi</name><affiliation><nlm:affiliation>Psychogeriatric Research Center, Department of Psychiatry, School of Medicine, Ain Shams University, 11566 Cairo, Egypt, and.</nlm:affiliation></affiliation></author><author><name sortKey="Moustafa, Ahmed A" sort="Moustafa, Ahmed A" uniqKey="Moustafa A" first="Ahmed A" last="Moustafa">Ahmed A. Moustafa</name><affiliation><nlm:affiliation>School of Social Sciences and Psychology and Marcs Institute for Brain and Behaviour, University of Western Sydney, NSW 2751, Australia p.piray@donders.ru.nl a.moustafa@uws.edu.au.</nlm:affiliation></affiliation></author></analytic><series><title level="j">The Journal of neuroscience : the official journal of the Society for Neuroscience</title><idno type="eISSN">1529-2401</idno><imprint><date when="2014" type="published">2014</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Aged</term><term>Antipsychotic Agents (therapeutic use)</term><term>Computer Simulation</term><term>Disruptive, Impulse Control, and Conduct Disorders (complications)</term><term>Female</term><term>Humans</term><term>Male</term><term>Middle Aged</term><term>Models, Psychological</term><term>Parkinson Disease (complications)</term><term>Parkinson Disease (drug therapy)</term><term>Probability Learning</term><term>Punishment</term><term>Reinforcement (Psychology)</term><term>Reward</term><term>Severity of Illness Index</term></keywords><keywords scheme="MESH" type="chemical" qualifier="therapeutic use" xml:lang="en"><term>Antipsychotic Agents</term></keywords><keywords scheme="MESH" qualifier="complications" xml:lang="en"><term>Disruptive, Impulse Control, and Conduct Disorders</term><term>Parkinson Disease</term></keywords><keywords scheme="MESH" qualifier="drug therapy" xml:lang="en"><term>Parkinson Disease</term></keywords><keywords scheme="MESH" xml:lang="en"><term>Aged</term><term>Computer Simulation</term><term>Female</term><term>Humans</term><term>Male</term><term>Middle Aged</term><term>Models, Psychological</term><term>Probability Learning</term><term>Punishment</term><term>Reinforcement (Psychology)</term><term>Reward</term><term>Severity of Illness Index</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">A substantial subset of Parkinson's disease (PD) patients suffers from impulse control disorders (ICDs), which are side effects of dopaminergic medication. Dopamine plays a key role in reinforcement learning processes. One class of reinforcement learning models, known as the actor-critic model, suggests that two components are involved in these reinforcement learning processes: a critic, which estimates values of stimuli and calculates prediction errors, and an actor, which estimates values of potential actions. To understand the information processing mechanism underlying impulsive behavior, we investigated stimulus and action value learning from reward and punishment in four groups of participants: on-medication PD patients with ICD, on-medication PD patients without ICD, off-medication PD patients without ICD, and healthy controls. Analysis of responses suggested that participants used an actor-critic learning strategy and computed prediction errors based on stimulus values rather than action values. Quantitative model fits also revealed that an actor-critic model of the basal ganglia with different learning rates for positive and negative prediction errors best matched the choice data. Moreover, whereas ICDs were associated with model parameters related to stimulus valuation (critic), PD was associated with parameters related to action valuation (actor). Specifically, PD patients with ICD exhibited lower learning from negative prediction errors in the critic, resulting in an underestimation of adverse consequences associated with stimuli. These findings offer a specific neurocomputational account of the nature of compulsive behaviors induced by dopaminergic drugs.</div></front></TEI><pubmed><MedlineCitation Status="MEDLINE" Owner="NLM"><PMID Version="1">24899705</PMID><DateCreated><Year>2014</Year><Month>06</Month><Day>06</Day></DateCreated><DateCompleted><Year>2014</Year><Month>07</Month><Day>25</Day></DateCompleted><DateRevised><Year>2015</Year><Month>11</Month><Day>19</Day></DateRevised><Article PubModel="Print"><Journal><ISSN IssnType="Electronic">1529-2401</ISSN><JournalIssue CitedMedium="Internet"><Volume>34</Volume><Issue>23</Issue><PubDate><Year>2014</Year><Month>Jun</Month><Day>04</Day></PubDate></JournalIssue><Title>The Journal of neuroscience : the official journal of the Society for Neuroscience</Title><ISOAbbreviation>J. Neurosci.</ISOAbbreviation></Journal><ArticleTitle>Impulse control disorders in Parkinson's disease are associated with dysfunction in stimulus valuation but not action valuation.</ArticleTitle><Pagination><MedlinePgn>7814-24</MedlinePgn></Pagination><ELocationID EIdType="doi" ValidYN="Y">10.1523/JNEUROSCI.4063-13.2014</ELocationID><Abstract><AbstractText>A substantial subset of Parkinson's disease (PD) patients suffers from impulse control disorders (ICDs), which are side effects of dopaminergic medication. Dopamine plays a key role in reinforcement learning processes. One class of reinforcement learning models, known as the actor-critic model, suggests that two components are involved in these reinforcement learning processes: a critic, which estimates values of stimuli and calculates prediction errors, and an actor, which estimates values of potential actions. To understand the information processing mechanism underlying impulsive behavior, we investigated stimulus and action value learning from reward and punishment in four groups of participants: on-medication PD patients with ICD, on-medication PD patients without ICD, off-medication PD patients without ICD, and healthy controls. Analysis of responses suggested that participants used an actor-critic learning strategy and computed prediction errors based on stimulus values rather than action values. Quantitative model fits also revealed that an actor-critic model of the basal ganglia with different learning rates for positive and negative prediction errors best matched the choice data. Moreover, whereas ICDs were associated with model parameters related to stimulus valuation (critic), PD was associated with parameters related to action valuation (actor). Specifically, PD patients with ICD exhibited lower learning from negative prediction errors in the critic, resulting in an underestimation of adverse consequences associated with stimuli. These findings offer a specific neurocomputational account of the nature of compulsive behaviors induced by dopaminergic drugs.</AbstractText><CopyrightInformation>Copyright © 2014 the authors 0270-6474/14/347814-11$15.00/0.</CopyrightInformation></Abstract><AuthorList CompleteYN="Y"><Author ValidYN="Y"><LastName>Piray</LastName><ForeName>Payam</ForeName><Initials>P</Initials><AffiliationInfo><Affiliation>Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, 6500 HB Nijmegen, the Netherlands, p.piray@donders.ru.nl a.moustafa@uws.edu.au.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Zeighami</LastName><ForeName>Yashar</ForeName><Initials>Y</Initials><AffiliationInfo><Affiliation>Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Bahrami</LastName><ForeName>Fariba</ForeName><Initials>F</Initials><AffiliationInfo><Affiliation>Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, University College of Engineering, University of Tehran, 14395-515 Tehran, Iran.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Eissa</LastName><ForeName>Abeer M</ForeName><Initials>AM</Initials><AffiliationInfo><Affiliation>Psychogeriatric Research Center, Department of Psychiatry, School of Medicine, Ain Shams University, 11566 Cairo, Egypt, and.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Hewedi</LastName><ForeName>Doaa H</ForeName><Initials>DH</Initials><AffiliationInfo><Affiliation>Psychogeriatric Research Center, Department of Psychiatry, School of Medicine, Ain Shams University, 11566 Cairo, Egypt, and.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Moustafa</LastName><ForeName>Ahmed A</ForeName><Initials>AA</Initials><AffiliationInfo><Affiliation>School of Social Sciences and Psychology and Marcs Institute for Brain and Behaviour, University of Western Sydney, NSW 2751, Australia p.piray@donders.ru.nl a.moustafa@uws.edu.au.</Affiliation></AffiliationInfo></Author></AuthorList><Language>eng</Language><PublicationTypeList><PublicationType UI="D016428">Journal Article</PublicationType><PublicationType UI="D013485">Research Support, Non-U.S. Gov't</PublicationType></PublicationTypeList></Article><MedlineJournalInfo><Country>United States</Country><MedlineTA>J Neurosci</MedlineTA><NlmUniqueID>8102140</NlmUniqueID><ISSNLinking>0270-6474</ISSNLinking></MedlineJournalInfo><ChemicalList><Chemical><RegistryNumber>0</RegistryNumber><NameOfSubstance UI="D014150">Antipsychotic Agents</NameOfSubstance></Chemical></ChemicalList><CitationSubset>IM</CitationSubset><MeshHeadingList><MeshHeading><DescriptorName UI="D000368" MajorTopicYN="N">Aged</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D014150" MajorTopicYN="N">Antipsychotic Agents</DescriptorName><QualifierName UI="Q000627" MajorTopicYN="Y">therapeutic use</QualifierName></MeshHeading><MeshHeading><DescriptorName UI="D003198" MajorTopicYN="N">Computer Simulation</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D007174" MajorTopicYN="N">Disruptive, Impulse Control, and Conduct Disorders</DescriptorName><QualifierName UI="Q000150" MajorTopicYN="Y">complications</QualifierName></MeshHeading><MeshHeading><DescriptorName UI="D005260" MajorTopicYN="N">Female</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D006801" MajorTopicYN="N">Humans</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D008297" MajorTopicYN="N">Male</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D008875" MajorTopicYN="N">Middle Aged</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D008960" MajorTopicYN="N">Models, Psychological</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D010300" MajorTopicYN="N">Parkinson Disease</DescriptorName><QualifierName UI="Q000150" MajorTopicYN="Y">complications</QualifierName><QualifierName UI="Q000188" MajorTopicYN="Y">drug therapy</QualifierName></MeshHeading><MeshHeading><DescriptorName UI="D011337" MajorTopicYN="N">Probability Learning</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D011678" MajorTopicYN="N">Punishment</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D012054" MajorTopicYN="Y">Reinforcement (Psychology)</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D012201" MajorTopicYN="N">Reward</DescriptorName></MeshHeading><MeshHeading><DescriptorName UI="D012720" MajorTopicYN="N">Severity of Illness Index</DescriptorName></MeshHeading></MeshHeadingList><KeywordList Owner="NOTNLM"><Keyword MajorTopicYN="N">Parkinson's disease</Keyword><Keyword MajorTopicYN="N">computational modeling</Keyword><Keyword MajorTopicYN="N">dopamine</Keyword><Keyword MajorTopicYN="N">impulse control disorders</Keyword><Keyword MajorTopicYN="N">prediction error</Keyword><Keyword MajorTopicYN="N">reinforcement learning</Keyword></KeywordList></MedlineCitation><PubmedData><History><PubMedPubDate PubStatus="entrez"><Year>2014</Year><Month>6</Month><Day>6</Day><Hour>6</Hour><Minute>0</Minute></PubMedPubDate><PubMedPubDate PubStatus="pubmed"><Year>2014</Year><Month>6</Month><Day>6</Day><Hour>6</Hour><Minute>0</Minute></PubMedPubDate><PubMedPubDate PubStatus="medline"><Year>2014</Year><Month>7</Month><Day>26</Day><Hour>6</Hour><Minute>0</Minute></PubMedPubDate></History><PublicationStatus>ppublish</PublicationStatus><ArticleIdList><ArticleId IdType="pubmed">24899705</ArticleId><ArticleId IdType="pii">34/23/7814</ArticleId><ArticleId IdType="doi">10.1523/JNEUROSCI.4063-13.2014</ArticleId></ArticleIdList></PubmedData></pubmed></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Canada/explor/ParkinsonCanadaV1/Data/PubMed/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000734 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/PubMed/Corpus/biblio.hfd -nk 000734 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Canada
|area= ParkinsonCanadaV1
|flux= PubMed
|étape= Corpus
|type= RBID
|clé= pubmed:24899705
|texte= Impulse control disorders in Parkinson's disease are associated with dysfunction in stimulus valuation but not action valuation.
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/PubMed/Corpus/RBID.i -Sk "pubmed:24899705" \
| HfdSelect -Kh $EXPLOR_AREA/Data/PubMed/Corpus/biblio.hfd \
| NlmPubMed2Wicri -a ParkinsonCanadaV1
| This area was generated with Dilib version V0.6.29. |  |