Exploring the cognitive and motor functions of the basal ganglia: an integrative review of computational cognitive neuroscience models
Identifieur interne : 000439 ( Ncbi/Merge ); précédent : 000438; suivant : 000440Exploring the cognitive and motor functions of the basal ganglia: an integrative review of computational cognitive neuroscience models
Auteurs : Sebastien Helie [États-Unis] ; Srinivasa Chakravarthy [Inde] ; Ahmed MoustafaSource :
- Frontiers in Computational Neuroscience ; 2013.
Abstract
Many computational models of the basal ganglia (BG) have been proposed over the past twenty-five years. While computational neuroscience models have focused on closely matching the neurobiology of the BG,
Url:
DOI: 10.3389/fncom.2013.00174
PubMed: 24367325
PubMed Central: 3854553
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000315
- to stream Pmc, to step Curation: 000315
- to stream Pmc, to step Checkpoint: 000079
Links to Exploration step
PMC:3854553Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Exploring the cognitive and motor functions of the basal ganglia: an integrative review of computational cognitive neuroscience models</title>
<author><name sortKey="Helie, Sebastien" sort="Helie, Sebastien" uniqKey="Helie S" first="Sebastien" last="Helie">Sebastien Helie</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Psychological Sciences, Purdue University</institution>
<country>West Lafayette, IN, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Chakravarthy, Srinivasa" sort="Chakravarthy, Srinivasa" uniqKey="Chakravarthy S" first="Srinivasa" last="Chakravarthy">Srinivasa Chakravarthy</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Department of Biotechnology, Indian Institute of Technology</institution>
<country>Madras, India</country>
</nlm:aff>
<country xml:lang="fr">Inde</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Moustafa, Ahmed A" sort="Moustafa, Ahmed A" uniqKey="Moustafa A" first="Ahmed" last="Moustafa">Ahmed Moustafa</name>
<affiliation><nlm:aff>NONE</nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">24367325</idno>
<idno type="pmc">3854553</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3854553</idno>
<idno type="RBID">PMC:3854553</idno>
<idno type="doi">10.3389/fncom.2013.00174</idno>
<date when="2013">2013</date>
<idno type="wicri:Area/Pmc/Corpus">000315</idno>
<idno type="wicri:Area/Pmc/Curation">000315</idno>
<idno type="wicri:Area/Pmc/Checkpoint">000079</idno>
<idno type="wicri:Area/Ncbi/Merge">000439</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Exploring the cognitive and motor functions of the basal ganglia: an integrative review of computational cognitive neuroscience models</title>
<author><name sortKey="Helie, Sebastien" sort="Helie, Sebastien" uniqKey="Helie S" first="Sebastien" last="Helie">Sebastien Helie</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Psychological Sciences, Purdue University</institution>
<country>West Lafayette, IN, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Chakravarthy, Srinivasa" sort="Chakravarthy, Srinivasa" uniqKey="Chakravarthy S" first="Srinivasa" last="Chakravarthy">Srinivasa Chakravarthy</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Department of Biotechnology, Indian Institute of Technology</institution>
<country>Madras, India</country>
</nlm:aff>
<country xml:lang="fr">Inde</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Moustafa, Ahmed A" sort="Moustafa, Ahmed A" uniqKey="Moustafa A" first="Ahmed" last="Moustafa">Ahmed Moustafa</name>
<affiliation><nlm:aff>NONE</nlm:aff>
</affiliation>
</author>
</analytic>
<series><title level="j">Frontiers in Computational Neuroscience</title>
<idno type="e-ISSN">1662-5188</idno>
<imprint><date when="2013">2013</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>Many computational models of the basal ganglia (BG) have been proposed over the past twenty-five years. While computational neuroscience models have focused on closely matching the neurobiology of the BG, <italic>computational cognitive neuroscience</italic>
(CCN) models have focused on how the BG can be used to implement cognitive and motor functions. This review article focuses on CCN models of the BG and how they use the neuroanatomy of the BG to account for cognitive and motor functions such as categorization, instrumental conditioning, probabilistic learning, working memory, sequence learning, automaticity, reaching, handwriting, and eye saccades. A total of 19 BG models accounting for one or more of these functions are reviewed and compared. The review concludes with a discussion of the limitations of existing CCN models of the BG and prescriptions for future modeling, including the need for computational models of the BG that can simultaneously account for cognitive and motor functions, and the need for a more complete specification of the role of the BG in behavioral functions.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Apicella, P" uniqKey="Apicella P">P. Apicella</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
<author><name sortKey="Alfonso Reese, L A" uniqKey="Alfonso Reese L">L. A. Alfonso-Reese</name>
</author>
<author><name sortKey="Turken, A U" uniqKey="Turken A">A. U. Turken</name>
</author>
<author><name sortKey="Waldron, E M" uniqKey="Waldron E">E. M. Waldron</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
<author><name sortKey="Crossley, M J" uniqKey="Crossley M">M. J. Crossley</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
<author><name sortKey="Ell, S W" uniqKey="Ell S">S. W. Ell</name>
</author>
<author><name sortKey="Valentin, V V" uniqKey="Valentin V">V. V. Valentin</name>
</author>
<author><name sortKey="Casale, M B" uniqKey="Casale M">M. B. Casale</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
<author><name sortKey="Ell, S W" uniqKey="Ell S">S. W. Ell</name>
</author>
<author><name sortKey="Waldron, E M" uniqKey="Waldron E">E. M. Waldron</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
<author><name sortKey="Ennis, J M" uniqKey="Ennis J">J. M. Ennis</name>
</author>
<author><name sortKey="Spiering, B J" uniqKey="Spiering B">B. J. Spiering</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
<author><name sortKey="Gott, R E" uniqKey="Gott R">R. E. Gott</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
<author><name sortKey="Helie, S" uniqKey="Helie S">S. Helie</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Assadi, S M" uniqKey="Assadi S">S. M. Assadi</name>
</author>
<author><name sortKey="Yucel, M" uniqKey="Yucel M">M. Yucel</name>
</author>
<author><name sortKey="Pantelis, C" uniqKey="Pantelis C">C. Pantelis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Batuev, A S" uniqKey="Batuev A">A. S. Batuev</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bergman, H" uniqKey="Bergman H">H. Bergman</name>
</author>
<author><name sortKey="Whichman, T" uniqKey="Whichman T">T. Whichman</name>
</author>
<author><name sortKey="Karmon, B" uniqKey="Karmon B">B. Karmon</name>
</author>
<author><name sortKey="Delong, M R" uniqKey="Delong M">M. R. DeLong</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bernheimer, H" uniqKey="Bernheimer H">H. Bernheimer</name>
</author>
<author><name sortKey="Birkmayer, W" uniqKey="Birkmayer W">W. Birkmayer</name>
</author>
<author><name sortKey="Hornykiewicz, O" uniqKey="Hornykiewicz O">O. Hornykiewicz</name>
</author>
<author><name sortKey="Jellinger, K" uniqKey="Jellinger K">K. Jellinger</name>
</author>
<author><name sortKey="Seitelberger, F" uniqKey="Seitelberger F">F. Seitelberger</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bischoff, A" uniqKey="Bischoff A">A. Bischoff</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Brown, P" uniqKey="Brown P">P. Brown</name>
</author>
<author><name sortKey="Olivero, A" uniqKey="Olivero A">A. Olivero</name>
</author>
<author><name sortKey="Mazzone, P" uniqKey="Mazzone P">P. Mazzone</name>
</author>
<author><name sortKey="Insola, A" uniqKey="Insola A">A. Insola</name>
</author>
<author><name sortKey="Tonali, P" uniqKey="Tonali P">P. Tonali</name>
</author>
<author><name sortKey="Lazzaro, V D" uniqKey="Lazzaro V">V. D. Lazzaro</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Brown, R G" uniqKey="Brown R">R. G. Brown</name>
</author>
<author><name sortKey="Jahanshahi, M" uniqKey="Jahanshahi M">M. Jahanshahi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bullock, D" uniqKey="Bullock D">D. Bullock</name>
</author>
<author><name sortKey="Grossberg, S" uniqKey="Grossberg S">S. Grossberg</name>
</author>
<author><name sortKey="Mannes, C" uniqKey="Mannes C">C. Mannes</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Burn, D J" uniqKey="Burn D">D. J. Burn</name>
</author>
<author><name sortKey="Rowan, E N" uniqKey="Rowan E">E. N. Rowan</name>
</author>
<author><name sortKey="Allan, L M" uniqKey="Allan L">L. M. Allan</name>
</author>
<author><name sortKey="Molloy, S" uniqKey="Molloy S">S. Molloy</name>
</author>
<author><name sortKey="O Rien, J T" uniqKey="O Rien J">J. T. O’Brien</name>
</author>
<author><name sortKey="Mckeith, I G" uniqKey="Mckeith I">I. G. McKeith</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Calzavara, R" uniqKey="Calzavara R">R. Calzavara</name>
</author>
<author><name sortKey="Mailly, P" uniqKey="Mailly P">P. Mailly</name>
</author>
<author><name sortKey="Haber, S N" uniqKey="Haber S">S. N. Haber</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chakravarthy, V" uniqKey="Chakravarthy V">V. Chakravarthy</name>
</author>
<author><name sortKey="Joseph, D" uniqKey="Joseph D">D. Joseph</name>
</author>
<author><name sortKey="Bapi, R S" uniqKey="Bapi R">R. S. Bapi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chersi, F" uniqKey="Chersi F">F. Chersi</name>
</author>
<author><name sortKey="Mirolli, M" uniqKey="Mirolli M">M. Mirolli</name>
</author>
<author><name sortKey="Pezzulo, G" uniqKey="Pezzulo G">G. Pezzulo</name>
</author>
<author><name sortKey="Baldassarre, G" uniqKey="Baldassarre G">G. Baldassarre</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Contreras Vidal, J" uniqKey="Contreras Vidal J">J. Contreras-Vidal</name>
</author>
<author><name sortKey="Stelmach, G" uniqKey="Stelmach G">G. Stelmach</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Desmurget, M" uniqKey="Desmurget M">M. Desmurget</name>
</author>
<author><name sortKey="Turner, R S" uniqKey="Turner R">R. S. Turner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Disbrow, E A" uniqKey="Disbrow E">E. A. Disbrow</name>
</author>
<author><name sortKey="Russo, K A" uniqKey="Russo K">K. A. Russo</name>
</author>
<author><name sortKey="Higginson, C I" uniqKey="Higginson C">C. I. Higginson</name>
</author>
<author><name sortKey="Yund, E W" uniqKey="Yund E">E. W. Yund</name>
</author>
<author><name sortKey="Ventura, M I" uniqKey="Ventura M">M. I. Ventura</name>
</author>
<author><name sortKey="Zhang, L" uniqKey="Zhang L">L. Zhang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Domellof, M E" uniqKey="Domellof M">M. E. Domellof</name>
</author>
<author><name sortKey="Elgh, E" uniqKey="Elgh E">E. Elgh</name>
</author>
<author><name sortKey="Forsgren, L" uniqKey="Forsgren L">L. Forsgren</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dominey, P F" uniqKey="Dominey P">P. F. Dominey</name>
</author>
<author><name sortKey="Arbib, M A" uniqKey="Arbib M">M. A. Arbib</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dreher, J C" uniqKey="Dreher J">J. C. Dreher</name>
</author>
<author><name sortKey="Burnod, Y" uniqKey="Burnod Y">Y. Burnod</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Durstewitz, D" uniqKey="Durstewitz D">D. Durstewitz</name>
</author>
<author><name sortKey="Seamans, J K" uniqKey="Seamans J">J. K. Seamans</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ehrt, U" uniqKey="Ehrt U">U. Ehrt</name>
</author>
<author><name sortKey="Broich, K" uniqKey="Broich K">K. Broich</name>
</author>
<author><name sortKey="Larsen, J P" uniqKey="Larsen J">J. P. Larsen</name>
</author>
<author><name sortKey="Ballard, C" uniqKey="Ballard C">C. Ballard</name>
</author>
<author><name sortKey="Aarsland, D" uniqKey="Aarsland D">D. Aarsland</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fearnley, J M" uniqKey="Fearnley J">J. M. Fearnley</name>
</author>
<author><name sortKey="Lees, A J" uniqKey="Lees A">A. J. Lees</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Flaherty, A W" uniqKey="Flaherty A">A. W. Flaherty</name>
</author>
<author><name sortKey="Graybiel, A M" uniqKey="Graybiel A">A. M. Graybiel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Frank, M J" uniqKey="Frank M">M. J. Frank</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Frank, M J" uniqKey="Frank M">M. J. Frank</name>
</author>
<author><name sortKey="Loughry, B" uniqKey="Loughry B">B. Loughry</name>
</author>
<author><name sortKey="O Eilly, R C" uniqKey="O Eilly R">R. C. O’Reilly</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fuster, J M" uniqKey="Fuster J">J. M. Fuster</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gangadhar, G" uniqKey="Gangadhar G">G. Gangadhar</name>
</author>
<author><name sortKey="Joseph, D" uniqKey="Joseph D">D. Joseph</name>
</author>
<author><name sortKey="Chakravarthy, V S" uniqKey="Chakravarthy V">V. S. Chakravarthy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gangadhar, G" uniqKey="Gangadhar G">G. Gangadhar</name>
</author>
<author><name sortKey="Joseph, D" uniqKey="Joseph D">D. Joseph</name>
</author>
<author><name sortKey="Chakravarthy, V S" uniqKey="Chakravarthy V">V. S. Chakravarthy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gangadhar, G" uniqKey="Gangadhar G">G. Gangadhar</name>
</author>
<author><name sortKey="Joseph, D" uniqKey="Joseph D">D. Joseph</name>
</author>
<author><name sortKey="Srinivasan, A V" uniqKey="Srinivasan A">A. V. Srinivasan</name>
</author>
<author><name sortKey="Subramanian, D" uniqKey="Subramanian D">D. Subramanian</name>
</author>
<author><name sortKey="Keshavan, S" uniqKey="Keshavan S">S. Keshavan</name>
</author>
<author><name sortKey="Chakravarthy, V S" uniqKey="Chakravarthy V">V. S. Chakravarthy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gerfen, C R" uniqKey="Gerfen C">C. R. Gerfen</name>
</author>
<author><name sortKey="Engber, T M" uniqKey="Engber T">T. M. Engber</name>
</author>
<author><name sortKey="Mahan, L C" uniqKey="Mahan L">L. C. Mahan</name>
</author>
<author><name sortKey="Susel, Z" uniqKey="Susel Z">Z. Susel</name>
</author>
<author><name sortKey="Chase, T N" uniqKey="Chase T">T. N. Chase</name>
</author>
<author><name sortKey="Monsma, F J" uniqKey="Monsma F">F. J. Monsma</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gerfen, C R" uniqKey="Gerfen C">C. R. Gerfen</name>
</author>
<author><name sortKey="Young, W S" uniqKey="Young W">W. S. Young</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gibb, W R" uniqKey="Gibb W">W. R. Gibb</name>
</author>
<author><name sortKey="Lees, A J" uniqKey="Lees A">A. J. Lees</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Giladi, N" uniqKey="Giladi N">N. Giladi</name>
</author>
<author><name sortKey="Mcmahon, D" uniqKey="Mcmahon D">D. McMahon</name>
</author>
<author><name sortKey="Przedborski, S" uniqKey="Przedborski S">S. Przedborski</name>
</author>
<author><name sortKey="Flaster, E" uniqKey="Flaster E">E. Flaster</name>
</author>
<author><name sortKey="Guillory, S" uniqKey="Guillory S">S. Guillory</name>
</author>
<author><name sortKey="Kostic, V" uniqKey="Kostic V">V. Kostic</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gluck, M A" uniqKey="Gluck M">M. A. Gluck</name>
</author>
<author><name sortKey="Shohamy, D" uniqKey="Shohamy D">D. Shohamy</name>
</author>
<author><name sortKey="Myers, C" uniqKey="Myers C">C. Myers</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gotham, A M" uniqKey="Gotham A">A. M. Gotham</name>
</author>
<author><name sortKey="Brown, R G" uniqKey="Brown R">R. G. Brown</name>
</author>
<author><name sortKey="Marsden, C D" uniqKey="Marsden C">C. D. Marsden</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gurney, K" uniqKey="Gurney K">K. Gurney</name>
</author>
<author><name sortKey="Prescott, T J" uniqKey="Prescott T">T. J. Prescott</name>
</author>
<author><name sortKey="Redgrave, P" uniqKey="Redgrave P">P. Redgrave</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Guthrie, M" uniqKey="Guthrie M">M. Guthrie</name>
</author>
<author><name sortKey="Leblois, A" uniqKey="Leblois A">A. Leblois</name>
</author>
<author><name sortKey="Garenne, A" uniqKey="Garenne A">A. Garenne</name>
</author>
<author><name sortKey="Boraud, T" uniqKey="Boraud T">T. Boraud</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Haber, S N" uniqKey="Haber S">S. N. Haber</name>
</author>
<author><name sortKey="Kim, K S" uniqKey="Kim K">K. S. Kim</name>
</author>
<author><name sortKey="Mailly, P" uniqKey="Mailly P">P. Mailly</name>
</author>
<author><name sortKey="Calzavara, R" uniqKey="Calzavara R">R. Calzavara</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hayhoe, M" uniqKey="Hayhoe M">M. Hayhoe</name>
</author>
<author><name sortKey="Aivar, P" uniqKey="Aivar P">P. Aivar</name>
</author>
<author><name sortKey="Shrivastavah, A" uniqKey="Shrivastavah A">A. Shrivastavah</name>
</author>
<author><name sortKey="Mruczek, R" uniqKey="Mruczek R">R. Mruczek</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Helie, S" uniqKey="Helie S">S. Helie</name>
</author>
<author><name sortKey="Ashby, G F" uniqKey="Ashby G">G. F. Ashby</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Helie, S" uniqKey="Helie S">S. Helie</name>
</author>
<author><name sortKey="Cousineau, D" uniqKey="Cousineau D">D. Cousineau</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Helie, S" uniqKey="Helie S">S. Helie</name>
</author>
<author><name sortKey="Paul, E J" uniqKey="Paul E">E. J. Paul</name>
</author>
<author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Helie, S" uniqKey="Helie S">S. Helie</name>
</author>
<author><name sortKey="Paul, E J" uniqKey="Paul E">E. J. Paul</name>
</author>
<author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Helie, S" uniqKey="Helie S">S. Helie</name>
</author>
<author><name sortKey="Waldschmidt, J G" uniqKey="Waldschmidt J">J. G. Waldschmidt</name>
</author>
<author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Herzallah, M M" uniqKey="Herzallah M">M. M. Herzallah</name>
</author>
<author><name sortKey="Moustafa, A A" uniqKey="Moustafa A">A. A. Moustafa</name>
</author>
<author><name sortKey="Misk, A J" uniqKey="Misk A">A. J. Misk</name>
</author>
<author><name sortKey="Al Dweib, L H" uniqKey="Al Dweib L">L. H. Al-Dweib</name>
</author>
<author><name sortKey="Abdelrazeq, S A" uniqKey="Abdelrazeq S">S. A. Abdelrazeq</name>
</author>
<author><name sortKey="Myers, C E" uniqKey="Myers C">C. E. Myers</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hikosaka, O" uniqKey="Hikosaka O">O. Hikosaka</name>
</author>
<author><name sortKey="Takikawa, Y" uniqKey="Takikawa Y">Y. Takikawa</name>
</author>
<author><name sortKey="Kawagoe, R" uniqKey="Kawagoe R">R. Kawagoe</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Histed, M H" uniqKey="Histed M">M. H. Histed</name>
</author>
<author><name sortKey="Pasupathy, A" uniqKey="Pasupathy A">A. Pasupathy</name>
</author>
<author><name sortKey="Miller, E K" uniqKey="Miller E">E. K. Miller</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hollerbach, J M" uniqKey="Hollerbach J">J. M. Hollerbach</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Issen, L A" uniqKey="Issen L">L. A. Issen</name>
</author>
<author><name sortKey="Knill, D C" uniqKey="Knill D">D. C. Knill</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Jankovic, J" uniqKey="Jankovic J">J. Jankovic</name>
</author>
<author><name sortKey="Mcdermott, M" uniqKey="Mcdermott M">M. McDermott</name>
</author>
<author><name sortKey="Carter, J" uniqKey="Carter J">J. Carter</name>
</author>
<author><name sortKey="Gauthier, S" uniqKey="Gauthier S">S. Gauthier</name>
</author>
<author><name sortKey="Goetz, C" uniqKey="Goetz C">C. Goetz</name>
</author>
<author><name sortKey="Golbe, L" uniqKey="Golbe L">L. Golbe</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kaasinen, V" uniqKey="Kaasinen V">V. Kaasinen</name>
</author>
<author><name sortKey="Nurmi, E" uniqKey="Nurmi E">E. Nurmi</name>
</author>
<author><name sortKey="Bergman, J" uniqKey="Bergman J">J. Bergman</name>
</author>
<author><name sortKey="Eskola, O" uniqKey="Eskola O">O. Eskola</name>
</author>
<author><name sortKey="Solin, O" uniqKey="Solin O">O. Solin</name>
</author>
<author><name sortKey="Sonninen, P" uniqKey="Sonninen P">P. Sonninen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kalveram, K T" uniqKey="Kalveram K">K. T. Kalveram</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kassubek, J" uniqKey="Kassubek J">J. Kassubek</name>
</author>
<author><name sortKey="Juengling, F D" uniqKey="Juengling F">F. D. Juengling</name>
</author>
<author><name sortKey="Hellwig, B" uniqKey="Hellwig B">B. Hellwig</name>
</author>
<author><name sortKey="Spreer, J" uniqKey="Spreer J">J. Spreer</name>
</author>
<author><name sortKey="Lucking, C H" uniqKey="Lucking C">C. H. Lucking</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kato, M" uniqKey="Kato M">M. Kato</name>
</author>
<author><name sortKey="Miyashita, N" uniqKey="Miyashita N">N. Miyashita</name>
</author>
<author><name sortKey="Hikosaka, O" uniqKey="Hikosaka O">O. Hikosaka</name>
</author>
<author><name sortKey="Matsumura, M" uniqKey="Matsumura M">M. Matsumura</name>
</author>
<author><name sortKey="Usui, S" uniqKey="Usui S">S. Usui</name>
</author>
<author><name sortKey="Kori, A" uniqKey="Kori A">A. Kori</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kemp, J M" uniqKey="Kemp J">J. M. Kemp</name>
</author>
<author><name sortKey="Powell, T P S" uniqKey="Powell T">T. P. S. Powell</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kincaid, A E" uniqKey="Kincaid A">A. E. Kincaid</name>
</author>
<author><name sortKey="Zheng, T" uniqKey="Zheng T">T. Zheng</name>
</author>
<author><name sortKey="Wilson, C J" uniqKey="Wilson C">C. J. Wilson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Knowlton, B J" uniqKey="Knowlton B">B. J. Knowlton</name>
</author>
<author><name sortKey="Mangels, J A" uniqKey="Mangels J">J. A. Mangels</name>
</author>
<author><name sortKey="Squire, L R" uniqKey="Squire L">L. R. Squire</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kostic, V S" uniqKey="Kostic V">V. S. Kostic</name>
</author>
<author><name sortKey="Agosta, F" uniqKey="Agosta F">F. Agosta</name>
</author>
<author><name sortKey="Pievani, M" uniqKey="Pievani M">M. Pievani</name>
</author>
<author><name sortKey="Stefanova, E" uniqKey="Stefanova E">E. Stefanova</name>
</author>
<author><name sortKey="Jecmenica Lukic, M" uniqKey="Jecmenica Lukic M">M. Jecmenica-Lukic</name>
</author>
<author><name sortKey="Scarale, A" uniqKey="Scarale A">A. Scarale</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Krishnan, R" uniqKey="Krishnan R">R. Krishnan</name>
</author>
<author><name sortKey="Ratnadurai, S" uniqKey="Ratnadurai S">S. Ratnadurai</name>
</author>
<author><name sortKey="Subramanian, D" uniqKey="Subramanian D">D. Subramanian</name>
</author>
<author><name sortKey="Chakravarthy, V S" uniqKey="Chakravarthy V">V. S. Chakravarthy</name>
</author>
<author><name sortKey="Rengaswamy, M" uniqKey="Rengaswamy M">M. Rengaswamy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lawrence, A D" uniqKey="Lawrence A">A. D. Lawrence</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Leblois, A" uniqKey="Leblois A">A. Leblois</name>
</author>
<author><name sortKey="Boraud, T" uniqKey="Boraud T">T. Boraud</name>
</author>
<author><name sortKey="Meissner, W" uniqKey="Meissner W">W. Meissner</name>
</author>
<author><name sortKey="Bergman, H" uniqKey="Bergman H">H. Bergman</name>
</author>
<author><name sortKey="Hansel, D" uniqKey="Hansel D">D. Hansel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lewis, S J" uniqKey="Lewis S">S. J. Lewis</name>
</author>
<author><name sortKey="Barker, R A" uniqKey="Barker R">R. A. Barker</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lyros, E" uniqKey="Lyros E">E. Lyros</name>
</author>
<author><name sortKey="Messinis, L" uniqKey="Messinis L">L. Messinis</name>
</author>
<author><name sortKey="Papathanasopoulos, P" uniqKey="Papathanasopoulos P">P. Papathanasopoulos</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Maddox, W T" uniqKey="Maddox W">W. T. Maddox</name>
</author>
<author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Magdoom, M" uniqKey="Magdoom M">M. Magdoom</name>
</author>
<author><name sortKey="Subramanian, D" uniqKey="Subramanian D">D. Subramanian</name>
</author>
<author><name sortKey="Chakravarthy, V S" uniqKey="Chakravarthy V">V. S. Chakravarthy</name>
</author>
<author><name sortKey="Ravindran, B" uniqKey="Ravindran B">B. Ravindran</name>
</author>
<author><name sortKey="Amari, S" uniqKey="Amari S">S. Amari</name>
</author>
<author><name sortKey="Meenakshisundaram, N" uniqKey="Meenakshisundaram N">N. Meenakshisundaram</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Matar, E" uniqKey="Matar E">E. Matar</name>
</author>
<author><name sortKey="Shine, J M" uniqKey="Shine J">J. M. Shine</name>
</author>
<author><name sortKey="Naismith, S L" uniqKey="Naismith S">S. L. Naismith</name>
</author>
<author><name sortKey="Lewis, S J" uniqKey="Lewis S">S. J. Lewis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Matsui, H" uniqKey="Matsui H">H. Matsui</name>
</author>
<author><name sortKey="Udaka, F" uniqKey="Udaka F">F. Udaka</name>
</author>
<author><name sortKey="Miyoshi, T" uniqKey="Miyoshi T">T. Miyoshi</name>
</author>
<author><name sortKey="Hara, N" uniqKey="Hara N">N. Hara</name>
</author>
<author><name sortKey="Tamaura, A" uniqKey="Tamaura A">A. Tamaura</name>
</author>
<author><name sortKey="Oda, M" uniqKey="Oda M">M. Oda</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Matsumoto, K" uniqKey="Matsumoto K">K. Matsumoto</name>
</author>
<author><name sortKey="Suzuki, W" uniqKey="Suzuki W">W. Suzuki</name>
</author>
<author><name sortKey="Tanaka, K" uniqKey="Tanaka K">K. Tanaka</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mcintyre, J" uniqKey="Mcintyre J">J. McIntyre</name>
</author>
<author><name sortKey="Stratta, F" uniqKey="Stratta F">F. Stratta</name>
</author>
<author><name sortKey="Lacquaniti, F" uniqKey="Lacquaniti F">F. Lacquaniti</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Meco, G" uniqKey="Meco G">G. Meco</name>
</author>
<author><name sortKey="Casacchia, M" uniqKey="Casacchia M">M. Casacchia</name>
</author>
<author><name sortKey="Lazzari, R" uniqKey="Lazzari R">R. Lazzari</name>
</author>
<author><name sortKey="Franzese, A" uniqKey="Franzese A">A. Franzese</name>
</author>
<author><name sortKey="Castellana, F" uniqKey="Castellana F">F. Castellana</name>
</author>
<author><name sortKey="Carta, A" uniqKey="Carta A">A. Carta</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Miyachi, S" uniqKey="Miyachi S">S. Miyachi</name>
</author>
<author><name sortKey="Hikosaka, O" uniqKey="Hikosaka O">O. Hikosaka</name>
</author>
<author><name sortKey="Lu, X" uniqKey="Lu X">X. Lu</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Miyachi, S" uniqKey="Miyachi S">S. Miyachi</name>
</author>
<author><name sortKey="Hikosaka, O" uniqKey="Hikosaka O">O. Hikosaka</name>
</author>
<author><name sortKey="Miyashita, K" uniqKey="Miyashita K">K. Miyashita</name>
</author>
<author><name sortKey="Karadi, Z" uniqKey="Karadi Z">Z. Kárádi</name>
</author>
<author><name sortKey="Rand, M K" uniqKey="Rand M">M. K. Rand</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Monchi, O" uniqKey="Monchi O">O. Monchi</name>
</author>
<author><name sortKey="Taylor, J G" uniqKey="Taylor J">J. G. Taylor</name>
</author>
<author><name sortKey="Dagher, A" uniqKey="Dagher A">A. Dagher</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moustafa, A A" uniqKey="Moustafa A">A. A. Moustafa</name>
</author>
<author><name sortKey="Bell, P" uniqKey="Bell P">P. Bell</name>
</author>
<author><name sortKey="Eissa, A M" uniqKey="Eissa A">A. M. Eissa</name>
</author>
<author><name sortKey="Hewedi, D H" uniqKey="Hewedi D">D. H. Hewedi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moustafa, A A" uniqKey="Moustafa A">A. A. Moustafa</name>
</author>
<author><name sortKey="Cohen, M X" uniqKey="Cohen M">M. X. Cohen</name>
</author>
<author><name sortKey="Sherman, S J" uniqKey="Sherman S">S. J. Sherman</name>
</author>
<author><name sortKey="Frank, M J" uniqKey="Frank M">M. J. Frank</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moustafa, A A" uniqKey="Moustafa A">A. A. Moustafa</name>
</author>
<author><name sortKey="Gluck, M A" uniqKey="Gluck M">M. A. Gluck</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moustafa, A A" uniqKey="Moustafa A">A. A. Moustafa</name>
</author>
<author><name sortKey="Gluck, M A" uniqKey="Gluck M">M. A. Gluck</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moustafa" uniqKey="Moustafa">Moustafa</name>
</author>
<author><name sortKey="Herzallah, M M" uniqKey="Herzallah M">M. M. Herzallah</name>
</author>
<author><name sortKey="Gluck, M A" uniqKey="Gluck M">M. A. Gluck</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moustafa, A A" uniqKey="Moustafa A">A. A. Moustafa</name>
</author>
<author><name sortKey="Maida, A S" uniqKey="Maida A">A. S. Maida</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mulder, A B" uniqKey="Mulder A">A. B. Mulder</name>
</author>
<author><name sortKey="Nordquist, R E" uniqKey="Nordquist R">R. E. Nordquist</name>
</author>
<author><name sortKey="Orgut, O" uniqKey="Orgut O">O. Orgut</name>
</author>
<author><name sortKey="Pennartz, C M" uniqKey="Pennartz C">C. M. Pennartz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mure, H" uniqKey="Mure H">H. Mure</name>
</author>
<author><name sortKey="Hirano, S" uniqKey="Hirano S">S. Hirano</name>
</author>
<author><name sortKey="Tang, C C" uniqKey="Tang C">C. C. Tang</name>
</author>
<author><name sortKey="Isaias, I U" uniqKey="Isaias I">I. U. Isaias</name>
</author>
<author><name sortKey="Antonini, A" uniqKey="Antonini A">A. Antonini</name>
</author>
<author><name sortKey="Ma, Y" uniqKey="Ma Y">Y. Ma</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Naismith, S L" uniqKey="Naismith S">S. L. Naismith</name>
</author>
<author><name sortKey="Shine, J M" uniqKey="Shine J">J. M. Shine</name>
</author>
<author><name sortKey="Lewis, S J" uniqKey="Lewis S">S. J. Lewis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nakahara, H" uniqKey="Nakahara H">H. Nakahara</name>
</author>
<author><name sortKey="Doya, K" uniqKey="Doya K">K. Doya</name>
</author>
<author><name sortKey="Hikosaka, O" uniqKey="Hikosaka O">O. Hikosaka</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nambu, A" uniqKey="Nambu A">A. Nambu</name>
</author>
<author><name sortKey="Tokuno, H" uniqKey="Tokuno H">H. Tokuno</name>
</author>
<author><name sortKey="Takada, M" uniqKey="Takada M">M. Takada</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Niv, Y" uniqKey="Niv Y">Y. Niv</name>
</author>
<author><name sortKey="Daw, N D" uniqKey="Daw N">N. D. Daw</name>
</author>
<author><name sortKey="Joel, D" uniqKey="Joel D">D. Joel</name>
</author>
<author><name sortKey="Dayan, P" uniqKey="Dayan P">P. Dayan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Obeso, J A" uniqKey="Obeso J">J. A. Obeso</name>
</author>
<author><name sortKey="Marin, C" uniqKey="Marin C">C. Marin</name>
</author>
<author><name sortKey="Rodriguez Oroz, C" uniqKey="Rodriguez Oroz C">C. Rodriguez-Oroz</name>
</author>
<author><name sortKey="Blesa, J" uniqKey="Blesa J">J. Blesa</name>
</author>
<author><name sortKey="Benitez Temino, B" uniqKey="Benitez Temino B">B. Benitez-Temino</name>
</author>
<author><name sortKey="Mena Segovia, J" uniqKey="Mena Segovia J">J. Mena-Segovia</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="O Oherty, J" uniqKey="O Oherty J">J. O’Doherty</name>
</author>
<author><name sortKey="Dayan, P" uniqKey="Dayan P">P. Dayan</name>
</author>
<author><name sortKey="Schultz, J" uniqKey="Schultz J">J. Schultz</name>
</author>
<author><name sortKey="Deichmann, R" uniqKey="Deichmann R">R. Deichmann</name>
</author>
<author><name sortKey="Friston, K" uniqKey="Friston K">K. Friston</name>
</author>
<author><name sortKey="Dolan, R J" uniqKey="Dolan R">R. J. Dolan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Oh, J Y" uniqKey="Oh J">J. Y. Oh</name>
</author>
<author><name sortKey="Kim, Y S" uniqKey="Kim Y">Y. S. Kim</name>
</author>
<author><name sortKey="Choi, B H" uniqKey="Choi B">B. H. Choi</name>
</author>
<author><name sortKey="Sohn, E H" uniqKey="Sohn E">E. H. Sohn</name>
</author>
<author><name sortKey="Lee, A Y" uniqKey="Lee A">A. Y. Lee</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ohbayashi, M" uniqKey="Ohbayashi M">M. Ohbayashi</name>
</author>
<author><name sortKey="Ohki, K" uniqKey="Ohki K">K. Ohki</name>
</author>
<author><name sortKey="Miyashita, Y" uniqKey="Miyashita Y">Y. Miyashita</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="O Eilly, R C" uniqKey="O Eilly R">R. C. O’Reilly</name>
</author>
<author><name sortKey="Frank, M J" uniqKey="Frank M">M. J. Frank</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Pakhotin, P" uniqKey="Pakhotin P">P. Pakhotin</name>
</author>
<author><name sortKey="Bracci, E" uniqKey="Bracci E">E. Bracci</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Piek, J P" uniqKey="Piek J">J. P. Piek</name>
</author>
<author><name sortKey="Dyck, M J" uniqKey="Dyck M">M. J. Dyck</name>
</author>
<author><name sortKey="Nieman, A" uniqKey="Nieman A">A. Nieman</name>
</author>
<author><name sortKey="Anderson, M" uniqKey="Anderson M">M. Anderson</name>
</author>
<author><name sortKey="Hay, D" uniqKey="Hay D">D. Hay</name>
</author>
<author><name sortKey="Smith, L M" uniqKey="Smith L">L. M. Smith</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Phillips, J G" uniqKey="Phillips J">J. G. Phillips</name>
</author>
<author><name sortKey="Stelmach, G E" uniqKey="Stelmach G">G. E. Stelmach</name>
</author>
<author><name sortKey="Teasdale, N" uniqKey="Teasdale N">N. Teasdale</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Plotnik, M" uniqKey="Plotnik M">M. Plotnik</name>
</author>
<author><name sortKey="Giladi, N" uniqKey="Giladi N">N. Giladi</name>
</author>
<author><name sortKey="Dagan, Y" uniqKey="Dagan Y">Y. Dagan</name>
</author>
<author><name sortKey="Hausdorff, J M" uniqKey="Hausdorff J">J. M. Hausdorff</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Poletti, M" uniqKey="Poletti M">M. Poletti</name>
</author>
<author><name sortKey="Bonuccelli, U" uniqKey="Bonuccelli U">U. Bonuccelli</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Poletti, M" uniqKey="Poletti M">M. Poletti</name>
</author>
<author><name sortKey="Emre, M" uniqKey="Emre M">M. Emre</name>
</author>
<author><name sortKey="Bonuccelli, U" uniqKey="Bonuccelli U">U. Bonuccelli</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Poletti, M" uniqKey="Poletti M">M. Poletti</name>
</author>
<author><name sortKey="Frosini, D" uniqKey="Frosini D">D. Frosini</name>
</author>
<author><name sortKey="Pagni, C" uniqKey="Pagni C">C. Pagni</name>
</author>
<author><name sortKey="Baldacci, F" uniqKey="Baldacci F">F. Baldacci</name>
</author>
<author><name sortKey="Nicoletti, V" uniqKey="Nicoletti V">V. Nicoletti</name>
</author>
<author><name sortKey="Tognoni, G" uniqKey="Tognoni G">G. Tognoni</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Pondal, M" uniqKey="Pondal M">M. Pondal</name>
</author>
<author><name sortKey="Del Ser, T" uniqKey="Del Ser T">T. Del Ser</name>
</author>
<author><name sortKey="Bermejo, F" uniqKey="Bermejo F">F. Bermejo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Price, A" uniqKey="Price A">A. Price</name>
</author>
<author><name sortKey="Filoteo, J V" uniqKey="Filoteo J">J. V. Filoteo</name>
</author>
<author><name sortKey="Maddox, W T" uniqKey="Maddox W">W. T. Maddox</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Probst Cousin, S" uniqKey="Probst Cousin S">S. Probst-Cousin</name>
</author>
<author><name sortKey="Druschky, A" uniqKey="Druschky A">A. Druschky</name>
</author>
<author><name sortKey="Neundorfer, B" uniqKey="Neundorfer B">B. Neundorfer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rascol, O" uniqKey="Rascol O">O. Rascol</name>
</author>
<author><name sortKey="Sabatini, U" uniqKey="Sabatini U">U. Sabatini</name>
</author>
<author><name sortKey="Simonetta Moreau, M" uniqKey="Simonetta Moreau M">M. Simonetta-Moreau</name>
</author>
<author><name sortKey="Montastruc, L" uniqKey="Montastruc L">L. Montastruc</name>
</author>
<author><name sortKey="Rascol, A" uniqKey="Rascol A">A. Rascol</name>
</author>
<author><name sortKey="Clanet, M" uniqKey="Clanet M">M. Clanet</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Reiner, A" uniqKey="Reiner A">A. Reiner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Reynolds, J N J" uniqKey="Reynolds J">J. N. J. Reynolds</name>
</author>
<author><name sortKey="Hyland, B I" uniqKey="Hyland B">B. I. Hyland</name>
</author>
<author><name sortKey="Wickens, J R" uniqKey="Wickens J">J. R. Wickens</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schillaci, O" uniqKey="Schillaci O">O. Schillaci</name>
</author>
<author><name sortKey="Chiaravalloti, A" uniqKey="Chiaravalloti A">A. Chiaravalloti</name>
</author>
<author><name sortKey="Pierantozzi, M" uniqKey="Pierantozzi M">M. Pierantozzi</name>
</author>
<author><name sortKey="Di Pietro, B" uniqKey="Di Pietro B">B. Di Pietro</name>
</author>
<author><name sortKey="Koch, G" uniqKey="Koch G">G. Koch</name>
</author>
<author><name sortKey="Bruni, C" uniqKey="Bruni C">C. Bruni</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schomaker, L R B" uniqKey="Schomaker L">L. R. B. Schomaker</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schroll, H" uniqKey="Schroll H">H. Schroll</name>
</author>
<author><name sortKey="Vitay, J" uniqKey="Vitay J">J. Vitay</name>
</author>
<author><name sortKey="Hamker, F H" uniqKey="Hamker F">F. H. Hamker</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Seger, C A" uniqKey="Seger C">C. A. Seger</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sheridan, M R" uniqKey="Sheridan M">M. R. Sheridan</name>
</author>
<author><name sortKey="Flowers, K A" uniqKey="Flowers K">K. A. Flowers</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shine, J M" uniqKey="Shine J">J. M. Shine</name>
</author>
<author><name sortKey="Matar, E" uniqKey="Matar E">E. Matar</name>
</author>
<author><name sortKey="Lewis, S J G" uniqKey="Lewis S">S. J. G. Lewis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Silberstein, P" uniqKey="Silberstein P">P. Silberstein</name>
</author>
<author><name sortKey="Pogosyan, A" uniqKey="Pogosyan A">A. Pogosyan</name>
</author>
<author><name sortKey="Kuhn, A A" uniqKey="Kuhn A">A. A. Kuhn</name>
</author>
<author><name sortKey="Hotton, G" uniqKey="Hotton G">G. Hotton</name>
</author>
<author><name sortKey="Tisch, S" uniqKey="Tisch S">S. Tisch</name>
</author>
<author><name sortKey="Kupsch, A" uniqKey="Kupsch A">A. Kupsch</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Smith, Y" uniqKey="Smith Y">Y. Smith</name>
</author>
<author><name sortKey="Galvan, A" uniqKey="Galvan A">A. Galvan</name>
</author>
<author><name sortKey="Raju, D" uniqKey="Raju D">D. Raju</name>
</author>
<author><name sortKey="Wichmann, T" uniqKey="Wichmann T">T. Wichmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Smith, Y" uniqKey="Smith Y">Y. Smith</name>
</author>
<author><name sortKey="Raju, D V" uniqKey="Raju D">D. V. Raju</name>
</author>
<author><name sortKey="Pare, J F" uniqKey="Pare J">J. F. Pare</name>
</author>
<author><name sortKey="Sidibe, M" uniqKey="Sidibe M">M. Sidibe</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Steiner, H" uniqKey="Steiner H">H. Steiner</name>
</author>
<author><name sortKey="Tseng, K Y" uniqKey="Tseng K">K. Y. Tseng</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tessitore, A" uniqKey="Tessitore A">A. Tessitore</name>
</author>
<author><name sortKey="Amboni, M" uniqKey="Amboni M">M. Amboni</name>
</author>
<author><name sortKey="Cirillo, G" uniqKey="Cirillo G">G. Cirillo</name>
</author>
<author><name sortKey="Corbo, D" uniqKey="Corbo D">D. Corbo</name>
</author>
<author><name sortKey="Picillo, M" uniqKey="Picillo M">M. Picillo</name>
</author>
<author><name sortKey="Russo, A" uniqKey="Russo A">A. Russo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Teulings, H L" uniqKey="Teulings H">H. L. Teulings</name>
</author>
<author><name sortKey="Stelmach, G E" uniqKey="Stelmach G">G. E. Stelmach</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vakil, E" uniqKey="Vakil E">E. Vakil</name>
</author>
<author><name sortKey="Herishanu Naaman, S" uniqKey="Herishanu Naaman S">S. Herishanu-Naaman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vandenbossche, J" uniqKey="Vandenbossche J">J. Vandenbossche</name>
</author>
<author><name sortKey="Deroost, N" uniqKey="Deroost N">N. Deroost</name>
</author>
<author><name sortKey="Soetens, E" uniqKey="Soetens E">E. Soetens</name>
</author>
<author><name sortKey="Spildooren, J" uniqKey="Spildooren J">J. Spildooren</name>
</author>
<author><name sortKey="Vercruysse, S" uniqKey="Vercruysse S">S. Vercruysse</name>
</author>
<author><name sortKey="Nieuwboer, A" uniqKey="Nieuwboer A">A. Nieuwboer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Van Gemmert, A W A" uniqKey="Van Gemmert A">A. W. A. Van Gemmert</name>
</author>
<author><name sortKey="Adler, C H" uniqKey="Adler C">C. H. Adler</name>
</author>
<author><name sortKey="Stelmach, G E" uniqKey="Stelmach G">G. E. Stelmach</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Van Gemmert, A W A" uniqKey="Van Gemmert A">A. W. A. Van Gemmert</name>
</author>
<author><name sortKey="Teulings, H L" uniqKey="Teulings H">H. L. Teulings</name>
</author>
<author><name sortKey="Contreras Idal, J L" uniqKey="Contreras Idal J">J. L. Contreras–Vidal</name>
</author>
<author><name sortKey="Stelmach, G E" uniqKey="Stelmach G">G. E. Stelmach</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Weinberger, M" uniqKey="Weinberger M">M. Weinberger</name>
</author>
<author><name sortKey="Hutchison, W D" uniqKey="Hutchison W">W. D. Hutchison</name>
</author>
<author><name sortKey="Lozano, A M" uniqKey="Lozano A">A. M. Lozano</name>
</author>
<author><name sortKey="Hodaie, M" uniqKey="Hodaie M">M. Hodaie</name>
</author>
<author><name sortKey="Dostrovsky, J O" uniqKey="Dostrovsky J">J. O. Dostrovsky</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Weiss, P" uniqKey="Weiss P">P. Weiss</name>
</author>
<author><name sortKey="Stelmach, G E" uniqKey="Stelmach G">G. E. Stelmach</name>
</author>
<author><name sortKey="Hefter, H" uniqKey="Hefter H">H. Hefter</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wickens, J R" uniqKey="Wickens J">J. R. Wickens</name>
</author>
<author><name sortKey="Begg, A J" uniqKey="Begg A">A. J. Begg</name>
</author>
<author><name sortKey="Arbuthnott, G W" uniqKey="Arbuthnott G">G. W. Arbuthnott</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wilson, C J" uniqKey="Wilson C">C. J. Wilson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yeterian, E H" uniqKey="Yeterian E">E. H. Yeterian</name>
</author>
<author><name sortKey="Pandya, D N" uniqKey="Pandya D">D. N. Pandya</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yeterian, E H" uniqKey="Yeterian E">E. H. Yeterian</name>
</author>
<author><name sortKey="Pandya, D N" uniqKey="Pandya D">D. N. Pandya</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yeterian, E H" uniqKey="Yeterian E">E. H. Yeterian</name>
</author>
<author><name sortKey="Pandya, D N" uniqKey="Pandya D">D. N. Pandya</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yin, H H" uniqKey="Yin H">H. H. Yin</name>
</author>
<author><name sortKey="Ostlund, S B" uniqKey="Ostlund S">S. B. Ostlund</name>
</author>
<author><name sortKey="Knowlton, B J" uniqKey="Knowlton B">B. J. Knowlton</name>
</author>
<author><name sortKey="Balleine, B W" uniqKey="Balleine B">B. W. Balleine</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zaidel, A" uniqKey="Zaidel A">A. Zaidel</name>
</author>
<author><name sortKey="Arkadir, D" uniqKey="Arkadir D">D. Arkadir</name>
</author>
<author><name sortKey="Israel, Z" uniqKey="Israel Z">Z. Israel</name>
</author>
<author><name sortKey="Bergman, H" uniqKey="Bergman H">H. Bergman</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="review-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Front Comput Neurosci</journal-id>
<journal-id journal-id-type="iso-abbrev">Front Comput Neurosci</journal-id>
<journal-id journal-id-type="publisher-id">Front. Comput. Neurosci.</journal-id>
<journal-title-group><journal-title>Frontiers in Computational Neuroscience</journal-title>
</journal-title-group>
<issn pub-type="epub">1662-5188</issn>
<publisher><publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">24367325</article-id>
<article-id pub-id-type="pmc">3854553</article-id>
<article-id pub-id-type="doi">10.3389/fncom.2013.00174</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Neuroscience</subject>
<subj-group><subject>Review Article</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group><article-title>Exploring the cognitive and motor functions of the basal ganglia: an integrative review of computational cognitive neuroscience models</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Helie</surname>
<given-names>Sebastien</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
<xref ref-type="author-notes" rid="fn001"><sup>*</sup>
</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Chakravarthy</surname>
<given-names>Srinivasa</given-names>
</name>
<xref ref-type="aff" rid="aff2"><sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Moustafa</surname>
<given-names>Ahmed A.</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>3</sup>
</xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup>
<institution>Department of Psychological Sciences, Purdue University</institution>
<country>West Lafayette, IN, USA</country>
</aff>
<aff id="aff2"><sup>2</sup>
<institution>Department of Biotechnology, Indian Institute of Technology</institution>
<country>Madras, India</country>
</aff>
<aff id="aff3"><sup>3</sup>
<institution>Marcs Institute for Brain and Behaviour and School of Social Sciences and Psychology, University of Western Sydney</institution>
<country>Sydney, NSW, Australia</country>
</aff>
<author-notes><fn fn-type="edited-by"><p>Edited by: Izhar Bar-Gad, Bar-Ilan University, Israel</p>
</fn>
<fn fn-type="edited-by"><p>Reviewed by: Thomas Boraud, Université de Bordeaux, CNRS, France; Arvind Kumar, University of Freiburg, Germany</p>
</fn>
<corresp id="fn001">*Correspondence: Sebastien Helie, Department of Psychological Sciences, Purdue University, 703 Third Street, West Lafayette, IN 47907, USA e-mail: <email xlink:type="simple">shelie@purdue.edu</email>
</corresp>
<fn fn-type="other" id="fn002"><p>This article was submitted to the journal Frontiers in Computational Neuroscience.</p>
</fn>
</author-notes>
<pub-date pub-type="epub"><day>06</day>
<month>12</month>
<year>2013</year>
</pub-date>
<pub-date pub-type="collection"><year>2013</year>
</pub-date>
<volume>7</volume>
<elocation-id>174</elocation-id>
<history><date date-type="received"><day>31</day>
<month>7</month>
<year>2013</year>
</date>
<date date-type="accepted"><day>15</day>
<month>11</month>
<year>2013</year>
</date>
</history>
<permissions><copyright-statement>Copyright © 2013 Helie, Chakravarthy and Moustafa.</copyright-statement>
<copyright-year>2013</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0/"><license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</license-p>
</license>
</permissions>
<abstract><p>Many computational models of the basal ganglia (BG) have been proposed over the past twenty-five years. While computational neuroscience models have focused on closely matching the neurobiology of the BG, <italic>computational cognitive neuroscience</italic>
(CCN) models have focused on how the BG can be used to implement cognitive and motor functions. This review article focuses on CCN models of the BG and how they use the neuroanatomy of the BG to account for cognitive and motor functions such as categorization, instrumental conditioning, probabilistic learning, working memory, sequence learning, automaticity, reaching, handwriting, and eye saccades. A total of 19 BG models accounting for one or more of these functions are reviewed and compared. The review concludes with a discussion of the limitations of existing CCN models of the BG and prescriptions for future modeling, including the need for computational models of the BG that can simultaneously account for cognitive and motor functions, and the need for a more complete specification of the role of the BG in behavioral functions.</p>
</abstract>
<kwd-group><kwd>basal ganglia</kwd>
<kwd>computational cognitive neuroscience</kwd>
<kwd>cognitive function</kwd>
<kwd>motor function</kwd>
<kwd>Parkinson’s disease</kwd>
</kwd-group>
<counts><fig-count count="1"></fig-count>
<table-count count="1"></table-count>
<equation-count count="0"></equation-count>
<ref-count count="135"></ref-count>
<page-count count="16"></page-count>
<word-count count="15427"></word-count>
</counts>
</article-meta>
</front>
<body><sec id="s1"><title>Introduction</title>
<p>The basal ganglia (BG) are a group of nuclei at the base of the forebrain that are strongly connected to the cortex. While the role of the BG had historically been restricted to motor function, a substantive amount of recent research suggests that the BG are also involved in a variety of cognitive functions (Steiner and Tseng, <xref ref-type="bibr" rid="B119">2010</xref>
). Behavioral and neural experiments with human and non-human animals have informed our understanding of the BG function for over a century, and the past two decades have seen an increased use of computational models to simulate the anatomy and functionality of the BG. The most anatomically detailed computational neuroscience models seldom go as far as simulating complex animal behavior (because of complexity issues), but simpler (less anatomically detailed) models can be used to simultaneously account for some anatomical details and complex animal behavior. The strength of these later <italic>computational cognitive neuroscience</italic>
(CCN) models lies in that they can simultaneously account for both neuroscience data and behavioral data (Ashby and Helie, <xref ref-type="bibr" rid="B8">2011</xref>
).</p>
<p>This review article focuses on CCN models of the BG and classifies existing models according to cognitive and motor function. The remainder of this article is organized as follows. First, the anatomy that is usually included in CCN models of the BG is reviewed. This anatomy section is incomplete by design, as only details that are simulated to account for specific cognitive or motor function are included. Next, we review CCN models used to simulate six different cognitive functions, namely categorization, instrumental conditioning, probabilistic learning, working memory, sequence learning, and automaticity. This presentation is followed by CCN models of motor function. Computational cognitive neuroscience models of motor functions are separated into models of reaching, handwriting, and eye saccades. The review concludes with a discussion of the limitations of existing CCN models of the BG and prescriptions for future modeling. Future directions emphasize the need for CCN models of the BG that can simultaneously account for cognitive and motor functions, and the need for a more complete specification of the role of the BG in the reviewed functions.</p>
</sec>
<sec id="s2"><title>Neuroanatomy of the basal ganglia</title>
<p>The BG include the striatum (caudate, putamen, nucleus accumbens), the globus pallidus (GP), the subthalamic nucleus (STN), the substantia nigra (SN), the ventral tegmental area, and the olfactory tubercle (see Figure <xref ref-type="fig" rid="F1">1</xref>
). The striatum receives the majority of afferent connections whereas the internal segment of the GP Globus pallidus (internal) (GPi) and SN pars reticulate (SNr) are the sources of the majority of efferent connections that target cortical regions via the thalamus. Based on both structural and functional evidence, the striatum is often divided into a ventral and a dorsal part. The ventral striatum includes the nucleus accumbens, ventromedial portions of the caudate and putamen, and the olfactory tubercle. The dorsal striatum, which is usually the main focus of CCN models of the BG, includes the remainder of the caudate and putamen.</p>
<fig id="F1" position="float"><label>Figure 1</label>
<caption><p><bold>Functional anatomy of the basal ganglia.</bold>
Note that only subdivisions included in most of the reviewed CCN models are represented. Purple boxes correspond to areas of the BG while black boxes are not included in the BG. Blue arrows represent excitatory (glutamatergic) connections while red arrows represent inhibitory (GABA) connections. The direct pathway <bold>(1)</bold>
passes through the D1 receptors in the striatum, the indirect pathway <bold>(2)</bold>
passes through the D2 receptors in the striatum, and the hyperdirect pathway <bold>(3)</bold>
passes through the STN. If the thalamic projections target the same cortical region that initially targeted the striatum, the circuit is called a closed loop. Otherwise, the circuit is an opened loop.</p>
</caption>
<graphic xlink:href="fncom-07-00174-g0001"></graphic>
</fig>
<p>Virtually all of the neocortex sends excitatory (glutamatergic) projections to the striatum (Reiner, <xref ref-type="bibr" rid="B108">2010</xref>
). Corticostriatal input is massively convergent with estimates ranging from 5,000 to 10,000 cortical neurons converging on a single striatal medium spiny neuron (MSN; the main striatal projection neurons) (Kincaid et al., <xref ref-type="bibr" rid="B63">1998</xref>
). Classically, corticostriatal organization is thought to follow a fairly strict spatial topography (Kemp and Powell, <xref ref-type="bibr" rid="B62">1970</xref>
). Along the rostral-to-caudal extent of the BG, the cortical afferents tend be more prevalent from rostral-to-caudal cortical regions. For instance, ventral striatum receives input predominantly from orbitofrontal cortex, ventromedial prefrontal cortex, and anterior cingulate cortex (ACC). As one moves caudally within the striatum, inputs from areas 9, 46, and 8 become more prevalent (Haber et al., <xref ref-type="bibr" rid="B45">2006</xref>
; Calzavara et al., <xref ref-type="bibr" rid="B18">2007</xref>
), followed by inputs from premotor regions (area 6) with the most caudal motor and somatosensory cortical regions projecting preferentially to the caudal putamen (Flaherty and Graybiel, <xref ref-type="bibr" rid="B30">1994</xref>
). Spatial topography holds as you continue rostrally and ventrally through parietal and temporal cortices as well as other extrastriate visual areas (Kemp and Powell, <xref ref-type="bibr" rid="B62">1970</xref>
; Yeterian and Pandya, <xref ref-type="bibr" rid="B130">1993</xref>
, <xref ref-type="bibr" rid="B131">1995</xref>
, <xref ref-type="bibr" rid="B132">1998</xref>
).</p>
<p>The thalamus provides another major source of input to the BG (Wilson, <xref ref-type="bibr" rid="B129">2004</xref>
), with the majority of thalamostriatal projections originating from the parafascicular-centromedian (CMPf) complex (Smith et al., <xref ref-type="bibr" rid="B117">2010</xref>
). Thalamic input to the striatum synapses on both MSNs and cholinergic tonically active neurons (TANs; a class of large-body interneurons) (Smith et al., <xref ref-type="bibr" rid="B118">2004</xref>
), with the latter likely playing an important role in modulating cortico-striatal synaptic plasticity (Ashby and Crossley, <xref ref-type="bibr" rid="B3">2011</xref>
). Finally, thalamic input to the striatum is in a position to modulate BG function by virtue of cortico-thalamo-striatal connections and striatal-thalamo-striatal feedback (Smith et al., <xref ref-type="bibr" rid="B117">2010</xref>
).</p>
<p>The BG also receives dopaminergic input that plays a critical role in modulating striatal activity. Dopamine is projected from the ventral tegmental area and SN pars compacta to the BG and prefrontal cortex, among other brain regions. Dopamine firing patterns fluctuate between two different modes: phasic and tonic. While the phasic mode is fast-acting and spans milliseconds, the tonic mode is long-acting and can span minutes or hours. The dissociable function of both phasic and tonic dopamine is debatable (Dreher and Burnod, <xref ref-type="bibr" rid="B26">2002</xref>
; Assadi et al., <xref ref-type="bibr" rid="B9">2009</xref>
; Moustafa et al., <xref ref-type="bibr" rid="B81">2013</xref>
). However, various studies suggest that phasic dopamine plays a key role in synaptic plasticity and reinforcement learning (Wickens et al., <xref ref-type="bibr" rid="B128">1996</xref>
; Reynolds et al., <xref ref-type="bibr" rid="B109">2001</xref>
), while tonic dopamine is important for speeding-up reaction times (Niv et al., <xref ref-type="bibr" rid="B92">2007</xref>
; Moustafa et al., <xref ref-type="bibr" rid="B82">2008</xref>
) and controlling the signal-to-noise ratio (Durstewitz and Seamans, <xref ref-type="bibr" rid="B27">2008</xref>
).</p>
<p>Information flow through the BG follows two distinct pathways (see Figure <xref ref-type="fig" rid="F1">1</xref>
). Striatal MSNs in the direct pathway project directly to the output nuclei (e.g., GPi) and selectively express D1-like receptors (i.e., D1 and D5; Gerfen et al., <xref ref-type="bibr" rid="B37">1990</xref>
). The striatal MSNs in the indirect pathway project to the external segment of the GP Globus pallidus (external) (GPe) prior to reaching the output nuclei of the BG (e.g., GPi), and selectively express D2-like receptors (i.e., D2, D3, and D4; Gerfen and Young, <xref ref-type="bibr" rid="B38">1988</xref>
). In addition to the direct and indirect pathways, the STN is another major input structure of the BG receiving extensive cortical and thalamic input. This so-called hyperdirect pathway provides a means by which frontal cortical regions can monosynapically influence STN function (Nambu et al., <xref ref-type="bibr" rid="B91">2002</xref>
).</p>
<p>With abundant dopamine receptors in the BG affecting the dynamics of the different pathways, most CCN models of the BG include a role for dopamine. One important way of testing whether the hypothesized role for dopamine in the model is adequate is to simulate the model under dopamine-depleted conditions. Specifically, reducing the amount of dopamine available in the model should produce Parkinsonian symptoms. Parkinson’s disease (PD) is caused by the accelerated death of dopamine producing neurons. The pattern of cell loss is opposite to that of, and more severe than in, normal aging. Within the SN pars compacta, cell loss is predominately found in the ventral tier with less (but still extensive) damage in the dorsal tier (Fearnley and Lees, <xref ref-type="bibr" rid="B29">1991</xref>
; Gibb and Lees, <xref ref-type="bibr" rid="B39">1991</xref>
). In contrast, normal aging yields substantially less cell loss and in a dorsal-to-ventral pattern. Parkinsonian motor symptoms appear after a loss of 60–70% of SN pars compacta cells and 70–80% of dopamine levels in striatal nuclei (Bernheimer et al., <xref ref-type="bibr" rid="B12">1973</xref>
; Gibb and Lees, <xref ref-type="bibr" rid="B39">1991</xref>
). Motor symptoms include tremor, rigidity, bradykinesia, and akinesia. In addition to motor deficits, non-demented PD patients present cognitive symptoms that resemble those observed in patients with frontal damage. Numerous studies documenting cognitive deficits of PD patients have revealed impairment in a variety of tasks related to memory, learning, visuospatial skills, and attention (e.g., Gotham et al., <xref ref-type="bibr" rid="B42">1988</xref>
; Price et al., <xref ref-type="bibr" rid="B106">2009</xref>
).</p>
</sec>
<sec id="s3"><title>Cognitive function</title>
<p>While many cognitive functions have been attributed to the BG (for a review, see Steiner and Tseng, <xref ref-type="bibr" rid="B119">2010</xref>
), relatively few have been modeled and numerically simulated using CCN models, i.e., models that can simultaneously account for both neurobiological and behavioral data. Hence, this review does not constitute an attempt at reviewing all the cognitive and motor functions attributed to the BG: the focus is on CCN models of the BG. Note that the model descriptions included are conceptual, in that implementation details and mathematical formulations are not discussed. The reader is referred to the cited original papers for model details and equations. Table <xref ref-type="table" rid="T1">1</xref>
summarizes the reviewed models along with their respective components.</p>
<table-wrap id="T1" position="float"><label>Table 1</label>
<caption><p>Summary of the basal ganglia components included in the reviewed models.</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">DP (1)</td>
<td rowspan="1" colspan="1">IP (2)</td>
<td rowspan="1" colspan="1">HP (3)</td>
<td rowspan="1" colspan="1">Str</td>
<td rowspan="1" colspan="1">GPi</td>
<td rowspan="1" colspan="1">GPe</td>
<td rowspan="1" colspan="1">STN</td>
</tr>
</thead>
<tbody><tr><td colspan="7" rowspan="1"><bold>Cognitive</bold>
</td>
</tr>
<tr><td rowspan="1" colspan="1">Ashby et al. (<xref ref-type="bibr" rid="B2">1998</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Frank (<xref ref-type="bibr" rid="B31">2005</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
</tr>
<tr><td rowspan="1" colspan="1">Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Ashby et al. (<xref ref-type="bibr" rid="B4">2005</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Moustafa and Maida (<xref ref-type="bibr" rid="B86">2007</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
</tr>
<tr><td rowspan="1" colspan="1">Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Ashby et al. (<xref ref-type="bibr" rid="B6">2007</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Chersi et al. (<xref ref-type="bibr" rid="B20">2013</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">*</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
</tr>
<tr><td colspan="7" rowspan="1"><bold>Motor</bold>
</td>
</tr>
<tr><td rowspan="1" colspan="1">Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
</tr>
<tr><td rowspan="1" colspan="1">Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Gangadhar et al. (<xref ref-type="bibr" rid="B35">2008</xref>
)</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
</tr>
<tr><td rowspan="1" colspan="1">Contreras-Vidal and Stelmach (<xref ref-type="bibr" rid="B21">1995</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
</tr>
<tr><td rowspan="1" colspan="1">Dominey and Arbib (<xref ref-type="bibr" rid="B25">1992</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">*</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1"></td>
</tr>
<tr><td rowspan="1" colspan="1">Krishnan et al. (<xref ref-type="bibr" rid="B66">2011</xref>
)</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1"></td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">*</td>
<td rowspan="1" colspan="1">X</td>
<td rowspan="1" colspan="1">X</td>
</tr>
</tbody>
</table>
<table-wrap-foot><p><italic>Note. DP = Direct pathway [(1) in Figure <xref ref-type="fig" rid="F1">1</xref>
]; IP = Indirect pathway [(2) in Figure <xref ref-type="fig" rid="F1">1</xref>
]; HP = Hyperdirect pathway [(3) in Figure <xref ref-type="fig" rid="F1">1</xref>
]; Str = Striatum; GPi = Globus pallidus (internal); GPe = Globus pallidus (external); STN = Subthalamic nucleus. * These models used the substantia nigra pars reticulate (SNr) as their output node of the basal ganglia. In this context, the SNr is functionally equivalent to the GPi</italic>
.</p>
</table-wrap-foot>
</table-wrap>
<sec id="s3-1"><title>Categorization</title>
<p>Categorization is the ubiquitous process by which individual items are grouped to form categories. The massive convergence of cortico-striatal connectivity makes the BG an ideal site for categorization, and much research supports the role of the BG in category learning (for a review, see Seger, <xref ref-type="bibr" rid="B113">2008</xref>
).</p>
<sec id="s3-1-1"><title>Models</title>
<p>One of the earliest and most prominent neurobiological models of categorization is called COVIS (Ashby et al., <xref ref-type="bibr" rid="B2">1998</xref>
). COVIS is a multiple-system theory that was originally developed to account for the many behavioral dissociations between verbal and non-verbal categorization (as described by the general recognition theory; Ashby and Gott, <xref ref-type="bibr" rid="B7">1988</xref>
). COVIS includes an hypothesis-testing system and a procedural learning system. The hypothesis-testing system can quickly learn a small set of (e.g., verbal) categories (those that can be found by hypothesis-testing and often be verbally described) while the procedural learning system can learn any type of arbitrary categories in a slow trial-and-error manner (e.g., non-verbal). Each categorization system relies on a separate brain circuit but, interestingly, they both include the BG. In the hypothesis-testing system, the BG is used to support working memory maintenance and for rule switching. In the procedural system, the BG is used to learn stimulus—response associations. The COVIS model of categorization has been used to simulate a large number of category learning experiments and made several behavioral predictions, many of which have been later confirmed by empirical experiments (for a review, Maddox and Ashby, <xref ref-type="bibr" rid="B71">2004</xref>
). For example, COVIS predicts that delaying the feedback in verbal categorization should not affect performance (because the hypothesis-testing system relies on working memory) whereas delaying feedback in non-verbal categorization should impair learning (because the procedural learning system relies on dopamine-mediated reinforcement learning in the BG). This prediction was confirmed in Ashby et al. (<xref ref-type="bibr" rid="B5">2003</xref>
). In addition, reducing dopamine levels in COVIS can account for many cognitive symptoms in PD patients such as perseveration, reduced sensitivity to negative feedback, and others (see Helie et al., <xref ref-type="bibr" rid="B49">2012a</xref>
, <xref ref-type="bibr" rid="B50">b</xref>
). Likewise, dopamine elevation can account for the effect of positive affect on verbal category learning (Helie et al., <xref ref-type="bibr" rid="B50">2012b</xref>
). While most COVIS simulations have used a rate version of the model, a spiking version of the procedural-learning system has been used to account for some categorization results and extended to account for instrumental conditioning (Ashby and Crossley, <xref ref-type="bibr" rid="B3">2011</xref>
) and automaticity (Ashby et al., <xref ref-type="bibr" rid="B6">2007</xref>
).</p>
<p>As an alternative, Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) proposed a computational model of the striatum and prefrontal cortex that focuses on the dopamine projections to these areas as well as their interactions during multi-cue category learning. In this task, participants learn to select and pay attention to a single cue among a multi-cue pattern, and then make a categorization response. Participants learn this task via corrective feedback. In the model, the prefrontal cortex is essential for attentional selection while the striatum is used for motor response selection. Similar to COVIS, the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model can account for categorization deficits in PD patients by reducing dopamine levels in both the BG and prefrontal cortex, which is in agreement with empirical results (Kaasinen et al., <xref ref-type="bibr" rid="B58">2001</xref>
; Silberstein et al., <xref ref-type="bibr" rid="B116">2005</xref>
). Additionally, the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model can account for some effects of dopaminergic and anticholinergic medication. The Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model assumes that the administration of anticholinergic medications in PD interferes with hippocampal function, which is also in agreement with empirical studies (Meco et al., <xref ref-type="bibr" rid="B77">1984</xref>
; Pondal et al., <xref ref-type="bibr" rid="B105">1996</xref>
; Ehrt et al., <xref ref-type="bibr" rid="B28">2010</xref>
; Herzallah et al., <xref ref-type="bibr" rid="B52">2010</xref>
). In contrast, the current version of COVIS has not been used to simulate medication effects in PD.</p>
</sec>
<sec id="s3-1-2"><title>Synthesis</title>
<p>The reviewed models of categorization both agree that the BG, and its interaction with the prefrontal cortex, are essential for category learning. Furthermore, they agree that dopamine levels in both the BG and prefrontal cortex are important. While COVIS (Ashby et al., <xref ref-type="bibr" rid="B2">1998</xref>
) has been used to simulate a wider range of categorization tasks, the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model has been used to simulate more details in a smaller subset. For example, one limitation of the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model is that it does not simulate complex multi-cue learning tasks that involve paying attention to more than one stimulus (which can be done using COVIS). However, the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model can simulate the effect of dopaminergic medication, whereas COVIS has not been used to simulate medication effects. One important difference between the COVIS and Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model is that COVIS assigns a different role for BG and cortical dopamine, namely error signal and signal gain (respectively). In contrast, Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) assign both of these roles to dopamine in both the BG and the prefrontal cortex. In addition, an important limitation of both models is that they oversimplify the anatomy of the BG by not including the indirect and hyperdirect pathways. Future work aimed at increasing the biological accuracy of COVIS and the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) models may highlight some additional key differences between the modeling approaches and allow for selecting the most appropriate BG model of categorization.</p>
</sec>
</sec>
<sec id="s3-2"><title>Instrumental conditioning</title>
<p>Instrumental conditioning (also called “operant” conditioning) is a process by which animals learn to behave in a way that will maximize reward and minimize punishment. In a typical instrumental conditioning experiment, a neutral environment is altered and begins generating rewards (acquisition phase). Next, the reward is removed from the environment and the environment reverts to its neutral state (extinction phase). Extinction is usually followed by a reacquisition phase, where the reward is introduced again in the same neutral environment. Typically, a new behavior is learned during the acquisition phase, and progressively disappears during the extinction phase. The behavior reappears during the reacquisition phase, usually at a much faster rate than during the initial acquisition phase. This phenomenon is called <italic>fast reacquisition</italic>
. Much evidence implicates the BG in instrumental conditioning (e.g., O’Doherty et al., <xref ref-type="bibr" rid="B94">2004</xref>
; Yin et al., <xref ref-type="bibr" rid="B133">2005</xref>
), but the neurobiology underlying extinction and fast reacquisition is poorly understood.</p>
<sec id="s3-2-1"><title>Models</title>
<p>Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) proposed a spiking model of the direct pathway of the BG (see Figure <xref ref-type="fig" rid="F1">1</xref>
) inspired by the COVIS procedural learning system (Ashby et al., <xref ref-type="bibr" rid="B2">1998</xref>
) to account for instrumental conditioning. The Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) model focuses on the TANs, a population of cholinergic interneurons in the striatum that is rarely included in CCN models of the BG. Pakhotin and Bracci (<xref ref-type="bibr" rid="B98">2007</xref>
) have shown that TANs play an important role in inhibiting cortical activation of the MSNs (i.e., the projection neurons generally modeled in the direct and indirect pathways). As suggested by their name, TANs have a high baseline firing rate, but they learn to pause in rewarding contexts (Apicella, <xref ref-type="bibr" rid="B1">2007</xref>
). Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) suggest that one possible role for the TANs is to protect striatal learning from catastrophic interference and allow for fast reacquisition. In addition to the direct pathway, the Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) model includes a sensory association area, the supplementary motor area (SMA), and the CMPf complex.</p>
<p>The Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) model is an opened loop through the BG (from sensory association cortex to the SMA). The stimulus activates the sensory association cortex, which in turn activates the striatum and the direct pathway of the BG. At the same time, the context activates the CMPf complex, which transmits activation to the TANs (this pathway is not included in Figure <xref ref-type="fig" rid="F1">1</xref>
). At the beginning of an experiment, the simulated subject does not know that the context is rewarding. Hence, the TANs do not pause, and the MSNs in the direct pathway cannot be activated by the sensory association cortex. This prevents stimulus—response association learning. During the acquisition phase, the TANs quickly learn that the context is rewarding and pause. The MSNs are thus released from inhibition and the model learns to produce the rewarding behavior using reinforcement learning. Next, during the extinction phase, the TANs learn that the context is no longer rewarding and stop pausing. This change inhibits the MSNs and interrupts cortico-striatal learning. Hence, the associations that were learned during the acquisition phase are protected. Finally, during the reacquisition phase, the context becomes rewarding again, and the TANs learn to pause. The MSNs are released from inhibition, and the learned associations are in the same state as in the acquisition phase, which produces fast reacquisition. Using this process, the model has been used to reproduce the acquisition, extinction, and fast reacquisition phases typical of instrumental conditioning and single-cell recording data from TANs showing that the cells learn to pause in rewarding contexts (Ashby and Crossley, <xref ref-type="bibr" rid="B3">2011</xref>
).</p>
</sec>
<sec id="s3-2-2"><title>Synthesis</title>
<p>The Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) model is the only CCN model of instrumental conditioning that can simultaneously account for behavioral (e.g., fast reacquisition) and single-cell data (from the TANs). This model constitutes an important step in that it provides an implementation and numerical simulation of the theory that TANs learn to pause in rewarding contexts, and how this can affect reinforcement learning in the BG. However, the neuroanatomy of the BG was simplified in that only the direct pathway through one of the cortico-BG loops was included. It is unclear at this time how the TANs’ dynamics would affect the indirect pathway, or how the model would behave if more than one loops was included. Future work is needed to verify how the theory implemented in Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) behaves in a more detailed model of the BG.</p>
</sec>
</sec>
<sec id="s3-3"><title>Probabilistic learning</title>
<p>Probabilistic learning typically refers to tasks where the association between the response and the reward is uncertain. Unlike most categorization experiments, the same response to the same stimulus can result in different outcomes on different trials. While probabilistic learning has been shown to rely on the BG since the mid-1990s (Knowlton et al., <xref ref-type="bibr" rid="B64">1996</xref>
), it took a decade before CCN models of the BG were used to attempt to account for probabilistic learning.</p>
<sec id="s3-3-1"><title>Models</title>
<p>The Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model was originally proposed to account for cognitive deficits in parkinsonism. The model includes both the direct and indirect pathways through the BG (see Figure <xref ref-type="fig" rid="F1">1</xref>
), the premotor cortex, and an unspecified input area (probably located in posterior cortex) (so the model is an opened loop). In the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model, the input activates both the premotor cortex and the striatum. However, cortical activation is insufficient to produce a response, so BG processing is required to gate the correct response. The focus of the model is on: (1) the role of the indirect pathway in probabilistic learning and (2) the role of dopamine in probabilistic learning. In the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model, the direct pathway is in charge of selecting the appropriate action (Go) whereas the indirect pathway is in charge of inhibiting inappropriate actions (NoGo). The direct and indirect pathways converge in the GPi and compete to control GPi activation, and eventually the response. Simulation results show that removing the indirect pathway in the model reduces performance, suggesting that both the direct and indirect pathways are essential in probabilistic learning. In addition, the effect of the indirect pathway needs to be specific to each action (so that the indirect pathway can individually inhibit each action).</p>
<p>As described in the neuroanatomy section above, the competition between the direct and indirect pathways is modulated by dopamine (the second focus of the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model). Specifically, higher dopamine levels increase activation in the direct pathway (e.g., through D1 receptors) and reduces activation in the indirect pathway (e.g., through D2 receptors). Hence, dopamine release following unexpected rewards results in long-term potentiation (LTP) in the direct pathway and long-term depression (LTD) in the indirect pathway. In contrast, dopamine dips following the unexpected absence of a reward reduces activation and produces LTD in the direct pathway but increases activation and produces LTP in the indirect pathway. The simulation results suggest that the dynamic range of the dopamine signal is crucial in probabilistic learning and reversal learning (e.g., when the response—reward associations are changed during learning). Reducing (to simulate PD) or increasing (to simulate medication overdose) dopamine levels can result in simulated Parkinsonian symptoms (Frank, <xref ref-type="bibr" rid="B31">2005</xref>
).</p>
<p>Another interesting model of probabilistic learning was recently proposed by Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
). The Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
) model is based on an earlier computational neuroscience model of the BG that focuses on the interaction between the direct and hyperdirect pathways (Leblois et al., <xref ref-type="bibr" rid="B68">2006</xref>
). The Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
) model includes two cortico-BG closed-loop that interact in the striatum. The first loop is called the “cognitive” loop and is used to identify the visual symbols used in the probabilistic learning task. The second loop is called the “motor” loop and is used to select a response based on the observed symbols. Some of the corticostriatal projections affect both loops, but the rest of the circuit is segregated. In both loops, the direct pathway is in charge of selecting the correct channel (i.e., identifying the symbols or the response) while the hyperdirect pathway sends non-specific inhibition to the GPi to produce a center-surround decision process. All corticostriatal synapses are plastic (using dopamine-mediated reinforcement learning) and the cognitive loop gradually learns to bias the motor loop, thus producing faster reaction times. The model successfully reproduces both neural firing rates and behavioral data in the double-arm bandit task.</p>
<p>The categorization models reviewed earlier have also been applied to probabilistic learning. The Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
) model focused on the role of dopamine in probabilistic learning. In addition to simulating probabilistic learning with normal dopamine levels, Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
) have simulated the effect of decreased dopamine (as in PD) and the effect of dopaminergic medication in both the BG and prefrontal cortex. The COVIS model has also been used to simulate probabilistic learning (Helie et al., <xref ref-type="bibr" rid="B49">2012a</xref>
). While COVIS was not used to simulate medication effects, the model could account for probabilistic learning with normal and reduced (as in PD) dopamine levels (with a dosage effect such that lowest levels of dopamine produced worst performance; see Knowlton et al., <xref ref-type="bibr" rid="B64">1996</xref>
).</p>
</sec>
<sec id="s3-3-2"><title>Synthesis</title>
<p>The reviewed models of probabilistic learning tend to be more biologically detailed than the reviewed models of categorization. Specifically, the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model includes the direct and indirect pathways, whereas the Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
) model includes the direct and hyperdirect pathways. In contrast, COVIS (Ashby et al., <xref ref-type="bibr" rid="B2">1998</xref>
) and the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) models only included the direct pathway. Interestingly, however, the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model does not include the same details as the Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
) model. Both models include the direct pathway for action selection, and use dopamine-mediated reinforcement learning to learn corticostriatal synapses. However, the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model uses the indirect pathway as a channel-specific excitatory process to cancel inappropriate actions whereas Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
) use the hyperdirect pathway as a non-specific excitatory process to cancel inappropriate actions. Neither model includes both the indirect and hyperdirect pathways. While there is agreement on the need for an excitatory process to enhance the contrast between the selected and non-selected actions, the exact process is still to be determined.</p>
<p>While the categorization models only included the direct pathway of the BG, one of their strengths is that, in addition to their generality, they also include other brain areas. For instance, Unlike the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) model, the Moustafa and Gluck (<xref ref-type="bibr" rid="B83">2011a</xref>
,<xref ref-type="bibr" rid="B84">b</xref>
) model simulates the role of prefrontal cortex and its dopamine projections, which is in agreement with empirical studies (Mulder et al., <xref ref-type="bibr" rid="B87">2003</xref>
; Histed et al., <xref ref-type="bibr" rid="B54">2009</xref>
). Also, analysis of the parameter space in the COVIS simulations challenges the role of the BG for procedural learning in probabilistic learning, and suggests instead that the BG are used for hypothesis-testing in this task (Gluck et al., <xref ref-type="bibr" rid="B41">2002</xref>
). So, both categorization models agree on an important role for the prefrontal cortex in probabilistic learning, and this role is missing from both the Frank (<xref ref-type="bibr" rid="B31">2005</xref>
) and the Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
) models. The most productive future approach might be to add a prefrontal cortex to the existing probabilistic learning models and see how this addition affects the dynamic of the different BG pathways.</p>
</sec>
</sec>
<sec id="s3-4"><title>Working memory</title>
<p>Working memory is a cognitive function used to maintain and manipulate information in real-time for a short duration (seconds). While working memory has traditionally been associated with the prefrontal cortex (Fuster, <xref ref-type="bibr" rid="B33">2008</xref>
), Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) proposed that the BG may be required to maintain information in prefrontal cortex.</p>
<sec id="s3-4-1"><title>Models</title>
<p>The Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) model was originally proposed to account for working memory deficits in PD and schizophrenia. The model includes three BG-thalamocortical closed loops: two with the prefrontal cortex (one for spatial information and the other for object information), and one through the ACC (for strategy selection). In all three cases, only the direct pathway through the BG was included (see Figure <xref ref-type="fig" rid="F1">1</xref>
). The role of the two prefrontal-BG loops is to maintain working memory information about the stimuli, whereas the ACC maintains the adopted strategy by inhibiting all the prefrontal cortex loops except one (i.e., representing the selected strategy). Visual input to the BG comes from the posterior parietal cortex (spatial) and inferior temporal cortex (object). The model output is located in the premotor cortex, and the nucleus accumbens (not shown in Figure <xref ref-type="fig" rid="F1">1</xref>
) is used to provide feedback. In the model, the visual stimulus is input to the prefrontal cortex loops, and the stimulus activity is propagated through the direct pathway of the BG. As a result, the thalamus is released from GPi inhibition, and activation produced by the stimulus in the prefrontal cortex reverberates through closed-loops with the thalamus. When a response is required, the prefrontal cortex transfers its activation to the premotor cortex. If the response is incorrect, the nucleus accumbens sends a feedback signal to the ACC loop, which selects a new strategy by switching its inhibition to different prefrontal cortex loops. The Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) model has been used to simulate a delayed response task and the Wisconsin Card Sorting Test. Interestingly, reducing the connection strengths within the BG-thalamocortical loops produces Parkinsonian symptoms, whereas reducing nucleus accumbens activity produces deficits similar to those observed in schizophrenia (Monchi et al., <xref ref-type="bibr" rid="B80">2000</xref>
).</p>
<p>Five years later, Ashby et al. (<xref ref-type="bibr" rid="B4">2005</xref>
) proposed the FROST model to account for intact spatial working memory maintenance. Similar to the Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) model, FROST includes the direct pathway of the BG (see Figure <xref ref-type="fig" rid="F1">1</xref>
), and working memory maintenance relies on reverberating activation between the prefrontal cortex and the thalamus. However, unlike in the Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) model, only one prefrontal cortex loop is included, and thalamic activation is not sufficient to maintain prefrontal activity: a second set of closed-loops between the prefrontal cortex and posterior cortex needs to be simultaneously activated to maintain working memory information. In Ashby et al. (<xref ref-type="bibr" rid="B4">2005</xref>
), the focus is on simulating spatial working memory tasks, and the area of posterior cortex required for working memory maintenance is the posterior parietal cortex. However, it is likely the case that the specific location in posterior cortex depends on what information is being maintained. For instance, if the items being maintained in working memory were objects, then it is likely that the posterior cortex area involved would be inferior temporal cortex. Another difference between FROST and the Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) model is that the striatum in FROST is activated by a different population of prefrontal neurons (separate from the working memory maintenance prefrontal population) whereas the same prefrontal neurons are used to activate the striatum and maintain information in Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
). As a result, the striatum becomes activated only after the stimulus has disappeared in FROST, whereas the striatum becomes activated as soon as the stimulus appears in Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
). These differences between FROST and Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) were motivated by recent single-cell recording results reviewed in Ashby et al. (<xref ref-type="bibr" rid="B4">2005</xref>
). FROST has been used to reproduce single-cell recordings from many experiments in several brain regions, in addition to accounting for working memory capacity limitation and the relation between memory span and the ability to ignore distracting information (Ashby et al., <xref ref-type="bibr" rid="B4">2005</xref>
).</p>
<p>One common theme of the two previous models is that working memory activity is maintained by closed-loops between the thalamus and prefrontal cortex, and the main role of the BG is to release the thalamus from inhibition and allow for the reverberating activation to take place. However, this view was challenged by Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
) who proposed a model of BG-prefrontal cortex interaction in working memory. Specifically, Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
) argued that in order for the thalamus to contribute to working memory maintenance in the way described by the previous models, it would need to have a dedicated number of cells comparable to the number of cells dedicated to working memory in prefrontal cortex (which is unlikely). Instead, the Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
) model proposes that working memory maintenance is accomplished by reverberating loops between two cell populations within the prefrontal cortex. Similar to Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) and FROST (Ashby et al., <xref ref-type="bibr" rid="B4">2005</xref>
), the Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
) model includes the direct pathway through the BG (see Figure <xref ref-type="fig" rid="F1">1</xref>
), but the role of the direct pathway is to “turn on the switch” on the prefrontal cortex cells and allow for reverberating activation. The “switch” can only be turned on if the prefrontal cortex cells from one population simultaneously receive activation from the BG and the other prefrontal cortex cell population. Once the switch is “on”, the BG is no longer required for working memory maintenance. The Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
) model has been used to simulate the 1-2-AX task, a working memory task that requires maintenance but also switching and selecting new items (Frank et al., <xref ref-type="bibr" rid="B32">2001</xref>
). Specifically, the 1-2-AX task requires the subject to maintain two cues in working memory in order to correctly select a response to a target sequence. The identity of the target sequence depends on the previous cue, which is used to trigger selection and switching.</p>
<p>One topic that was not addressed by any of the previous models of working memory is learning. How can the brain learn what is important, and what needs to be maintained in working memory? Moustafa and Maida (<xref ref-type="bibr" rid="B86">2007</xref>
) proposed a computational model of prefrontal cortex and BG interactions that is similar to the Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
) model except that Moustafa and Maida (<xref ref-type="bibr" rid="B86">2007</xref>
) also simulate: (a) temporal difference learning based on phasic dopamine signaling and (b) more than one corticostriatal loops that are responsible for both motor and cognitive processes. Specifically, the model includes a cortico-striatal motor loop and a cortico-striatal cognitive loop whose functions are action selection (choosing motor responses) and cognitive selection (choosing the perceptual information to be maintained in working memory), respectively. The model can account for the separate roles of the motor and cognitive loops in working memory maintenance, including delayed-response tasks.</p>
<p>Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) recently proposed a CCN model of working memory to address the problem of learning complex working memory tasks. The Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) model includes two separate BG-thalamocortical closed loops, one through the prefrontal cortex for maintenance and another through motor cortex to produce a response. Only the direct pathways were used for maintenance and response selection, but the hyperdirect pathway was also included in the prefrontal loop as a reset mechanism (see Figure <xref ref-type="fig" rid="F1">1</xref>
). Specifically, visual information enters the model through the inferior temporal cortex, which then activates the lateral prefrontal cortex. This activation is transferred through the direct pathway of the BG and releases the thalamus from inhibition, which in turn activates the lateral prefrontal cortex. In the Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) model, working memory activation in the prefrontal cortex is maintained by a reverberating activation loop through the direct pathway, so the BG does not only act as a gating mechanism but is part of the maintenance loop (unlike Monchi et al., <xref ref-type="bibr" rid="B80">2000</xref>
; Frank et al., <xref ref-type="bibr" rid="B32">2001</xref>
; Ashby et al., <xref ref-type="bibr" rid="B4">2005</xref>
). At any moment, the prefrontal cortex can activate the STN, which increases activation in the GPi and interrupt working memory maintenance (i.e., the reset mechanism). More importantly, the connectivity between the prefrontal cortex and the striatum and the connections between the prefrontal cortex and the STN are learned using dopamine-mediated reinforcement learning. Hence, the model can automatically adapt and only maintain information that is rewarded in working memory. The model has been used to simulate a delayed response task, a delayed alternation task, and the 1-2-AX task (Schroll et al., <xref ref-type="bibr" rid="B112">2012</xref>
).</p>
</sec>
<sec id="s3-4-2"><title>Synthesis</title>
<p>Working memory is one of the most active areas for CCN modeling of the BG. Five different models were reviewed, each having both commonalities and differences. First, all five models focused on the interaction between the BG and the prefrontal cortex, but only included the direct pathway of the BG for working memory maintenance and response selection. Hence, the neuroanatomy of the BG was not very detailed. Also, all models except Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) used the BG as a gating mechanism that turns working memory maintenance “on” or “off”. The main difference is that Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
) and Ashby et al. (<xref ref-type="bibr" rid="B4">2005</xref>
) used the BG to gate closed loops between the prefrontal cortex and the thalamus, whereas Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
) and Moustafa and Maida (<xref ref-type="bibr" rid="B86">2007</xref>
) used the BG to gate closed loop between two populations of prefrontal cortex units. This differs from Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) where the BG was not used for gating, but instead was part of the working memory maintenance mechanism itself (i.e., the closed loop went through the BG). In all cases, however, working memory maintenance was achieved by closed loop through the prefrontal cortex.</p>
<p>Another important difference between the models is that the Ashby et al. (<xref ref-type="bibr" rid="B4">2005</xref>
) and the Moustafa and Maida (<xref ref-type="bibr" rid="B86">2007</xref>
) models focused on simple maintenance tasks. In contrast, the Monchi et al. (<xref ref-type="bibr" rid="B80">2000</xref>
), Frank et al. (<xref ref-type="bibr" rid="B32">2001</xref>
), and Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) models were able to simulate more complex tasks involving hierarchical structures and switching. Only the Moustafa and Maida (<xref ref-type="bibr" rid="B86">2007</xref>
) and the Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) models include learning mechanisms that allowed for selecting the relevant information that needs to be maintained in working memory. The other models assumed a pre-filtering of the information.</p>
<p>Interestingly, there seems to be a progression and a building up of knowledge related to CCN models of working memory. The Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
) model is the most recent, and also the most detailed. It is the only model that can learn and simulate complex tasks. However, this model departs from all the others in that the BG is not used as a gating mechanism but is part of the maintenance mechanism. This departure from previous modeling is not extensively discussed in Schroll et al. (<xref ref-type="bibr" rid="B112">2012</xref>
), and it is unclear at this point what motivated this departure. More work is needed to determine which of these two roles the BG play in working memory, but the overlap in the models, and the progression in functionality, suggest a steady progress in CCN modeling of working memory.</p>
</sec>
</sec>
<sec id="s3-5"><title>Sequence learning</title>
<p>Almost all our everyday behaviors and cognitive activities can be interpreted as a sequence of steps that bring us closer to achieving a goal. One key question is how can we learn to chain these sequences of substeps? Miyachi et al. (<xref ref-type="bibr" rid="B79">1997</xref>
, <xref ref-type="bibr" rid="B78">2002</xref>
) have gathered much data suggesting that the BG is important in learning such sequences.</p>
<sec id="s3-5-1"><title>Models</title>
<p>Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) formalized Miyachi et al. (<xref ref-type="bibr" rid="B79">1997</xref>
, <xref ref-type="bibr" rid="B78">2002</xref>
) findings into a CCN model. According to Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
), sequences are learned in both visual and motor coordinates. The visual sequences are learned by a BG-thalamocortical closed-loop linking the anterior striatum with the dorsolateral prefrontal cortex while motor sequences are learned by a BG-thalamocortical closed-loop linking the posterior striatum with the SMA. Only the direct pathway through the BG is included in each loop (see Figure <xref ref-type="fig" rid="F1">1</xref>
), and both the visual and motor loops learn every sequence in parallel using reinforcement learning. The visual loop learns faster than the motor loop, and response coordination between the loops is controlled by the pre-SMA. According to Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
), the visual loop relies on working memory and is important for rapid acquisition of sequences. However, the motor loop is more reliable and produces movement more rapidly after training. As a result, control is gradually transferred from the visual loop to the motor loop in the Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model. The Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model has been used to account for: (1) the time course of learning (including single-cell recordings and lesion studies); (2) the effect of opposite hand use; (3) the effect of sequence reversal; and (4) the change in brain locus from early to late sequence production (Nakahara et al., <xref ref-type="bibr" rid="B90">2001</xref>
).</p>
</sec>
<sec id="s3-5-2"><title>Synthesis</title>
<p>The Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model is interesting for several reasons. First, it successfully accounts for lesion data, single-cell recordings, and behavioral phenomena. In addition, the transition from a visual loop to a motor loop represents an early attempt at bridging the gap between cognitive and motor functions of the BG. However, a recent study by Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) challenges the generality of the Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model. Specifically, Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) had monkeys perform a sequence of visually-cued joystick movements aimed at moving a cursor into a pre-determined part of a computer screen. After some training, muscimol was injected into the motor segment of the GPi to functionally disconnect the BG from the frontal cortex. The results show that the kinematics of the movements were impaired, but not sequence knowledge. Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) interpreted these results as suggesting that the BG contributes to motor execution in automatic sequence production, but not to the motor sequencing or the storage of the overlearned sequence. This result is problematic for the Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model.</p>
</sec>
</sec>
<sec id="s3-6"><title>Automaticity</title>
<p>Automaticity results from overtraining in a task until performance requires little attentional resources and becomes highly rigid (Helie et al., <xref ref-type="bibr" rid="B51">2010</xref>
; Helie and Cousineau, <xref ref-type="bibr" rid="B48">2011</xref>
). Many computational models of automaticity development have assigned a role for the BG.</p>
<sec id="s3-6-1"><title>Models</title>
<p>First, in the Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model of sequence learning (above), automaticity in sequence production is characterized by a gradual transfer from the visual loop (which learns sequences in visual coordinates) to the motor loop (which learns sequences in motor coordinates). This corresponds well with the results of Miyachi et al. (<xref ref-type="bibr" rid="B79">1997</xref>
, <xref ref-type="bibr" rid="B78">2002</xref>
), who showed using single-cell recordings that task-sensitive cells in early learning are mostly located in the anterior striatum whereas selective cells in late sequence production are mostly located in the posterior striatum (Miyachi et al., <xref ref-type="bibr" rid="B78">2002</xref>
). This specialization of the striatum is further supported by inactivation studies where muscimol (a GABA agonist) was injected in different parts of the striatum in early and late sequence production. Well-learned sequence production was selectively disrupted by muscimol injection in the middle-posterior putamen while early sequence production was selectively disrupted by muscimol injection in the anterior caudate and putamen (Miyachi et al., <xref ref-type="bibr" rid="B79">1997</xref>
).</p>
<p>However, a recent study by Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) challenges the generality of the Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model. Specifically, injecting muscimol into the motor segment of the GPi to functionally disconnect the BG from the frontal cortex affects the kinematics of the movements but not sequence knowledge. These results suggest that the BG contributes to motor execution in automatic sequence production, but not to the motor sequencing or the storage of the overlearned sequence. Interestingly, the results of Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) are consistent with a neurobiological model of automaticity in perceptual categorization (SPEED) (Ashby et al., <xref ref-type="bibr" rid="B6">2007</xref>
). SPEED uses the procedural system of COVIS (Ashby et al., <xref ref-type="bibr" rid="B2">1998</xref>
) (i.e., the direct pathway of an opened loop between posterior cortex and premotor areas) but also includes a Hebbian learning mechanism between posterior cortex and premotor areas. The role of the BG in SPEED is to learn to produce the correct categorization responses early in training to ensure that the correct motor plan in the premotor areas is consistently activated shortly after the visual representation in associative cortex (using dopamine-mediated reinforcement learning). This consistent association between associative and premotor cortical activity triggers Hebbian learning between associative cortex (stimulus) and the premotor areas (response), and the direct cortico-cortical connections eventually become strong enough so that the BG is no longer required to produce a response. When responding becomes purely cortical, the skill is said to be “automatic” [note that this is different from Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
), in which the posterior striatum is still required for automatic sequence production]. SPEED has been used to simulate single-cell recordings data in many categorization experiments, as well as human reaction times and accuracies in categorization (Ashby et al., <xref ref-type="bibr" rid="B6">2007</xref>
; Helie and Ashby, <xref ref-type="bibr" rid="B47">2009</xref>
).</p>
<p>While the Hikosaka et al. (<xref ref-type="bibr" rid="B53">2000</xref>
) and SPEED models can account for how behavior becomes automatic, they cannot account for how automatic responses are overridden by goal-directed behavior when needed (e.g., when the stimulus—response associations change). Chersi et al. (<xref ref-type="bibr" rid="B20">2013</xref>
) proposed a computational model of automaticity in instrumental conditioning that can account for the change back to goal-directed behavior when needed. The Chersi et al. (<xref ref-type="bibr" rid="B20">2013</xref>
) model includes the prefrontal cortex (for goal representation), the motor cortex (for action representation), the sensory cortex (for stimulus representation), the BG (for action selection), and the thalamus (to relay information between the BG and the motor cortex). Two sets of connections are plastic: (1) connections from the prefrontal cortex to the motor cortex (to learn goal—response associations) and (2) connections from the sensory cortex to the striatum (to learn stimulus—response associations). According to this model, the stimulus activates the sensory cortex, which in turn activates a goal in prefrontal cortex and action representations in the striatum. For automatic behavior, the striatal activation propagates through both the direct and indirect pathways (see Figure <xref ref-type="fig" rid="F1">1</xref>
) of the BG and an action is selected by inhibiting all but one action at the output level (SNr, but it is functionally equivalent to the GPi shown in Figure <xref ref-type="fig" rid="F1">1</xref>
). The action that is not inhibited activates the appropriate response in motor cortex (through the thalamus). For goal-directed behaviors, the prefrontal activation propagates to the appropriate action in motor cortex. When an automatic action needs to be overwritten by a goal-directed behavior, the prefrontal cortex sends activation to the STN, which hyperpolarizes the SNr and prevents the BG from controlling the motor response (Chersi et al., <xref ref-type="bibr" rid="B20">2013</xref>
). The model has been successfully used to account for the development of automaticity in an instrumental conditioning task and the reversal of stimulus—response associations after automaticity had developed (Chersi et al., <xref ref-type="bibr" rid="B20">2013</xref>
).</p>
</sec>
<sec id="s3-6-2"><title>Synthesis</title>
<p>The Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) and the Chersi et al. (<xref ref-type="bibr" rid="B20">2013</xref>
) models both assign the role of producing automatic behavior to the BG. However, this “classic” role of the BG in automaticity is difficult to reconcile with the Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) data. As an alternative, SPEED (Ashby et al., <xref ref-type="bibr" rid="B6">2007</xref>
) also assigns an important role to the BG in automaticity, but this role is restricted to training automatic cortico-cortical projections that can account for automaticity. Simply put, the BG is required to learn automatic behaviors, but the BG is no longer required to produce automatic behaviors once the cortico-cortical connectivity is sufficiently strong. The SPEED model can account for the Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) data, but it includes only the direct pathway of one loop through the BG. In contrast, the Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model includes two loops through the BG (only the direct pathways) and the Chersi et al. (<xref ref-type="bibr" rid="B20">2013</xref>
) model includes both the direct and indirect pathways, but only one loop through the BG (similar to SPEED). In addition to being the most biologically detailed, the Chersi et al. (<xref ref-type="bibr" rid="B20">2013</xref>
) model is the only reviewed model that can override automatic behavior using goal-directed behavior. This is an important function that was not accounted for by the previous models. However, like the Nakahara et al. (<xref ref-type="bibr" rid="B90">2001</xref>
) model, the Chersi et al. (<xref ref-type="bibr" rid="B20">2013</xref>
) model cannot account for the Desmurget and Turner (<xref ref-type="bibr" rid="B22">2010</xref>
) data. To summarize, each one of these models was designed to account for a different aspect of automatic behavior, and successfully accounts for the aspect of automaticity for which it was designed. The next step is to explore how each one of these candidate models can account for the missing function/data that was the focus of the other candidate models.</p>
</sec>
</sec>
</sec>
<sec id="s4"><title>Motor function</title>
<p>This section describes motor functions that have been attributed to the BG and that have been simulated using CCN models. Hence, computational models that focus only on modeling biological data or motor function (e.g., kinematics) were not included. Similar to the section reviewing cognitive functions above, the model descriptions are conceptual, in that implementation details and formalities are not discussed. The reader is referred to the cited original papers for details and equations. Table <xref ref-type="table" rid="T1">1</xref>
summarizes the reviewed models along with their respective components.</p>
<sec id="s4-1"><title>Reaching</title>
<p>The BG has been implicated in reaching movements for many years (for a review, see Bischoff, <xref ref-type="bibr" rid="B13">1998</xref>
). Not surprisingly, PD patients show unmistakable changes in reaching movements, which can be used for diagnostic purposes (Brown and Jahanshahi, <xref ref-type="bibr" rid="B15">1996</xref>
). Simple reaching movements in PD patients show longer reaction times and movement times than normal controls. This reduced movement speed seen in PD reaching is called bradykinesia. From a physiological perspective, a typical reaching movement under normal conditions consists of a sequence of agonist-antagonist bursts. In contrast, a PD reaching movement is generally multi-staged and involves multiple agonist bursts. Furthermore, PD reaching movements have greater variability of hand position for larger movements (Sheridan and Flowers, <xref ref-type="bibr" rid="B114">1990</xref>
). PD patients also show impairment in sequential movements (Weiss et al., <xref ref-type="bibr" rid="B127">1997</xref>
). For example, during movements aimed at reaching a glass of water, PD patients exhibit an inordinately long pause between the reaching and retrieval of the glass.</p>
<sec id="s4-1-1"><title>Models</title>
<p>Several computational models relating dopamine deficiencies to impaired reaching movements have been proposed. One of the first models of PD reaching movements is the model of Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
). Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
) model includes the prefrontal cortex (for working memory/learning), the SMA (for sequence generation), the pre-SMA (for sequence preparation), motor cortex (for movement parameters), the thalamus (to filter information from the BG to cortex), and the BG. The BG model assigns complementary roles to the direct and indirect pathways (see Figure <xref ref-type="fig" rid="F1">1</xref>
). According to Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
), the role of the direct pathway is to inform the motor cortex of the movement’s next sensory state, while the role of the indirect pathway is to inhibit competing movements. The function of dopamine is to keep the balance between the two pathways, which is impaired in PD. The Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
) model was used to simulate the reciprocal aiming task, a task where subjects are asked to alternatively tap a stylus between two targets as quickly as possible. Reducing the dopamine levels in the simulation reproduced bradykinesia and the exaggerated pauses in sequential movements observed in PD.</p>
<p>Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) also proposed a model of the role of the BG in PD reaching movements. The model is cast in the framework of reinforcement learning and focuses on interactions between the motor cortex and the BG. The Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) model uses the classical interpretations of BG pathways according to which the direct pathway facilitates movement, (i.e., the “Go” pathway), while the indirect pathway inhibits movements (i.e., the “NoGo” pathway). Switching between the two pathways is thought to be driven by striatal dopamine levels. However, Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) also deviate from the classical “Go”/“NoGo” model of the BG by adding an intermediate regime called the <italic>explore</italic>
regime. The explore regime is used to control the stochasticity of action selection when the gradient is absent or too weak to allow for reinforcement learning. The indirect pathway is proposed to be the substrate supporting the explore regime. Simulations show that under dopamine-deficient conditions of PD, the model spends less time in the “Go” regime while spending more time in the remaining two regimes. These regime changes were used to account for a variety of features of impaired reaching movements in PD including movement undershoot (Van Gemmert et al., <xref ref-type="bibr" rid="B124">2003</xref>
), bradykinesia, and increased path variability (Sheridan and Flowers, <xref ref-type="bibr" rid="B114">1990</xref>
).</p>
</sec>
<sec id="s4-1-2"><title>Synthesis</title>
<p>Two models that highlight the role of the BG in reaching were reviewed. The Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
) model includes, in addition to the BG, cortical areas such as prefrontal areas, the SMA and the pre-SMA. The model captures bradykinesia and abnormal pauses in sequential movements under Parkinsonian conditions. The reaching model of Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) also incorporates the BG and the motor cortex. However, the Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) model is cast in the framework of reinforcement learning, whereas there is no learning in the Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
) model. Focus on learning makes the Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) model consistent with the proposed role of BG in error correction (Lawrence, <xref ref-type="bibr" rid="B67">2000</xref>
). As a result, the Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) model is more general and is consistent with the view that a wide range of BG functions can be explained within the framework of reinforcement learning (Chakravarthy et al., <xref ref-type="bibr" rid="B19">2010</xref>
). The compatibility of the Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) model with other CCN models of BG function may facilitate integration to achieve a more complete model of BG function.</p>
</sec>
</sec>
<sec id="s4-2"><title>Handwriting</title>
<p>Handwriting is a fine motor skill. PD patients often exhibit an impaired form of handwriting, known as micrographia, characterized by reduced letter size, a “kinky” handwriting contour, and abnormal fluctuations in velocity and acceleration (Teulings and Stelmach, <xref ref-type="bibr" rid="B121">1991</xref>
; Van Gemmert et al., <xref ref-type="bibr" rid="B125">1999</xref>
; Gangadhar et al., <xref ref-type="bibr" rid="B36">2009</xref>
). As a result, handwriting features like stroke size, peak acceleration, and stroke duration have been attributed to the BG and used for diagnosis of PD (Phillips et al., <xref ref-type="bibr" rid="B100">1991</xref>
; Van Gemmert et al., <xref ref-type="bibr" rid="B124">2003</xref>
).</p>
<sec id="s4-2-1"><title>Models</title>
<p>Although models of PD handwriting are scanty, extensive work has been done on modeling handwriting generation. One of the earliest insights into modeling handwriting consisted of performing a Fourier-like resolution of handwriting into oscillatory components (Hollerbach, <xref ref-type="bibr" rid="B55">1981</xref>
). This notion has led to the development of oscillatory or spiking neural network models of handwriting generation that can be trained to produce single characters (Schomaker, <xref ref-type="bibr" rid="B111">1991</xref>
; Kalveram, <xref ref-type="bibr" rid="B59">1998</xref>
). However, the models of Schomaker (<xref ref-type="bibr" rid="B111">1991</xref>
) and Kalveram (<xref ref-type="bibr" rid="B59">1998</xref>
) suffered from the absence of a plausible procedure for initializing the phases of neural oscillators, a difficulty that was solved in an oscillatory neural network model of handwriting generation proposed by Gangadhar et al. (<xref ref-type="bibr" rid="B34">2007</xref>
).</p>
<p>While the above-described models did not explicitly include the BG, Gangadhar et al. (<xref ref-type="bibr" rid="B35">2008</xref>
) combined the Gangadhar et al. (<xref ref-type="bibr" rid="B34">2007</xref>
) handwriting generation model with a model of the BG. Similar to handwriting patterns observed in PD patients, the Gangadhar et al. (<xref ref-type="bibr" rid="B35">2008</xref>
) model exhibits micrographia under conditions of reduced dopamine. Another significant feature of the model is the role of the dynamics of the STN and the GPe, which are connected as a loop to produce complex oscillations. Under pathological conditions, the oscillations of the STN and the GPe in the model are highly correlated, resembling the correlated neural firing from STN and GPe neurons under dopamine-deficient conditions observed in real electrophysiology experiments (Bergman et al., <xref ref-type="bibr" rid="B11">1994</xref>
; Brown et al., <xref ref-type="bibr" rid="B14">2001</xref>
). Under the influence of correlated oscillations of STN and GPe, the Gangadhar et al. (<xref ref-type="bibr" rid="B35">2008</xref>
) model produces handwriting with large fluctuations in velocity in addition to diminutive letter size.</p>
<p>As another example, Contreras-Vidal and Stelmach (<xref ref-type="bibr" rid="B21">1995</xref>
) attached a BG model to the VITE-WRITE model (Bullock et al., <xref ref-type="bibr" rid="B16">1993</xref>
) to simulate PD handwriting. The Contreras-Vidal and Stelmach (<xref ref-type="bibr" rid="B21">1995</xref>
) model includes the direct, indirect, and hyperdirect pathways of the BG (see Figure <xref ref-type="fig" rid="F1">1</xref>
), the SMA, and other motor and premotor areas. The role of the SMA is to read-in the next motor subprogram from the movement plan, while the role of the other motor and premotor areas is to produce the movement selected by the SMA. The role of the BG is to modulate the dynamics of the formation of movement trajectories (produced by VITE-WRITE). Reducing dopamine in the model to simulate PD results in reduced letter size, as observed in PD patients.</p>
</sec>
<sec id="s4-2-2"><title>Synthesis</title>
<p>Two models of PD handwriting were reviewed above. The model of Contreras-Vidal and Stelmach (<xref ref-type="bibr" rid="B21">1995</xref>
) combines the VITE-WRITE model (Bullock et al., <xref ref-type="bibr" rid="B16">1993</xref>
) with a BG model. The essence of the model consists of showing that dopamine reduction in PD causes an imbalance in the outputs of the direct and indirect pathways. Although constructed out of considerably different modeling components, the model of Gangadhar et al. (<xref ref-type="bibr" rid="B35">2008</xref>
) also shows an imbalance in the activations of the direct and indirect pathways under simulated PD conditions, which causes a reduction in letter size. In addition, Gangadhar et al. (<xref ref-type="bibr" rid="B35">2008</xref>
) also account for the oscillations in STN-GPe interaction. Loss of complexity in these oscillations under PD conditions were linked to higher velocity fluctuations and distorted handwriting contour in PD handwriting. To summarize, the indirect pathway appears to be critical in accounting for handwriting.</p>
</sec>
</sec>
<sec id="s4-3"><title>Eye saccades</title>
<p>Eye saccades are rapid, darting eye movements that shift the fovea to points of interest in the visual scene. There is an extensive cortical and subcortical network that is responsible for saccade generation, and the BG play a key role among the subcortical substrates for saccade generation (Hikosaka et al., <xref ref-type="bibr" rid="B53">2000</xref>
). The influence of BG on saccades is propagated via the superior colliculus, a midbrain nucleus with a central role in saccade generation (not shown in Figure <xref ref-type="fig" rid="F1">1</xref>
). Studies on Parkinsonian monkeys prepared by MPTP (a neurotoxin used to destroy dopaminergic neurons) infusion have observed prolonged saccades, longer reaction times, smaller peak velocities, and smaller amplitudes (Kato et al., <xref ref-type="bibr" rid="B61">1995</xref>
). Smaller peak velocities and smaller amplitudes in PD saccades may be comparable to bradykinesia and hypometria found in PD reaching movements. Similarly, analogous to PD tremor in extremities, some PD patients exhibit square-wave jerks in visually guided saccades (Rascol et al., <xref ref-type="bibr" rid="B135">1991</xref>
).</p>
<sec id="s4-3-1"><title>Models</title>
<p>Computational modeling literature that specifically focuses on the role of BG in saccade generation is rather limited. Dominey and Arbib (<xref ref-type="bibr" rid="B25">1992</xref>
) proposed a model of the role of the BG in sequential saccade generation. Their model includes a number of relevant neural substrates such as the superior colliculus, thalamus, frontal eye fields, and the BG. In the Dominey and Arbib (<xref ref-type="bibr" rid="B25">1992</xref>
) model, the BG is used as an indirect link between the frontal eye field and the superior colliculus, and its main function is to prevent saccades while a target stimulus is foveated. As such, only the direct pathway through the BG is modeled. The Dominey and Arbib (<xref ref-type="bibr" rid="B25">1992</xref>
) model has been used to simulate simple saccade data, memory saccade data, double saccade data, compensatory saccade data, and lesion data.</p>
<p>Two decades later, Krishnan et al. (<xref ref-type="bibr" rid="B66">2011</xref>
) proposed a model of the role of the BG in saccade generation using the principle of reinforcement learning. Similar to their model of PD reaching movement (Magdoom et al., <xref ref-type="bibr" rid="B72">2011</xref>
), the indirect pathway serves as an explorer that drives the saccades toward more rewarding targets. The model was able to successfully simulate two forms of visual search, namely feature search and conjunction search, a sequential saccade task, and a directional saccade task. When PD-related changes were incorporated in the model by reducing BG output, the model exhibited increased search times (Krishnan et al., <xref ref-type="bibr" rid="B66">2011</xref>
).</p>
</sec>
<sec id="s4-3-2"><title>Synthesis</title>
<p>Two models of the role of BG in saccade generation were reviewed above (Dominey and Arbib, <xref ref-type="bibr" rid="B25">1992</xref>
; Krishnan et al., <xref ref-type="bibr" rid="B66">2011</xref>
). Both models can account for a range of saccade data in normal and lesioned/pathological conditions. The anatomical components incorporated by the two models are also quite similar. However, there are two main distinguishing features between the two models. One of these features is anatomical: the Dominey and Arbib (<xref ref-type="bibr" rid="B25">1992</xref>
) model does not include the indirect pathway in the BG, whereas the indirect pathway plays a key role in the Krishnan et al. (<xref ref-type="bibr" rid="B66">2011</xref>
) model. The second feature is functional: the Dominey and Arbib (<xref ref-type="bibr" rid="B25">1992</xref>
) model does not involve learning, while that of Krishnan et al. (<xref ref-type="bibr" rid="B66">2011</xref>
) model is based on reinforcement learning. These key differences make the Krishnan et al. (<xref ref-type="bibr" rid="B66">2011</xref>
) model more biologically and functionally detailed.</p>
</sec>
</sec>
</sec>
<sec id="s5"><title>General discussion</title>
<p>This article presented a review of CCN models of cognitive and motor functions. The 19 reviewed models were organized to highlight BG functionality and classified according to six cognitive functions (i.e., categorization, instrumental conditioning, probabilistic learning, working memory, sequence learning, and automaticity) and three motor functions (i.e., reaching, handwriting, and visual saccades). On the one hand, some of the reviewed models are standalone models of specific functions of BG, e.g., the reaching model of Bischoff (<xref ref-type="bibr" rid="B13">1998</xref>
). On the other hand, there are models that are specific instances of a more general learning framework applied to BG function. COVIS (Ashby et al., <xref ref-type="bibr" rid="B2">1998</xref>
, <xref ref-type="bibr" rid="B6">2007</xref>
; Ashby and Crossley, <xref ref-type="bibr" rid="B3">2011</xref>
), and the models of Chakravarthy and colleagues (Krishnan et al., <xref ref-type="bibr" rid="B66">2011</xref>
; Magdoom et al., <xref ref-type="bibr" rid="B72">2011</xref>
) belong to the second category. For example, both the models of Krishnan et al. (<xref ref-type="bibr" rid="B66">2011</xref>
) and Magdoom et al. (<xref ref-type="bibr" rid="B72">2011</xref>
) used a nearly identical reinforcement learning-based approach to account for the specific motor functions of reaching and saccade generation. A review article by Chakravarthy et al. (<xref ref-type="bibr" rid="B19">2010</xref>
) proposes that an expanded framework based on reinforcement learning, adapted to BG anatomy and physiology, can be used to explain a wide variety of BG functions. Such a proposal needs a more extensive modeling and experimental investigation for further confirmation. However, interestingly, CCN models accounting for more than one function were accounting for more than one cognitive function or more than one motor function. None of the reviewed CCN models could account for at least one motor and one cognitive function simultaneously. This may be a serious limitation as behavioral experiments are beginning to reveal important interactions between motor and cognitive processes. Below, we discuss how cognitive processes might impact motor function, and point to novel directions for computational modeling studies.</p>
<sec id="s5-1"><title>Interaction of motor and cognitive processes</title>
<p>While none of the models included simultaneously accounted cognitive and motor functions, they all had a cognitive and motor component. For example, the Ashby and Crossley (<xref ref-type="bibr" rid="B3">2011</xref>
) model made a cognitive decision, but it also included premotor areas associated with the response. It just did not include a detailed model of the motor response (e.g., how is the left button pressed). Likewise, the Gangadhar et al. (<xref ref-type="bibr" rid="B34">2007</xref>
) has to include a cognitive component specifying what character is to be drawn. However, the focus is on how the movement is produced. Perhaps the model that comes closest to integrating motor and cognitive functions is the model of Guthrie et al. (<xref ref-type="bibr" rid="B44">2013</xref>
). In this model, both a cognitive and a motor decision are taken, and the interaction between these decisions is accounted for. However, this model does not include a detailed simulation of how the movement is produced. Therefore, it was only discussed in the context of cognitive function.</p>
<p>One way to explore how cognitive and motor functions interact is to explore disease states. For example, akinesia and bradykinesia in PD are arguably associated with BG (and corticostriatal circuits) dysfunction, while tremor is perhaps associated with cerebellar, thalamic, and STN abnormalities (Kassubek et al., <xref ref-type="bibr" rid="B60">2002</xref>
; Probst-Cousin et al., <xref ref-type="bibr" rid="B107">2003</xref>
; Weinberger et al., <xref ref-type="bibr" rid="B126">2009</xref>
; Zaidel et al., <xref ref-type="bibr" rid="B134">2009</xref>
; Mure et al., <xref ref-type="bibr" rid="B88">2011</xref>
). For example, Schillaci et al. (<xref ref-type="bibr" rid="B110">2011</xref>
) found that PD patients with akinesia and rigidity as the predominant symptoms have significantly more widespread dopamine loss in the striatum than PD patients with tremor as the predominant symptom. Because these different brain areas (e.g., striatum, cerebellum) are also involved in different cognitive functions, it is reasonable to hypothesize that different PD motor symptoms may be associated with different cognitive impairments. Accordingly, Jankovic et al. (<xref ref-type="bibr" rid="B57">1990</xref>
) found that PD patients with predominant tremor are less cognitively impaired than patients with bradykinesia. Below we explore some specific PD motor symptoms and their relation to cognition.</p>
<sec id="s5-1-1"><title>Akinesia</title>
<p>Experimental studies have shown that PD patients with severe akinesia are generally more cognitively impaired than PD patients with predominant tremor (Vakil and Herishanu-Naaman, <xref ref-type="bibr" rid="B122">1998</xref>
; Poletti et al., <xref ref-type="bibr" rid="B103">2011</xref>
, <xref ref-type="bibr" rid="B104">2012</xref>
; Poletti and Bonuccelli, <xref ref-type="bibr" rid="B102">2013</xref>
). For instance, PD patients with severe akinesia and rigidity symptoms are more impaired than PD patients with severe resting tremor at working memory tasks (Moustafa et al., <xref ref-type="bibr" rid="B85">2013</xref>
). Likewise, studies have shown that PD patients with tremor are usually less cognitively impaired than PD patients with akinesia or gait dysfunction (Burn et al., <xref ref-type="bibr" rid="B17">2006</xref>
; Lyros et al., <xref ref-type="bibr" rid="B70">2008</xref>
; Oh et al., <xref ref-type="bibr" rid="B95">2009</xref>
; Domellof et al., <xref ref-type="bibr" rid="B24">2011</xref>
). For example, Vakil and Herishanu-Naaman (<xref ref-type="bibr" rid="B122">1998</xref>
) found that tremor-dominant PD patients are less impaired at procedural learning than akinesia-dominant PD patients.</p>
<p>Most motor models of the BG and corticostriatal circuit function have been able to explain the occurrence of akinesia and bradykinesia, but not tremor (Obeso et al., <xref ref-type="bibr" rid="B93">2008</xref>
). We suggest that motor performance may rely on cognitive processes in two different ways: (a) maintenance of motor plans in working memory while performing a sequence of movements, such as hand/leg movement, grasping, or reaching (Hayhoe et al., <xref ref-type="bibr" rid="B46">2002</xref>
; Ohbayashi et al., <xref ref-type="bibr" rid="B96">2003</xref>
; Piek et al., <xref ref-type="bibr" rid="B99">2004</xref>
; Issen and Knill, <xref ref-type="bibr" rid="B56">2012</xref>
); or (b) maintenance of goals in working memory while performing a motor act, such as maintaining the goal of grasping the cup in working memory while moving the hands (Batuev, <xref ref-type="bibr" rid="B10">1989</xref>
; McIntyre et al., <xref ref-type="bibr" rid="B76">1998</xref>
; Matsumoto et al., <xref ref-type="bibr" rid="B75">2003</xref>
). This relationship between cognitive and motor processes could explain why some cognitive training programs are effective at treating motor dysfunction in PD patients (Disbrow et al., <xref ref-type="bibr" rid="B23">2012</xref>
). Although this is speculative, computational models are needed to explicitly study the complex relationship between motor and cognitive processes in healthy subjects and PD patients.</p>
</sec>
<sec id="s5-1-2"><title>Freezing of gait</title>
<p>Freezing of gait—paroxysmal cessation of motor output—is a common symptom in advanced PD (Hoehn and Yahr stage 2+) (Giladi et al., <xref ref-type="bibr" rid="B40">1992</xref>
). Freezing of gait is debilitating since it often leads to falls and, importantly, is not manageable by common psychopharmacological medications (Giladi et al., <xref ref-type="bibr" rid="B40">1992</xref>
; Matar et al., <xref ref-type="bibr" rid="B73">2013</xref>
).</p>
<p>Research shows that perceptual and cognitive factors play a role in successful locomotion and the occurrence of freezing of gait episodes in PD patients (Lewis and Barker, <xref ref-type="bibr" rid="B69">2009</xref>
; Naismith et al., <xref ref-type="bibr" rid="B89">2010</xref>
; Matar et al., <xref ref-type="bibr" rid="B73">2013</xref>
). For example, providing auditory or visual cues or instructions can often reduce the occurrence of freezing behavior in PD patients (Lewis and Barker, <xref ref-type="bibr" rid="B69">2009</xref>
). Other studies found that walking dysfunction in PD is related to difficulty in resolving response interference produced by distractors (Plotnik et al., <xref ref-type="bibr" rid="B101">2011</xref>
; Vandenbossche et al., <xref ref-type="bibr" rid="B123">2011</xref>
). Locomotive dysfunction in PD is associated with brain volume changes (Kostic et al., <xref ref-type="bibr" rid="B65">2012</xref>
; Tessitore et al., <xref ref-type="bibr" rid="B120">2012</xref>
) and aberrant neural activity within the prefrontal cortex (Matsui et al., <xref ref-type="bibr" rid="B74">2005</xref>
; Shine et al., <xref ref-type="bibr" rid="B115">2013</xref>
), suggesting a role for cognitive processes in locomotion.</p>
<p>There are currently no computational models that simulate the role of cognitive processes in the occurrence of freezing of gait in PD patients. Prior computational models of BG-cortex interactions have focused on the simulation of cognitive processes (O’Reilly and Frank, <xref ref-type="bibr" rid="B97">2006</xref>
), learning, or simple action selection in static environments (Gurney et al., <xref ref-type="bibr" rid="B43">2001</xref>
) without considering how cognitive factors might affect motor actions such as locomotion. Future models should simulate how the cortex represents multiple inputs (including perceptual and cognitive) that feed into the BG, which is important for action selection (e.g., move right, left, forward, etc.). Future models should also be more dynamical in that they should continuously receive and update perceptual input from the environment and produce motor output (step right, left, …), which then takes the model to a new perceptual input, and so forth.</p>
</sec>
</sec>
<sec id="s5-2"><title>What is the role of the basal ganglia in cognitive and motor function?</title>
<p>In addition to the current unavailability of CCN models of the BG that can simultaneously account for cognitive and motor function, another limitation of the current state of BG modeling is the absence of consensus on the specific function of the BG in a given task. For example, many CCN models of working memory assign a role for the BG, but some models use the BG as a gating mechanism allowing for thalamo-cortical loops (e.g., Monchi et al., <xref ref-type="bibr" rid="B80">2000</xref>
; Ashby et al., <xref ref-type="bibr" rid="B4">2005</xref>
), while others use the BG as a gating mechanism for cortico-cortical loops (e.g., Frank et al., <xref ref-type="bibr" rid="B32">2001</xref>
) or as the actual maintenance mechanism (Schroll et al., <xref ref-type="bibr" rid="B112">2012</xref>
). As with many other cognitive and motor functions, CCN models are critical in pinpointing the specific function of the BG in the cognitive task (e.g., working memory). Computational models can be simulated to identify the consequences of different design choices, and these predictions need to be tested empirically. While models tend to do very well at simulating the function that motivated the model, it is unclear at this point how the model can handle other (different) functions. One way to select useful BG CCN models is to consider generalization capabilities. Towards this end, general integrative frameworks are most useful. For example, the reinforcement learning approach of Chakravarthy and colleagues (Krishnan et al., <xref ref-type="bibr" rid="B66">2011</xref>
; Magdoom et al., <xref ref-type="bibr" rid="B72">2011</xref>
) or the COVIS-based approach of Ashby and colleagues (Ashby et al., <xref ref-type="bibr" rid="B2">1998</xref>
; Apicella, <xref ref-type="bibr" rid="B1">2007</xref>
; Ashby and Crossley, <xref ref-type="bibr" rid="B3">2011</xref>
) are useful because they have been used to account for functions that were outside of the original scope of the model. Other models of cognitive and motor functions need to be generalized to account for data for which they were not originally designed to build biological “cognitive architectures”. Frameworks that are already general should attempt to bridge the gap between CCN models of cognitive function and CCN models of motor function. This could be achieved by integrating existing models. For example, a detailed CCN model of motor function could be added to the COVIS framework. Likewise, a detailed CCN model of cognitive function could be added to the reinforcement-learning-based approach of Chakravarthy and colleagues. While more data will help in eliminating some of the candidate CCN BG models, generalization and integration will be required to avoid overfitting the model to the available data.</p>
</sec>
</sec>
<sec><title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="B1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Apicella</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Leading tonically active neurons of the striatum from reward detection to context recognition</article-title>
. <source>Trends Neurosci.</source>
<volume>30</volume>
, <fpage>299</fpage>
–<lpage>306</lpage>
<pub-id pub-id-type="doi">10.1016/j.tins.2007.03.011</pub-id>
<pub-id pub-id-type="pmid">17420057</pub-id>
</mixed-citation>
</ref>
<ref id="B2"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
<name><surname>Alfonso-Reese</surname>
<given-names>L. A.</given-names>
</name>
<name><surname>Turken</surname>
<given-names>A. U.</given-names>
</name>
<name><surname>Waldron</surname>
<given-names>E. M.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>A neuropsychological theory of multiple systems in category learning</article-title>
. <source>Psychol. Rev.</source>
<volume>105</volume>
, <fpage>442</fpage>
–<lpage>481</lpage>
<pub-id pub-id-type="doi">10.1037//0033-295x.105.3.442</pub-id>
<pub-id pub-id-type="pmid">9697427</pub-id>
</mixed-citation>
</ref>
<ref id="B3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
<name><surname>Crossley</surname>
<given-names>M. J.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>A computational model of how cholinergic interneurons protect striatal-dependent learning</article-title>
. <source>J. Cogn. Neurosci.</source>
<volume>23</volume>
, <fpage>1549</fpage>
–<lpage>1566</lpage>
<pub-id pub-id-type="doi">10.1162/jocn.2010.21523</pub-id>
<pub-id pub-id-type="pmid">20521851</pub-id>
</mixed-citation>
</ref>
<ref id="B4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
<name><surname>Ell</surname>
<given-names>S. W.</given-names>
</name>
<name><surname>Valentin</surname>
<given-names>V. V.</given-names>
</name>
<name><surname>Casale</surname>
<given-names>M. B.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>FROST: a distributed neurocomputational model of working memory maintenance</article-title>
. <source>J. Cogn. Neurosci.</source>
<volume>17</volume>
, <fpage>1728</fpage>
–<lpage>1743</lpage>
<pub-id pub-id-type="doi">10.1162/089892905774589271</pub-id>
<pub-id pub-id-type="pmid">16269109</pub-id>
</mixed-citation>
</ref>
<ref id="B5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
<name><surname>Ell</surname>
<given-names>S. W.</given-names>
</name>
<name><surname>Waldron</surname>
<given-names>E. M.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Procedural learning in perceptual categorization</article-title>
. <source>Mem. Cognit.</source>
<volume>31</volume>
, <fpage>1114</fpage>
–<lpage>1125</lpage>
<pub-id pub-id-type="doi">10.3758/bf03196132</pub-id>
<pub-id pub-id-type="pmid">14704026</pub-id>
</mixed-citation>
</ref>
<ref id="B6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
<name><surname>Ennis</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Spiering</surname>
<given-names>B. J.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>A neurobiological theory of automaticity in perceptual categorization</article-title>
. <source>Psychol. Rev.</source>
<volume>114</volume>
, <fpage>632</fpage>
–<lpage>656</lpage>
<pub-id pub-id-type="doi">10.1037/0033-295x.114.3.632</pub-id>
<pub-id pub-id-type="pmid">17638499</pub-id>
</mixed-citation>
</ref>
<ref id="B7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
<name><surname>Gott</surname>
<given-names>R. E.</given-names>
</name>
</person-group>
(<year>1988</year>
). <article-title>Decision rules in the perception and categorization of multidimensional stimuli</article-title>
. <source>J. Exp. Psychol. Learn. Mem. Cogn.</source>
<volume>14</volume>
, <fpage>33</fpage>
–<lpage>53</lpage>
<pub-id pub-id-type="doi">10.1037/0278-7393.14.1.33</pub-id>
<pub-id pub-id-type="pmid">2963894</pub-id>
</mixed-citation>
</ref>
<ref id="B8"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
<name><surname>Helie</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>A tutorial on computational cognitive neuroscience: modeling the neurodynamics of cognition</article-title>
. <source>J. Math. Psychol.</source>
<volume>55</volume>
, <fpage>273</fpage>
–<lpage>289</lpage>
<pub-id pub-id-type="doi">10.1016/j.jmp.2011.04.003</pub-id>
<pub-id pub-id-type="pmid">21841845</pub-id>
</mixed-citation>
</ref>
<ref id="B9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Assadi</surname>
<given-names>S. M.</given-names>
</name>
<name><surname>Yucel</surname>
<given-names>M.</given-names>
</name>
<name><surname>Pantelis</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Dopamine modulates neural networks involved in effort-based decision-making</article-title>
. <source>Neurosci. Biobehav. Rev.</source>
<volume>33</volume>
, <fpage>383</fpage>
–<lpage>393</lpage>
<pub-id pub-id-type="doi">10.1016/j.neubiorev.2008.10.010</pub-id>
<pub-id pub-id-type="pmid">19046987</pub-id>
</mixed-citation>
</ref>
<ref id="B10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Batuev</surname>
<given-names>A. S.</given-names>
</name>
</person-group>
(<year>1989</year>
). <article-title>Neuronal mechanisms of goal-directed behaviour in monkeys</article-title>
. <source>Int. J. Neurosci.</source>
<volume>44</volume>
, <fpage>59</fpage>
–<lpage>66</lpage>
<pub-id pub-id-type="doi">10.3109/00207458908986183</pub-id>
<pub-id pub-id-type="pmid">2518573</pub-id>
</mixed-citation>
</ref>
<ref id="B11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bergman</surname>
<given-names>H.</given-names>
</name>
<name><surname>Whichman</surname>
<given-names>T.</given-names>
</name>
<name><surname>Karmon</surname>
<given-names>B.</given-names>
</name>
<name><surname>DeLong</surname>
<given-names>M. R.</given-names>
</name>
</person-group>
(<year>1994</year>
). <article-title>The primate subthalamic nucleus. II. neural activity in MPTP model of Parkinsonism</article-title>
. <source>J. Neurophysiol.</source>
<volume>72</volume>
, <fpage>507</fpage>
–<lpage>520</lpage>
<pub-id pub-id-type="pmid">7983515</pub-id>
</mixed-citation>
</ref>
<ref id="B12"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bernheimer</surname>
<given-names>H.</given-names>
</name>
<name><surname>Birkmayer</surname>
<given-names>W.</given-names>
</name>
<name><surname>Hornykiewicz</surname>
<given-names>O.</given-names>
</name>
<name><surname>Jellinger</surname>
<given-names>K.</given-names>
</name>
<name><surname>Seitelberger</surname>
<given-names>F.</given-names>
</name>
</person-group>
(<year>1973</year>
). <article-title>Brain dopamine and the syndromes of Parkinson and huntington clinical, morphological and neurochemical correlations</article-title>
. <source>J. Neurol. Sci.</source>
<volume>20</volume>
, <fpage>415</fpage>
–<lpage>455</lpage>
<pub-id pub-id-type="doi">10.1016/0022-510x(73)90175-5</pub-id>
<pub-id pub-id-type="pmid">4272516</pub-id>
</mixed-citation>
</ref>
<ref id="B13"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Bischoff</surname>
<given-names>A.</given-names>
</name>
</person-group>
(<year>1998</year>
). <source>Modeling the Basal Ganglia in the Control of Arm Movements</source>
. <publisher-loc>Doctoral Dissertation, University of Southern California</publisher-loc>
</mixed-citation>
</ref>
<ref id="B14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname>
<given-names>P.</given-names>
</name>
<name><surname>Olivero</surname>
<given-names>A.</given-names>
</name>
<name><surname>Mazzone</surname>
<given-names>P.</given-names>
</name>
<name><surname>Insola</surname>
<given-names>A.</given-names>
</name>
<name><surname>Tonali</surname>
<given-names>P.</given-names>
</name>
<name><surname>Lazzaro</surname>
<given-names>V. D.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Dopamine dependency of oscillations in between subthalamic neucleus and pallidum in Parkinson’s disease</article-title>
. <source>J. Neurosci.</source>
<volume>21</volume>
, <fpage>1033</fpage>
–<lpage>1038</lpage>
<pub-id pub-id-type="pmid">11157088</pub-id>
</mixed-citation>
</ref>
<ref id="B15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname>
<given-names>R. G.</given-names>
</name>
<name><surname>Jahanshahi</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1996</year>
). <article-title>Cognitive-motor function in Parkinson’s disease</article-title>
. <source>Eur. Neurol.</source>
<volume>36</volume>
, <fpage>24</fpage>
–<lpage>31</lpage>
<pub-id pub-id-type="doi">10.1159/000118880</pub-id>
<pub-id pub-id-type="pmid">8791018</pub-id>
</mixed-citation>
</ref>
<ref id="B16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bullock</surname>
<given-names>D.</given-names>
</name>
<name><surname>Grossberg</surname>
<given-names>S.</given-names>
</name>
<name><surname>Mannes</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>1993</year>
). <article-title>A neural network model for cursive script production</article-title>
. <source>Biol. Cybern.</source>
<volume>70</volume>
, <fpage>15</fpage>
–<lpage>28</lpage>
<pub-id pub-id-type="doi">10.1007/bf00202562</pub-id>
</mixed-citation>
</ref>
<ref id="B17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Burn</surname>
<given-names>D. J.</given-names>
</name>
<name><surname>Rowan</surname>
<given-names>E. N.</given-names>
</name>
<name><surname>Allan</surname>
<given-names>L. M.</given-names>
</name>
<name><surname>Molloy</surname>
<given-names>S.</given-names>
</name>
<name><surname>O’Brien</surname>
<given-names>J. T.</given-names>
</name>
<name><surname>McKeith</surname>
<given-names>I. G.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Motor subtype and cognitive decline in Parkinson’s disease, Parkinson’s disease with dementia and dementia with Lewy bodies</article-title>
. <source>J. Neurol. Neurosurg. Psychiatry</source>
<volume>77</volume>
, <fpage>585</fpage>
–<lpage>589</lpage>
<pub-id pub-id-type="doi">10.1136/jnnp.2005.081711</pub-id>
<pub-id pub-id-type="pmid">16614017</pub-id>
</mixed-citation>
</ref>
<ref id="B18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Calzavara</surname>
<given-names>R.</given-names>
</name>
<name><surname>Mailly</surname>
<given-names>P.</given-names>
</name>
<name><surname>Haber</surname>
<given-names>S. N.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Relationship between the corticostriatal terminals from areas 9 and 46 and those from area 8A, dorsal and rostral premotor cortex and area 24c: an anatomical substrate for cognition to action</article-title>
. <source>Eur. J. Neurosci.</source>
<volume>26</volume>
, <fpage>2005</fpage>
–<lpage>2024</lpage>
<pub-id pub-id-type="doi">10.1111/j.1460-9568.2007.05825.x</pub-id>
<pub-id pub-id-type="pmid">17892479</pub-id>
</mixed-citation>
</ref>
<ref id="B19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chakravarthy</surname>
<given-names>V.</given-names>
</name>
<name><surname>Joseph</surname>
<given-names>D.</given-names>
</name>
<name><surname>Bapi</surname>
<given-names>R. S.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>What do the basal ganglia do? A modeling perspective</article-title>
. <source>Biol. Cybern.</source>
<volume>103</volume>
, <fpage>237</fpage>
–<lpage>253</lpage>
<pub-id pub-id-type="doi">10.1007/s00422-010-0401-y</pub-id>
<pub-id pub-id-type="pmid">20644953</pub-id>
</mixed-citation>
</ref>
<ref id="B20"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chersi</surname>
<given-names>F.</given-names>
</name>
<name><surname>Mirolli</surname>
<given-names>M.</given-names>
</name>
<name><surname>Pezzulo</surname>
<given-names>G.</given-names>
</name>
<name><surname>Baldassarre</surname>
<given-names>G.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>A spiking model of the cortico-basal ganglia circuits for goal-directed and habitual action learning</article-title>
. <source>Neural Netw.</source>
<volume>41</volume>
, <fpage>212</fpage>
–<lpage>224</lpage>
<pub-id pub-id-type="doi">10.1016/j.neunet.2012.11.009</pub-id>
<pub-id pub-id-type="pmid">23266482</pub-id>
</mixed-citation>
</ref>
<ref id="B21"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Contreras-Vidal</surname>
<given-names>J.</given-names>
</name>
<name><surname>Stelmach</surname>
<given-names>G.</given-names>
</name>
</person-group>
(<year>1995</year>
). <article-title>A neural model of basal ganglia-thalamocortical relations in normal and Parkinsonian movement</article-title>
. <source>Biol. Cybern.</source>
<volume>73</volume>
, <fpage>467</fpage>
–<lpage>476</lpage>
<pub-id pub-id-type="doi">10.1007/bf00201481</pub-id>
<pub-id pub-id-type="pmid">7578481</pub-id>
</mixed-citation>
</ref>
<ref id="B22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Desmurget</surname>
<given-names>M.</given-names>
</name>
<name><surname>Turner</surname>
<given-names>R. S.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Motor sequences and the basal ganglia: kinematics, not habits</article-title>
. <source>J. Neurosci.</source>
<volume>30</volume>
, <fpage>7685</fpage>
–<lpage>7690</lpage>
<pub-id pub-id-type="doi">10.1523/jneurosci.0163-10.2010</pub-id>
<pub-id pub-id-type="pmid">20519543</pub-id>
</mixed-citation>
</ref>
<ref id="B23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Disbrow</surname>
<given-names>E. A.</given-names>
</name>
<name><surname>Russo</surname>
<given-names>K. A.</given-names>
</name>
<name><surname>Higginson</surname>
<given-names>C. I.</given-names>
</name>
<name><surname>Yund</surname>
<given-names>E. W.</given-names>
</name>
<name><surname>Ventura</surname>
<given-names>M. I.</given-names>
</name>
<name><surname>Zhang</surname>
<given-names>L.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2012</year>
). <article-title>Efficacy of tailored computer-based neurorehabilitation for improvement of movement initiation in Parkinson’s disease</article-title>
. <source>Brain Res.</source>
<volume>1452</volume>
, <fpage>151</fpage>
–<lpage>164</lpage>
<pub-id pub-id-type="doi">10.1016/j.brainres.2012.02.073</pub-id>
<pub-id pub-id-type="pmid">22459048</pub-id>
</mixed-citation>
</ref>
<ref id="B24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Domellof</surname>
<given-names>M. E.</given-names>
</name>
<name><surname>Elgh</surname>
<given-names>E.</given-names>
</name>
<name><surname>Forsgren</surname>
<given-names>L.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>The relation between cognition and motor dysfunction in drug-naive newly diagnosed patients with Parkinson’s disease</article-title>
. <source>Mov. Disord.</source>
<volume>26</volume>
, <fpage>2183</fpage>
–<lpage>2189</lpage>
<pub-id pub-id-type="doi">10.1002/mds.23814</pub-id>
<pub-id pub-id-type="pmid">21661051</pub-id>
</mixed-citation>
</ref>
<ref id="B25"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dominey</surname>
<given-names>P. F.</given-names>
</name>
<name><surname>Arbib</surname>
<given-names>M. A.</given-names>
</name>
</person-group>
(<year>1992</year>
). <article-title>A cortico-subcortical model for generation of spatially accurate sequential saccades</article-title>
. <source>Cereb. Cortex</source>
<volume>2</volume>
, <fpage>153</fpage>
–<lpage>175</lpage>
<pub-id pub-id-type="doi">10.1093/cercor/2.2.153</pub-id>
<pub-id pub-id-type="pmid">1633413</pub-id>
</mixed-citation>
</ref>
<ref id="B26"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dreher</surname>
<given-names>J. C.</given-names>
</name>
<name><surname>Burnod</surname>
<given-names>Y.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>An integrative theory of the phasic and tonic modes of dopamine modulation in the prefrontal cortex</article-title>
. <source>Neural Netw.</source>
<volume>15</volume>
, <fpage>583</fpage>
–<lpage>602</lpage>
<pub-id pub-id-type="doi">10.1016/s0893-6080(02)00051-5</pub-id>
<pub-id pub-id-type="pmid">12371514</pub-id>
</mixed-citation>
</ref>
<ref id="B27"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Durstewitz</surname>
<given-names>D.</given-names>
</name>
<name><surname>Seamans</surname>
<given-names>J. K.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia</article-title>
. <source>Biol. Psychiatry</source>
<volume>64</volume>
, <fpage>739</fpage>
–<lpage>749</lpage>
<pub-id pub-id-type="doi">10.1016/j.biopsych.2008.05.015</pub-id>
<pub-id pub-id-type="pmid">18620336</pub-id>
</mixed-citation>
</ref>
<ref id="B28"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ehrt</surname>
<given-names>U.</given-names>
</name>
<name><surname>Broich</surname>
<given-names>K.</given-names>
</name>
<name><surname>Larsen</surname>
<given-names>J. P.</given-names>
</name>
<name><surname>Ballard</surname>
<given-names>C.</given-names>
</name>
<name><surname>Aarsland</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Use of drugs with anticholinergic effect and impact on cognition in Parkinson’s disease: a cohort study</article-title>
. <source>J. Neurol. Neurosurg. Psychiatry</source>
<volume>81</volume>
, <fpage>160</fpage>
–<lpage>165</lpage>
<pub-id pub-id-type="doi">10.1136/jnnp.2009.186239</pub-id>
<pub-id pub-id-type="pmid">19770163</pub-id>
</mixed-citation>
</ref>
<ref id="B29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fearnley</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Lees</surname>
<given-names>A. J.</given-names>
</name>
</person-group>
(<year>1991</year>
). <article-title>Ageing and Parkinson’s disease: substantia nigra regional selectivity</article-title>
. <source>Brain</source>
<volume>114</volume>
, <fpage>2283</fpage>
–<lpage>2301</lpage>
<pub-id pub-id-type="doi">10.1093/brain/114.5.2283</pub-id>
<pub-id pub-id-type="pmid">1933245</pub-id>
</mixed-citation>
</ref>
<ref id="B30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Flaherty</surname>
<given-names>A. W.</given-names>
</name>
<name><surname>Graybiel</surname>
<given-names>A. M.</given-names>
</name>
</person-group>
(<year>1994</year>
). <article-title>Input-output organization of the sensorimotor striatum in the squirrel monkey</article-title>
. <source>J. Neurosci.</source>
<volume>14</volume>
, <fpage>599</fpage>
–<lpage>610</lpage>
<pub-id pub-id-type="pmid">7507981</pub-id>
</mixed-citation>
</ref>
<ref id="B31"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frank</surname>
<given-names>M. J.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism</article-title>
. <source>J. Cogn. Neurosci.</source>
<volume>17</volume>
, <fpage>51</fpage>
–<lpage>72</lpage>
<pub-id pub-id-type="doi">10.1162/0898929052880093</pub-id>
<pub-id pub-id-type="pmid">15701239</pub-id>
</mixed-citation>
</ref>
<ref id="B32"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frank</surname>
<given-names>M. J.</given-names>
</name>
<name><surname>Loughry</surname>
<given-names>B.</given-names>
</name>
<name><surname>O’Reilly</surname>
<given-names>R. C.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Interactions between frontal cortex and basal ganglia in working memory: a computational model</article-title>
. <source>Cogn. Affect. Behav. Neurosci.</source>
<volume>1</volume>
, <fpage>137</fpage>
–<lpage>160</lpage>
<pub-id pub-id-type="doi">10.3758/cabn.1.2.137</pub-id>
<pub-id pub-id-type="pmid">12467110</pub-id>
</mixed-citation>
</ref>
<ref id="B33"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Fuster</surname>
<given-names>J. M.</given-names>
</name>
</person-group>
(<year>2008</year>
). <source>The Prefrontal Cortex</source>
. <edition>4th Edn</edition>
<publisher-loc>Singapore</publisher-loc>
: <publisher-name>Academic Press</publisher-name>
</mixed-citation>
</ref>
<ref id="B34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gangadhar</surname>
<given-names>G.</given-names>
</name>
<name><surname>Joseph</surname>
<given-names>D.</given-names>
</name>
<name><surname>Chakravarthy</surname>
<given-names>V. S.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>An oscillatory neuromotor model of handwriting generation</article-title>
. <source>Int. J. Document Anal. Recognition</source>
<volume>10</volume>
, <fpage>69</fpage>
–<lpage>84</lpage>
<pub-id pub-id-type="doi">10.1007/s10032-007-0046-0</pub-id>
</mixed-citation>
</ref>
<ref id="B35"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gangadhar</surname>
<given-names>G.</given-names>
</name>
<name><surname>Joseph</surname>
<given-names>D.</given-names>
</name>
<name><surname>Chakravarthy</surname>
<given-names>V. S.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Understanding Parkinsonian handwriting using a computational model of basal ganglia</article-title>
. <source>Neural Comput.</source>
<volume>20</volume>
, <fpage>2491</fpage>
–<lpage>2525</lpage>
<pub-id pub-id-type="doi">10.1162/neco.2008.03-07-498</pub-id>
<pub-id pub-id-type="pmid">18386983</pub-id>
</mixed-citation>
</ref>
<ref id="B36"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gangadhar</surname>
<given-names>G.</given-names>
</name>
<name><surname>Joseph</surname>
<given-names>D.</given-names>
</name>
<name><surname>Srinivasan</surname>
<given-names>A. V.</given-names>
</name>
<name><surname>Subramanian</surname>
<given-names>D.</given-names>
</name>
<name><surname>Keshavan</surname>
<given-names>S.</given-names>
</name>
<name><surname>Chakravarthy</surname>
<given-names>V. S.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>A computational model of Parkinsonian handwriting that high lights the role of the indirect pathway in the basal ganglia</article-title>
. <source>Hum. Mov. Sci.</source>
<volume>28</volume>
, <fpage>602</fpage>
–<lpage>618</lpage>
<pub-id pub-id-type="doi">10.1016/j.humov.2009.07.008</pub-id>
<pub-id pub-id-type="pmid">19720411</pub-id>
</mixed-citation>
</ref>
<ref id="B37"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gerfen</surname>
<given-names>C. R.</given-names>
</name>
<name><surname>Engber</surname>
<given-names>T. M.</given-names>
</name>
<name><surname>Mahan</surname>
<given-names>L. C.</given-names>
</name>
<name><surname>Susel</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Chase</surname>
<given-names>T. N.</given-names>
</name>
<name><surname>Monsma</surname>
<given-names>F. J.</given-names>
</name>
<etal></etal>
</person-group>
(<year>1990</year>
). <article-title>D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons</article-title>
. <source>Science</source>
<volume>250</volume>
, <fpage>1429</fpage>
–<lpage>1432</lpage>
<pub-id pub-id-type="doi">10.1126/science.2147780</pub-id>
<pub-id pub-id-type="pmid">2147780</pub-id>
</mixed-citation>
</ref>
<ref id="B38"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gerfen</surname>
<given-names>C. R.</given-names>
</name>
<name><surname>Young</surname>
<given-names>W. S.</given-names>
</name>
</person-group>
(<year>1988</year>
). <article-title>Distribution of striatonigral and striatopallidal peptidergic neurons in both patch and matrix compartments: an in situ hybridization histochemistry and fluorescent retrograde tracing study</article-title>
. <source>Brain Res.</source>
<volume>460</volume>
, <fpage>161</fpage>
–<lpage>167</lpage>
<pub-id pub-id-type="doi">10.1016/0006-8993(88)91217-6</pub-id>
<pub-id pub-id-type="pmid">2464402</pub-id>
</mixed-citation>
</ref>
<ref id="B39"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gibb</surname>
<given-names>W. R.</given-names>
</name>
<name><surname>Lees</surname>
<given-names>A. J.</given-names>
</name>
</person-group>
(<year>1991</year>
). <article-title>Anatomy, pigmentation, ventral and dorsal subpopulations of the substantia nigra and differential cell death in Parkinson’s disease</article-title>
. <source>J. Neurol. Neurosurg. Psychiatry</source>
<volume>54</volume>
, <fpage>388</fpage>
–<lpage>396</lpage>
<pub-id pub-id-type="doi">10.1136/jnnp.54.5.388</pub-id>
<pub-id pub-id-type="pmid">1865199</pub-id>
</mixed-citation>
</ref>
<ref id="B40"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Giladi</surname>
<given-names>N.</given-names>
</name>
<name><surname>McMahon</surname>
<given-names>D.</given-names>
</name>
<name><surname>Przedborski</surname>
<given-names>S.</given-names>
</name>
<name><surname>Flaster</surname>
<given-names>E.</given-names>
</name>
<name><surname>Guillory</surname>
<given-names>S.</given-names>
</name>
<name><surname>Kostic</surname>
<given-names>V.</given-names>
</name>
<etal></etal>
</person-group>
(<year>1992</year>
). <article-title>Motor blocks in Parkinson’s disease</article-title>
. <source>Neurology</source>
<volume>42</volume>
, <fpage>333</fpage>
–<lpage>339</lpage>
<pub-id pub-id-type="doi">10.1212/WNL.42.2.333</pub-id>
<pub-id pub-id-type="pmid">1736161</pub-id>
</mixed-citation>
</ref>
<ref id="B41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gluck</surname>
<given-names>M. A.</given-names>
</name>
<name><surname>Shohamy</surname>
<given-names>D.</given-names>
</name>
<name><surname>Myers</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>How do people solve the “Weather Prediction” Task?: individual variability in strategies for probabilistic category learning</article-title>
. <source>Learn. Mem.</source>
<volume>9</volume>
, <fpage>408</fpage>
–<lpage>418</lpage>
<pub-id pub-id-type="doi">10.1101/lm.45202</pub-id>
<pub-id pub-id-type="pmid">12464701</pub-id>
</mixed-citation>
</ref>
<ref id="B42"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gotham</surname>
<given-names>A. M.</given-names>
</name>
<name><surname>Brown</surname>
<given-names>R. G.</given-names>
</name>
<name><surname>Marsden</surname>
<given-names>C. D.</given-names>
</name>
</person-group>
(<year>1988</year>
). <article-title>“Frontal” cognitive function in patients with Parkinson’s disease “on”and “off” levodopa</article-title>
. <source>Brain</source>
<volume>111</volume>
, <fpage>299</fpage>
–<lpage>321</lpage>
<pub-id pub-id-type="doi">10.1093/brain/111.2.299</pub-id>
<pub-id pub-id-type="pmid">3378138</pub-id>
</mixed-citation>
</ref>
<ref id="B43"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gurney</surname>
<given-names>K.</given-names>
</name>
<name><surname>Prescott</surname>
<given-names>T. J.</given-names>
</name>
<name><surname>Redgrave</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour</article-title>
. <source>Biol. Cybern.</source>
<volume>84</volume>
, <fpage>411</fpage>
–<lpage>423</lpage>
<pub-id pub-id-type="doi">10.1007/pl00007985</pub-id>
<pub-id pub-id-type="pmid">11417053</pub-id>
</mixed-citation>
</ref>
<ref id="B44"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Guthrie</surname>
<given-names>M.</given-names>
</name>
<name><surname>Leblois</surname>
<given-names>A.</given-names>
</name>
<name><surname>Garenne</surname>
<given-names>A.</given-names>
</name>
<name><surname>Boraud</surname>
<given-names>T.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study</article-title>
. <source>J. Neurophysiol.</source>
<volume>109</volume>
, <fpage>3025</fpage>
–<lpage>3040</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00026.2013</pub-id>
<pub-id pub-id-type="pmid">23536713</pub-id>
</mixed-citation>
</ref>
<ref id="B45"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Haber</surname>
<given-names>S. N.</given-names>
</name>
<name><surname>Kim</surname>
<given-names>K. S.</given-names>
</name>
<name><surname>Mailly</surname>
<given-names>P.</given-names>
</name>
<name><surname>Calzavara</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning</article-title>
. <source>J. Neurosci.</source>
<volume>26</volume>
, <fpage>8368</fpage>
–<lpage>8376</lpage>
<pub-id pub-id-type="doi">10.1523/jneurosci.0271-06.2006</pub-id>
<pub-id pub-id-type="pmid">16899732</pub-id>
</mixed-citation>
</ref>
<ref id="B46"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hayhoe</surname>
<given-names>M.</given-names>
</name>
<name><surname>Aivar</surname>
<given-names>P.</given-names>
</name>
<name><surname>Shrivastavah</surname>
<given-names>A.</given-names>
</name>
<name><surname>Mruczek</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Visual short-term memory and motor planning</article-title>
. <source>Prog. Brain Res.</source>
<volume>140</volume>
, <fpage>349</fpage>
–<lpage>363</lpage>
<pub-id pub-id-type="doi">10.1016/s0079-6123(02)40062-3</pub-id>
<pub-id pub-id-type="pmid">12508602</pub-id>
</mixed-citation>
</ref>
<ref id="B47"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Helie</surname>
<given-names>S.</given-names>
</name>
<name><surname>Ashby</surname>
<given-names>G. F.</given-names>
</name>
</person-group>
(<year>2009</year>
). “<article-title>A neurocomputational model of automaticity and maintenance of abstract rules</article-title>
,” in <source>Proceedings of the International Joint Conference on Neural Networks (IEEE Press)</source>
, <fpage>1192</fpage>
–<lpage>1198</lpage>
</mixed-citation>
</ref>
<ref id="B48"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Helie</surname>
<given-names>S.</given-names>
</name>
<name><surname>Cousineau</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>The cognitive neuroscience of automaticity: behavioral and brain signatures</article-title>
. <source>Cogn. Sci.</source>
<volume>6</volume>
, <fpage>25</fpage>
–<lpage>43</lpage>
</mixed-citation>
</ref>
<ref id="B49"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Helie</surname>
<given-names>S.</given-names>
</name>
<name><surname>Paul</surname>
<given-names>E. J.</given-names>
</name>
<name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
</person-group>
(<year>2012a</year>
). <article-title>A neurocomputational account of cognitive deficits in Parkinson’s disease</article-title>
. <source>Neuropsychologia</source>
<volume>50</volume>
, <fpage>2290</fpage>
–<lpage>2302</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2012.05.033</pub-id>
<pub-id pub-id-type="pmid">22683450</pub-id>
</mixed-citation>
</ref>
<ref id="B50"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Helie</surname>
<given-names>S.</given-names>
</name>
<name><surname>Paul</surname>
<given-names>E. J.</given-names>
</name>
<name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
</person-group>
(<year>2012b</year>
). <article-title>Simulating the effect of dopamine imbalance on cognition: from positive affect to Parkinson’s disease</article-title>
. <source>Neural. Netw.</source>
<volume>32</volume>
, <fpage>74</fpage>
–<lpage>85</lpage>
<pub-id pub-id-type="doi">10.1016/j.neunet.2012.02.033</pub-id>
<pub-id pub-id-type="pmid">22402326</pub-id>
</mixed-citation>
</ref>
<ref id="B51"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Helie</surname>
<given-names>S.</given-names>
</name>
<name><surname>Waldschmidt</surname>
<given-names>J. G.</given-names>
</name>
<name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Automaticity in rule-based and information-integration categorization</article-title>
. <source>Atten. Percept. Psychophys.</source>
<volume>72</volume>
, <fpage>1013</fpage>
–<lpage>1031</lpage>
<pub-id pub-id-type="doi">10.3758/app.72.4.1013</pub-id>
<pub-id pub-id-type="pmid">20436197</pub-id>
</mixed-citation>
</ref>
<ref id="B52"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Herzallah</surname>
<given-names>M. M.</given-names>
</name>
<name><surname>Moustafa</surname>
<given-names>A. A.</given-names>
</name>
<name><surname>Misk</surname>
<given-names>A. J.</given-names>
</name>
<name><surname>Al-Dweib</surname>
<given-names>L. H.</given-names>
</name>
<name><surname>Abdelrazeq</surname>
<given-names>S. A.</given-names>
</name>
<name><surname>Myers</surname>
<given-names>C. E.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2010</year>
). <article-title>Depression impairs learning whereas anticholinergics impair transfer generalization in Parkinson patients tested on dopaminergic medications</article-title>
. <source>Cogn. Behav. Neurol.</source>
<volume>23</volume>
, <fpage>98</fpage>
–<lpage>105</lpage>
<pub-id pub-id-type="doi">10.1097/wnn.0b013e3181df3048</pub-id>
<pub-id pub-id-type="pmid">20535058</pub-id>
</mixed-citation>
</ref>
<ref id="B53"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hikosaka</surname>
<given-names>O.</given-names>
</name>
<name><surname>Takikawa</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Kawagoe</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>Role of the basal ganglia in the control of purposive saccadic eye movements</article-title>
. <source>Physiol. Rev.</source>
<volume>80</volume>
, <fpage>953</fpage>
–<lpage>978</lpage>
<pub-id pub-id-type="pmid">10893428</pub-id>
</mixed-citation>
</ref>
<ref id="B54"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Histed</surname>
<given-names>M. H.</given-names>
</name>
<name><surname>Pasupathy</surname>
<given-names>A.</given-names>
</name>
<name><surname>Miller</surname>
<given-names>E. K.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions</article-title>
. <source>Neuron</source>
<volume>63</volume>
, <fpage>244</fpage>
–<lpage>253</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2009.06.019</pub-id>
<pub-id pub-id-type="pmid">19640482</pub-id>
</mixed-citation>
</ref>
<ref id="B55"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hollerbach</surname>
<given-names>J. M.</given-names>
</name>
</person-group>
(<year>1981</year>
). <article-title>An oscillation theory of handwriting</article-title>
. <source>Biol. Cybern.</source>
<volume>39</volume>
, <fpage>139</fpage>
–<lpage>156</lpage>
<pub-id pub-id-type="doi">10.1007/bf00336740</pub-id>
</mixed-citation>
</ref>
<ref id="B56"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Issen</surname>
<given-names>L. A.</given-names>
</name>
<name><surname>Knill</surname>
<given-names>D. C.</given-names>
</name>
</person-group>
(<year>2012</year>
). <article-title>Decoupling eye and hand movement control: visual short-term memory influences reach planning more than saccade planning</article-title>
. <source>J. Vis.</source>
<volume>12</volume>
, <fpage>1</fpage>
–<lpage>13</lpage>
<pub-id pub-id-type="doi">10.1167/12.1.3</pub-id>
<pub-id pub-id-type="pmid">22219310</pub-id>
</mixed-citation>
</ref>
<ref id="B57"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jankovic</surname>
<given-names>J.</given-names>
</name>
<name><surname>McDermott</surname>
<given-names>M.</given-names>
</name>
<name><surname>Carter</surname>
<given-names>J.</given-names>
</name>
<name><surname>Gauthier</surname>
<given-names>S.</given-names>
</name>
<name><surname>Goetz</surname>
<given-names>C.</given-names>
</name>
<name><surname>Golbe</surname>
<given-names>L.</given-names>
</name>
<etal></etal>
</person-group>
(<year>1990</year>
). <article-title>Variable expression of Parkinson’s disease: a base-line analysis of the DATATOP cohort</article-title>
. <source>Neurology</source>
<volume>40</volume>
, <fpage>1529</fpage>
–<lpage>1534</lpage>
<pub-id pub-id-type="doi">10.1212/wnl.40.10.1529</pub-id>
<pub-id pub-id-type="pmid">2215943</pub-id>
</mixed-citation>
</ref>
<ref id="B58"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kaasinen</surname>
<given-names>V.</given-names>
</name>
<name><surname>Nurmi</surname>
<given-names>E.</given-names>
</name>
<name><surname>Bergman</surname>
<given-names>J.</given-names>
</name>
<name><surname>Eskola</surname>
<given-names>O.</given-names>
</name>
<name><surname>Solin</surname>
<given-names>O.</given-names>
</name>
<name><surname>Sonninen</surname>
<given-names>P.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2001</year>
). <article-title>Personality traits and brain dopaminergic function in Parkinson’s disease</article-title>
. <source>Proc. Natl. Acad. Sci. U S A</source>
<volume>98</volume>
, <fpage>13272</fpage>
–<lpage>13277</lpage>
<pub-id pub-id-type="doi">10.1073/pnas.231313198</pub-id>
<pub-id pub-id-type="pmid">11687621</pub-id>
</mixed-citation>
</ref>
<ref id="B59"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Kalveram</surname>
<given-names>K. T.</given-names>
</name>
</person-group>
(<year>1998</year>
). “<article-title>A neural oscillator model learning given trajectories, or how an allo-imitation algorithm can be implemented into a motor controller</article-title>
,” in <source>Motor Behavior and Human Skill: A Multi-Disciplinary Approach</source>
, ed <person-group person-group-type="editor"><name><surname>Piek</surname>
<given-names>J.</given-names>
</name>
</person-group>
(<publisher-loc>Champaign, IL, USA</publisher-loc>
: <publisher-name>Human Kinetics Publishers</publisher-name>
), <fpage>127</fpage>
–<lpage>140</lpage>
</mixed-citation>
</ref>
<ref id="B60"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kassubek</surname>
<given-names>J.</given-names>
</name>
<name><surname>Juengling</surname>
<given-names>F. D.</given-names>
</name>
<name><surname>Hellwig</surname>
<given-names>B.</given-names>
</name>
<name><surname>Spreer</surname>
<given-names>J.</given-names>
</name>
<name><surname>Lucking</surname>
<given-names>C. H.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Thalamic gray matter changes in unilateral Parkinsonian resting tremor: a voxel-based morphometric analysis of 3-dimensional magnetic resonance imaging</article-title>
. <source>Neurosci. Lett.</source>
<volume>323</volume>
, <fpage>29</fpage>
–<lpage>32</lpage>
<pub-id pub-id-type="doi">10.1016/s0304-3940(02)00111-8</pub-id>
<pub-id pub-id-type="pmid">11911983</pub-id>
</mixed-citation>
</ref>
<ref id="B61"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kato</surname>
<given-names>M.</given-names>
</name>
<name><surname>Miyashita</surname>
<given-names>N.</given-names>
</name>
<name><surname>Hikosaka</surname>
<given-names>O.</given-names>
</name>
<name><surname>Matsumura</surname>
<given-names>M.</given-names>
</name>
<name><surname>Usui</surname>
<given-names>S.</given-names>
</name>
<name><surname>Kori</surname>
<given-names>A.</given-names>
</name>
</person-group>
(<year>1995</year>
). <article-title>Eye movements in monkeys with local dopamine depletion in caudate nucleus.I. Deficits in spontaneous saccades</article-title>
. <source>J. Neurosci.</source>
<volume>15</volume>
, <fpage>912</fpage>
–<lpage>927</lpage>
<pub-id pub-id-type="pmid">7823189</pub-id>
</mixed-citation>
</ref>
<ref id="B62"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kemp</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Powell</surname>
<given-names>T. P. S.</given-names>
</name>
</person-group>
(<year>1970</year>
). <article-title>The cortico-striate projections in the monkey</article-title>
. <source>Brain</source>
<volume>93</volume>
, <fpage>525</fpage>
–<lpage>546</lpage>
<pub-id pub-id-type="doi">10.1093/brain/93.3.525</pub-id>
<pub-id pub-id-type="pmid">4990231</pub-id>
</mixed-citation>
</ref>
<ref id="B63"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kincaid</surname>
<given-names>A. E.</given-names>
</name>
<name><surname>Zheng</surname>
<given-names>T.</given-names>
</name>
<name><surname>Wilson</surname>
<given-names>C. J.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Connectivity and convergence of single corticostriatal axons</article-title>
. <source>J. Neurosci.</source>
<volume>18</volume>
, <fpage>4722</fpage>
–<lpage>4731</lpage>
<pub-id pub-id-type="pmid">9614246</pub-id>
</mixed-citation>
</ref>
<ref id="B64"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Knowlton</surname>
<given-names>B. J.</given-names>
</name>
<name><surname>Mangels</surname>
<given-names>J. A.</given-names>
</name>
<name><surname>Squire</surname>
<given-names>L. R.</given-names>
</name>
</person-group>
(<year>1996</year>
). <article-title>A neostriatal habit learning system in humans</article-title>
. <source>Science</source>
<volume>273</volume>
, <fpage>1399</fpage>
–<lpage>1402</lpage>
<pub-id pub-id-type="doi">10.1126/science.273.5280.1399</pub-id>
<pub-id pub-id-type="pmid">8703077</pub-id>
</mixed-citation>
</ref>
<ref id="B65"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kostic</surname>
<given-names>V. S.</given-names>
</name>
<name><surname>Agosta</surname>
<given-names>F.</given-names>
</name>
<name><surname>Pievani</surname>
<given-names>M.</given-names>
</name>
<name><surname>Stefanova</surname>
<given-names>E.</given-names>
</name>
<name><surname>Jecmenica-Lukic</surname>
<given-names>M.</given-names>
</name>
<name><surname>Scarale</surname>
<given-names>A.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2012</year>
). <article-title>Pattern of brain tissue loss associated with freezing of gait in Parkinson disease</article-title>
. <source>Neurology</source>
<volume>78</volume>
, <fpage>409</fpage>
–<lpage>416</lpage>
<pub-id pub-id-type="doi">10.1212/wnl.0b013e318245d23c</pub-id>
<pub-id pub-id-type="pmid">22282641</pub-id>
</mixed-citation>
</ref>
<ref id="B66"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Krishnan</surname>
<given-names>R.</given-names>
</name>
<name><surname>Ratnadurai</surname>
<given-names>S.</given-names>
</name>
<name><surname>Subramanian</surname>
<given-names>D.</given-names>
</name>
<name><surname>Chakravarthy</surname>
<given-names>V. S.</given-names>
</name>
<name><surname>Rengaswamy</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Modeling the role of basal ganglia in saccade generation: is the indirect pathway the explorer?</article-title>
<source>Neural Netw.</source>
<volume>24</volume>
, <fpage>801</fpage>
–<lpage>813</lpage>
<pub-id pub-id-type="doi">10.1016/j.neunet.2011.06.002</pub-id>
<pub-id pub-id-type="pmid">21726978</pub-id>
</mixed-citation>
</ref>
<ref id="B67"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lawrence</surname>
<given-names>A. D.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>Error correction and the basal ganglia: similar computations for action, cognition and emotion?</article-title>
<source>Trends Cogn. Sci.</source>
<volume>4</volume>
, <fpage>365</fpage>
–<lpage>367</lpage>
<pub-id pub-id-type="doi">10.1016/s1364-6613(00)01535-7</pub-id>
<pub-id pub-id-type="pmid">11025274</pub-id>
</mixed-citation>
</ref>
<ref id="B68"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Leblois</surname>
<given-names>A.</given-names>
</name>
<name><surname>Boraud</surname>
<given-names>T.</given-names>
</name>
<name><surname>Meissner</surname>
<given-names>W.</given-names>
</name>
<name><surname>Bergman</surname>
<given-names>H.</given-names>
</name>
<name><surname>Hansel</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Competition between feedback loops underlies normal and pathological dynamics in the basal ganglia</article-title>
. <source>J. Neurosci.</source>
<volume>26</volume>
, <fpage>3567</fpage>
–<lpage>3583</lpage>
<pub-id pub-id-type="doi">10.1523/jneurosci.5050-05.2006</pub-id>
<pub-id pub-id-type="pmid">16571765</pub-id>
</mixed-citation>
</ref>
<ref id="B69"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lewis</surname>
<given-names>S. J.</given-names>
</name>
<name><surname>Barker</surname>
<given-names>R. A.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>A pathophysiological model of freezing of gait in Parkinson’s disease</article-title>
. <source>Parkinsonism Relat. Disord.</source>
<volume>15</volume>
, <fpage>333</fpage>
–<lpage>338</lpage>
<pub-id pub-id-type="doi">10.1016/j.parkreldis.2008.08.006</pub-id>
<pub-id pub-id-type="pmid">18930430</pub-id>
</mixed-citation>
</ref>
<ref id="B70"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lyros</surname>
<given-names>E.</given-names>
</name>
<name><surname>Messinis</surname>
<given-names>L.</given-names>
</name>
<name><surname>Papathanasopoulos</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Does motor subtype influence neurocognitive performance in Parkinson’s disease without dementia?</article-title>
<source>Eur. J. Neurol.</source>
<volume>15</volume>
, <fpage>262</fpage>
–<lpage>267</lpage>
<pub-id pub-id-type="doi">10.1111/j.1468-1331.2007.02046.x</pub-id>
<pub-id pub-id-type="pmid">18190508</pub-id>
</mixed-citation>
</ref>
<ref id="B71"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Maddox</surname>
<given-names>W. T.</given-names>
</name>
<name><surname>Ashby</surname>
<given-names>F. G.</given-names>
</name>
</person-group>
(<year>2004</year>
). <article-title>Dissociating explicit and procedural-learning based systems of perceptual category learning</article-title>
. <source>Behav. Processes</source>
<volume>66</volume>
, <fpage>309</fpage>
–<lpage>332</lpage>
<pub-id pub-id-type="doi">10.1016/j.beproc.2004.03.011</pub-id>
<pub-id pub-id-type="pmid">15157979</pub-id>
</mixed-citation>
</ref>
<ref id="B72"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Magdoom</surname>
<given-names>M.</given-names>
</name>
<name><surname>Subramanian</surname>
<given-names>D.</given-names>
</name>
<name><surname>Chakravarthy</surname>
<given-names>V. S.</given-names>
</name>
<name><surname>Ravindran</surname>
<given-names>B.</given-names>
</name>
<name><surname>Amari</surname>
<given-names>S.</given-names>
</name>
<name><surname>Meenakshisundaram</surname>
<given-names>N.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Modeling basal ganglia for understanding Parkinsonian reaching movements</article-title>
. <source>Neural Comput.</source>
<volume>23</volume>
, <fpage>477</fpage>
–<lpage>516</lpage>
<pub-id pub-id-type="doi">10.1162/neco_a_00073</pub-id>
<pub-id pub-id-type="pmid">21105828</pub-id>
</mixed-citation>
</ref>
<ref id="B73"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Matar</surname>
<given-names>E.</given-names>
</name>
<name><surname>Shine</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Naismith</surname>
<given-names>S. L.</given-names>
</name>
<name><surname>Lewis</surname>
<given-names>S. J.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Using virtual reality to explore the role of conflict resolution and environmental salience in freezing of gait in Parkinson’s disease</article-title>
. <source>Parkinsonism Relat. Disord.</source>
<volume>19</volume>
, <fpage>937</fpage>
–<lpage>942</lpage>
<pub-id pub-id-type="doi">10.1016/j.parkreldis.2013.06.002</pub-id>
<pub-id pub-id-type="pmid">23831480</pub-id>
</mixed-citation>
</ref>
<ref id="B74"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Matsui</surname>
<given-names>H.</given-names>
</name>
<name><surname>Udaka</surname>
<given-names>F.</given-names>
</name>
<name><surname>Miyoshi</surname>
<given-names>T.</given-names>
</name>
<name><surname>Hara</surname>
<given-names>N.</given-names>
</name>
<name><surname>Tamaura</surname>
<given-names>A.</given-names>
</name>
<name><surname>Oda</surname>
<given-names>M.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2005</year>
). <article-title>Three-dimensional stereotactic surface projection study of freezing of gait and brain perfusion image in Parkinson’s disease</article-title>
. <source>Mov. Disord.</source>
<volume>20</volume>
, <fpage>1272</fpage>
–<lpage>1277</lpage>
<pub-id pub-id-type="doi">10.1002/mds.20520</pub-id>
<pub-id pub-id-type="pmid">16007622</pub-id>
</mixed-citation>
</ref>
<ref id="B75"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Matsumoto</surname>
<given-names>K.</given-names>
</name>
<name><surname>Suzuki</surname>
<given-names>W.</given-names>
</name>
<name><surname>Tanaka</surname>
<given-names>K.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Neuronal correlates of goal-based motor selection in the prefrontal cortex</article-title>
. <source>Science</source>
<volume>301</volume>
, <fpage>229</fpage>
–<lpage>232</lpage>
<pub-id pub-id-type="doi">10.1126/science.1084204</pub-id>
<pub-id pub-id-type="pmid">12855813</pub-id>
</mixed-citation>
</ref>
<ref id="B76"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McIntyre</surname>
<given-names>J.</given-names>
</name>
<name><surname>Stratta</surname>
<given-names>F.</given-names>
</name>
<name><surname>Lacquaniti</surname>
<given-names>F.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Short-term memory for reaching to visual targets: psychophysical evidence for body-centered reference frames</article-title>
. <source>J. Neurosci.</source>
<volume>18</volume>
, <fpage>8423</fpage>
–<lpage>8435</lpage>
<pub-id pub-id-type="pmid">9763485</pub-id>
</mixed-citation>
</ref>
<ref id="B77"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meco</surname>
<given-names>G.</given-names>
</name>
<name><surname>Casacchia</surname>
<given-names>M.</given-names>
</name>
<name><surname>Lazzari</surname>
<given-names>R.</given-names>
</name>
<name><surname>Franzese</surname>
<given-names>A.</given-names>
</name>
<name><surname>Castellana</surname>
<given-names>F.</given-names>
</name>
<name><surname>Carta</surname>
<given-names>A.</given-names>
</name>
<etal></etal>
</person-group>
(<year>1984</year>
). <article-title>Mental impairment in Parkinson’s disease. The role of anticholinergic drugs</article-title>
. <source>Acta Psychiatr. Belg.</source>
<volume>84</volume>
, <fpage>325</fpage>
–<lpage>335</lpage>
<pub-id pub-id-type="pmid">6507124</pub-id>
</mixed-citation>
</ref>
<ref id="B78"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Miyachi</surname>
<given-names>S.</given-names>
</name>
<name><surname>Hikosaka</surname>
<given-names>O.</given-names>
</name>
<name><surname>Lu</surname>
<given-names>X.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Differential activation of monkey striatal neurons in the early and late stages of procedural learning</article-title>
. <source>Exp. Brain Res.</source>
<volume>146</volume>
, <fpage>122</fpage>
–<lpage>126</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-002-1213-7</pub-id>
<pub-id pub-id-type="pmid">12192586</pub-id>
</mixed-citation>
</ref>
<ref id="B79"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Miyachi</surname>
<given-names>S.</given-names>
</name>
<name><surname>Hikosaka</surname>
<given-names>O.</given-names>
</name>
<name><surname>Miyashita</surname>
<given-names>K.</given-names>
</name>
<name><surname>Kárádi</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Rand</surname>
<given-names>M. K.</given-names>
</name>
</person-group>
(<year>1997</year>
). <article-title>Differential roles of monkey striatum in learning of sequential hand movement</article-title>
. <source>Exp. Brain Res.</source>
<volume>115</volume>
, <fpage>1</fpage>
–<lpage>5</lpage>
<pub-id pub-id-type="doi">10.1007/pl00005669</pub-id>
<pub-id pub-id-type="pmid">9224828</pub-id>
</mixed-citation>
</ref>
<ref id="B80"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Monchi</surname>
<given-names>O.</given-names>
</name>
<name><surname>Taylor</surname>
<given-names>J. G.</given-names>
</name>
<name><surname>Dagher</surname>
<given-names>A.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>A neural model of working memory processes in normal subjects, Parkinson’s disease and schizophrenia for fMRI design and predictions</article-title>
. <source>Neural Netw.</source>
<volume>13</volume>
, <fpage>953</fpage>
–<lpage>973</lpage>
<pub-id pub-id-type="doi">10.1016/s0893-6080(00)00058-7</pub-id>
<pub-id pub-id-type="pmid">11156204</pub-id>
</mixed-citation>
</ref>
<ref id="B81"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moustafa</surname>
<given-names>A. A.</given-names>
</name>
<name><surname>Bell</surname>
<given-names>P.</given-names>
</name>
<name><surname>Eissa</surname>
<given-names>A. M.</given-names>
</name>
<name><surname>Hewedi</surname>
<given-names>D. H.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>The effects of clinical motor variables and medication dosage on working memory in Parkinson’s disease</article-title>
. <source>Brain Cogn.</source>
<volume>82</volume>
, <fpage>137</fpage>
–<lpage>145</lpage>
<pub-id pub-id-type="doi">10.1016/j.bandc.2013.04.001</pub-id>
<pub-id pub-id-type="pmid">23660434</pub-id>
</mixed-citation>
</ref>
<ref id="B82"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moustafa</surname>
<given-names>A. A.</given-names>
</name>
<name><surname>Cohen</surname>
<given-names>M. X.</given-names>
</name>
<name><surname>Sherman</surname>
<given-names>S. J.</given-names>
</name>
<name><surname>Frank</surname>
<given-names>M. J.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>A role for dopamine in temporal decision making and reward maximization in Parkinsonism</article-title>
. <source>J. Neurosci.</source>
<volume>28</volume>
, <fpage>12294</fpage>
–<lpage>12304</lpage>
<pub-id pub-id-type="doi">10.1523/jneurosci.3116-08.2008</pub-id>
<pub-id pub-id-type="pmid">19020023</pub-id>
</mixed-citation>
</ref>
<ref id="B83"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moustafa</surname>
<given-names>A. A.</given-names>
</name>
<name><surname>Gluck</surname>
<given-names>M. A.</given-names>
</name>
</person-group>
(<year>2011a</year>
). <article-title>A neurocomputational model of dopamine and prefrontal-striatal interactions during multi-cue category learning by Parkinson’s patients</article-title>
. <source>J. Cogn. Neurosci.</source>
<volume>23</volume>
, <fpage>151</fpage>
–<lpage>167</lpage>
<pub-id pub-id-type="doi">10.1162/jocn.2010.21420</pub-id>
<pub-id pub-id-type="pmid">20044893</pub-id>
</mixed-citation>
</ref>
<ref id="B84"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moustafa</surname>
<given-names>A. A.</given-names>
</name>
<name><surname>Gluck</surname>
<given-names>M. A.</given-names>
</name>
</person-group>
(<year>2011b</year>
). <article-title>Computational cognitive models of prefrontal-striatal-hippocampal interactions in Parkinson’s disease and schizophrenia</article-title>
. <source>Neural Netw.</source>
<volume>24</volume>
, <fpage>575</fpage>
–<lpage>591</lpage>
<pub-id pub-id-type="doi">10.1016/j.neunet.2011.02.006</pub-id>
<pub-id pub-id-type="pmid">21411277</pub-id>
</mixed-citation>
</ref>
<ref id="B85"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moustafa</surname>
</name>
<name><surname>Herzallah</surname>
<given-names>M. M.</given-names>
</name>
<name><surname>Gluck</surname>
<given-names>M. A.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Dissociating the cognitive effects of levodopa versus dopamine agonists in a neurocomputational model of learning in Parkinson’s disease</article-title>
. <source>Neurodegener. Dis.</source>
<volume>11</volume>
, <fpage>102</fpage>
–<lpage>111</lpage>
<pub-id pub-id-type="doi">10.1159/000341999</pub-id>
<pub-id pub-id-type="pmid">23128796</pub-id>
</mixed-citation>
</ref>
<ref id="B86"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moustafa</surname>
<given-names>A. A.</given-names>
</name>
<name><surname>Maida</surname>
<given-names>A. S.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Using TD learning to simulate working memory performance in a model of the prefrontal cortex and basal ganglia</article-title>
. <source>Cogn. Syst. Res.</source>
<volume>8</volume>
, <fpage>262</fpage>
–<lpage>281</lpage>
<pub-id pub-id-type="doi">10.1016/j.cogsys.2007.02.001</pub-id>
</mixed-citation>
</ref>
<ref id="B87"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mulder</surname>
<given-names>A. B.</given-names>
</name>
<name><surname>Nordquist</surname>
<given-names>R. E.</given-names>
</name>
<name><surname>Orgut</surname>
<given-names>O.</given-names>
</name>
<name><surname>Pennartz</surname>
<given-names>C. M.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning</article-title>
. <source>Behav. Brain Res.</source>
<volume>146</volume>
, <fpage>77</fpage>
–<lpage>88</lpage>
<pub-id pub-id-type="doi">10.1016/j.bbr.2003.09.016</pub-id>
<pub-id pub-id-type="pmid">14643461</pub-id>
</mixed-citation>
</ref>
<ref id="B88"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mure</surname>
<given-names>H.</given-names>
</name>
<name><surname>Hirano</surname>
<given-names>S.</given-names>
</name>
<name><surname>Tang</surname>
<given-names>C. C.</given-names>
</name>
<name><surname>Isaias</surname>
<given-names>I. U.</given-names>
</name>
<name><surname>Antonini</surname>
<given-names>A.</given-names>
</name>
<name><surname>Ma</surname>
<given-names>Y.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2011</year>
). <article-title>Parkinson’s disease tremor-related metabolic network: characterization, progression and treatment effects</article-title>
. <source>Neuroimage</source>
<volume>54</volume>
, <fpage>1244</fpage>
–<lpage>1253</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuroimage.2010.09.028</pub-id>
<pub-id pub-id-type="pmid">20851193</pub-id>
</mixed-citation>
</ref>
<ref id="B89"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Naismith</surname>
<given-names>S. L.</given-names>
</name>
<name><surname>Shine</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Lewis</surname>
<given-names>S. J.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>The specific contributions of set-shifting to freezing of gait in Parkinson’s disease</article-title>
. <source>Mov. Disord.</source>
<volume>25</volume>
, <fpage>1000</fpage>
–<lpage>1004</lpage>
<pub-id pub-id-type="doi">10.1002/mds.23005</pub-id>
<pub-id pub-id-type="pmid">20198644</pub-id>
</mixed-citation>
</ref>
<ref id="B90"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nakahara</surname>
<given-names>H.</given-names>
</name>
<name><surname>Doya</surname>
<given-names>K.</given-names>
</name>
<name><surname>Hikosaka</surname>
<given-names>O.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences-a computational approach</article-title>
. <source>J. Cogn. Neurosci.</source>
<volume>13</volume>
, <fpage>626</fpage>
–<lpage>647</lpage>
<pub-id pub-id-type="doi">10.1162/089892901750363208</pub-id>
<pub-id pub-id-type="pmid">11506661</pub-id>
</mixed-citation>
</ref>
<ref id="B91"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nambu</surname>
<given-names>A.</given-names>
</name>
<name><surname>Tokuno</surname>
<given-names>H.</given-names>
</name>
<name><surname>Takada</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Functional significance of the cortico-subthalamo-pallidal ‘hyperdirect’ pathway</article-title>
. <source>Neurosci. Res.</source>
<volume>43</volume>
, <fpage>111</fpage>
–<lpage>117</lpage>
<pub-id pub-id-type="doi">10.1016/s0168-0102(02)00027-5</pub-id>
<pub-id pub-id-type="pmid">12067746</pub-id>
</mixed-citation>
</ref>
<ref id="B92"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Niv</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Daw</surname>
<given-names>N. D.</given-names>
</name>
<name><surname>Joel</surname>
<given-names>D.</given-names>
</name>
<name><surname>Dayan</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Tonic dopamine: opportunity costs and the control of response vigor</article-title>
. <source>Psychopharmacology (Berl)</source>
<volume>191</volume>
, <fpage>507</fpage>
–<lpage>520</lpage>
<pub-id pub-id-type="doi">10.1007/s00213-006-0502-4</pub-id>
<pub-id pub-id-type="pmid">17031711</pub-id>
</mixed-citation>
</ref>
<ref id="B93"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Obeso</surname>
<given-names>J. A.</given-names>
</name>
<name><surname>Marin</surname>
<given-names>C.</given-names>
</name>
<name><surname>Rodriguez-Oroz</surname>
<given-names>C.</given-names>
</name>
<name><surname>Blesa</surname>
<given-names>J.</given-names>
</name>
<name><surname>Benitez-Temino</surname>
<given-names>B.</given-names>
</name>
<name><surname>Mena-Segovia</surname>
<given-names>J.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2008</year>
). <article-title>The basal ganglia in Parkinson’s disease: current concepts and unexplained observations</article-title>
. <source>Ann. Neurol.</source>
<volume>64</volume>
, <fpage>S30</fpage>
–<lpage>S46</lpage>
<pub-id pub-id-type="doi">10.1002/ana.21481</pub-id>
<pub-id pub-id-type="pmid">19127584</pub-id>
</mixed-citation>
</ref>
<ref id="B94"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>O’Doherty</surname>
<given-names>J.</given-names>
</name>
<name><surname>Dayan</surname>
<given-names>P.</given-names>
</name>
<name><surname>Schultz</surname>
<given-names>J.</given-names>
</name>
<name><surname>Deichmann</surname>
<given-names>R.</given-names>
</name>
<name><surname>Friston</surname>
<given-names>K.</given-names>
</name>
<name><surname>Dolan</surname>
<given-names>R. J.</given-names>
</name>
</person-group>
(<year>2004</year>
). <article-title>Dissociable roles of ventral and dorsal striatum in instrumental conditioning</article-title>
. <source>Science</source>
<volume>304</volume>
, <fpage>452</fpage>
–<lpage>454</lpage>
<pub-id pub-id-type="doi">10.1126/science.1094285</pub-id>
<pub-id pub-id-type="pmid">15087550</pub-id>
</mixed-citation>
</ref>
<ref id="B95"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oh</surname>
<given-names>J. Y.</given-names>
</name>
<name><surname>Kim</surname>
<given-names>Y. S.</given-names>
</name>
<name><surname>Choi</surname>
<given-names>B. H.</given-names>
</name>
<name><surname>Sohn</surname>
<given-names>E. H.</given-names>
</name>
<name><surname>Lee</surname>
<given-names>A. Y.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Relationship between clinical phenotypes and cognitive impairment in Parkinson’s disease (PD)</article-title>
. <source>Arch. Gerontol. Geriatr.</source>
<volume>49</volume>
, <fpage>351</fpage>
–<lpage>354</lpage>
<pub-id pub-id-type="doi">10.1016/j.archger.2008.11.013</pub-id>
<pub-id pub-id-type="pmid">19136159</pub-id>
</mixed-citation>
</ref>
<ref id="B96"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ohbayashi</surname>
<given-names>M.</given-names>
</name>
<name><surname>Ohki</surname>
<given-names>K.</given-names>
</name>
<name><surname>Miyashita</surname>
<given-names>Y.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Conversion of working memory to motor sequence in the monkey premotor cortex</article-title>
. <source>Science</source>
<volume>301</volume>
, <fpage>233</fpage>
–<lpage>236</lpage>
<pub-id pub-id-type="doi">10.1126/science.1084884</pub-id>
<pub-id pub-id-type="pmid">12855814</pub-id>
</mixed-citation>
</ref>
<ref id="B97"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>O’Reilly</surname>
<given-names>R. C.</given-names>
</name>
<name><surname>Frank</surname>
<given-names>M. J.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia</article-title>
. <source>Neural Comput.</source>
<volume>18</volume>
, <fpage>283</fpage>
–<lpage>328</lpage>
<pub-id pub-id-type="doi">10.1162/089976606775093909</pub-id>
<pub-id pub-id-type="pmid">16378516</pub-id>
</mixed-citation>
</ref>
<ref id="B98"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pakhotin</surname>
<given-names>P.</given-names>
</name>
<name><surname>Bracci</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Cholinergic interneurons control the excitatory input to the striatum</article-title>
. <source>J. Neurosci.</source>
<volume>27</volume>
, <fpage>391</fpage>
–<lpage>400</lpage>
<pub-id pub-id-type="doi">10.1523/jneurosci.3709-06.2007</pub-id>
<pub-id pub-id-type="pmid">17215400</pub-id>
</mixed-citation>
</ref>
<ref id="B99"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Piek</surname>
<given-names>J. P.</given-names>
</name>
<name><surname>Dyck</surname>
<given-names>M. J.</given-names>
</name>
<name><surname>Nieman</surname>
<given-names>A.</given-names>
</name>
<name><surname>Anderson</surname>
<given-names>M.</given-names>
</name>
<name><surname>Hay</surname>
<given-names>D.</given-names>
</name>
<name><surname>Smith</surname>
<given-names>L. M.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2004</year>
). <article-title>The relationship between motor coordination, executive functioning and attention in school aged children</article-title>
. <source>Arch. Clin. Neuropsychol.</source>
<volume>19</volume>
, <fpage>1063</fpage>
–<lpage>1076</lpage>
<pub-id pub-id-type="doi">10.1016/j.acn.2003.12.007</pub-id>
<pub-id pub-id-type="pmid">15533697</pub-id>
</mixed-citation>
</ref>
<ref id="B100"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Phillips</surname>
<given-names>J. G.</given-names>
</name>
<name><surname>Stelmach</surname>
<given-names>G. E.</given-names>
</name>
<name><surname>Teasdale</surname>
<given-names>N.</given-names>
</name>
</person-group>
(<year>1991</year>
). <article-title>What can indices of handwriting quality tell us about Parkinsonian handwriting?</article-title>
<source>Hum. Mov. Sci.</source>
<volume>10</volume>
, <fpage>301</fpage>
–<lpage>314</lpage>
<pub-id pub-id-type="doi">10.1016/0167-9457(91)90009-m</pub-id>
</mixed-citation>
</ref>
<ref id="B101"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Plotnik</surname>
<given-names>M.</given-names>
</name>
<name><surname>Giladi</surname>
<given-names>N.</given-names>
</name>
<name><surname>Dagan</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Hausdorff</surname>
<given-names>J. M.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Postural instability and fall risk in Parkinson’s disease: impaired dual tasking, pacing and bilateral coordination of gait during the “ON” medication state</article-title>
. <source>Exp. Brain Res.</source>
<volume>210</volume>
, <fpage>529</fpage>
–<lpage>538</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-011-2551-0</pub-id>
<pub-id pub-id-type="pmid">21279632</pub-id>
</mixed-citation>
</ref>
<ref id="B102"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Poletti</surname>
<given-names>M.</given-names>
</name>
<name><surname>Bonuccelli</surname>
<given-names>U.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Acute and chronic cognitive effects of levodopa and dopamine agonists in patients with Parkinson’s disease: a review</article-title>
. <source>Ther. Adv. Psychopharmacol.</source>
<volume>3</volume>
, <fpage>101</fpage>
–<lpage>113</lpage>
<pub-id pub-id-type="doi">10.1177/2045125312470130</pub-id>
<pub-id pub-id-type="pmid">24167681</pub-id>
</mixed-citation>
</ref>
<ref id="B103"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Poletti</surname>
<given-names>M.</given-names>
</name>
<name><surname>Emre</surname>
<given-names>M.</given-names>
</name>
<name><surname>Bonuccelli</surname>
<given-names>U.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Mild cognitive impairment and cognitive reserve in Parkinson’s disease</article-title>
. <source>Parkinsonism Relat. Disord.</source>
<volume>17</volume>
, <fpage>579</fpage>
–<lpage>586</lpage>
<pub-id pub-id-type="doi">10.1016/j.parkreldis.2011.03.013</pub-id>
<pub-id pub-id-type="pmid">21489852</pub-id>
</mixed-citation>
</ref>
<ref id="B104"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Poletti</surname>
<given-names>M.</given-names>
</name>
<name><surname>Frosini</surname>
<given-names>D.</given-names>
</name>
<name><surname>Pagni</surname>
<given-names>C.</given-names>
</name>
<name><surname>Baldacci</surname>
<given-names>F.</given-names>
</name>
<name><surname>Nicoletti</surname>
<given-names>V.</given-names>
</name>
<name><surname>Tognoni</surname>
<given-names>G.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2012</year>
). <article-title>Mild cognitive impairment and cognitive-motor relationships in newly diagnosed drug-naive patients with Parkinson’s disease</article-title>
. <source>J. Neurol. Neurosurg. Psychiatry</source>
<volume>83</volume>
, <fpage>601</fpage>
–<lpage>606</lpage>
<pub-id pub-id-type="doi">10.1136/jnnp-2011-301874</pub-id>
<pub-id pub-id-type="pmid">22492216</pub-id>
</mixed-citation>
</ref>
<ref id="B105"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pondal</surname>
<given-names>M.</given-names>
</name>
<name><surname>Del Ser</surname>
<given-names>T.</given-names>
</name>
<name><surname>Bermejo</surname>
<given-names>F.</given-names>
</name>
</person-group>
(<year>1996</year>
). <article-title>Anticholinergic therapy and dementia in patients with Parkinson’s disease</article-title>
. <source>J. Neurol.</source>
<volume>243</volume>
, <fpage>543</fpage>
–<lpage>546</lpage>
<pub-id pub-id-type="doi">10.1007/bf00886877</pub-id>
<pub-id pub-id-type="pmid">8836945</pub-id>
</mixed-citation>
</ref>
<ref id="B106"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Price</surname>
<given-names>A.</given-names>
</name>
<name><surname>Filoteo</surname>
<given-names>J. V.</given-names>
</name>
<name><surname>Maddox</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Rule-based category learning in patients with Parkinson’s disease</article-title>
. <source>Neuropsychologia</source>
<volume>47</volume>
, <fpage>1213</fpage>
–<lpage>1226</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2009.01.031</pub-id>
<pub-id pub-id-type="pmid">19428385</pub-id>
</mixed-citation>
</ref>
<ref id="B107"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Probst-Cousin</surname>
<given-names>S.</given-names>
</name>
<name><surname>Druschky</surname>
<given-names>A.</given-names>
</name>
<name><surname>Neundorfer</surname>
<given-names>B.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Disappearance of resting tremor after “stereotaxic” thalamic stroke</article-title>
. <source>Neurology</source>
<volume>61</volume>
, <fpage>1013</fpage>
–<lpage>1014</lpage>
<pub-id pub-id-type="doi">10.1212/01.wnl.0000086810.14643.fc</pub-id>
<pub-id pub-id-type="pmid">14557586</pub-id>
</mixed-citation>
</ref>
<ref id="B135"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rascol</surname>
<given-names>O.</given-names>
</name>
<name><surname>Sabatini</surname>
<given-names>U.</given-names>
</name>
<name><surname>Simonetta-Moreau</surname>
<given-names>M.</given-names>
</name>
<name><surname>Montastruc</surname>
<given-names>L.</given-names>
</name>
<name><surname>Rascol</surname>
<given-names>A.</given-names>
</name>
<name><surname>Clanet</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1991</year>
). <article-title>Square wave jerks in Parkinsonian syndromes</article-title>
. <source>J. Neurol. Neurosurg. Psychiatry</source>
<volume>54</volume>
, <fpage>599</fpage>
–<lpage>602</lpage>
<pub-id pub-id-type="doi">10.1136/jnnp.54.7.599</pub-id>
<pub-id pub-id-type="pmid">1895124</pub-id>
</mixed-citation>
</ref>
<ref id="B108"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Reiner</surname>
<given-names>A.</given-names>
</name>
</person-group>
(<year>2010</year>
). “<article-title>Organization of corticostriatal projection neuron types</article-title>
,” in <source>Handbook of Basal Ganglia Structure and Function</source>
, eds <person-group person-group-type="editor"><name><surname>Steiner</surname>
<given-names>H.</given-names>
</name>
<name><surname>Tseng</surname>
<given-names>K. Y.</given-names>
</name>
</person-group>
(<publisher-loc>New York, NY</publisher-loc>
: <publisher-name>Academic Press</publisher-name>
), <fpage>323</fpage>
–<lpage>340</lpage>
</mixed-citation>
</ref>
<ref id="B109"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Reynolds</surname>
<given-names>J. N. J.</given-names>
</name>
<name><surname>Hyland</surname>
<given-names>B. I.</given-names>
</name>
<name><surname>Wickens</surname>
<given-names>J. R.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>A cellular mechanism of reward-related learning</article-title>
. <source>Nature</source>
<volume>413</volume>
, <fpage>67</fpage>
–<lpage>70</lpage>
<pub-id pub-id-type="doi">10.1038/35092560</pub-id>
<pub-id pub-id-type="pmid">11544526</pub-id>
</mixed-citation>
</ref>
<ref id="B110"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schillaci</surname>
<given-names>O.</given-names>
</name>
<name><surname>Chiaravalloti</surname>
<given-names>A.</given-names>
</name>
<name><surname>Pierantozzi</surname>
<given-names>M.</given-names>
</name>
<name><surname>Di Pietro</surname>
<given-names>B.</given-names>
</name>
<name><surname>Koch</surname>
<given-names>G.</given-names>
</name>
<name><surname>Bruni</surname>
<given-names>C.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2011</year>
). <article-title>Different patterns of nigrostriatal degeneration in tremor type versus the akinetic-rigid and mixed types of Parkinson’s disease at the early stages: molecular imaging with 123I-FP-CIT SPECT</article-title>
. <source>Int. J. Mol. Med.</source>
<volume>28</volume>
, <fpage>881</fpage>
–<lpage>886</lpage>
<pub-id pub-id-type="doi">10.3892/ijmm.2011.764</pub-id>
<pub-id pub-id-type="pmid">21811760</pub-id>
</mixed-citation>
</ref>
<ref id="B111"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Schomaker</surname>
<given-names>L. R. B.</given-names>
</name>
</person-group>
(<year>1991</year>
). <source>Simulation and Recognition of Handwriting Movements: A Vertical Approach to Modeling Human Motor Behavior</source>
. (<publisher-loc>Doctoral Dissertation, Nijmegen University</publisher-loc>
).</mixed-citation>
</ref>
<ref id="B112"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schroll</surname>
<given-names>H.</given-names>
</name>
<name><surname>Vitay</surname>
<given-names>J.</given-names>
</name>
<name><surname>Hamker</surname>
<given-names>F. H.</given-names>
</name>
</person-group>
(<year>2012</year>
). <article-title>Working memory and response selection: a computational account of interactions among cortico-basal ganglio-thalamic loops</article-title>
. <source>Neural Netw.</source>
<volume>26</volume>
, <fpage>59</fpage>
–<lpage>74</lpage>
<pub-id pub-id-type="doi">10.1016/j.neunet.2011.10.008</pub-id>
<pub-id pub-id-type="pmid">22075035</pub-id>
</mixed-citation>
</ref>
<ref id="B113"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Seger</surname>
<given-names>C. A.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>How do the basal ganglia contribute to categorization? Their roles in generalization, response selection and learning via feedback</article-title>
. <source>Neurosci. Biobehav. Rev.</source>
<volume>32</volume>
, <fpage>265</fpage>
–<lpage>278</lpage>
<pub-id pub-id-type="doi">10.1016/j.neubiorev.2007.07.010</pub-id>
<pub-id pub-id-type="pmid">17919725</pub-id>
</mixed-citation>
</ref>
<ref id="B114"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sheridan</surname>
<given-names>M. R.</given-names>
</name>
<name><surname>Flowers</surname>
<given-names>K. A.</given-names>
</name>
</person-group>
(<year>1990</year>
). <article-title>Movement variability and bradykinesia in Parkinson’s disease</article-title>
. <source>Brain</source>
<volume>113</volume>
, <fpage>1149</fpage>
–<lpage>1161</lpage>
<pub-id pub-id-type="doi">10.1093/brain/113.4.1149</pub-id>
<pub-id pub-id-type="pmid">2397387</pub-id>
</mixed-citation>
</ref>
<ref id="B115"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shine</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Matar</surname>
<given-names>E.</given-names>
</name>
<name><surname>Lewis</surname>
<given-names>S. J. G.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Differential neural activation patterns in patients with Parkinson’s disease and freezing of gait in response to concurrent cognitive and motor load</article-title>
. <source>PLoS One</source>
<volume>8</volume>
:<fpage>e52602</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pone.0052602</pub-id>
<pub-id pub-id-type="pmid">23382821</pub-id>
</mixed-citation>
</ref>
<ref id="B116"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Silberstein</surname>
<given-names>P.</given-names>
</name>
<name><surname>Pogosyan</surname>
<given-names>A.</given-names>
</name>
<name><surname>Kuhn</surname>
<given-names>A. A.</given-names>
</name>
<name><surname>Hotton</surname>
<given-names>G.</given-names>
</name>
<name><surname>Tisch</surname>
<given-names>S.</given-names>
</name>
<name><surname>Kupsch</surname>
<given-names>A.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2005</year>
). <article-title>Cortico-cortical coupling in Parkinson’s disease and its modulation by therapy</article-title>
. <source>Brain</source>
<volume>128</volume>
, <fpage>1277</fpage>
–<lpage>1291</lpage>
<pub-id pub-id-type="doi">10.1093/brain/awh480</pub-id>
<pub-id pub-id-type="pmid">15774503</pub-id>
</mixed-citation>
</ref>
<ref id="B117"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Smith</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Galvan</surname>
<given-names>A.</given-names>
</name>
<name><surname>Raju</surname>
<given-names>D.</given-names>
</name>
<name><surname>Wichmann</surname>
<given-names>T.</given-names>
</name>
</person-group>
(<year>2010</year>
). “<article-title>Anatomical and functional organization of the thalamostriatal systems</article-title>
,” in <source>Handbook of Basal Ganglia Structure and Function</source>
, eds <person-group person-group-type="editor"><name><surname>Steiner</surname>
<given-names>H.</given-names>
</name>
<name><surname>Tseng</surname>
<given-names>K. Y.</given-names>
</name>
</person-group>
(<publisher-loc>New York, NY</publisher-loc>
: <publisher-name>Academic Press</publisher-name>
), <fpage>381</fpage>
–<lpage>396</lpage>
</mixed-citation>
</ref>
<ref id="B118"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Raju</surname>
<given-names>D. V.</given-names>
</name>
<name><surname>Pare</surname>
<given-names>J. F.</given-names>
</name>
<name><surname>Sidibe</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2004</year>
). <article-title>The thalamostriatal system: a highly specific network of the basal ganglia circuitry</article-title>
. <source>Trends Neurosci.</source>
<volume>27</volume>
, <fpage>520</fpage>
–<lpage>527</lpage>
<pub-id pub-id-type="doi">10.1016/j.tins.2004.07.004</pub-id>
<pub-id pub-id-type="pmid">15331233</pub-id>
</mixed-citation>
</ref>
<ref id="B119"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Steiner</surname>
<given-names>H.</given-names>
</name>
<name><surname>Tseng</surname>
<given-names>K. Y.</given-names>
</name>
</person-group>
(<year>2010</year>
). <source>Handbook of Basal Ganglia Structure and Function</source>
. <publisher-loc>New York</publisher-loc>
: <publisher-name>Academic Press</publisher-name>
</mixed-citation>
</ref>
<ref id="B120"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tessitore</surname>
<given-names>A.</given-names>
</name>
<name><surname>Amboni</surname>
<given-names>M.</given-names>
</name>
<name><surname>Cirillo</surname>
<given-names>G.</given-names>
</name>
<name><surname>Corbo</surname>
<given-names>D.</given-names>
</name>
<name><surname>Picillo</surname>
<given-names>M.</given-names>
</name>
<name><surname>Russo</surname>
<given-names>A.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2012</year>
). <article-title>Regional gray matter atrophy in patients with Parkinson disease and freezing of gait</article-title>
. <source>AJNR Am. J. Neuroradiol.</source>
<volume>33</volume>
, <fpage>1804</fpage>
–<lpage>1809</lpage>
<pub-id pub-id-type="doi">10.3174/ajnr.a3066</pub-id>
<pub-id pub-id-type="pmid">22538070</pub-id>
</mixed-citation>
</ref>
<ref id="B121"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Teulings</surname>
<given-names>H. L.</given-names>
</name>
<name><surname>Stelmach</surname>
<given-names>G. E.</given-names>
</name>
</person-group>
(<year>1991</year>
). <article-title>Control of stroke size, peak acceleration and stroke duration in Parkinsonian handwriting</article-title>
. <source>Hum. Mov. Sci.</source>
<volume>10</volume>
, <fpage>315</fpage>
–<lpage>334</lpage>
<pub-id pub-id-type="doi">10.1016/0167-9457(91)90010-u</pub-id>
</mixed-citation>
</ref>
<ref id="B122"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vakil</surname>
<given-names>E.</given-names>
</name>
<name><surname>Herishanu-Naaman</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Declarative and procedural learning in Parkinson’s disease patients having tremor or bradykinesia as the predominant symptom</article-title>
. <source>Cortex</source>
<volume>34</volume>
, <fpage>611</fpage>
–<lpage>620</lpage>
<pub-id pub-id-type="doi">10.1016/s0010-9452(08)70518-5</pub-id>
<pub-id pub-id-type="pmid">9800094</pub-id>
</mixed-citation>
</ref>
<ref id="B123"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vandenbossche</surname>
<given-names>J.</given-names>
</name>
<name><surname>Deroost</surname>
<given-names>N.</given-names>
</name>
<name><surname>Soetens</surname>
<given-names>E.</given-names>
</name>
<name><surname>Spildooren</surname>
<given-names>J.</given-names>
</name>
<name><surname>Vercruysse</surname>
<given-names>S.</given-names>
</name>
<name><surname>Nieuwboer</surname>
<given-names>A.</given-names>
</name>
<etal></etal>
</person-group>
(<year>2011</year>
). <article-title>Freezing of gait in Parkinson disease is associated with impaired conflict resolution</article-title>
. <source>Neurorehabil. Neural Repair</source>
<volume>25</volume>
, <fpage>765</fpage>
–<lpage>773</lpage>
<pub-id pub-id-type="doi">10.1177/1545968311403493</pub-id>
<pub-id pub-id-type="pmid">21478498</pub-id>
</mixed-citation>
</ref>
<ref id="B124"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van Gemmert</surname>
<given-names>A. W. A.</given-names>
</name>
<name><surname>Adler</surname>
<given-names>C. H.</given-names>
</name>
<name><surname>Stelmach</surname>
<given-names>G. E.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Parkinson’s disease patients undershoot target size in handwriting and similar tasks</article-title>
. <source>J. Neurol. Neurosurg. Psychiatry</source>
<volume>74</volume>
, <fpage>1502</fpage>
–<lpage>1508</lpage>
<pub-id pub-id-type="doi">10.1136/jnnp.74.11.1502</pub-id>
<pub-id pub-id-type="pmid">14617705</pub-id>
</mixed-citation>
</ref>
<ref id="B125"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van Gemmert</surname>
<given-names>A. W. A.</given-names>
</name>
<name><surname>Teulings</surname>
<given-names>H. L.</given-names>
</name>
<name><surname>Contreras–Vidal</surname>
<given-names>J. L.</given-names>
</name>
<name><surname>Stelmach</surname>
<given-names>G. E.</given-names>
</name>
</person-group>
(<year>1999</year>
). <article-title>Parkinson’s disease and the control of size and speed in handwriting</article-title>
. <source>Neuropsychologia</source>
<volume>37</volume>
, <fpage>685</fpage>
–<lpage>694</lpage>
<pub-id pub-id-type="doi">10.1016/s0028-3932(98)00122-5</pub-id>
<pub-id pub-id-type="pmid">10390030</pub-id>
</mixed-citation>
</ref>
<ref id="B126"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Weinberger</surname>
<given-names>M.</given-names>
</name>
<name><surname>Hutchison</surname>
<given-names>W. D.</given-names>
</name>
<name><surname>Lozano</surname>
<given-names>A. M.</given-names>
</name>
<name><surname>Hodaie</surname>
<given-names>M.</given-names>
</name>
<name><surname>Dostrovsky</surname>
<given-names>J. O.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Increased gamma oscillatory activity in the subthalamic nucleus during tremor in Parkinson’s disease patients</article-title>
. <source>J. Neurophysiol.</source>
<volume>101</volume>
, <fpage>789</fpage>
–<lpage>802</lpage>
<pub-id pub-id-type="doi">10.1152/jn.90837.2008</pub-id>
<pub-id pub-id-type="pmid">19004998</pub-id>
</mixed-citation>
</ref>
<ref id="B127"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Weiss</surname>
<given-names>P.</given-names>
</name>
<name><surname>Stelmach</surname>
<given-names>G. E.</given-names>
</name>
<name><surname>Hefter</surname>
<given-names>H.</given-names>
</name>
</person-group>
(<year>1997</year>
). <article-title>Programming of a movement sequence in Parkinson’s disease</article-title>
. <source>Brain</source>
<volume>120</volume>
, <fpage>91</fpage>
–<lpage>102</lpage>
<pub-id pub-id-type="doi">10.1093/brain/120.1.91</pub-id>
<pub-id pub-id-type="pmid">9055800</pub-id>
</mixed-citation>
</ref>
<ref id="B128"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wickens</surname>
<given-names>J. R.</given-names>
</name>
<name><surname>Begg</surname>
<given-names>A. J.</given-names>
</name>
<name><surname>Arbuthnott</surname>
<given-names>G. W.</given-names>
</name>
</person-group>
(<year>1996</year>
). <article-title>Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro</article-title>
. <source>Neuroscience</source>
<volume>70</volume>
, <fpage>1</fpage>
–<lpage>5</lpage>
<pub-id pub-id-type="doi">10.1016/0306-4522(95)00436-m</pub-id>
<pub-id pub-id-type="pmid">8848115</pub-id>
</mixed-citation>
</ref>
<ref id="B129"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Wilson</surname>
<given-names>C. J.</given-names>
</name>
</person-group>
(<year>2004</year>
). “<article-title>Basal ganglia</article-title>
,” in <source>The Synaptic Organization of the Brain</source>
, ed <person-group person-group-type="editor"><name><surname>Shepherd</surname>
<given-names>G. M.</given-names>
</name>
</person-group>
(<publisher-loc>New York</publisher-loc>
: <publisher-name>Oxford University Press</publisher-name>
), <fpage>361</fpage>
–<lpage>414</lpage>
</mixed-citation>
</ref>
<ref id="B130"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yeterian</surname>
<given-names>E. H.</given-names>
</name>
<name><surname>Pandya</surname>
<given-names>D. N.</given-names>
</name>
</person-group>
(<year>1993</year>
). <article-title>Striatal connections of the parietal association cortices in rhesus monkeys</article-title>
. <source>J. Comp. Neurol.</source>
<volume>332</volume>
, <fpage>175</fpage>
–<lpage>197</lpage>
<pub-id pub-id-type="doi">10.1002/cne.903320204</pub-id>
<pub-id pub-id-type="pmid">8331211</pub-id>
</mixed-citation>
</ref>
<ref id="B131"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yeterian</surname>
<given-names>E. H.</given-names>
</name>
<name><surname>Pandya</surname>
<given-names>D. N.</given-names>
</name>
</person-group>
(<year>1995</year>
). <article-title>Corticostriatal connections of extrastriate visual areas in rhesus monkeys</article-title>
. <source>J. Comp. Neurol.</source>
<volume>352</volume>
, <fpage>436</fpage>
–<lpage>457</lpage>
<pub-id pub-id-type="doi">10.1002/cne.903520309</pub-id>
<pub-id pub-id-type="pmid">7706560</pub-id>
</mixed-citation>
</ref>
<ref id="B132"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yeterian</surname>
<given-names>E. H.</given-names>
</name>
<name><surname>Pandya</surname>
<given-names>D. N.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Corticostriatal connections of the superior temporal region in rhesus monkeys</article-title>
. <source>J. Comp. Neurol.</source>
<volume>399</volume>
, <fpage>384</fpage>
–<lpage>402</lpage>
<pub-id pub-id-type="doi">10.1002/(sici)1096-9861(19980928)399:3<384::aid-cne7>3.0.co;2-x</pub-id>
<pub-id pub-id-type="pmid">9733085</pub-id>
</mixed-citation>
</ref>
<ref id="B133"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yin</surname>
<given-names>H. H.</given-names>
</name>
<name><surname>Ostlund</surname>
<given-names>S. B.</given-names>
</name>
<name><surname>Knowlton</surname>
<given-names>B. J.</given-names>
</name>
<name><surname>Balleine</surname>
<given-names>B. W.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>The role of the dorsomedial striatum in instrumental conditioning</article-title>
. <source>Eur. J. Neurosci.</source>
<volume>22</volume>
, <fpage>513</fpage>
–<lpage>523</lpage>
<pub-id pub-id-type="doi">10.1111/j.1460-9568.2005.04218.x</pub-id>
<pub-id pub-id-type="pmid">16045504</pub-id>
</mixed-citation>
</ref>
<ref id="B134"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zaidel</surname>
<given-names>A.</given-names>
</name>
<name><surname>Arkadir</surname>
<given-names>D.</given-names>
</name>
<name><surname>Israel</surname>
<given-names>Z.</given-names>
</name>
<name><surname>Bergman</surname>
<given-names>H.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Akineto-rigid vs. tremor syndromes in Parkinsonism</article-title>
. <source>Curr. Opin. Neurol.</source>
<volume>22</volume>
, <fpage>387</fpage>
–<lpage>393</lpage>
<pub-id pub-id-type="doi">10.1097/wco.0b013e32832d9d67</pub-id>
<pub-id pub-id-type="pmid">19494773</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
<affiliations><list><country><li>Inde</li>
<li>États-Unis</li>
</country>
</list>
<tree><noCountry><name sortKey="Moustafa, Ahmed A" sort="Moustafa, Ahmed A" uniqKey="Moustafa A" first="Ahmed" last="Moustafa">Ahmed Moustafa</name>
</noCountry>
<country name="États-Unis"><noRegion><name sortKey="Helie, Sebastien" sort="Helie, Sebastien" uniqKey="Helie S" first="Sebastien" last="Helie">Sebastien Helie</name>
</noRegion>
</country>
<country name="Inde"><noRegion><name sortKey="Chakravarthy, Srinivasa" sort="Chakravarthy, Srinivasa" uniqKey="Chakravarthy S" first="Srinivasa" last="Chakravarthy">Srinivasa Chakravarthy</name>
</noRegion>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Santé/explor/JankovicV1/Data/Ncbi/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000439 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd -nk 000439 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Wicri/Santé |area= JankovicV1 |flux= Ncbi |étape= Merge |type= RBID |clé= PMC:3854553 |texte= Exploring the cognitive and motor functions of the basal ganglia: an integrative review of computational cognitive neuroscience models }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/RBID.i -Sk "pubmed:24367325" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd \ | NlmPubMed2Wicri -a JankovicV1
![]() | This area was generated with Dilib version V0.6.19. | ![]() |