Distributed cerebellar plasticity implements generalized multiple-scale memory components in real-robot sensorimotor tasks
Identifieur interne : 001D13 ( Pmc/Curation ); précédent : 001D12; suivant : 001D14Distributed cerebellar plasticity implements generalized multiple-scale memory components in real-robot sensorimotor tasks
Auteurs : Claudia Casellato [Italie] ; Alberto Antonietti [Italie] ; Jesus A. Garrido [Italie, Espagne] ; Giancarlo Ferrigno [Italie] ; Egidio D'Angelo [Italie] ; Alessandra Pedrocchi [Italie]Source :
- Frontiers in Computational Neuroscience [ 1662-5188 ] ; 2015.
Abstract
The cerebellum plays a crucial role in motor learning and it acts as a predictive controller. Modeling it and embedding it into sensorimotor tasks allows us to create functional links between plasticity mechanisms, neural circuits and behavioral learning. Moreover, if applied to real-time control of a neurorobot, the cerebellar model has to deal with a real noisy and changing environment, thus showing its robustness and effectiveness in learning. A biologically inspired cerebellar model with distributed plasticity, both at cortical and nuclear sites, has been used. Two cerebellum-mediated paradigms have been designed: an associative Pavlovian task and a vestibulo-ocular reflex, with multiple sessions of acquisition and extinction and with different stimuli and perturbation patterns. The cerebellar controller succeeded to generate conditioned responses and finely tuned eye movement compensation, thus reproducing human-like behaviors. Through a productive plasticity transfer from cortical to nuclear sites, the distributed cerebellar controller showed in both tasks the capability to optimize learning on multiple time-scales, to store motor memory and to effectively adapt to dynamic ranges of stimuli.
Url:
DOI: 10.3389/fncom.2015.00024
PubMed: 25762922
PubMed Central: 4340181
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :001D13
Links to Exploration step
PMC:4340181Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Distributed cerebellar plasticity implements generalized multiple-scale memory components in real-robot sensorimotor tasks</title>
<author><name sortKey="Casellato, Claudia" sort="Casellato, Claudia" uniqKey="Casellato C" first="Claudia" last="Casellato">Claudia Casellato</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Antonietti, Alberto" sort="Antonietti, Alberto" uniqKey="Antonietti A" first="Alberto" last="Antonietti">Alberto Antonietti</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Brain Connectivity Center, IRCCS Istituto Neurologico Nazionale C. Mondino</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Garrido, Jesus A" sort="Garrido, Jesus A" uniqKey="Garrido J" first="Jesus A." last="Garrido">Jesus A. Garrido</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Brain Connectivity Center, IRCCS Istituto Neurologico Nazionale C. Mondino</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Department of Computer Architecture and Technology, University of Granada</institution>
<country>Granada, Spain</country>
</nlm:aff>
<country xml:lang="fr">Espagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Ferrigno, Giancarlo" sort="Ferrigno, Giancarlo" uniqKey="Ferrigno G" first="Giancarlo" last="Ferrigno">Giancarlo Ferrigno</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="D Angelo, Egidio" sort="D Angelo, Egidio" uniqKey="D Angelo E" first="Egidio" last="D'Angelo">Egidio D'Angelo</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Brain Connectivity Center, IRCCS Istituto Neurologico Nazionale C. Mondino</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff4"><institution>Department Brain and Behavioral Sciences, University of Pavia</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Pedrocchi, Alessandra" sort="Pedrocchi, Alessandra" uniqKey="Pedrocchi A" first="Alessandra" last="Pedrocchi">Alessandra Pedrocchi</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">25762922</idno>
<idno type="pmc">4340181</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4340181</idno>
<idno type="RBID">PMC:4340181</idno>
<idno type="doi">10.3389/fncom.2015.00024</idno>
<date when="2015">2015</date>
<idno type="wicri:Area/Pmc/Corpus">001D13</idno>
<idno type="wicri:Area/Pmc/Curation">001D13</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Distributed cerebellar plasticity implements generalized multiple-scale memory components in real-robot sensorimotor tasks</title>
<author><name sortKey="Casellato, Claudia" sort="Casellato, Claudia" uniqKey="Casellato C" first="Claudia" last="Casellato">Claudia Casellato</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Antonietti, Alberto" sort="Antonietti, Alberto" uniqKey="Antonietti A" first="Alberto" last="Antonietti">Alberto Antonietti</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Brain Connectivity Center, IRCCS Istituto Neurologico Nazionale C. Mondino</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Garrido, Jesus A" sort="Garrido, Jesus A" uniqKey="Garrido J" first="Jesus A." last="Garrido">Jesus A. Garrido</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Brain Connectivity Center, IRCCS Istituto Neurologico Nazionale C. Mondino</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Department of Computer Architecture and Technology, University of Granada</institution>
<country>Granada, Spain</country>
</nlm:aff>
<country xml:lang="fr">Espagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Ferrigno, Giancarlo" sort="Ferrigno, Giancarlo" uniqKey="Ferrigno G" first="Giancarlo" last="Ferrigno">Giancarlo Ferrigno</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="D Angelo, Egidio" sort="D Angelo, Egidio" uniqKey="D Angelo E" first="Egidio" last="D'Angelo">Egidio D'Angelo</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Brain Connectivity Center, IRCCS Istituto Neurologico Nazionale C. Mondino</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff4"><institution>Department Brain and Behavioral Sciences, University of Pavia</institution>
<country>Pavia, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Pedrocchi, Alessandra" sort="Pedrocchi, Alessandra" uniqKey="Pedrocchi A" first="Alessandra" last="Pedrocchi">Alessandra Pedrocchi</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series><title level="j">Frontiers in Computational Neuroscience</title>
<idno type="eISSN">1662-5188</idno>
<imprint><date when="2015">2015</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>The cerebellum plays a crucial role in motor learning and it acts as a predictive controller. Modeling it and embedding it into sensorimotor tasks allows us to create functional links between plasticity mechanisms, neural circuits and behavioral learning. Moreover, if applied to real-time control of a neurorobot, the cerebellar model has to deal with a real noisy and changing environment, thus showing its robustness and effectiveness in learning. A biologically inspired cerebellar model with distributed plasticity, both at cortical and nuclear sites, has been used. Two cerebellum-mediated paradigms have been designed: an associative Pavlovian task and a vestibulo-ocular reflex, with multiple sessions of acquisition and extinction and with different stimuli and perturbation patterns. The cerebellar controller succeeded to generate conditioned responses and finely tuned eye movement compensation, thus reproducing human-like behaviors. Through a productive plasticity transfer from cortical to nuclear sites, the distributed cerebellar controller showed in both tasks the capability to optimize learning on multiple time-scales, to store motor memory and to effectively adapt to dynamic ranges of stimuli.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Albus, J S" uniqKey="Albus J">J. S. Albus</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Attwell, P J" uniqKey="Attwell P">P. J. Attwell</name>
</author>
<author><name sortKey="Cooke, S F" uniqKey="Cooke S">S. F. Cooke</name>
</author>
<author><name sortKey="Yeo, C H" uniqKey="Yeo C">C. H. Yeo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Attwell, P J" uniqKey="Attwell P">P. J. Attwell</name>
</author>
<author><name sortKey="Rahman, S" uniqKey="Rahman S">S. Rahman</name>
</author>
<author><name sortKey="Yeo, C H" uniqKey="Yeo C">C. H. Yeo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Batllori, R" uniqKey="Batllori R">R. Batllori</name>
</author>
<author><name sortKey="Laramee, C" uniqKey="Laramee C">C. Laramee</name>
</author>
<author><name sortKey="Land, W" uniqKey="Land W">W. Land</name>
</author>
<author><name sortKey="Schaffer, J" uniqKey="Schaffer J">J. Schaffer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bracha, V" uniqKey="Bracha V">V. Bracha</name>
</author>
<author><name sortKey="Irwin, K B" uniqKey="Irwin K">K. B. Irwin</name>
</author>
<author><name sortKey="Webster, M L" uniqKey="Webster M">M. L. Webster</name>
</author>
<author><name sortKey="Wunderlich, D A" uniqKey="Wunderlich D">D. A. Wunderlich</name>
</author>
<author><name sortKey="Stachowiak, M K" uniqKey="Stachowiak M">M. K. Stachowiak</name>
</author>
<author><name sortKey="Bloedel, J R" uniqKey="Bloedel J">J. R. Bloedel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bracha, V" uniqKey="Bracha V">V. Bracha</name>
</author>
<author><name sortKey="Zhao, L" uniqKey="Zhao L">L. Zhao</name>
</author>
<author><name sortKey="Irwin, K B" uniqKey="Irwin K">K. B. Irwin</name>
</author>
<author><name sortKey="Bloedel, J R" uniqKey="Bloedel J">J. R. Bloedel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Burdess, C" uniqKey="Burdess C">C. Burdess</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Casellato, C" uniqKey="Casellato C">C. Casellato</name>
</author>
<author><name sortKey="Antonietti, A" uniqKey="Antonietti A">A. Antonietti</name>
</author>
<author><name sortKey="Garrido, J A" uniqKey="Garrido J">J. A. Garrido</name>
</author>
<author><name sortKey="Carrillo, R R" uniqKey="Carrillo R">R. R. Carrillo</name>
</author>
<author><name sortKey="Luque, N R" uniqKey="Luque N">N. R. Luque</name>
</author>
<author><name sortKey="Ros, E" uniqKey="Ros E">E. Ros</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cheron, G" uniqKey="Cheron G">G. Cheron</name>
</author>
<author><name sortKey="Dan, B" uniqKey="Dan B">B. Dan</name>
</author>
<author><name sortKey="Marquez Ruiz, J" uniqKey="Marquez Ruiz J">J. Márquez-Ruiz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Clopath, C" uniqKey="Clopath C">C. Clopath</name>
</author>
<author><name sortKey="Badura, A" uniqKey="Badura A">A. Badura</name>
</author>
<author><name sortKey="De Zeeuw, C I" uniqKey="De Zeeuw C">C. I. De Zeeuw</name>
</author>
<author><name sortKey="Brunel, N" uniqKey="Brunel N">N. Brunel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="D Angelo, E" uniqKey="D Angelo E">E. D'Angelo</name>
</author>
<author><name sortKey="Solinas, S" uniqKey="Solinas S">S. Solinas</name>
</author>
<author><name sortKey="Garrido, J" uniqKey="Garrido J">J. Garrido</name>
</author>
<author><name sortKey="Casellato, C" uniqKey="Casellato C">C. Casellato</name>
</author>
<author><name sortKey="Pedrocchi, A" uniqKey="Pedrocchi A">A. Pedrocchi</name>
</author>
<author><name sortKey="Mapelli, J" uniqKey="Mapelli J">J. Mapelli</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Day, J J" uniqKey="Day J">J. J. Day</name>
</author>
<author><name sortKey="Wheeler, R A" uniqKey="Wheeler R">R. A. Wheeler</name>
</author>
<author><name sortKey="Roitman, M F" uniqKey="Roitman M">M. F. Roitman</name>
</author>
<author><name sortKey="Carelli, R M" uniqKey="Carelli R">R. M. Carelli</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="De Zeeuw, C I" uniqKey="De Zeeuw C">C. I. De Zeeuw</name>
</author>
<author><name sortKey="Yeo, C H" uniqKey="Yeo C">C. H. Yeo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gao, Z" uniqKey="Gao Z">Z. Gao</name>
</author>
<author><name sortKey="Van Beugen, B J" uniqKey="Van Beugen B">B. J. van Beugen</name>
</author>
<author><name sortKey="De Zeeuw, C I" uniqKey="De Zeeuw C">C. I. De Zeeuw</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Garrido, J" uniqKey="Garrido J">J. Garrido</name>
</author>
<author><name sortKey="Luque, N" uniqKey="Luque N">N. Luque</name>
</author>
<author><name sortKey="D Angelo, E" uniqKey="D Angelo E">E. D'Angelo</name>
</author>
<author><name sortKey="Ros, E" uniqKey="Ros E">E. Ros</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Georgopoulos, A P" uniqKey="Georgopoulos A">A. P. Georgopoulos</name>
</author>
<author><name sortKey="Schwartz, A B" uniqKey="Schwartz A">A. B. Schwartz</name>
</author>
<author><name sortKey="Kettner, R E" uniqKey="Kettner R">R. E. Kettner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gerwig, M" uniqKey="Gerwig M">M. Gerwig</name>
</author>
<author><name sortKey="Hajjar, K" uniqKey="Hajjar K">K. Hajjar</name>
</author>
<author><name sortKey="Dimitrova, A" uniqKey="Dimitrova A">A. Dimitrova</name>
</author>
<author><name sortKey="Maschke, M" uniqKey="Maschke M">M. Maschke</name>
</author>
<author><name sortKey="Kolb, F" uniqKey="Kolb F">F. Kolb</name>
</author>
<author><name sortKey="Frings, M" uniqKey="Frings M">M. Frings</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hansel, C" uniqKey="Hansel C">C. Hansel</name>
</author>
<author><name sortKey="Linden, D J" uniqKey="Linden D">D. J. Linden</name>
</author>
<author><name sortKey="D Angelo, E" uniqKey="D Angelo E">E. D'Angelo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hoffland, B S" uniqKey="Hoffland B">B. S. Hoffland</name>
</author>
<author><name sortKey="Bologna, M" uniqKey="Bologna M">M. Bologna</name>
</author>
<author><name sortKey="Kassavetis, P" uniqKey="Kassavetis P">P. Kassavetis</name>
</author>
<author><name sortKey="Teo, J T" uniqKey="Teo J">J. T. Teo</name>
</author>
<author><name sortKey="Rothwell, J C" uniqKey="Rothwell J">J. C. Rothwell</name>
</author>
<author><name sortKey="Yeo, C H" uniqKey="Yeo C">C. H. Yeo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hofstotter, C" uniqKey="Hofstotter C">C. Hofstotter</name>
</author>
<author><name sortKey="Mintz, M" uniqKey="Mintz M">M. Mintz</name>
</author>
<author><name sortKey="Verschure, P" uniqKey="Verschure P">P. Verschure</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ito, M" uniqKey="Ito M">M. Ito</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ito, M" uniqKey="Ito M">M. Ito</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ito, M" uniqKey="Ito M">M. Ito</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kimpo, R R" uniqKey="Kimpo R">R. R. Kimpo</name>
</author>
<author><name sortKey="Boyden, E S" uniqKey="Boyden E">E. S. Boyden</name>
</author>
<author><name sortKey="Katoh, A" uniqKey="Katoh A">A. Katoh</name>
</author>
<author><name sortKey="Ke, M C" uniqKey="Ke M">M. C. Ke</name>
</author>
<author><name sortKey="Raymond, J L" uniqKey="Raymond J">J. L. Raymond</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lee, J Y" uniqKey="Lee J">J. Y. Lee</name>
</author>
<author><name sortKey="Schweighofer, N" uniqKey="Schweighofer N">N. Schweighofer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lenz, A" uniqKey="Lenz A">A. Lenz</name>
</author>
<author><name sortKey="Anderson, S R" uniqKey="Anderson S">S. R. Anderson</name>
</author>
<author><name sortKey="Pipe, A G" uniqKey="Pipe A">A. G. Pipe</name>
</author>
<author><name sortKey="Melhuish, C" uniqKey="Melhuish C">C. Melhuish</name>
</author>
<author><name sortKey="Dean, P" uniqKey="Dean P">P. Dean</name>
</author>
<author><name sortKey="Porrill, J" uniqKey="Porrill J">J. Porrill</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lepora, N F" uniqKey="Lepora N">N. F. Lepora</name>
</author>
<author><name sortKey="Porrill, J" uniqKey="Porrill J">J. Porrill</name>
</author>
<author><name sortKey="Yeo, C H" uniqKey="Yeo C">C. H. Yeo</name>
</author>
<author><name sortKey="Dean, P" uniqKey="Dean P">P. Dean</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Llinas, R" uniqKey="Llinas R">R. Llinás</name>
</author>
<author><name sortKey="Muhlethaler, M" uniqKey="Muhlethaler M">M. Mühlethaler</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Luque, N" uniqKey="Luque N">N. Luque</name>
</author>
<author><name sortKey="Garrido, J" uniqKey="Garrido J">J. Garrido</name>
</author>
<author><name sortKey="Carrillo, R" uniqKey="Carrillo R">R. Carrillo</name>
</author>
<author><name sortKey="Coenen, O" uniqKey="Coenen O">O. Coenen</name>
</author>
<author><name sortKey="Ros, E" uniqKey="Ros E">E. Ros</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Luque, N" uniqKey="Luque N">N. Luque</name>
</author>
<author><name sortKey="Garrido, J" uniqKey="Garrido J">J. Garrido</name>
</author>
<author><name sortKey="Carrillo, R" uniqKey="Carrillo R">R. Carrillo</name>
</author>
<author><name sortKey="D Angelo, E" uniqKey="D Angelo E">E. D'Angelo</name>
</author>
<author><name sortKey="Ros, E" uniqKey="Ros E">E. Ros</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Marr, D" uniqKey="Marr D">D. Marr</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Masuda, N" uniqKey="Masuda N">N. Masuda</name>
</author>
<author><name sortKey="Amari, S" uniqKey="Amari S">S. Amari</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mckinstry, J L" uniqKey="Mckinstry J">J. L. McKinstry</name>
</author>
<author><name sortKey="Edelman, G M" uniqKey="Edelman G">G. M. Edelman</name>
</author>
<author><name sortKey="Krichmar, J L" uniqKey="Krichmar J">J. L. Krichmar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Medina, J" uniqKey="Medina J">J. Medina</name>
</author>
<author><name sortKey="Mauk, M" uniqKey="Mauk M">M. Mauk</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Medina, J" uniqKey="Medina J">J. Medina</name>
</author>
<author><name sortKey="Mauk, M" uniqKey="Mauk M">M. Mauk</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Medina, J" uniqKey="Medina J">J. Medina</name>
</author>
<author><name sortKey="Nores, W" uniqKey="Nores W">W. Nores</name>
</author>
<author><name sortKey="Ohyama, T" uniqKey="Ohyama T">T. Ohyama</name>
</author>
<author><name sortKey="Mauk, M" uniqKey="Mauk M">M. Mauk</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Medina, J F" uniqKey="Medina J">J. F. Medina</name>
</author>
<author><name sortKey="Garcia, K S" uniqKey="Garcia K">K. S. Garcia</name>
</author>
<author><name sortKey="Mauk, M D" uniqKey="Mauk M">M. D. Mauk</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Monaco, J" uniqKey="Monaco J">J. Monaco</name>
</author>
<author><name sortKey="Casellato, C" uniqKey="Casellato C">C. Casellato</name>
</author>
<author><name sortKey="Koch, G" uniqKey="Koch G">G. Koch</name>
</author>
<author><name sortKey="D Angelo, E" uniqKey="D Angelo E">E. D'Angelo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ozgur, B M" uniqKey="Ozgur B">B. M. Ozgur</name>
</author>
<author><name sortKey="Berberian, J" uniqKey="Berberian J">J. Berberian</name>
</author>
<author><name sortKey="Aryan, H E" uniqKey="Aryan H">H. E. Aryan</name>
</author>
<author><name sortKey="Meltzer, H S" uniqKey="Meltzer H">H. S. Meltzer</name>
</author>
<author><name sortKey="Levy, M L" uniqKey="Levy M">M. L. Levy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Pugh, J R" uniqKey="Pugh J">J. R. Pugh</name>
</author>
<author><name sortKey="Raman, I M" uniqKey="Raman I">I. M. Raman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R. Shadmehr</name>
</author>
<author><name sortKey="Smith, M A" uniqKey="Smith M">M. A. Smith</name>
</author>
<author><name sortKey="Krakauer, J W" uniqKey="Krakauer J">J. W. Krakauer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shibuki, K" uniqKey="Shibuki K">K. Shibuki</name>
</author>
<author><name sortKey="Gomi, H" uniqKey="Gomi H">H. Gomi</name>
</author>
<author><name sortKey="Chen, L" uniqKey="Chen L">L. Chen</name>
</author>
<author><name sortKey="Bao, S" uniqKey="Bao S">S. Bao</name>
</author>
<author><name sortKey="Kim, J J" uniqKey="Kim J">J. J. Kim</name>
</author>
<author><name sortKey="Wakatsuki, H" uniqKey="Wakatsuki H">H. Wakatsuki</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Smith, M A" uniqKey="Smith M">M. A. Smith</name>
</author>
<author><name sortKey="Ghazizadeh, A" uniqKey="Ghazizadeh A">A. Ghazizadeh</name>
</author>
<author><name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R. Shadmehr</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Trhan, P" uniqKey="Trhan P">P. Trhan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Thompson, R F" uniqKey="Thompson R">R. F. Thompson</name>
</author>
<author><name sortKey="Steinmetz, J E" uniqKey="Steinmetz J">J. E. Steinmetz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tyrrell, T" uniqKey="Tyrrell T">T. Tyrrell</name>
</author>
<author><name sortKey="Willshaw, D" uniqKey="Willshaw D">D. Willshaw</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Van Der Smagt, P" uniqKey="Van Der Smagt P">P. Van der Smagt</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Verschure, P F" uniqKey="Verschure P">P. F. Verschure</name>
</author>
<author><name sortKey="Voegtlin, T" uniqKey="Voegtlin T">T. Voegtlin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Voegtlin, T" uniqKey="Voegtlin T">T. Voegtlin</name>
</author>
<author><name sortKey="Verschure, P F" uniqKey="Verschure P">P. F. Verschure</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Welsh, J P" uniqKey="Welsh J">J. P. Welsh</name>
</author>
<author><name sortKey="Harvey, J A" uniqKey="Harvey J">J. A. Harvey</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yamamoto, K" uniqKey="Yamamoto K">K. Yamamoto</name>
</author>
<author><name sortKey="Kawato, M" uniqKey="Kawato M">M. Kawato</name>
</author>
<author><name sortKey="Kotosaka, S" uniqKey="Kotosaka S">S. Kotosaka</name>
</author>
<author><name sortKey="Kitazawa, S" uniqKey="Kitazawa S">S. Kitazawa</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yamazaki, T" uniqKey="Yamazaki T">T. Yamazaki</name>
</author>
<author><name sortKey="Igarashi, J" uniqKey="Igarashi J">J. Igarashi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yamazaki, T" uniqKey="Yamazaki T">T. Yamazaki</name>
</author>
<author><name sortKey="Nagao, S" uniqKey="Nagao S">S. Nagao</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yamazaki, T" uniqKey="Yamazaki T">T. Yamazaki</name>
</author>
<author><name sortKey="Tanaka, S" uniqKey="Tanaka S">S. Tanaka</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhang, W" uniqKey="Zhang W">W. Zhang</name>
</author>
<author><name sortKey="Linden, D J" uniqKey="Linden D">D. J. Linden</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Front Comput Neurosci</journal-id>
<journal-id journal-id-type="iso-abbrev">Front Comput Neurosci</journal-id>
<journal-id journal-id-type="publisher-id">Front. Comput. Neurosci.</journal-id>
<journal-title-group><journal-title>Frontiers in Computational Neuroscience</journal-title>
</journal-title-group>
<issn pub-type="epub">1662-5188</issn>
<publisher><publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">25762922</article-id>
<article-id pub-id-type="pmc">4340181</article-id>
<article-id pub-id-type="doi">10.3389/fncom.2015.00024</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Neuroscience</subject>
<subj-group><subject>Original Research Article</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group><article-title>Distributed cerebellar plasticity implements generalized multiple-scale memory components in real-robot sensorimotor tasks</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Casellato</surname>
<given-names>Claudia</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
<xref ref-type="author-notes" rid="fn001"><sup>*</sup>
</xref>
<uri xlink:type="simple" xlink:href="http://community.frontiersin.org/people/u/83957"></uri>
</contrib>
<contrib contrib-type="author"><name><surname>Antonietti</surname>
<given-names>Alberto</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup>
</xref>
<uri xlink:type="simple" xlink:href="http://community.frontiersin.org/people/u/188216"></uri>
</contrib>
<contrib contrib-type="author"><name><surname>Garrido</surname>
<given-names>Jesus A.</given-names>
</name>
<xref ref-type="aff" rid="aff2"><sup>2</sup>
</xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup>
</xref>
<uri xlink:type="simple" xlink:href="http://community.frontiersin.org/people/u/44012"></uri>
</contrib>
<contrib contrib-type="author"><name><surname>Ferrigno</surname>
<given-names>Giancarlo</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
<uri xlink:type="simple" xlink:href="http://community.frontiersin.org/people/u/3091"></uri>
</contrib>
<contrib contrib-type="author"><name><surname>D'Angelo</surname>
<given-names>Egidio</given-names>
</name>
<xref ref-type="aff" rid="aff2"><sup>2</sup>
</xref>
<xref ref-type="aff" rid="aff4"><sup>4</sup>
</xref>
<uri xlink:type="simple" xlink:href="http://community.frontiersin.org/people/u/219"></uri>
</contrib>
<contrib contrib-type="author"><name><surname>Pedrocchi</surname>
<given-names>Alessandra</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
<uri xlink:type="simple" xlink:href="http://community.frontiersin.org/people/u/132960"></uri>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup>
<institution>NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano</institution>
<country>Milano, Italy</country>
</aff>
<aff id="aff2"><sup>2</sup>
<institution>Brain Connectivity Center, IRCCS Istituto Neurologico Nazionale C. Mondino</institution>
<country>Pavia, Italy</country>
</aff>
<aff id="aff3"><sup>3</sup>
<institution>Department of Computer Architecture and Technology, University of Granada</institution>
<country>Granada, Spain</country>
</aff>
<aff id="aff4"><sup>4</sup>
<institution>Department Brain and Behavioral Sciences, University of Pavia</institution>
<country>Pavia, Italy</country>
</aff>
<author-notes><fn fn-type="edited-by"><p>Edited by: Florentin Wörgötter, University Goettingen, Germany</p>
</fn>
<fn fn-type="edited-by"><p>Reviewed by: Simon R. Schultz, Imperial College London, UK; Christian Tetzlaff, Georg-August University, Germany</p>
</fn>
<corresp id="fn001">*Correspondence: Claudia Casellato, NeuroEngineering And Medical Robotics Laboratory, Department Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci 31, 20133 Milano, Italy e-mail: <email xlink:type="simple">claudia.casellato@polimi.it</email>
</corresp>
<fn fn-type="other" id="fn002"><p>This article was submitted to the journal Frontiers in Computational Neuroscience.</p>
</fn>
</author-notes>
<pub-date pub-type="epub"><day>25</day>
<month>2</month>
<year>2015</year>
</pub-date>
<pub-date pub-type="collection"><year>2015</year>
</pub-date>
<volume>9</volume>
<elocation-id>24</elocation-id>
<history><date date-type="received"><day>13</day>
<month>10</month>
<year>2014</year>
</date>
<date date-type="accepted"><day>08</day>
<month>2</month>
<year>2015</year>
</date>
</history>
<permissions><copyright-statement>Copyright © 2015 Casellato, Antonietti, Garrido, Ferrigno, D'Angelo and Pedrocchi.</copyright-statement>
<copyright-year>2015</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/"><license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</license-p>
</license>
</permissions>
<abstract><p>The cerebellum plays a crucial role in motor learning and it acts as a predictive controller. Modeling it and embedding it into sensorimotor tasks allows us to create functional links between plasticity mechanisms, neural circuits and behavioral learning. Moreover, if applied to real-time control of a neurorobot, the cerebellar model has to deal with a real noisy and changing environment, thus showing its robustness and effectiveness in learning. A biologically inspired cerebellar model with distributed plasticity, both at cortical and nuclear sites, has been used. Two cerebellum-mediated paradigms have been designed: an associative Pavlovian task and a vestibulo-ocular reflex, with multiple sessions of acquisition and extinction and with different stimuli and perturbation patterns. The cerebellar controller succeeded to generate conditioned responses and finely tuned eye movement compensation, thus reproducing human-like behaviors. Through a productive plasticity transfer from cortical to nuclear sites, the distributed cerebellar controller showed in both tasks the capability to optimize learning on multiple time-scales, to store motor memory and to effectively adapt to dynamic ranges of stimuli.</p>
</abstract>
<kwd-group><kwd>cerebellar model</kwd>
<kwd>neurorobot</kwd>
<kwd>motor learning</kwd>
<kwd>distributed plasticity</kwd>
<kwd>long term plasticity</kwd>
</kwd-group>
<counts><fig-count count="9"></fig-count>
<table-count count="0"></table-count>
<equation-count count="5"></equation-count>
<ref-count count="55"></ref-count>
<page-count count="14"></page-count>
<word-count count="9210"></word-count>
</counts>
</article-meta>
</front>
<body><sec sec-type="introduction" id="s1"><title>Introduction</title>
<p>In order to develop a comprehensive theory of learning, it is crucial to define a causality chain linking neural signals, plasticity mechanisms, neural circuits and behavioral learning (Cheron et al., <xref rid="B9" ref-type="bibr">2013</xref>
). Cerebellar-mediated learning ranges from associative conditioning of discrete behavioral responses to on-line adaptation in voluntary and reflex movement control (Ito, <xref rid="B20" ref-type="bibr">1982</xref>
), driving acquisition, tuning, extinction and consolidation of motor skills.</p>
<p>In order to learn and store information in internal models of movement so to act as a predictive controller, the cerebellum is thought to employ long-term synaptic plasticity: Long-Term Depression (LTD) and Long-Term Potentiation (LTP). The plasticity at the Parallel Fibers-Purkinje Cells (PF-PC) synapses has classically been assumed to subserve this function (Marr, <xref rid="B30" ref-type="bibr">1969</xref>
). However, multiple processes, with different learning rates, may contribute to these mechanisms (Smith et al., <xref rid="B43" ref-type="bibr">2006</xref>
; Lee and Schweighofer, <xref rid="B24" ref-type="bibr">2009</xref>
; Shadmehr et al., <xref rid="B41" ref-type="bibr">2010</xref>
) and PF-PC single plasticity cannot account for the broad dynamic ranges and multiple time scales of cerebellar adaptation. One hypothesis is that the cerebellum learns basically on two time scales ascribable to two anatomical sites: the cerebellar cortex operates as a fast learning module while deeper structures operate as a slow learning module where the motor skill is transferred and consolidated into more persistent memory (Medina et al., <xref rid="B36" ref-type="bibr">2001</xref>
). Indeed, the activity of the Deep Cerebellar Nuclei (DCN) can be modulated and DCN spike times are strongly correlated with memory acquisition (Zhang and Linden, <xref rid="B55" ref-type="bibr">2006</xref>
). However, there have been few physiological studies on long-term plasticity in DCN and on their roles in motor learning paradigms. Cerebellar cortical and nuclear plasticities have been proposed to be involved and complementary in controlling cerebellar learning in EyeBlink Classical Conditioning (EBCC) (Bracha et al., <xref rid="B5" ref-type="bibr">1998</xref>
; Medina and Mauk, <xref rid="B34" ref-type="bibr">2000</xref>
; Medina et al., <xref rid="B35" ref-type="bibr">2000</xref>
) and in Vestibulo-Ocular Reflex (VOR) (Burdess, <xref rid="B7" ref-type="bibr">1996</xref>
; Ito, <xref rid="B22" ref-type="bibr">1998</xref>
; Masuda and Amari, <xref rid="B31" ref-type="bibr">2008</xref>
). Indeed, inactivation of cerebellar cortex (Attwell et al., <xref rid="B3" ref-type="bibr">2001</xref>
), cerebellar nuclei (Attwell et al., <xref rid="B2" ref-type="bibr">2002</xref>
) or Inferior Olive (IO) (Welsh and Harvey, <xref rid="B50" ref-type="bibr">1998</xref>
) all prevent acquisition skills. There are several possible molecular and cellular mechanisms that could underlie adaptation of the vestibulo-ocular reflex and eyeblink conditioning. Behavioral observations showed common and robust mechanisms between EBCC and VOR tasks: slow and fast complementary adaptation processes, spontaneous recovery of the original response and faster relearning due to consolidation mechanisms. However, causal relationships between particular cellular processes and individual components of a learned behavior have not been demonstrated unequivocally (De Zeeuw and Yeo, <xref rid="B13" ref-type="bibr">2005</xref>
).</p>
<p>One complementary approach to the experimental and behavioral one to better understand the mechanisms of the cerebellum information processing is to make computational models of the cerebellum network and to test them in paradigms as close as possible to the neurophysiological ones. Different simplified cerebellar models based on the Adaptive Filter Model derived from the Marr-Albus Motor Learning Theory have been developed (Marr, <xref rid="B30" ref-type="bibr">1969</xref>
; Albus, <xref rid="B1" ref-type="bibr">1971</xref>
; Tyrrell and Willshaw, <xref rid="B46" ref-type="bibr">1992</xref>
; Ito, <xref rid="B21" ref-type="bibr">1997</xref>
; Lepora et al., <xref rid="B26" ref-type="bibr">2010</xref>
), in few studies also translated into spiking neural networks (Yamazaki and Tanaka, <xref rid="B54" ref-type="bibr">2007</xref>
; Yamazaki and Nagao, <xref rid="B53" ref-type="bibr">2012</xref>
), and tested in computational simulations of EBCC, VOR and upper-limb tracking tasks. In these models, learning occurred as long-term PF-PC single plasticity.</p>
<p>Very recently (Garrido et al., <xref rid="B15" ref-type="bibr">2013</xref>
), beside the PF-PC cortical plasticity, the cerebellum model was endowed with biologically plausible plastic mechanisms at two additional synaptic sites of DCN: Mossy Fibers-DCN (MF-DCN) and PC-DCN (Hansel et al., <xref rid="B17" ref-type="bibr">2001</xref>
; Gao et al., <xref rid="B14" ref-type="bibr">2012</xref>
). This 3-site cerebellar model, as a general computational scheme, was tested in a tracking task only in simulations. <italic>In-silico</italic>
simulations are always a first important test bench of new features of controllers but they can only partially be used to show the real behavior of a computational model. The literature has already discussed this point and interesting works have been proposed to check the use of neural-inspired control models acting into real-world conditions by being embedded into a controller of a robot (Voegtlin and Verschure, <xref rid="B49" ref-type="bibr">1999</xref>
; Hofstotter et al., <xref rid="B19" ref-type="bibr">2002</xref>
; McKinstry et al., <xref rid="B32" ref-type="bibr">2006</xref>
; Lenz et al., <xref rid="B25" ref-type="bibr">2009</xref>
; Trhan, <xref rid="B44" ref-type="bibr">2010</xref>
; Batllori et al., <xref rid="B4" ref-type="bibr">2011</xref>
; Yamazaki and Igarashi, <xref rid="B52" ref-type="bibr">2013</xref>
). Indeed, modeling the cerebellar structure and embedding it into the control of a real robot immersed into real-world conditions is a key approach to associate the detailed model of neuronal connectivity and synaptic plasticity with behavioral functionalities. Experiments with real robots allow the exploration of the robustness and generalization capability of the controlling model (Verschure and Voegtlin, <xref rid="B48" ref-type="bibr">1998</xref>
). Specific experimental paradigms have been already proposed in the literature to highlight specific features of the computational model used in the robotic control, for example Yamazaki and coworkers (Yamazaki and Igarashi, <xref rid="B52" ref-type="bibr">2013</xref>
) designed a ball intercept robotic task in order to test the timing properties of a single-plasticity spiking cerebellar controller.</p>
<p>In this context, we have tested into realistic sensorimotor tasks the learning skills of the 3-site distributed plasticity cerebellar model, embodied in a robot acting and sensing in real-time in real environment (<italic>neurorobot</italic>
). In order to focus our tests on the learning properties of the cerebellar network model, the robot has been acting in two experimental protocols of different nature, selected to mimic typical cerebellum-mediated neurophysiological paradigms: an associative Pavlovian task, as the EBCC, and a VOR. Very often the models using cerebellar principles, more or less detailed and realistic, have been designed specifically for one single task (Van der Smagt, <xref rid="B47" ref-type="bibr">2000</xref>
; Day et al., <xref rid="B12" ref-type="bibr">2006</xref>
; Yamamoto et al., <xref rid="B51" ref-type="bibr">2007</xref>
; Thompson and Steinmetz, <xref rid="B45" ref-type="bibr">2009</xref>
; Clopath et al., <xref rid="B10" ref-type="bibr">2013</xref>
), while the real cerebellum is good at learning a wide variety of tasks, going from stimuli associations to adaptive sensorimotor transformations and coordination.</p>
<p>The Pavlovian associative task is learned along with repeated presentation of paired stimuli, a Conditioned Stimulus (CS, like a tone) followed by an Unconditioned Stimulus (US, like an air-puff, eliciting the eye-blink reflex). The cerebellum learns to produce a Conditioned Response (CR, like an eye-blink, anticipating the US onset) (Medina et al., <xref rid="B35" ref-type="bibr">2000</xref>
). The VOR produces eye movements that stabilize images on the retina compensating head movements. The EBCC requires a fine timing control, whereas the VOR requires a continuous timing and gain control (Yamazaki and Nagao, <xref rid="B53" ref-type="bibr">2012</xref>
).</p>
<p>We have compared the performances of the 3-site distributed plasticity model with the basic one that implements only the PF-PC learning rule. Each task, repeated varying the provided stimuli or the perturbation patterns, was tested and then re-tested after extinction. The main goal is to seek the real-world behavioral outcomes generated by the neural mechanisms modeled into the cerebellar controller, in order to deepen the roles of the plasticity sites and their interaction along multiple learning stages.</p>
</sec>
<sec sec-type="materials|methods" id="s2"><title>Materials and methods</title>
<sec><title>Neurorobot</title>
<p>The robot was a Phantom Premium 1.0 (SensAble™), with 3 degrees of freedom, equipped with digital encoders and controllable by torque commands. It was integrated with an optical tracking system, a VICRA-Polaris (NDI™), acquiring marker-tools at 20 Hz. The controller, ad-hoc developed in C++, exploited the low-level access provided by the Haptic Device Application Programming Interface, sending the torque signals to the joints by servo loops (HDCALLBACKS) executed in high-priority threads at 1 kHz. For the tracking device, the low-level libraries from Image-Guided Surgery Toolkit (<ext-link ext-link-type="uri" xlink:href="http://www.igstk.org/">http://www.igstk.org/</ext-link>
), based on Request-Observer-patterns, were used to acquire the visual information. The cerebellar adaptive module was embedded into the C++ controller.</p>
</sec>
<sec><title>Protocols</title>
<p>The <bold>Pavlovian EBCC-like protocol</bold>
was reproduced as a collision-avoidance task in real-robot (Figures <xref ref-type="fig" rid="F1">1A–C</xref>
). The robotic arm was moving on a pre-defined straight trajectory (followed thanks to joint torques computed through a Proportional-Derivative feedback controller, given the desired joint kinematics and the actual joint kinematics). A fixed obstacle was placed along that path. The US was a step lasting 200 ms; the rise front was triggered through the tracking system, when the distance between obstacle-vertex and robot end-effector underwent a pre-defined threshold (US-threshold, collision risk). Thus, this threshold determined the Inter-Stimuli-Interval (ISI). US-signal reached PCs through Climbing Fibers (CFs). The CS on the MFs (passage of time from trial onset) was decoded into the GRanular (GR) layer. In order to reproduce the “delay EBCC,” i.e., the two stimuli on MF and CF pathways co-terminated in each trial, the input from MFs was made silent from the end of US till the end of the trial. Each trial lasted 1 s.</p>
<fig id="F1" position="float"><label>Figure 1</label>
<caption><p><bold>Embodied cerebellar model and set-up</bold>
. <bold>(A)</bold>
Cerebellar model embedded into the neurorobot, with EBCC-specific input and output signals. The red circles represent the plasticity sites: straight line the PF-PC synapses; dot line and dashed line the MF-DCN and PC-DCN synapses, respectively, activated only within the 3-plasticity model. Arrows represent excitatory connections, whereas dot-arrows inhibitory connections. The EBCC-like Pavlovian task is reproduced into the robotic platform by defining the onset of the US stimulus based on the distance between the moving robot end-effector and the fixed obstacle placed along the trajectory (US-threshold), detected by the optical tracker. CS, fed into the CF pathway, represents the system time-state, decoded by the GR layer. CS and US coterminate (“delay EBCC”). The DCN triggers the conditioned response (CR). <bold>(B)</bold>
Human-like EBCC task. <bold>(C)</bold>
Robotic set-up reproducing the Pavlovian EBCC-like task. <bold>(D)</bold>
Cerebellar model with VOR-specific input and output signals. The red circles represent the plasticity sites: straight line the PF-PC synapses; dot line and dashed line the MF-DCN and PC-DCN synapses, respectively, activated only within the 3-plasticity model. Arrows represent excitatory connections, whereas dot-arrows inhibitory connections. The VOR is reproduced into the robotic platform by using the second joint of the robotic arm as the head (imposed rotation) and the third joint (determining the orientation of the second link, on which the green laser is placed) as the eye. The disalignment between the gaze direction (i.e., second link orientation) and the environmental target to be looked at is computed through geometric equations from the optical tracker recording. Head vestibular stimulus represents the system time-state, decoded by the GR layer. The gaze error is fed into the CF pathway, the DCN modulate the compensatory eye movement. <bold>(E)</bold>
Human-like VOR task. <bold>(F)</bold>
Robotic set-up reproducing the VOR task.</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0001"></graphic>
</fig>
<p>The DCN response, anticipated with respect to the US-onset, modulated the upcoming US-based signal, ranging between 0 and 1, through an inhibitory connection from DCN to IO, i.e., in each trial, <italic>IO</italic>
= 1 − <italic>DCN</italic>
(<italic>t<sub>USonset</sub>
</italic>
). Stronger was the anticipated eyelid protecting the eyes from US, less powerful was the US-related signal arriving on the PC from IO (Medina et al., <xref rid="B35" ref-type="bibr">2000</xref>
).</p>
<p>The CR generation, by thresholding the DCN activity [<italic>DCN</italic>
(<italic>t</italic>
) ≥ 0.9], triggered a pre-programmed 15° triangular increase of the desired angle for the second joint of the moving robotic arm, so the obstacle was vertically overstepped.</p>
<p>The test was made up of two sessions (session1 and session2). Each session consisted of 80 trials of acquisition (CS-US paired presentation) directly followed by 20 trials of extinction (CS-alone, with CS lasting 600 ms).</p>
<p>In order to validate the robustness of the embedded cerebellar controller, different stimuli patterns, i.e., three US-thresholds, were defined so as to generate three average ISIs within a physiologically effective range (Shibuki et al., <xref rid="B42" ref-type="bibr">1996</xref>
): US-th<sub>1</sub>
= 80 mm; US-th<sub>2</sub>
= 105 mm; US-th<sub>3</sub>
= 120 mm. For each US-threshold, 20 tests were carried out. DCN activity was analyzed; as the timing nature of the protocol, we focused on the maximum DCN activity achieved within each trial.</p>
<p>The <bold>VOR</bold>
was reproduced by using the 2nd joint as the head, on which a desired joint displacement was imposed, and the 3rd joint as the eye motion driven only by the cerebellar module. The set-up was arranged so that the two involved joints (2nd and 3rd) moved on a horizontal plane (Figures <xref ref-type="fig" rid="F1">1D–F</xref>
). The visual error, thanks to the tracking system, was computed as the disalignment angle between the actual gaze, i.e., the orientation of the second link of the robot, and the desired one aligned with the fixed object to be looked at (identified by a markers-tool). The normalized value of this visual error was sent to the IO corresponding to the actual error sign (IO+/IO−). Two PCs (one receiving IO+ and one receiving IO−) inhibited DCN+ and DCN− activity, respectively. The net activity of DCNs was proportionally translated, through a fixed gain set to 0.065 Nm, into a net torque on the 3rd joint at each time sample (Luque et al., <xref rid="B28" ref-type="bibr">2011</xref>
). The neural controller architecture and computational principles were designed as for the Pavlovian task, except that at the input stage two IO subgroups coding the error directions (sign), and, accordingly, at the output stage, two DCN subgroups coding the motor command directions (sign) were included. It is biologically plausible (Georgopoulos et al., <xref rid="B56" ref-type="bibr">1986</xref>
) and consistent with the different nature of the two cerebellar paradigms: the stimuli-based discrete EBCC and the continuous direction-dependent VOR. Unlikely the EBCC-like task, no inhibitory connection between DCNs and IOs was modeled, because the DCN activity itself, by changing the outcome gaze angle, directly affected the gaze error signal coded by the IOs.</p>
<p>The test was made up of two VOR sessions (session1 and session2) with fixed target. Each VOR session consisted of 40 trials of acquisition by imposing a pre-defined head rotation, directly followed by 20 extinction trials (head turn null).</p>
<p>In order to validate the robustness of the embedded cerebellar controller, different vestibular stimulus patterns, i.e., three Head Rotation (HR) profiles, were set: HR<sub>1</sub>
= 25° in 2 s, HR<sub>2</sub>
= 30° in 2 s, HR<sub>3</sub>
= 35° in 2 s. For each HR, 15 tests were carried out.</p>
<p>In order to check the capability to rapidly face changes of the stimulus, for each cerebellar controller, a second test was carried out. It reproduced initially the same condition as in the VOR session1 with HR<sub>1</sub>
= 25° in 2 s, but during the steady plateau of the network outcome (at the 35th trial of acquisition), a gain-up stimulus was provided: the head rotation was increased 1.5 times, from 25° to 37.5°, and imposed for other 15 trials. Thus, the test was made up of 50 repetitions.</p>
<p>Gaze error and DCN activity were analyzed; since the protocol required a continuous shape modulation of the motor response, we focused on the Root Mean Square (RMS) of the net DCN activity (taking into account the net activity, DCN+ and DCN−) within each trial.</p>
</sec>
<sec><title>Cerebellum model</title>
<p>In this work, we adapted the cerebellar model developed in (Garrido et al., <xref rid="B15" ref-type="bibr">2013</xref>
). The model represents a theoretical abstraction of the laying physiological mechanisms, it is inspired by the cerebellum neurophysiological mechanisms but the univocal correspondences are not straightforward.</p>
<p>Neuronal signals traveling represent firing rates for the associated neuron or population of neurons, so that all information is assumed rate-coded. Shortly, MF activity, the “context” information, is represented by a constant activity and the GR layer circuit is capable of generating not-recurrent time-evolving states, in each trial, thus univocally identifying the passage of time (Yamazaki and Tanaka, <xref rid="B54" ref-type="bibr">2007</xref>
). This procedure formally corresponds to a labeled-line coding scheme. One different state for each time sample is generated through a sequential activation of PFs within each trial. Hence, the number of PFs (axons of GRs) depends on the movement duration.</p>
<p>The DCNs integrate the excitatory activity coming from MFs and the inhibitory activity coming from PCs (1).</p>
<disp-formula id="E1"><label>(1)</label>
<mml:math id="M1"><mml:mrow><mml:mi>D</mml:mi>
<mml:mi>C</mml:mi>
<mml:msub><mml:mi>N</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mtext> </mml:mtext>
<mml:mo>=</mml:mo>
<mml:mtext> </mml:mtext>
<mml:msub><mml:mi>W</mml:mi>
<mml:mrow><mml:mi>M</mml:mi>
<mml:mi>F</mml:mi>
<mml:mtext>-</mml:mtext>
<mml:mi>D</mml:mi>
<mml:mi>C</mml:mi>
<mml:msub><mml:mi>N</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>−</mml:mo>
<mml:mi>P</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub><mml:mi>r</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mtext> </mml:mtext>
<mml:mo>·</mml:mo>
<mml:mtext> </mml:mtext>
<mml:msub><mml:mi>W</mml:mi>
<mml:mrow><mml:mi>P</mml:mi>
<mml:msub><mml:mi>C</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mtext>-</mml:mtext>
<mml:mi>D</mml:mi>
<mml:mi>C</mml:mi>
<mml:msub><mml:mi>N</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mtext> </mml:mtext>
<mml:mi>i</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mtext> </mml:mtext>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:math>
</disp-formula>
<p>Where <italic>DCN</italic>
<sub><italic>i</italic>
</sub>
(<italic>t</italic>
) represents the activity of the DCN associated with the agonist (<italic>i</italic>
= 1, i.e., +) or antagonist (<italic>i</italic>
= 2, i.e., −) actuators, <italic>W</italic>
<sub><italic>MF</italic>
-<italic>DCN</italic>
<sub><italic>i</italic>
</sub>
</sub>
(<italic>t</italic>
) is the synaptic strength of the MF-DCN connections at the <italic>i</italic>
-th actuator, and <italic>W</italic>
<sub><italic>PC</italic>
<sub><italic>i</italic>
</sub>
-<italic>DCN</italic>
<sub><italic>i</italic>
</sub>
</sub>
(<italic>t</italic>
) is the synaptic strength of the PC-DCN connections at the <italic>i</italic>
-th actuator. For the Pavlovian task, only one actuator is contemplated (<italic>i</italic>
= 1). <italic>Pur</italic>
<sub><italic>i</italic>
</sub>
(<italic>t</italic>
) is the current activity coming from the associated PC (2).</p>
<disp-formula id="E2"><label>(2)</label>
<mml:math id="M2"><mml:mrow><mml:mi>P</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub><mml:mi>r</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:msub><mml:mi>f</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>P</mml:mi>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">)</mml:mo>
<mml:mtext> </mml:mtext>
<mml:mi>i</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mtext> </mml:mtext>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:math>
</disp-formula>
<p>Where <italic>Pur<sub>i</sub>
</italic>
(<italic>t</italic>
) represents the firing rate of the PCs associated with the <italic>i</italic>
-th actuator and <italic>f<sub>i</sub>
</italic>
associates each granular layer state (i.e., one active PF) with a particular output firing rate at the <italic>i</italic>
-th PC.</p>
<p>The Purkinje cells receive error from CFs, coming from IOs, and state information from GRs, and work as a state-error correlator (3).</p>
<disp-formula id="E3"><label>(3)</label>
<mml:math id="M3"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mi>Δ</mml:mi>
<mml:msub><mml:mi>W</mml:mi>
<mml:mrow><mml:mi>P</mml:mi>
<mml:msub><mml:mi>F</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mtext>-</mml:mtext>
<mml:mi>P</mml:mi>
<mml:msub><mml:mi>C</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:mi>t</mml:mi>
<mml:mo>−</mml:mo>
<mml:mi>τ</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr><mml:mtd><mml:mo>=</mml:mo>
<mml:mrow><mml:mo>{</mml:mo>
<mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mfrac><mml:mrow><mml:msup><mml:mrow></mml:mrow>
<mml:mn>1</mml:mn>
</mml:msup>
<mml:mi>L</mml:mi>
<mml:mi>T</mml:mi>
<mml:msub><mml:mi>P</mml:mi>
<mml:mrow><mml:mi>m</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:msub><mml:mi>ε</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mi>α</mml:mi>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:msup><mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:msup>
<mml:mi>L</mml:mi>
<mml:mi>T</mml:mi>
<mml:msub><mml:mi>D</mml:mi>
<mml:mrow><mml:mi>m</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mtext> </mml:mtext>
<mml:mo>·</mml:mo>
<mml:mtext> </mml:mtext>
<mml:msub><mml:mi>ε</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mtext> </mml:mtext>
<mml:mi>i</mml:mi>
<mml:mi>f</mml:mi>
<mml:mtext> </mml:mtext>
<mml:mi>P</mml:mi>
<mml:msub><mml:mi>F</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mtext> </mml:mtext>
<mml:mi>i</mml:mi>
<mml:mi>s</mml:mi>
<mml:mtext> </mml:mtext>
<mml:mi>a</mml:mi>
<mml:mi>c</mml:mi>
<mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>e</mml:mi>
<mml:mtext> </mml:mtext>
<mml:mi>a</mml:mi>
<mml:mi>t</mml:mi>
<mml:mtext> </mml:mtext>
<mml:mi>t</mml:mi>
</mml:mtd>
</mml:mtr>
<mml:mtr><mml:mtd><mml:mtext> </mml:mtext>
<mml:mn>0</mml:mn>
<mml:mtext> </mml:mtext>
<mml:mi>o</mml:mi>
<mml:mi>t</mml:mi>
<mml:mi>h</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>r</mml:mi>
<mml:mi>w</mml:mi>
<mml:mi>i</mml:mi>
<mml:mi>s</mml:mi>
<mml:mi>e</mml:mi>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:math>
</disp-formula>
<p>Where Δ<italic>W</italic>
<sub><italic>PF</italic>
<sub><italic>j</italic>
</sub>
-<italic>PC</italic>
<sub><italic>i</italic>
</sub>
</sub>
(<italic>t</italic>
) is the weight change between the <italic>j</italic>
-th PF and the <italic>i</italic>
-th PC associated with the agonist actuator (<italic>i</italic>
= 1) or with the antagonist actuator (<italic>i</italic>
= 2); <italic>j</italic>
is the number of PFs, equal to the time samples within each task repetition; ε<sub><italic>i</italic>
</sub>
(<italic>t</italic>
) is the current activity coming from the associated <italic>i</italic>
-th CF, expressed from 0 to 1. <sup>1</sup>
<italic>LTP</italic>
<sub><italic>max</italic>
</sub>
and <sup>1</sup>
<italic>LTD</italic>
<sub><italic>max</italic>
</sub>
are the maximum LTP and LTD values and α is the LTP decaying factor (set at 1000 in order to allow a fast decrease of LTP and prevent early plasticity saturation). With respect to the model in (Garrido et al., <xref rid="B15" ref-type="bibr">2013</xref>
), we introduced the τ term, so modeling the physiological delay of the neural circuit, which ranges from 50 to 150 ms (Gerwig et al., <xref rid="B16" ref-type="bibr">2005</xref>
); it means that the weight update takes into account the PF activity preceding the error-related signal carried by CFs. We set τ equal to 100 ms.</p>
<p>The weights at the DCN plastic sites evolve as the learning rules in (4) and (5).</p>
<disp-formula id="E4"><label>(4)</label>
<mml:math id="M4"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mi>Δ</mml:mi>
<mml:msub><mml:mi>W</mml:mi>
<mml:mrow><mml:mi>M</mml:mi>
<mml:mi>F</mml:mi>
<mml:mtext>-</mml:mtext>
<mml:mi>D</mml:mi>
<mml:mi>C</mml:mi>
<mml:msub><mml:mi>N</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:msup><mml:mrow></mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mi>L</mml:mi>
<mml:mi>T</mml:mi>
<mml:msub><mml:mi>P</mml:mi>
<mml:mrow><mml:mi>m</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:mi>P</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub><mml:mi>r</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>∝</mml:mo>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:msup><mml:mo>−</mml:mo>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mi>L</mml:mi>
<mml:mi>T</mml:mi>
<mml:msub><mml:mi>D</mml:mi>
<mml:mrow><mml:mi>m</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
</mml:mtr>
<mml:mtr><mml:mtd><mml:mtext> </mml:mtext>
<mml:mo>·</mml:mo>
<mml:mtext> </mml:mtext>
<mml:mi>P</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub><mml:mi>r</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mtext> </mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mtext> </mml:mtext>
<mml:mi>i</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mtext> </mml:mtext>
<mml:mn>2</mml:mn>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:math>
</disp-formula>
<p>Where Δ<italic>W</italic>
<sub><italic>MF</italic>
-<italic>DCN</italic>
<sub><italic>i</italic>
</sub>
</sub>
(<italic>t</italic>
) represents the weight change between the MF and the target DCN associated with the <italic>i</italic>
-th actuator, <sup>2</sup>
<italic>LTP</italic>
<sub><italic>max</italic>
</sub>
and <sup>2</sup>
<italic>LTD</italic>
<sub><italic>max</italic>
</sub>
are the maximum LTP and LTD values and α is the LTP decaying factor (= 1000).</p>
<disp-formula id="E5"><label>(5)</label>
<mml:math id="M5"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mi>Δ</mml:mi>
<mml:msub><mml:mi>W</mml:mi>
<mml:mrow><mml:mi>P</mml:mi>
<mml:msub><mml:mi>C</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mtext>-</mml:mtext>
<mml:mi>D</mml:mi>
<mml:mi>C</mml:mi>
<mml:msub><mml:mi>N</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:msup><mml:mtext> </mml:mtext>
<mml:mn>3</mml:mn>
</mml:msup>
<mml:mi>L</mml:mi>
<mml:mi>T</mml:mi>
<mml:msub><mml:mi>P</mml:mi>
<mml:mrow><mml:mi>m</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mtext> </mml:mtext>
<mml:mo>·</mml:mo>
<mml:mtext> </mml:mtext>
<mml:mi>P</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub><mml:mi>r</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:msup><mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mi>α</mml:mi>
</mml:msup>
</mml:mtd>
</mml:mtr>
<mml:mtr><mml:mtd><mml:mtext> </mml:mtext>
<mml:mo>·</mml:mo>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:mn>1</mml:mn>
<mml:mo>−</mml:mo>
<mml:mfrac><mml:mn>1</mml:mn>
<mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:mi>D</mml:mi>
<mml:mi>C</mml:mi>
<mml:msub><mml:mi>N</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>∝</mml:mo>
</mml:msup>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:msup><mml:mo>−</mml:mo>
<mml:mn>3</mml:mn>
</mml:msup>
<mml:mi>L</mml:mi>
<mml:mi>T</mml:mi>
<mml:msub><mml:mi>D</mml:mi>
<mml:mrow><mml:mi>m</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
</mml:mtr>
<mml:mtr><mml:mtd><mml:mtext> </mml:mtext>
<mml:mo>·</mml:mo>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:mn>1</mml:mn>
<mml:mo>−</mml:mo>
<mml:mi>P</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub><mml:mi>r</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mtext> </mml:mtext>
<mml:mi>i</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mtext> </mml:mtext>
<mml:mn>2</mml:mn>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:math>
</disp-formula>
<p>Where Δ<italic>W</italic>
<sub><italic>PC</italic>
<sub><italic>i</italic>
</sub>
-<italic>DCN</italic>
<sub><italic>i</italic>
</sub>
</sub>
(<italic>t</italic>
) is the synaptic weight adjustment at the PC-DCN connection reaching the DCN associated with the <italic>i</italic>
-th actuator, <italic>Pur</italic>
<sub><italic>i</italic>
</sub>
(<italic>t</italic>
) is the current activity coming from the associated PC, <italic>DCN</italic>
<sub><italic>i</italic>
</sub>
(<italic>t</italic>
) is the current DCN activity, <sup>3</sup>
<italic>LTP</italic>
<sub><italic>max</italic>
</sub>
and <sup>3</sup>
<italic>LTD</italic>
<sub><italic>max</italic>
</sub>
are the maximum LTP and LTD values and α is the LTP decaying factor (= 1000). All the weights were initialized to 1.</p>
<p>Previous findings suggest a concrete but speculative mechanism for inducing LTP and LTD at MF-DCN synapses that is consistent with Purkinje cell control of plasticity at these sites (Llinás and Mühlethaler, <xref rid="B27" ref-type="bibr">1988</xref>
; Medina and Mauk, <xref rid="B33" ref-type="bibr">1999</xref>
; Ozgur et al., <xref rid="B38" ref-type="bibr">2006</xref>
; Pugh and Raman, <xref rid="B40" ref-type="bibr">2006</xref>
; Zhang and Linden, <xref rid="B55" ref-type="bibr">2006</xref>
). In particular, MF-DCN synapses may increase in strength when coactive during the high levels of calcium likely to exist during transient decreases in Purkinje cell activity and decrease in strength when active during lower levels of calcium, as may occur during strong inhibitory input from Purkinje cells.</p>
<p>The cerebellar controller was embedded into the whole control system, with input and output customized on the task (Figures <xref ref-type="fig" rid="F1">1A,D</xref>
).</p>
<p>The <italic>LTP<sub><italic>max</italic>
</sub>
</italic>
and <italic>LTD<sub>max</sub>
</italic>
of each plasticity site could be tuned. In the 1st plasticity site (PF-PC), <sup><italic>1</italic>
</sup>
<italic>LTP<sub>max</sub>
</italic>
has to be lower than <sup><italic>1</italic>
</sup>
<italic>LTD<sub>max</sub>
</italic>
, otherwise LTP, constantly generated when a state-related activity comes from GRs, could counterbalance and nullify LTD effects. Moreover, to maintain the stability of the learning process, <italic>LTP<sub>max</sub>
</italic>
and <italic>LTD<sub>max</sub>
</italic>
values of the other two plasticity rules (<sup>2</sup>
<italic>LTP<sub>max</sub>
</italic>
,<sup>2</sup>
<italic>LTD<sub>max</sub>
</italic>
, <sup>3</sup>
<italic>LTP<sub>max</sub>
</italic>
, and <sup>3</sup>
<italic>LTD<sub>max</sub>
</italic>
) have to be lower than those defined at the PF-PC synapses.</p>
<p>We have explored different LTP and LTD values, evaluating their effect on the acquisition effectiveness and rate, on the late acquisition stability and on the extinction effectiveness and rate. We have tested a delay-EBCC task in computational simulations, with an EBCC session made up of 80 trials of acquisition (CS-US pairs) and 20 trials of extinction (CS-alone). The CS was provided as a constant activity, activating one different PF each 1 ms, US as a step signal whose amplitude was reduced from the maximum (= 1) depending on the ongoing DCN activity at the US onset instant (as described above in the <italic>Protocols</italic>
section). US lasted 200 ms and occurred after 200 ms from each trial onset (each trial lasted 400 ms).</p>
<p>For each combination (1200) of <italic><sup><italic>1</italic>
</sup>
LTP<sub>max</sub>
</italic>
and <italic><sup><italic>1</italic>
</sup>
LTD<sub>max</sub>
</italic>
, we performed one computational simulation in which the behavior was controlled by the single-site model (<italic>W<sub><italic>MF</italic>
-<italic>DCN</italic>
</sub>
</italic>
and <italic>W<sub>PC-DCN</sub>
</italic>
fixed at 1). We established some significant instants during the EBCC session, to evaluate the effects of the <italic><sup><italic>1</italic>
</sup>
<italic>LTP</italic>
<sub>max</sub>
</italic>
and <italic><sup><italic>1</italic>
</sup>
<italic>LTD</italic>
<sub>max</sub>
</italic>
values on the learning process. In details, DCN activity at the 40th trial was used as index of acquisition, since after 40 repetitions the cerebellum should have learned the stimuli association and achieved a steady maximum output activity. As index of acquisition stability, the DCN activity standard deviation from 40th to 80th trials was computed, and it was supposed to be minimized. Finally, the DCN activity at the 100th trial provided us with an index about the skill of “reverse learning” (extinction), which was supposed to be a fast and effective process. Thus, we set <italic><sup><italic>1</italic>
</sup>
<italic>LTP</italic>
<sub>max</sub>
</italic>
and <italic><sup><italic>1</italic>
</sup>
<italic>LTD</italic>
<sub>max</sub>
</italic>
as a compromise between maximum acquisition level, minimum oscillations during the plateau in late acquisition, and maximum extinction effectiveness. Among the acceptable combinations, we hence set <italic><sup><italic>1</italic>
</sup>
<italic>LTP</italic>
<sub>max</sub>
</italic>
= 0.1 and <italic><sup><italic>1</italic>
</sup>
<italic>LTD</italic>
<sub>max</sub>
</italic>
= 0.15 (Figures <xref ref-type="fig" rid="F2">2A–C</xref>
).</p>
<fig id="F2" position="float"><label>Figure 2</label>
<caption><p><bold>Cerebellar model parameters: LTD and LTP</bold>
. EBCC task (80 trials of acquisition + 20 trials of extinction) in computational simulations in which <italic>LTD<sub>max</sub>
</italic>
and <italic>LTP<sub>max</sub>
</italic>
of the plasticity rules were varied, testing 1200 parameters combinations. First row reports the network performance when the task was controlled by the 1-plasticity model and varying <sup>1</sup>
<italic>LTD<sub>max</sub>
</italic>
and <sup>1</sup>
<italic>LTP<sub>max</sub>
</italic>
. <bold>(A)</bold>
Maximum DCN output at the 40th trial (achieved acquisition); <bold>(B)</bold>
maximum DCN output at the 100<sup>th</sup>
trial (late extinction); <bold>(C)</bold>
maximum DCN output standard deviation from 40th to 80th trials (late acquisition stability). Once fixed <sup>1</sup>
<italic>LTD<sub>max</sub>
</italic>
and <sup>1</sup>
<italic>LTP<sub>max</sub>
</italic>
, the same performance parameters <bold>(D–F)</bold>
were evaluated when the task was controlled by the 3-plasticity model, varying the <italic>LTD<sub>max</sub>
</italic>
and <italic>LTP<sub>max</sub>
</italic>
of the other two plasticity sites (<sup>2</sup>
<italic>LTD<sub>max</sub>
</italic>
, <sup>2</sup>
<italic>LTD<sub>max</sub>
</italic>
, <sup>3</sup>
<italic>LTD<sub>max</sub>
</italic>
, <sup>3</sup>
<italic>LTP<sub>max</sub>
</italic>
). The yellow arrows and points highlight the position of the selected LTP and LTD parameters.</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0002"></graphic>
</fig>
<p>Further, we activated the other two plasticity sites into the controller and we repeated the tests, exploring different <italic>LTP<sub>max</sub>
</italic>
and <italic>LTD<sub>max</sub>
</italic>
values at MF-DCN and PC-DCN, imposing an analogous dynamics to the two learning rules (<sup>2</sup>
<italic>LTP<sub>max</sub>
</italic>
= <sup>3</sup>
LTP<sub><italic>max</italic>
</sub>
and <sup>2</sup>
<italic>LTD</italic>
<sub><italic>max</italic>
</sub>
= <sup>3</sup>
LTD<sub><italic>max</italic>
</sub>
) (Garrido et al., <xref rid="B15" ref-type="bibr">2013</xref>
). We computed the same 3 indexes on the DCN activity (value at the 40th trial, standard deviation 40th–80th trials, and value at the 100th trial). The goal was to maintain the same properties achieved in the tests driven only by the PF-PC plasticity. Indeed, the slower deep nuclear synapses should not significantly affect the overall behavior during a single session started from a naïve state, but rather during a re-testing phase. Among the acceptable combinations, we hence set <sup>2</sup>
<italic>LTP<sub>max</sub>
</italic>
= <sup>3</sup>
<italic>LTP<sub>max</sub>
</italic>
= 2·10<sup>−3</sup>
and <sup>2</sup>
<italic>LTD<sub>max</sub>
</italic>
= <sup>3</sup>
<italic>LTD<sub>max</sub>
</italic>
= 3.5·10<sup>−6</sup>
(Figures <xref ref-type="fig" rid="F2">2D–F</xref>
). Indeed, the multi-rate learning modeling suggests that the role of the slower nuclear dynamics should emerge in longer timeframes calling for consolidation mechanisms, as the ones designed for the robot described above (multi-session EBCC and VOR).</p>
<p>Therefore, afterwards the tuning of the model parameters by simulations from which <italic>LTP<sub>max</sub>
</italic>
and <italic>LTD<sub>max</sub>
</italic>
parameters of all the three sites were defined, we have investigated whether, in real-robot multiple-session protocols, the 3-site distributed model determined a different learning behavior and how these potential differences were related to any interactions of the synaptic weight changes at cortical and nuclear sites.</p>
</sec>
<sec><title>Data analyses</title>
<p>All tests were performed embedding the 1-plasticity cerebellum model (PF-PC) and the 3-plasticity model (PF-PC, MF-DCN, PC-DCN) into the robotic controllers.</p>
<p>For the Pavlovian task, the model performances were evaluated by computing the average gradient of the maximum DCN activity during acquisition trials (1st–40th trials) in session1 (ΔDCN<sub>s1</sub>
) and in session2 (ΔDCN<sub>s2</sub>
) and by calculating the mean anticipation value of the DCN activity onset, generating CR, with respect to the US onset (latency) along all the two-session trials.</p>
<p>For the VOR task, the model performances were evaluated computing the average gradient of the RMS DCN activity during acquisition trials (1st–10th trials) in session1 (ΔDCN<sub>s1</sub>
) and in session2 (ΔDCN<sub>s2</sub>
).</p>
<p>The One-Way ANOVA test was used to check whether each model showed a comparable performance across the different experimental conditions of each task (3 levels of ISI and 3 levels of HR).</p>
<p>For each parameter quantifying the learning performance, the <italic>t</italic>
-test for two independent populations was applied to highlight any differences between 1-plasticity and 3-plasticity behaviors, for each experimental condition separately (ISI<sub>1</sub>
, ISI<sub>2</sub>
, and ISI<sub>3</sub>
; HR<sub>1</sub>
, HR<sub>2</sub>
, and HR<sub>3</sub>
).</p>
<p>In all tests, the level of statistical significance was preset to <italic>p</italic>
< 0.01. Unless otherwise stated, all results are indicated as mean ± standard deviation.</p>
</sec>
</sec>
<sec sec-type="results" id="s3"><title>Results</title>
<sec><title>Pavlovian task</title>
<p>The time-evolving states were decoded into the granular layer. From granule cells, activity was transmitted to the PC and in parallel excited the DCN. The US-related pattern reached the Purkinje cell when US-threshold was detected. The Purkinje cell in turn inhibited the DCN. At the beginning of the acquisition phase, the Purkinje cell was spontaneously active, supplying tonic inhibition to the DCN (Figure <xref ref-type="fig" rid="F3">3A</xref>
). After acquisition, PC activity was decreased; summing up all the presynaptic (constant or plastic) inputs to DCN, DCN neurons began to fire strongly before the onset of the US as neurorobot acquired the CR (Figure <xref ref-type="fig" rid="F3">3B</xref>
). Then during extinction trials, PC activity was progressively re-increased; and DCN did not produce CR anymore (Figure <xref ref-type="fig" rid="F3">3C</xref>
).</p>
<fig id="F3" position="float"><label>Figure 3</label>
<caption><p><bold>Real-robot Pavlovian task</bold>
. Three exemplificative trials of the session1 (80 trials of acquisition + 20 trials of extinction) of Pavlovian task carried out by the neurorobot are described by displaying the provided CS and US, IO, PC and DCN activity. <bold>(A)</bold>
1st trial, <bold>(B)</bold>
80th trial, <bold>(C)</bold>
85th trial.</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0003"></graphic>
</fig>
<p>In each condition (three different US thresholds), the ISI came out not perfectly constant, both across trials of the same test and across the 20 tests (ISI<sub>1</sub>
1-plast: 349 ± 16; ISI<sub>1</sub>
3-plast: 350 ± 16; ISI<sub>2</sub>
1-plast: 478 ± 21; ISI<sub>2</sub>
3-plast: 493 ± 34; ISI<sub>3</sub>
1-plast: 524 ± 17; ISI<sub>3</sub>
3-plast: 516 ± 17 ms). This variability was related to the noise due to the inertial components of the robot and to the tracking system refresh. In each condition, no statistical differences came out between the resulting ISI which 1-plasticity and 3-plasticity models were subjected to. Thus, the necessary prerequisite about the same experimental conditions between the two cerebellar models was verified, so allowing us to ascribe possible differences between their behavioral outcomes to the different neural mechanism functioning.</p>
<p>The One-Way ANOVA tests confirmed the robustness and consistency of each cerebellar model behavior in the three experimental conditions. Both for the 1-plasticity model and for the 3-plasticity model, ISI value did not affect the learning rates, neither the CR latency (overall mean CR latency 1-plast: 66 ± 19 ms; overall mean CR latency 3-plast: 63 ± 23 ms). Only for the 3-plasticity model in session1, the ISI factor resulted significant on the ΔDCN<sub>s1</sub>
(<italic>F</italic>
= 11.9; <italic>p</italic>
= 0.00005).</p>
<p>When comparing the two models in terms of ΔDCN<sub>s1</sub>
, ΔDCN<sub>s2</sub>
, and CR latency for each ISI, a significant difference came out only for the ΔDCN<sub>s2</sub>
in all the three ISIs (Figure <xref ref-type="fig" rid="F4">4</xref>
): in ISI<sub>1</sub>
, <italic>t</italic>
= −5.8; <italic>p</italic>
= 9.3289e-07; in ISI<sub>2</sub>
, <italic>t</italic>
= −5.8; <italic>p</italic>
= 1.2288e-06; in ISI<sub>3</sub>
, <italic>t</italic>
= −4.6; <italic>p</italic>
= 4.0573e-05. Hence, the learning in the re-testing phase was significantly faster when the neurorobot was controlled by the 3-plasticity model than by the 1-plasticity model (Figure <xref ref-type="fig" rid="F5">5A</xref>
).</p>
<fig id="F4" position="float"><label>Figure 4</label>
<caption><p><bold>Real-robot two-session Pavlovian task: models comparison</bold>
. The histogram reports the performances (ΔDCN) of the 1-plasticity and 3-plasticity models in the three EBCC conditions (ISI<sub>1</sub>
, ISI<sub>2</sub>
, and ISI<sub>3</sub>
) in both sessions (s1 and s2). Bars indicate the mean across the 20 tests and the relative standard deviation. <sup>*</sup>
Corresponds to significant statistical difference between the two cerebellar models (<italic>p</italic>
< 0.01).</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0004"></graphic>
</fig>
<fig id="F5" position="float"><label>Figure 5</label>
<caption><p><bold>Plasticity roles in real-robot Pavlovian task. (A)</bold>
The two-session Pavlovian task, with ISI<sub>2.</sub>
The curves are the maximum DCN output within each trial, averaged on the 20 tests, and the areas are the standard deviations. Dark gray: 1-plasticity model; light gray: 3-plasticity model. <bold>(B,C)</bold>
For each model, histograms of the PF-PC weights at the end of three trials (1st, 80th, and 85th), in one of the 20 tests. The arrows indicate the percentages of saturated LTD at PF-PC synapses (weights = 0) at the 80th trial. For the 1-plasticity model, a considerable number of PF-PC connections is saturated to zero, on the contrary for the 3-plasticity model none of the connections is saturated. <bold>(D,E)</bold>
For each model, PF-PC weights at the end of each trial of the test. Here each of the 1000 PF-PC synapses corresponds to one line (there are a lot of overlap, i.e., PF-bundles, as explained in the Results). <bold>(F,G)</bold>
For each model, MF-DCN weight at the end of all trials of the test. The value is fixed for the 1-plasticity model. <bold>(H,I)</bold>
For each model, PC-DCN weight at the end of all trials of the test. The value is fixed for the 1-plasticity model.</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0005"></graphic>
</fig>
<p>The modulation of each plastic connection embedded into the cerebellar models represents the intrinsic mechanisms underlying these observed behaviors. For each trial, the PF-PC synapses that were activated without any correlated CF-signal reaching the PC underwent LTP, whereas the PF-PC synapses activated at the time-states of the movement when a signal arrived to the PC from CF developed LTD. As the trial-by-trial variability, LTD and LTP did not develop alike in fixed bundles of PF-PC connections; the most of PFs decoded system time-states outside the US timeframe; indeed, the US lasted 20% of the whole trial duration. Therefore, these synapses maintained maximum values (saturated LTP); the PFs always decoding system time-state during US occurrence underwent an equal strong LTD; the few PFs at the US time-window borders underwent different balance LTD/LTP, thus they spread across the weight ranges (0–1) (Figures <xref ref-type="fig" rid="F5">5B–E</xref>
).</p>
<p>The main phenomenon driving acquisition was the development of LTD at the PF-PC synapses. In the 3-plasticity model, in the meanwhile, with a slower rate, plasticity at the MF-DCN synapse and at the PC–DCN synapse occurred (Medina et al., <xref rid="B35" ref-type="bibr">2000</xref>
) (Figures <xref ref-type="fig" rid="F5">5F–I</xref>
): the nuclear sites evolved taking charge of a part of the activity generating output responses, which initially was entirely due to the cortical plasticity effects. In other words, a partial transfer of output activity occurred from cortical to nuclear plasticity sites. In session1, this slow transfer did not change any overall learning performances. The network was able to rapidly extinguish the stimuli association by fast PF-PC LTP, but without canceling the slower nuclear plastic changes which had occurred. At the first trials of the session2, the cerebellar synapses of the 3-plasticity model were in an effectively different state compared to the synapses of the 1-plasticity model: the distributed plasticity dynamics, able to store information, was responsible for the higher learning rate in session 2.</p>
</sec>
<sec><title>VOR task</title>
<p>The onset of the vestibular stimulus, i.e., the onset of MF activity, initiated the generation of the state coding within the GR layer, and also provided the excitatory drive to DCN cells. The decoding of the gaze error reached continuously the Purkinje cells through the IOs. The Purkinje cells in turn inhibited the DCNs. At the beginning of the acquisition phase, the Purkinje cells were spontaneously active, supplying tonic inhibition to the DCNs (Figure <xref ref-type="fig" rid="F6">6A</xref>
). After acquisition, PC+ activity was decreased. Summing up all the presynaptic (constant or plastic) inputs to DCN+, DCN+ neurons began to fire so as to continuously counterbalance the head movement, minimizing the gaze error (Figure <xref ref-type="fig" rid="F6">6B</xref>
). Then during extinction trials, PC activity was progressively re-increased; and DCN+ decreased the output motor commands actuating eye motion (Figure <xref ref-type="fig" rid="F6">6C</xref>
).</p>
<fig id="F6" position="float"><label>Figure 6</label>
<caption><p><bold>Real-robot VOR task</bold>
. Three exemplificative trials of the session1 (40 trials of acquisition + 20 trial of extinction) of VOR task carried out by the neurorobot are described by displaying the IO, PC, and DCN activity. <bold>(A)</bold>
1st trial, <bold>(B)</bold>
40th trial, <bold>(C)</bold>
45th trial.</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0006"></graphic>
</fig>
<p>In each condition (three different HRs), the maximum HR came out not perfectly constant, both across trials of the same test and across the 15 tests (HR<sub>1</sub>
1-plast: 24 ± 0.8; HR<sub>1</sub>
3-plast: 24.8 ± 2; HR<sub>2</sub>
1-plast: 29.2 ± 0.8; HR<sub>2</sub>
3-plast: 30 ± 1; HR<sub>3</sub>
1-plast: 36.9 ± 0.7; HR<sub>3</sub>
3-plast: 36.2 ± 1.1). This variability was due to the inertial components of the robot. In each condition, no statistical difference came out between the resulting HR which 1-plasticity and 3-plasticity models were subjected to. Thus, as for the EBCC task, the necessary prerequisite about the same experimental conditions between the two cerebellar models was verified, so allowing us to ascribe possible differences between their behavioral outcomes to the different neural mechanism functioning.</p>
<p>The One-Way ANOVA tests analyzed whether the experimental condition (3 levels of HR) affected the outcome behavior for each cerebellar model. Both for the 1-plasticity model and for the 3-plasticity model, HR value affected the two learning rates (ΔDCN<sub>s1</sub>
1-plast: <italic>F</italic>
= 63167, <italic>p</italic>
= 0; ΔDCN<sub>s1</sub>
3-plast: <italic>F</italic>
= 24433, <italic>p</italic>
= 0; ΔDCN<sub>s2</sub>
1-plast: <italic>F</italic>
= 261, <italic>p</italic>
= 0; ΔDCN<sub>s2</sub>
3-plast: <italic>F</italic>
= 6150, <italic>p</italic>
= 0). Higher was the head perturbation, faster was the DCN activity modulation.</p>
<p>When comparing the two models in terms of ΔDCN<sub>s1</sub>
and ΔDCN<sub>s2</sub>
for each HR, a significant difference came out only for the ΔDCN<sub>s2</sub>
in all the three HRs (Figure <xref ref-type="fig" rid="F7">7</xref>
): in HR<sub>1</sub>
, <italic>t</italic>
= −24.4; <italic>p</italic>
= 0; in HR<sub>2</sub>
, <italic>t</italic>
= −29; <italic>p</italic>
= 0; in HR<sub>3</sub>
, <italic>t</italic>
= −132; <italic>p</italic>
= 0. Hence, the learning in the re-testing phase was significantly faster when the neurorobot was controlled by the 3-plasticity model than by the 1-plasticity model.</p>
<fig id="F7" position="float"><label>Figure 7</label>
<caption><p><bold>Real-robot two-session VOR task: models comparison</bold>
. The histogram reports the performances (ΔDCN) of the 1-plasticity and 3-plasticity models in the three VOR conditions (HR<sub>1</sub>
, HR<sub>2</sub>
, and HR<sub>3</sub>
) in both sessions (s1 and s2). Bars indicate the mean across the 15 tests and the relative standard deviation. <sup>*</sup>
Means significant statistical difference between the two cerebellar models (<italic>p</italic>
< 0.01).</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0007"></graphic>
</fig>
<p>The DCN output of the 3-plasticity model showed an evolution across sessions, while the DCN output of the 1-plasticity model repeated exactly the same adaptation process regardless any previous achieved acquisition (Figure <xref ref-type="fig" rid="F8">8A</xref>
).</p>
<fig id="F8" position="float"><label>Figure 8</label>
<caption><p><bold>Plasticity roles in real-robot VOR task. (A)</bold>
The two-session VOR task, with HR<sub>1.</sub>
The curves are the RMS DCN output within each trial, averaged on the 15 tests, and the areas are the standard deviations. Dark gray: 1-plasticity model; light gray: 3-plasticity model. <bold>(B)</bold>
The corresponding RMS gaze error within each trial, taking into account the error sign. <bold>(C,D)</bold>
For each model, histograms of the PF-PC+ weights at the end of three trials (1st, 40th, and 45th). in one of the 15 tests. The arrows indicate the percentages of saturated LTD at PF-PC synapses (weights = 0) at the 40th trial. For the 1-plasticity model, a considerable number of PF-PC connections is saturated to zero, on the contrary for the 3-plasticity model none of the connections is saturated. <bold>(E,F)</bold>
For each model, PF-PC+ weights at the end of all trials of the test. Here each of the 2000 PF-PC synapses corresponds to one line (there are a lot of overlap, i.e., PF-bundles, as explained in the Results). <bold>(G,H)</bold>
For each model, MF-DCN+ weight at the end of each trial of the test. The values are fixed for the 1-plasticity model. <bold>(I,J)</bold>
For each model, PC+-DCN+ weight at the end of all trials of the test. The values are fixed for the 1-plasticity model. For picture clarity, we report only the weights at the DCN+, which is the only output cell involved during the acquisition phases, since the positive sign of the gaze error (in extinction for few trials, during the after-effects, DCN- is slightly involved).</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0008"></graphic>
</fig>
<p>Since the functioning of the cerebellum as predictive controller acting based on previous trials, during the extinction phases the after-effects occurred for few repetitions: even if the head rotation was canceled, the network output still produced eye compensation; this overcompensation led to a gaze error with opposite sign (Figure <xref ref-type="fig" rid="F8">8B</xref>
). Rapidly, the network learned to bring back the error to zero level.</p>
<p>The modulation of each plastic connection embedded into the cerebellar models represents the intrinsic mechanisms underlying these observed behaviors. For each trial, the PF-PC synapses that were activated without any correlated CF-signal reaching the PC underwent LTP, whereas the PF-PC synapses activated at the time-states of the movement when a signal arrived to the PC from CF developed LTD. Sequentially all the 2000 PFs decoded system time-state during head motion, therefore corresponding to a not-null but not constant gaze error; they underwent a proportional LTD, hence spreading across the weight range (0–1) (Figures <xref ref-type="fig" rid="F8">8C–F</xref>
). The PF-PC weight histograms (Figures <xref ref-type="fig" rid="F8">8C,D</xref>
) clearly showed that in late acquisition the same behavioral outcomes, i.e., steady eye motion fully compensating head motion, was achieved by different weight distributions between the two models. Most of these weights in the 1-plasticity controller was saturated at 0 level; whereas, in the 3-plasticity one, they were more distributed around half value of their range. The main phenomenon driving acquisition was the development of LTD at the synapses PF-PC; however, in the 3-plasticity model, in the meanwhile, with a slower rate, plasticity at the MF-DCN synapse and at the PC–DCN synapse occurred (Medina et al., <xref rid="B35" ref-type="bibr">2000</xref>
) (Figures <xref ref-type="fig" rid="F8">8G–J</xref>
). Thus, in the same way as in the EBCC task, a partial transfer of activity responsible for motor response generation occurred from cortical to nuclear plasticity sites. These changes of weights at DCN sites led to a partial release of the cortical synapses. The network was then able to decrease the eye motion by fast PF-PC LTP, but without canceling the slower nuclear plastic changes had occurred. Again the distributed plasticity dynamics, able to store information, was responsible for the higher learning rate in session2.</p>
<p>The memory transfer effect pointedly arose in the gain-up VOR test (Figure <xref ref-type="fig" rid="F9">9</xref>
). Indeed, the passage from cortical to nuclear sites made the PF-PC synapses ready for further plasticity. In this way, they were able to react to other additive perturbations, suddenly presented to the system. In late acquisition, the performances of the two models were comparable, but the PF-PC synapses of the 1-plasticity controller were close to saturation. When the gain-up stimulus was provided, the 1-plasticity model exploited the residual cortical plasticity till complete saturation; it did not lead to an accurate eye compensatory movement. Whilst, the 3-plasticity model exploited the more persistent nuclear changes and the more availability of plasticity at cortical level; this efficient plasticity interaction led to an accurate recalibration of the eye motion.</p>
<fig id="F9" position="float"><label>Figure 9</label>
<caption><p><bold>Real-robot gain-up VOR task. (A)</bold>
The gain-up VOR test, with HR<sub>1</sub>
from 1st to 35th trials and then 150% of HR<sub>1</sub>
for the following 15 trials. The curves report the RMS gaze error within each trial, taking into account the error sign. Dark gray: 1-plasticity model; light gray: 3-plasticity model. <bold>(B,C)</bold>
For each model, PF-PC+ weights at the end of all trials of the test. Here each of the 2000 PF-PC synapses corresponds to one line. <bold>(D,E)</bold>
For each model, MF-DCN+ weight at the end of all trials of the test. The values are fixed for the 1-plasticity model. <bold>(F,G)</bold>
For each model, PC+-DCN+ weight at the end of all trials of the test. The values are fixed for the 1-plasticity model. For picture clarity, we report only the weights at the DCN+, which is the only output cell involved in this acquisition test.</p>
</caption>
<graphic xlink:href="fncom-09-00024-g0009"></graphic>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4"><title>Discussion</title>
<p>In this study, the developed cerebellar scheme, equipped with cortical and nuclear plasticity mechanisms (Garrido et al., <xref rid="B15" ref-type="bibr">2013</xref>
), has been transformed into a real-time controller of cerebellar-mediated tasks in real-world, EBCC-like and VOR protocols. In this way, it allowed us to challenge the realistic learning properties of the model in uncertainty conditions, in which inputs repeatability was not guaranteed along trials within each test and along multiple tests. By varying stimuli patterns, control robustness has been investigated. Through the designed protocols, we have shed light on acquisition, extinction and consolidation mechanisms, credited to the different active plasticity sites, and we have tested the generalization capability of the modeled computational mechanisms in learning both associative discrete responses and continuously tuned motor responses. The cerebellar controller equipped with cortical and nuclear plasticity mechanisms proved superior to single-site plasticity in developing consolidation process and memory transfer and in implementing adaptable gain control facing varying operative ranges.</p>
<p>The model we have customized and embedded here in the neurorobot was previously developed as a general computational scheme and tested in perfectly repeatable <italic>in-silico</italic>
simulations. Moreover, the tracking task carried out by a simulated robotic arm did not represent a cerebellum-based learning paradigm.</p>
<p>The model was built on the assumption that there are three main cerebellar learning sites, one in the cerebellar cortex (PF-PC) and two in the DCN (MF-DCN and PC-DCN), all generating LTP and LTD with site-specific dynamics.</p>
<p>Recently, neurophysiological studies (Masuda and Amari, <xref rid="B31" ref-type="bibr">2008</xref>
) proposed that MF-DCN synapses or PC-DCN synapses are plastic on a slow time scale and store permanent memory, whose content is passed from the cerebellar cortex storing transient memory.</p>
<p>Clear evidences from mouse mutants (De Zeeuw and Yeo, <xref rid="B13" ref-type="bibr">2005</xref>
) showed similarities in EBCC and VOR behaviors: postsynaptic parallel fibers LTD is the main responsible for adaptation; whereas postsynaptic parallel fibers LTP is responsible for decreasing VOR gain and for driving EBCC extinction. Since spontaneous recovery of the original response and faster relearning (“savings” effect) observed in human behaviors, they suggested that other forms of plasticity may contribute when longer time periods are available. One of the interesting candidates for this mechanism is the firing rate modulation in the deep nuclei. Their long-lasting changes in intrinsic excitability, which are relatively difficult to reverse, make this form of plasticity well suited for chronic motor learning and persistent memory.</p>
<p>The behavioral fall-outs of this model emerged in our tests. To our knowledge, it is the first time an embodied distributed realistic cerebellar model, tested in cerebellum-mediated paradigms, came across able to robustly reproduce human-like effective learning properties in acquisition, extinction and re-acquisition, dealing with different external and noisy stimuli in real-world.</p>
<p>In the Pavlovian task, the neurorobot expressed response levels comparable to those found in human EBCC with similar ISIs, where a stable behavior was achieved in about 30 trials (Bracha et al., <xref rid="B6" ref-type="bibr">2000</xref>
; Hoffland et al., <xref rid="B18" ref-type="bibr">2012</xref>
; Monaco et al., <xref rid="B37" ref-type="bibr">2014</xref>
). Concerning the VOR task, neurophysiological studies showed how in a visual-vestibular training the cerebellum functioning led to an image slip minimization around 0.2° (Kimpo et al., <xref rid="B23" ref-type="bibr">2005</xref>
).</p>
<p>The 3-site model revealed itself in the motor memory transfer between cerebellar sites; in this way, the cerebellar model was equipped with the intrinsic capability to optimize the learning on multiple time-scales and to effectively adapt to dynamic ranges of stimuli.</p>
<p>These outcomes are consistent with the hypothesis about the coexistence of two processes proceeding at different rates in the cerebellum-mediated learning and located in different cerebellar sites, cerebellar cortex and deep cerebellar structures (Medina et al., <xref rid="B36" ref-type="bibr">2001</xref>
; Smith et al., <xref rid="B43" ref-type="bibr">2006</xref>
). The fast process was made dominant by large errors, while the slow process by small errors. The existence of a fast rapidly reversible learning process emerged during the early acquisition and extinction phases. The existence of a slower process emerged in late acquisition. When re-tested, the neurorobot seemed to partially exploit previous learned skills; indeed, the extinction phase of the first session did not reset all the DCN plastic changes achieved in the acquisition training.</p>
<p>In summary, we have linked low-level mechanisms of the cerebellar circuit with high-level functions, by integrating a detailed adaptive cerebellar controller into a neurorobot sensing and operating in real-world. The embedded plasticity dynamics were reflected in behavioral tasks: the fundamental aspects of cerebellar function—prediction, learning, timing and memory—were generated (D'Angelo et al., <xref rid="B11" ref-type="bibr">2013</xref>
).</p>
<p>As a further advance, the platform could be updated with new neurophysiological properties, such as the IO-DCN excitatory connection, working on a much faster timescale than the ones embedded in the present neural model (Luque et al., <xref rid="B29" ref-type="bibr">2014</xref>
). Furthermore, the distributed plasticity model could be translated into a more realistic spike-timing computational scheme (Casellato et al., <xref rid="B8" ref-type="bibr">2014</xref>
).</p>
<p>It is envisaged that improving the realism of the model will allow us to make predictions about the nature of implicit computations occurring in the cerebellar circuits; it could represent a precious tool to simulate neural dysfunctions and thus to predict behaviors, or viceversa to reproduce observed misbehaviors and thus to predict underlying dysfunctions; the platform can be easily manipulated to generate and test any conditions to associate neural features with explicit functions.</p>
<sec><title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back><ack><p>This work was supported by grants of European Union: REALNET (FP7-ICT270434) and Human Brain Project (HBP-604102).</p>
</ack>
<ref-list><title>References</title>
<ref id="B1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Albus</surname>
<given-names>J. S.</given-names>
</name>
</person-group>
(<year>1971</year>
). <article-title>A theory of cerebellar function</article-title>
. <source>Math. Biosci</source>
. <volume>10</volume>
, <fpage>25</fpage>
–<lpage>61</lpage>
<pub-id pub-id-type="doi">10.1016/0025-5564(71)90051-4</pub-id>
</mixed-citation>
</ref>
<ref id="B2"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Attwell</surname>
<given-names>P. J.</given-names>
</name>
<name><surname>Cooke</surname>
<given-names>S. F.</given-names>
</name>
<name><surname>Yeo</surname>
<given-names>C. H.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Cerebellar function in consolidation of a motor memory</article-title>
. <source>Neuron</source>
<volume>34</volume>
, <fpage>1011</fpage>
–<lpage>1020</lpage>
. <pub-id pub-id-type="doi">10.1016/S0896-6273(02)00719-5</pub-id>
<pub-id pub-id-type="pmid">12086647</pub-id>
</mixed-citation>
</ref>
<ref id="B3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Attwell</surname>
<given-names>P. J.</given-names>
</name>
<name><surname>Rahman</surname>
<given-names>S.</given-names>
</name>
<name><surname>Yeo</surname>
<given-names>C. H.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Acquisition of eyeblink conditioning is critically dependent on normal function in cerebellar cortical lobule HVI</article-title>
. <source>J. Neurosci</source>
. <volume>21</volume>
, <fpage>5715</fpage>
–<lpage>5722</lpage>
. <pub-id pub-id-type="pmid">11466443</pub-id>
</mixed-citation>
</ref>
<ref id="B4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Batllori</surname>
<given-names>R.</given-names>
</name>
<name><surname>Laramee</surname>
<given-names>C.</given-names>
</name>
<name><surname>Land</surname>
<given-names>W.</given-names>
</name>
<name><surname>Schaffer</surname>
<given-names>J.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Evolving spiking neural networks for robot control</article-title>
. <source>Procedia Comput. Sci</source>
. <volume>6</volume>
, <fpage>329</fpage>
–<lpage>334</lpage>
. <pub-id pub-id-type="doi">10.1016/j.procs.2011.08.060</pub-id>
<pub-id pub-id-type="pmid">22830963</pub-id>
</mixed-citation>
</ref>
<ref id="B5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bracha</surname>
<given-names>V.</given-names>
</name>
<name><surname>Irwin</surname>
<given-names>K. B.</given-names>
</name>
<name><surname>Webster</surname>
<given-names>M. L.</given-names>
</name>
<name><surname>Wunderlich</surname>
<given-names>D. A.</given-names>
</name>
<name><surname>Stachowiak</surname>
<given-names>M. K.</given-names>
</name>
<name><surname>Bloedel</surname>
<given-names>J. R.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Microinjections of anisomycin into the intermediate cerebellum during learning affect the acquisition of classically conditioned responses in the rabbit</article-title>
. <source>Brain Res</source>
. <volume>788</volume>
, <fpage>169</fpage>
–<lpage>178</lpage>
. <pub-id pub-id-type="doi">10.1016/S0006-8993(97)01535-7</pub-id>
<pub-id pub-id-type="pmid">9554999</pub-id>
</mixed-citation>
</ref>
<ref id="B6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bracha</surname>
<given-names>V.</given-names>
</name>
<name><surname>Zhao</surname>
<given-names>L.</given-names>
</name>
<name><surname>Irwin</surname>
<given-names>K. B.</given-names>
</name>
<name><surname>Bloedel</surname>
<given-names>J. R.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>The human cerebellum and associative learning: dissociation between the acquisition, retention and extinction of conditioned eyeblinks</article-title>
. <source>Brain Res</source>
. <volume>860</volume>
, <fpage>87</fpage>
–<lpage>94</lpage>
. <pub-id pub-id-type="doi">10.1016/S0006-8993(00)01995-8</pub-id>
<pub-id pub-id-type="pmid">10727626</pub-id>
</mixed-citation>
</ref>
<ref id="B7"><mixed-citation publication-type="other"><person-group person-group-type="author"><name><surname>Burdess</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>1996</year>
). <source>The Vestibulo-Ocular Reflex: Computation in the Cerebellar Flocculus</source>
. Ph. D. thesis, University of Edinburgh.</mixed-citation>
</ref>
<ref id="B8"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Casellato</surname>
<given-names>C.</given-names>
</name>
<name><surname>Antonietti</surname>
<given-names>A.</given-names>
</name>
<name><surname>Garrido</surname>
<given-names>J. A.</given-names>
</name>
<name><surname>Carrillo</surname>
<given-names>R. R.</given-names>
</name>
<name><surname>Luque</surname>
<given-names>N. R.</given-names>
</name>
<name><surname>Ros</surname>
<given-names>E.</given-names>
</name>
<etal></etal>
</person-group>
. (<year>2014</year>
). <article-title>Adaptive robotic control driven by a versatile spiking cerebellar network</article-title>
. <source>PLoS ONE</source>
<volume>9</volume>
:<fpage>e112265</fpage>
. <pub-id pub-id-type="doi">10.1371/journal.pone.0112265</pub-id>
<pub-id pub-id-type="pmid">25390365</pub-id>
</mixed-citation>
</ref>
<ref id="B9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cheron</surname>
<given-names>G.</given-names>
</name>
<name><surname>Dan</surname>
<given-names>B.</given-names>
</name>
<name><surname>Márquez-Ruiz</surname>
<given-names>J.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Translational approach to behavioral learning: lessons from cerebellar plasticity</article-title>
. <source>Neural Plast</source>
. <volume>2013</volume>
:<fpage>853654</fpage>
. <pub-id pub-id-type="doi">10.1155/2013/853654</pub-id>
<pub-id pub-id-type="pmid">24319600</pub-id>
</mixed-citation>
</ref>
<ref id="B10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Clopath</surname>
<given-names>C.</given-names>
</name>
<name><surname>Badura</surname>
<given-names>A.</given-names>
</name>
<name><surname>De Zeeuw</surname>
<given-names>C. I.</given-names>
</name>
<name><surname>Brunel</surname>
<given-names>N.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>A cerebellar learning model thatreproduces the behavior of vestibulo-ocular reflex adaptation in wild-type and knock-out mice</article-title>
. <source>BMC Neurosci</source>
. <volume>14</volume>
:<fpage>O4</fpage>
. <pub-id pub-id-type="doi">10.1186/1471-2202-14-S1-O4</pub-id>
<pub-id pub-id-type="pmid">24849355</pub-id>
</mixed-citation>
</ref>
<ref id="B11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>D'Angelo</surname>
<given-names>E.</given-names>
</name>
<name><surname>Solinas</surname>
<given-names>S.</given-names>
</name>
<name><surname>Garrido</surname>
<given-names>J.</given-names>
</name>
<name><surname>Casellato</surname>
<given-names>C.</given-names>
</name>
<name><surname>Pedrocchi</surname>
<given-names>A.</given-names>
</name>
<name><surname>Mapelli</surname>
<given-names>J.</given-names>
</name>
<etal></etal>
</person-group>
. (<year>2013</year>
). <article-title>Realistic modeling of neurons and networks: towards brain simulation</article-title>
. <source>Funct. Neurol</source>
. <volume>28</volume>
:<fpage>153</fpage>
. <pub-id pub-id-type="doi">10.11138/FNeur/2013.28.3.153</pub-id>
<pub-id pub-id-type="pmid">24139652</pub-id>
</mixed-citation>
</ref>
<ref id="B12"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Day</surname>
<given-names>J. J.</given-names>
</name>
<name><surname>Wheeler</surname>
<given-names>R. A.</given-names>
</name>
<name><surname>Roitman</surname>
<given-names>M. F.</given-names>
</name>
<name><surname>Carelli</surname>
<given-names>R. M.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm</article-title>
. <source>Eur. J. Neurosci</source>
. <volume>23</volume>
, <fpage>1341</fpage>
–<lpage>1351</lpage>
. <pub-id pub-id-type="doi">10.1111/j.1460-9568.2006.04654.x</pub-id>
<pub-id pub-id-type="pmid">16553795</pub-id>
</mixed-citation>
</ref>
<ref id="B13"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>De Zeeuw</surname>
<given-names>C. I.</given-names>
</name>
<name><surname>Yeo</surname>
<given-names>C. H.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Time and tide in cerebellar memory formation</article-title>
. <source>Curr. Opin. Neurobiol</source>
. <volume>15</volume>
, <fpage>667</fpage>
–<lpage>674</lpage>
. <pub-id pub-id-type="doi">10.1016/j.conb.2005.10.008</pub-id>
<pub-id pub-id-type="pmid">16271462</pub-id>
</mixed-citation>
</ref>
<ref id="B14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gao</surname>
<given-names>Z.</given-names>
</name>
<name><surname>van Beugen</surname>
<given-names>B. J.</given-names>
</name>
<name><surname>De Zeeuw</surname>
<given-names>C. I.</given-names>
</name>
</person-group>
(<year>2012</year>
). <article-title>Distributed synergistic plasticity and cerebellar learning</article-title>
. <source>Nat. Rev. Neurosci</source>
. <volume>13</volume>
, <fpage>619</fpage>
–<lpage>635</lpage>
. <pub-id pub-id-type="doi">10.1038/nrn3312</pub-id>
<pub-id pub-id-type="pmid">22895474</pub-id>
</mixed-citation>
</ref>
<ref id="B15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Garrido</surname>
<given-names>J.</given-names>
</name>
<name><surname>Luque</surname>
<given-names>N.</given-names>
</name>
<name><surname>D'Angelo</surname>
<given-names>E.</given-names>
</name>
<name><surname>Ros</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Distributed cerebellar plasticity implements adaptable gain control in a manipulation task: a closed-loop robotic simulation</article-title>
. <source>Front. Neural Cir</source>
. <volume>7</volume>
:<issue>159</issue>
. <pub-id pub-id-type="doi">10.3389/fncir.2013.00159</pub-id>
<pub-id pub-id-type="pmid">24130518</pub-id>
</mixed-citation>
</ref>
<ref id="B56"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Georgopoulos</surname>
<given-names>A. P.</given-names>
</name>
<name><surname>Schwartz</surname>
<given-names>A. B.</given-names>
</name>
<name><surname>Kettner</surname>
<given-names>R. E.</given-names>
</name>
</person-group>
(<year>1986</year>
). <article-title>Neuronal population coding of movement direction</article-title>
. <source>Science</source>
<volume>233</volume>
, <fpage>1416</fpage>
–<lpage>1419</lpage>
. <pub-id pub-id-type="doi">10.1126/science.3749885</pub-id>
<pub-id pub-id-type="pmid">3749885</pub-id>
</mixed-citation>
</ref>
<ref id="B16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gerwig</surname>
<given-names>M.</given-names>
</name>
<name><surname>Hajjar</surname>
<given-names>K.</given-names>
</name>
<name><surname>Dimitrova</surname>
<given-names>A.</given-names>
</name>
<name><surname>Maschke</surname>
<given-names>M.</given-names>
</name>
<name><surname>Kolb</surname>
<given-names>F.</given-names>
</name>
<name><surname>Frings</surname>
<given-names>M.</given-names>
</name>
<etal></etal>
</person-group>
. (<year>2005</year>
). <article-title>Timing of conditioned eyeblink responses is impaired in cerebellar patients</article-title>
. <source>J. Neurosci</source>
. <volume>25</volume>
, <fpage>3919</fpage>
–<lpage>3931</lpage>
. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0266-05.2005</pub-id>
<pub-id pub-id-type="pmid">15829644</pub-id>
</mixed-citation>
</ref>
<ref id="B17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hansel</surname>
<given-names>C.</given-names>
</name>
<name><surname>Linden</surname>
<given-names>D. J.</given-names>
</name>
<name><surname>D'Angelo</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Beyond parallel fiber LTD: the diversity of synaptic and non-synaptic plasticity in the cerebellum</article-title>
. <source>Nat. Neurosci</source>
. <volume>4</volume>
, <fpage>467</fpage>
–<lpage>475</lpage>
. <pub-id pub-id-type="doi">10.1038/87419</pub-id>
<pub-id pub-id-type="pmid">11319554</pub-id>
</mixed-citation>
</ref>
<ref id="B18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hoffland</surname>
<given-names>B. S.</given-names>
</name>
<name><surname>Bologna</surname>
<given-names>M.</given-names>
</name>
<name><surname>Kassavetis</surname>
<given-names>P.</given-names>
</name>
<name><surname>Teo</surname>
<given-names>J. T.</given-names>
</name>
<name><surname>Rothwell</surname>
<given-names>J. C.</given-names>
</name>
<name><surname>Yeo</surname>
<given-names>C. H.</given-names>
</name>
<etal></etal>
</person-group>
. (<year>2012</year>
). <article-title>Cerebellar theta burst stimulation impairs eyeblink classical conditioning</article-title>
. <source>J. Physiolog</source>
. <volume>590</volume>
, <fpage>887</fpage>
–<lpage>897</lpage>
. <pub-id pub-id-type="doi">10.1113/jphysiol.2011.218537</pub-id>
<pub-id pub-id-type="pmid">22199171</pub-id>
</mixed-citation>
</ref>
<ref id="B19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hofstotter</surname>
<given-names>C.</given-names>
</name>
<name><surname>Mintz</surname>
<given-names>M.</given-names>
</name>
<name><surname>Verschure</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>The cerebellum in action: a simulation and robotics study</article-title>
. <source>Eur. J. Neurosci</source>
. <volume>16</volume>
, <fpage>1361</fpage>
–<lpage>1376</lpage>
. <pub-id pub-id-type="doi">10.1046/j.1460-9568.2002.02182.x</pub-id>
<pub-id pub-id-type="pmid">12405996</pub-id>
</mixed-citation>
</ref>
<ref id="B20"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ito</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1982</year>
). <article-title>Cerebellar control of the vestibulo-ocular reflex–around the flocculus hypothesis</article-title>
. <source>Annu. Rev. Neurosci</source>
. <volume>5</volume>
, <fpage>275</fpage>
–<lpage>297</lpage>
. <pub-id pub-id-type="doi">10.1146/annurev.ne.05.030182.001423</pub-id>
<pub-id pub-id-type="pmid">6803651</pub-id>
</mixed-citation>
</ref>
<ref id="B21"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ito</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1997</year>
). <article-title>Cerebellar microcomplexes</article-title>
. <source>Int. Rev. Neurobiol</source>
. <volume>41</volume>
, <fpage>475</fpage>
–<lpage>487</lpage>
. <pub-id pub-id-type="pmid">9378604</pub-id>
</mixed-citation>
</ref>
<ref id="B22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ito</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Cerebellar learning in the vestibulo-ocular reflex</article-title>
. <source>Trends Cogn. Sci</source>
. <volume>2</volume>
, <fpage>313</fpage>
–<lpage>321</lpage>
. <pub-id pub-id-type="doi">10.1016/S1364-6613(98)01222-4</pub-id>
<pub-id pub-id-type="pmid">21227227</pub-id>
</mixed-citation>
</ref>
<ref id="B23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kimpo</surname>
<given-names>R. R.</given-names>
</name>
<name><surname>Boyden</surname>
<given-names>E. S.</given-names>
</name>
<name><surname>Katoh</surname>
<given-names>A.</given-names>
</name>
<name><surname>Ke</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Raymond</surname>
<given-names>J. L.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Distinct patterns of stimulus generalization of increases and decreases in VOR gain</article-title>
. <source>J. Neurophysiol</source>
. <volume>94</volume>
, <fpage>3092</fpage>
–<lpage>3100</lpage>
. <pub-id pub-id-type="doi">10.1152/jn.00048.2005</pub-id>
<pub-id pub-id-type="pmid">16033945</pub-id>
</mixed-citation>
</ref>
<ref id="B24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname>
<given-names>J. Y.</given-names>
</name>
<name><surname>Schweighofer</surname>
<given-names>N.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Dual adaptation supports a parallel architecture of motor memory</article-title>
. <source>J. Neurosci</source>
. <volume>29</volume>
, <fpage>10396</fpage>
–<lpage>10404</lpage>
. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.1294-09.2009</pub-id>
<pub-id pub-id-type="pmid">19692614</pub-id>
</mixed-citation>
</ref>
<ref id="B25"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lenz</surname>
<given-names>A.</given-names>
</name>
<name><surname>Anderson</surname>
<given-names>S. R.</given-names>
</name>
<name><surname>Pipe</surname>
<given-names>A. G.</given-names>
</name>
<name><surname>Melhuish</surname>
<given-names>C.</given-names>
</name>
<name><surname>Dean</surname>
<given-names>P.</given-names>
</name>
<name><surname>Porrill</surname>
<given-names>J.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Cerebellar-inspired adaptive control of a robot eye actuated by pneumatic artificial muscles</article-title>
. <source>IEEE Trans. Syst. Man Cybern. B Cybern</source>
. <volume>39</volume>
, <fpage>1420</fpage>
–<lpage>1433</lpage>
. <pub-id pub-id-type="doi">10.1109/TSMCB.2009.2018138</pub-id>
<pub-id pub-id-type="pmid">19369158</pub-id>
</mixed-citation>
</ref>
<ref id="B26"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lepora</surname>
<given-names>N. F.</given-names>
</name>
<name><surname>Porrill</surname>
<given-names>J.</given-names>
</name>
<name><surname>Yeo</surname>
<given-names>C. H.</given-names>
</name>
<name><surname>Dean</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Sensory prediction or motor control? Application of marr–albus type models of cerebellar function to classical conditioning</article-title>
. <source>Front. Comput. Neurosci</source>
. <volume>4</volume>
:<issue>140</issue>
<pub-id pub-id-type="doi">10.3389/fncom.2010.00140</pub-id>
</mixed-citation>
</ref>
<ref id="B27"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Llinás</surname>
<given-names>R.</given-names>
</name>
<name><surname>Mühlethaler</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1988</year>
). <article-title>Electrophysiology of guinea-pig cerebellar nuclear cells in the <italic>in vitro</italic>
brain stem-cerebellar preparation</article-title>
. <source>J. Physiol</source>
. <volume>404</volume>
, <fpage>241</fpage>
–<lpage>258</lpage>
. <pub-id pub-id-type="doi">10.1113/jphysiol.1988.sp017288</pub-id>
<pub-id pub-id-type="pmid">2855348</pub-id>
</mixed-citation>
</ref>
<ref id="B28"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Luque</surname>
<given-names>N.</given-names>
</name>
<name><surname>Garrido</surname>
<given-names>J.</given-names>
</name>
<name><surname>Carrillo</surname>
<given-names>R.</given-names>
</name>
<name><surname>Coenen</surname>
<given-names>O.</given-names>
</name>
<name><surname>Ros</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Cerebellarlike corrective model inference engine for manipulation tasks</article-title>
. <source>IEEE Trans. Syst. Man Cybern. B Cybern</source>
. <volume>41</volume>
, <fpage>1299</fpage>
–<lpage>1312</lpage>
. <pub-id pub-id-type="doi">10.1109/TSMCB.2011.2138693</pub-id>
<pub-id pub-id-type="pmid">21536535</pub-id>
</mixed-citation>
</ref>
<ref id="B29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Luque</surname>
<given-names>N.</given-names>
</name>
<name><surname>Garrido</surname>
<given-names>J.</given-names>
</name>
<name><surname>Carrillo</surname>
<given-names>R.</given-names>
</name>
<name><surname>D'Angelo</surname>
<given-names>E.</given-names>
</name>
<name><surname>Ros</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2014</year>
). <article-title>Fast convergence of learning requires plasticity between inferior olive and deep cerebellar nuclei in a manipulation task: a closed-loop robotic simulation</article-title>
. <source>Front. Comput. Neurosci</source>
. <volume>8</volume>
:<issue>97</issue>
. <pub-id pub-id-type="doi">10.3389/fncom.2014.00097</pub-id>
<pub-id pub-id-type="pmid">25177290</pub-id>
</mixed-citation>
</ref>
<ref id="B30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Marr</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>1969</year>
). <article-title>A theory of cerebellar cortex</article-title>
. <source>J. Physiol</source>
. <volume>202</volume>
, <fpage>437</fpage>
–<lpage>470</lpage>
. <pub-id pub-id-type="pmid">5784296</pub-id>
</mixed-citation>
</ref>
<ref id="B31"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Masuda</surname>
<given-names>N.</given-names>
</name>
<name><surname>Amari</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>A computational study of synaptic mechanisms of partial memory transfer in cerebellar vestibulo-ocular-reflex learning</article-title>
. <source>J. Comput. Neurosci</source>
. <volume>24</volume>
, <fpage>137</fpage>
–<lpage>156</lpage>
. <pub-id pub-id-type="doi">10.1007/s10827-007-0045-7</pub-id>
<pub-id pub-id-type="pmid">17616795</pub-id>
</mixed-citation>
</ref>
<ref id="B32"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McKinstry</surname>
<given-names>J. L.</given-names>
</name>
<name><surname>Edelman</surname>
<given-names>G. M.</given-names>
</name>
<name><surname>Krichmar</surname>
<given-names>J. L.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>A cerebellar model for predictive motor control tested in a brain-based device</article-title>
. <source>Proc. Natl. Acad. Sci. U.S.A</source>
. <volume>103</volume>
, <fpage>3387</fpage>
–<lpage>3392</lpage>
. <pub-id pub-id-type="doi">10.1073/pnas.0511281103</pub-id>
<pub-id pub-id-type="pmid">16488974</pub-id>
</mixed-citation>
</ref>
<ref id="B33"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Medina</surname>
<given-names>J.</given-names>
</name>
<name><surname>Mauk</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1999</year>
). <article-title>Simulations of cerebellar motor learning: computational analysis of plasticity at the mossy fiber to deep nucleus synapse</article-title>
. <source>J. Neurosci</source>
. <volume>19</volume>
, <fpage>7140</fpage>
–<lpage>7151</lpage>
. <pub-id pub-id-type="pmid">10436067</pub-id>
</mixed-citation>
</ref>
<ref id="B34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Medina</surname>
<given-names>J.</given-names>
</name>
<name><surname>Mauk</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>Computer simulation of cerebellar information processing</article-title>
. <source>Nat. Neurosci</source>
. <volume>3</volume>
, <fpage>1205</fpage>
–<lpage>1211</lpage>
. <pub-id pub-id-type="doi">10.1038/81486</pub-id>
<pub-id pub-id-type="pmid">11127839</pub-id>
</mixed-citation>
</ref>
<ref id="B35"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Medina</surname>
<given-names>J.</given-names>
</name>
<name><surname>Nores</surname>
<given-names>W.</given-names>
</name>
<name><surname>Ohyama</surname>
<given-names>T.</given-names>
</name>
<name><surname>Mauk</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>Mechanisms of cerebellar learning suggested by eyelid conditioning</article-title>
. <source>Curr. Opin. Neurobiol</source>
. <volume>10</volume>
, <fpage>717</fpage>
–<lpage>724</lpage>
. <pub-id pub-id-type="doi">10.1016/S0959-4388(00)00154-9</pub-id>
<pub-id pub-id-type="pmid">11240280</pub-id>
</mixed-citation>
</ref>
<ref id="B36"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Medina</surname>
<given-names>J. F.</given-names>
</name>
<name><surname>Garcia</surname>
<given-names>K. S.</given-names>
</name>
<name><surname>Mauk</surname>
<given-names>M. D.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>A mechanism for savings in the cerebellum</article-title>
. <source>J. Neurosci</source>
. <volume>21</volume>
, <fpage>4081</fpage>
–<lpage>4089</lpage>
. <pub-id pub-id-type="pmid">11356896</pub-id>
</mixed-citation>
</ref>
<ref id="B37"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Monaco</surname>
<given-names>J.</given-names>
</name>
<name><surname>Casellato</surname>
<given-names>C.</given-names>
</name>
<name><surname>Koch</surname>
<given-names>G.</given-names>
</name>
<name><surname>D'Angelo</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2014</year>
). <article-title>Cerebellar theta burst stimulation dissociates memory components in eyeblink classical conditioning</article-title>
. <source>Eur. J. Neurosci</source>
. <volume>40</volume>
, <fpage>3363</fpage>
–<lpage>3370</lpage>
. <pub-id pub-id-type="doi">10.1111/ejn.12700</pub-id>
<pub-id pub-id-type="pmid">25185744</pub-id>
</mixed-citation>
</ref>
<ref id="B38"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ozgur</surname>
<given-names>B. M.</given-names>
</name>
<name><surname>Berberian</surname>
<given-names>J.</given-names>
</name>
<name><surname>Aryan</surname>
<given-names>H. E.</given-names>
</name>
<name><surname>Meltzer</surname>
<given-names>H. S.</given-names>
</name>
<name><surname>Levy</surname>
<given-names>M. L.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>The pathophysiologic mechanism of cerebellar mutism</article-title>
. <source>Surg. Neurol</source>
. <volume>66</volume>
, <fpage>18</fpage>
–<lpage>25</lpage>
. <pub-id pub-id-type="doi">10.1016/j.surneu.2005.12.003</pub-id>
<pub-id pub-id-type="pmid">16793430</pub-id>
</mixed-citation>
</ref>
<ref id="B40"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pugh</surname>
<given-names>J. R.</given-names>
</name>
<name><surname>Raman</surname>
<given-names>I. M.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Potentiation of mossy fiber EPSCs in the cerebellar nuclei by NMDA receptor activation followed by postinhibitory rebound current</article-title>
. <source>Neuron</source>
<volume>51</volume>
, <fpage>113</fpage>
–<lpage>123</lpage>
. <pub-id pub-id-type="doi">10.1016/j.neuron.2006.05.021</pub-id>
<pub-id pub-id-type="pmid">16815336</pub-id>
</mixed-citation>
</ref>
<ref id="B41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shadmehr</surname>
<given-names>R.</given-names>
</name>
<name><surname>Smith</surname>
<given-names>M. A.</given-names>
</name>
<name><surname>Krakauer</surname>
<given-names>J. W.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Error correction, sensory prediction, and adaptation in motor control</article-title>
. <source>Annu. Rev. Neurosci</source>
. <volume>33</volume>
, <fpage>89</fpage>
–<lpage>108</lpage>
. <pub-id pub-id-type="doi">10.1146/annurev-neuro-060909-153135</pub-id>
<pub-id pub-id-type="pmid">20367317</pub-id>
</mixed-citation>
</ref>
<ref id="B42"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shibuki</surname>
<given-names>K.</given-names>
</name>
<name><surname>Gomi</surname>
<given-names>H.</given-names>
</name>
<name><surname>Chen</surname>
<given-names>L.</given-names>
</name>
<name><surname>Bao</surname>
<given-names>S.</given-names>
</name>
<name><surname>Kim</surname>
<given-names>J. J.</given-names>
</name>
<name><surname>Wakatsuki</surname>
<given-names>H.</given-names>
</name>
<etal></etal>
</person-group>
. (<year>1996</year>
). <article-title>Deficient cerebellar long-term depression, impaired eyeblink conditioning, and normal motor coordination in GFAP mutant mice</article-title>
. <source>Neuron</source>
<volume>16</volume>
, <fpage>587</fpage>
–<lpage>599</lpage>
. <pub-id pub-id-type="doi">10.1016/S0896-6273(00)80078-1</pub-id>
<pub-id pub-id-type="pmid">8785056</pub-id>
</mixed-citation>
</ref>
<ref id="B43"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname>
<given-names>M. A.</given-names>
</name>
<name><surname>Ghazizadeh</surname>
<given-names>A.</given-names>
</name>
<name><surname>Shadmehr</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Interacting adaptive processes with different timescales underlie short-term motor learning</article-title>
. <source>PLoS Biol</source>
. <volume>4</volume>
:<fpage>e179</fpage>
. <pub-id pub-id-type="doi">10.1371/journal.pbio.0040179</pub-id>
<pub-id pub-id-type="pmid">16700627</pub-id>
</mixed-citation>
</ref>
<ref id="B44"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Trhan</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>The application of spiking neural networks in autonomous robot control</article-title>
. <source>Comput. Inform</source>
. <volume>29</volume>
, <fpage>823</fpage>
–<lpage>847</lpage>
.</mixed-citation>
</ref>
<ref id="B45"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Thompson</surname>
<given-names>R. F.</given-names>
</name>
<name><surname>Steinmetz</surname>
<given-names>J. E.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>The role of the cerebellum in classical conditioning of discrete behavioral responses</article-title>
. <source>Neuroscience</source>
<volume>162</volume>
, <fpage>732</fpage>
–<lpage>755</lpage>
. <pub-id pub-id-type="doi">10.1016/j.neuroscience.2009.01.041</pub-id>
<pub-id pub-id-type="pmid">19409234</pub-id>
</mixed-citation>
</ref>
<ref id="B46"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tyrrell</surname>
<given-names>T.</given-names>
</name>
<name><surname>Willshaw</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>1992</year>
). <article-title>Cerebellar cortex: its simulation and the relevance of Marr's theory</article-title>
. <source>Philos. Trans. R. Soc. Lond. B Biol. Sci</source>
. <volume>336</volume>
, <fpage>239</fpage>
–<lpage>257</lpage>
. <pub-id pub-id-type="doi">10.1098/rstb.1992.0059</pub-id>
<pub-id pub-id-type="pmid">1353267</pub-id>
</mixed-citation>
</ref>
<ref id="B47"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van der Smagt</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>Benchmarking cerebellar control</article-title>
. <source>Rob. Auton. Syst</source>
. <volume>32</volume>
, <fpage>237</fpage>
–<lpage>251</lpage>
<pub-id pub-id-type="doi">10.1016/S0921-8890(00)00090-7</pub-id>
</mixed-citation>
</ref>
<ref id="B48"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Verschure</surname>
<given-names>P. F.</given-names>
</name>
<name><surname>Voegtlin</surname>
<given-names>T.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>A bottom up approach towards the acquisition and expression of sequential representations applied to a behaving real-world device: distributed Adaptive Control III</article-title>
. <source>Neural Netw</source>
. <volume>11</volume>
, <fpage>1531</fpage>
–<lpage>1549</lpage>
. <pub-id pub-id-type="doi">10.1016/S0893-6080(98)00029-X</pub-id>
<pub-id pub-id-type="pmid">12662766</pub-id>
</mixed-citation>
</ref>
<ref id="B49"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Voegtlin</surname>
<given-names>T.</given-names>
</name>
<name><surname>Verschure</surname>
<given-names>P. F.</given-names>
</name>
</person-group>
(<year>1999</year>
). <article-title>What can robots tell us about brains? A synthetic approach towards the study of learning and problem solving</article-title>
. <source>Rev. Neurosci</source>
. <volume>10</volume>
, <fpage>291</fpage>
–<lpage>310</lpage>
. <pub-id pub-id-type="doi">10.1515/REVNEURO.1999.10.3-4.291</pub-id>
<pub-id pub-id-type="pmid">10526893</pub-id>
</mixed-citation>
</ref>
<ref id="B50"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Welsh</surname>
<given-names>J. P.</given-names>
</name>
<name><surname>Harvey</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Acute inactivation of the inferior olive blocks associative learning</article-title>
. <source>Eur. J. Neurosci</source>
. <volume>10</volume>
, <fpage>3321</fpage>
–<lpage>3332</lpage>
. <pub-id pub-id-type="doi">10.1046/j.1460-9568.1998.00400.x</pub-id>
<pub-id pub-id-type="pmid">9824445</pub-id>
</mixed-citation>
</ref>
<ref id="B51"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yamamoto</surname>
<given-names>K.</given-names>
</name>
<name><surname>Kawato</surname>
<given-names>M.</given-names>
</name>
<name><surname>Kotosaka</surname>
<given-names>S.</given-names>
</name>
<name><surname>Kitazawa</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Encoding of movement dynamics by Purkinje cell simple spike activity during fast arm movements under resistive and assistive force fields</article-title>
. <source>J. Neurophysiol</source>
. <volume>97</volume>
, <fpage>1588</fpage>
–<lpage>1599</lpage>
. <pub-id pub-id-type="doi">10.1152/jn.00206.2006</pub-id>
<pub-id pub-id-type="pmid">17079350</pub-id>
</mixed-citation>
</ref>
<ref id="B52"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yamazaki</surname>
<given-names>T.</given-names>
</name>
<name><surname>Igarashi</surname>
<given-names>J.</given-names>
</name>
</person-group>
(<year>2013</year>
). <article-title>Realtime cerebellum: a large-scale spiking network model of the cerebellum that runs in realtime using a graphics processing unit</article-title>
. <source>Neural Netw</source>
. <volume>47</volume>
, <fpage>103</fpage>
–<lpage>111</lpage>
. <pub-id pub-id-type="doi">10.1016/j.neunet.2013.01.019</pub-id>
<pub-id pub-id-type="pmid">23434303</pub-id>
</mixed-citation>
</ref>
<ref id="B53"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yamazaki</surname>
<given-names>T.</given-names>
</name>
<name><surname>Nagao</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>2012</year>
). <article-title>A computational mechanism for unified gain and timing control in the cerebellum</article-title>
. <source>PLoS ONE</source>
<volume>7</volume>
:<fpage>e33319</fpage>
. <pub-id pub-id-type="doi">10.1371/journal.pone.0033319</pub-id>
<pub-id pub-id-type="pmid">22438912</pub-id>
</mixed-citation>
</ref>
<ref id="B54"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yamazaki</surname>
<given-names>T.</given-names>
</name>
<name><surname>Tanaka</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>The cerebellum as a liquid state machine</article-title>
. <source>Neural Netw</source>
. <volume>20</volume>
, <fpage>290</fpage>
–<lpage>297</lpage>
. <pub-id pub-id-type="doi">10.1016/j.neunet.2007.04.004</pub-id>
<pub-id pub-id-type="pmid">17517494</pub-id>
</mixed-citation>
</ref>
<ref id="B55"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname>
<given-names>W.</given-names>
</name>
<name><surname>Linden</surname>
<given-names>D. J.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Long-term depression at the mossy fiber–deep cerebellar nucleus synapse</article-title>
. <source>J. Neurosci</source>
. <volume>26</volume>
, <fpage>6935</fpage>
–<lpage>6944</lpage>
. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0784-06.2006</pub-id>
<pub-id pub-id-type="pmid">16807323</pub-id>
</mixed-citation>
</ref>
</ref-list>
<glossary><def-list><title>Abbreviations</title>
<def-item><term>CF</term>
<def><p>Climbing Fiber</p>
</def>
</def-item>
<def-item><term>CR</term>
<def><p>Conditioned Response</p>
</def>
</def-item>
<def-item><term>CS</term>
<def><p>Conditioned Stimulus</p>
</def>
</def-item>
<def-item><term>DCN</term>
<def><p>Deep Cerebellar Nucleus</p>
</def>
</def-item>
<def-item><term>EBCC</term>
<def><p>EyeBlink Classical Conditioning</p>
</def>
</def-item>
<def-item><term>GR</term>
<def><p>Granular cell</p>
</def>
</def-item>
<def-item><term>HR</term>
<def><p>Head Rotation</p>
</def>
</def-item>
<def-item><term>IO</term>
<def><p>Inferior Olive cell</p>
</def>
</def-item>
<def-item><term>ISI</term>
<def><p>Inter-Stimuli Interval</p>
</def>
</def-item>
<def-item><term>LTD</term>
<def><p>Long-Term Depression</p>
</def>
</def-item>
<def-item><term>LTP</term>
<def><p>Long-Term Potentiation</p>
</def>
</def-item>
<def-item><term>MF</term>
<def><p>Mossy Fiber</p>
</def>
</def-item>
<def-item><term>PC</term>
<def><p>Purkinje Cell</p>
</def>
</def-item>
<def-item><term>PF</term>
<def><p>Parallel Fiber</p>
</def>
</def-item>
<def-item><term>RMS</term>
<def><p>Root Mean Square</p>
</def>
</def-item>
<def-item><term>US</term>
<def><p>Unconditioned Stimulus</p>
</def>
</def-item>
<def-item><term>VOR</term>
<def><p>Vestibulo-Ocular Reflex.</p>
</def>
</def-item>
</def-list>
</glossary>
</back>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001D13 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 001D13 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Curation |type= RBID |clé= PMC:4340181 |texte= Distributed cerebellar plasticity implements generalized multiple-scale memory components in real-robot sensorimotor tasks }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:25762922" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |