Curation
Pmc
Racine
Curation
Checkpoint
Pmc
Racine
Pmc
Exploration
Accueil
Racine
Racine

Serveur d'exploration sur les dispositifs haptiques

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

Two different motor learning mechanisms contribute to learning reaching movements in a rotated visual environment

Identifieur interne : 000156 ( Pmc/Curation ); précédent : 000155; suivant : 000157

Two different motor learning mechanisms contribute to learning reaching movements in a rotated visual environment

Auteurs : Virginia Way Tong Chu [États-Unis] ; Terence David Sanger [États-Unis]

Source :

RBID : PMC:4670007

Abstract

Practice of movement in virtual-reality and other artificially altered environments has been proposed as a method for rehabilitation following neurological injury and for training new skills in healthy humans.  For such training to be useful, there must be transfer of learning from the artificial environment to the performance of desired skills in the natural environment.  Therefore an important assumption of such methods is that practice in the altered environment engages the same learning and plasticity mechanisms that are required for skill performance in the natural environment.  We test the hypothesis that transfer of learning may fail because the learning and plasticity mechanism that adapts to the altered environment is different from the learning mechanism required for improvement of motor skill.  In this paper, we propose that a model that separates skill learning and environmental adaptation is necessary to explain the learning and aftereffects that are observed in virtual reality experiments.  In particular, we studied the condition where practice in the altered environment should lead to correct skill performance in the original environment. Our 2-mechanism model predicts that aftereffects will still be observed when returning to the original environment, indicating a lack of skill transfer from the artificial environment to the original environment. To illustrate the model prediction, we tested 10 healthy participants on the interaction between a simple overlearned motor skill (straight hand movements to targets in different directions) and an artificially altered visuomotor environment (rotation of visual feedback of the results of movement).  As predicted by the models, participants show adaptation to the altered environment and after-effects on return to the baseline environment even when practice in the altered environment should have led to correct skill performance.  The presence of aftereffect under all conditions that involved changes in environment demonstrates separation of environmental adaptation and skill learning. Our results support the existence of two distinct learning modules with different adaptation properties.  Therefore we suggest that adaptation to an altered environment may not be useful for training new skills.


Url:
DOI: 10.12688/f1000research.3676.2
PubMed: 26673417
PubMed Central: 4670007

Links toward previous steps (curation, corpus...)

Links to Exploration step

PMC:4670007

Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Two different motor learning mechanisms contribute to learning reaching movements in a rotated visual environment</title>
<author>
<name sortKey="Chu, Virginia Way Tong" sort="Chu, Virginia Way Tong" uniqKey="Chu V" first="Virginia Way Tong" last="Chu">Virginia Way Tong Chu</name>
<affiliation wicri:level="1">
<nlm:aff id="a1">Department of Occupational Therapy, University of Illinois at Chicago, Chicago, IL 60612, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Occupational Therapy, University of Illinois at Chicago, Chicago, IL 60612</wicri:regionArea>
</affiliation>
</author>
<author>
<name sortKey="Sanger, Terence David" sort="Sanger, Terence David" uniqKey="Sanger T" first="Terence David" last="Sanger">Terence David Sanger</name>
<affiliation wicri:level="1">
<nlm:aff id="a2">Departments of Biomedical Engineering, Neurology, and Biokinesiology, University of Southern California, Los Angeles, CA 90089-1111, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Departments of Biomedical Engineering, Neurology, and Biokinesiology, University of Southern California, Los Angeles, CA 90089-1111</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">PMC</idno>
<idno type="pmid">26673417</idno>
<idno type="pmc">4670007</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4670007</idno>
<idno type="RBID">PMC:4670007</idno>
<idno type="doi">10.12688/f1000research.3676.2</idno>
<date when="2014">2014</date>
<idno type="wicri:Area/Pmc/Corpus">000156</idno>
<idno type="wicri:Area/Pmc/Curation">000156</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en" level="a" type="main">Two different motor learning mechanisms contribute to learning reaching movements in a rotated visual environment</title>
<author>
<name sortKey="Chu, Virginia Way Tong" sort="Chu, Virginia Way Tong" uniqKey="Chu V" first="Virginia Way Tong" last="Chu">Virginia Way Tong Chu</name>
<affiliation wicri:level="1">
<nlm:aff id="a1">Department of Occupational Therapy, University of Illinois at Chicago, Chicago, IL 60612, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Occupational Therapy, University of Illinois at Chicago, Chicago, IL 60612</wicri:regionArea>
</affiliation>
</author>
<author>
<name sortKey="Sanger, Terence David" sort="Sanger, Terence David" uniqKey="Sanger T" first="Terence David" last="Sanger">Terence David Sanger</name>
<affiliation wicri:level="1">
<nlm:aff id="a2">Departments of Biomedical Engineering, Neurology, and Biokinesiology, University of Southern California, Los Angeles, CA 90089-1111, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Departments of Biomedical Engineering, Neurology, and Biokinesiology, University of Southern California, Los Angeles, CA 90089-1111</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series>
<title level="j">F1000Research</title>
<idno type="eISSN">2046-1402</idno>
<imprint>
<date when="2014">2014</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass></textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">
<p>Practice of movement in virtual-reality and other artificially altered environments has been proposed as a method for rehabilitation following neurological injury and for training new skills in healthy humans.  For such training to be useful, there must be transfer of learning from the artificial environment to the performance of desired skills in the natural environment.  Therefore an important assumption of such methods is that practice in the altered environment engages the same learning and plasticity mechanisms that are required for skill performance in the natural environment.  We test the hypothesis that transfer of learning may fail because the learning and plasticity mechanism that adapts to the altered environment is different from the learning mechanism required for improvement of motor skill.  In this paper, we propose that a model that separates skill learning and environmental adaptation is necessary to explain the learning and aftereffects that are observed in virtual reality experiments.  In particular, we studied the condition where practice in the altered environment should lead to correct skill performance in the original environment. Our 2-mechanism model predicts that aftereffects will still be observed when returning to the original environment, indicating a lack of skill transfer from the artificial environment to the original environment. To illustrate the model prediction, we tested 10 healthy participants on the interaction between a simple overlearned motor skill (straight hand movements to targets in different directions) and an artificially altered visuomotor environment (rotation of visual feedback of the results of movement).  As predicted by the models, participants show adaptation to the altered environment and after-effects on return to the baseline environment even when practice in the altered environment should have led to correct skill performance.  The presence of aftereffect under all conditions that involved changes in environment demonstrates separation of environmental adaptation and skill learning. Our results support the existence of two distinct learning modules with different adaptation properties.  Therefore we suggest that adaptation to an altered environment may not be useful for training new skills.</p>
</div>
</front>
<back>
<div1 type="bibliography">
<listBibl>
<biblStruct>
<analytic>
<author>
<name sortKey="Abeele, S" uniqKey="Abeele S">S Abeele</name>
</author>
<author>
<name sortKey="Bock, O" uniqKey="Bock O">O Bock</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Bachman, Jc" uniqKey="Bachman J">JC Bachman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Baizer, Js" uniqKey="Baizer J">JS Baizer</name>
</author>
<author>
<name sortKey="Kralj Hans, I" uniqKey="Kralj Hans I">I Kralj-Hans</name>
</author>
<author>
<name sortKey="Glickstein, M" uniqKey="Glickstein M">M Glickstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Berthier, Ne" uniqKey="Berthier N">NE Berthier</name>
</author>
<author>
<name sortKey="Singh, Sp" uniqKey="Singh S">SP Singh</name>
</author>
<author>
<name sortKey="Barto, Ag" uniqKey="Barto A">AG Barto</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Bizzi, E" uniqKey="Bizzi E">E Bizzi</name>
</author>
<author>
<name sortKey="Abend, W" uniqKey="Abend W">W Abend</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Chen Harris, H" uniqKey="Chen Harris H">H Chen-Harris</name>
</author>
<author>
<name sortKey="Joiner, Wm" uniqKey="Joiner W">WM Joiner</name>
</author>
<author>
<name sortKey="Ethier, V" uniqKey="Ethier V">V Ethier</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Chu, Vwt" uniqKey="Chu V">VWT Chu</name>
</author>
<author>
<name sortKey="Sanger, Td" uniqKey="Sanger T">TD Sanger</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Della Maggiore, V" uniqKey="Della Maggiore V">V Della-Maggiore</name>
</author>
<author>
<name sortKey="Malfait, N" uniqKey="Malfait N">N Malfait</name>
</author>
<author>
<name sortKey="Ostry, Dj" uniqKey="Ostry D">DJ Ostry</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Doya, K" uniqKey="Doya K">K Doya</name>
</author>
<author>
<name sortKey="Kimura, H" uniqKey="Kimura H">H Kimura</name>
</author>
<author>
<name sortKey="Miyamura, A" uniqKey="Miyamura A">A Miyamura</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Fischer, B" uniqKey="Fischer B">B Fischer</name>
</author>
<author>
<name sortKey="Ramsperger, E" uniqKey="Ramsperger E">E Ramsperger</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gandolfo, F" uniqKey="Gandolfo F">F Gandolfo</name>
</author>
<author>
<name sortKey="Mussa Ivaldi, Fa" uniqKey="Mussa Ivaldi F">FA Mussa-Ivaldi</name>
</author>
<author>
<name sortKey="Bizzi, E" uniqKey="Bizzi E">E Bizzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gordon, Am" uniqKey="Gordon A">AM Gordon</name>
</author>
<author>
<name sortKey="Forssberg, H" uniqKey="Forssberg H">H Forssberg</name>
</author>
<author>
<name sortKey="Johansson, Rs" uniqKey="Johansson R">RS Johansson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Goodbody, Sj" uniqKey="Goodbody S">SJ Goodbody</name>
</author>
<author>
<name sortKey="Wolpert, Dm" uniqKey="Wolpert D">DM Wolpert</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Haith, Am" uniqKey="Haith A">AM Haith</name>
</author>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Henry, Fm" uniqKey="Henry F">FM Henry</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Huang, Vs" uniqKey="Huang V">VS Huang</name>
</author>
<author>
<name sortKey="Haith, A" uniqKey="Haith A">A Haith</name>
</author>
<author>
<name sortKey="Mazzoni, P" uniqKey="Mazzoni P">P Mazzoni</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Hwang, Ej" uniqKey="Hwang E">EJ Hwang</name>
</author>
<author>
<name sortKey="Smith, Ma" uniqKey="Smith M">MA Smith</name>
</author>
<author>
<name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Joiner, Wm" uniqKey="Joiner W">WM Joiner</name>
</author>
<author>
<name sortKey="Smith, Ma" uniqKey="Smith M">MA Smith</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kawato, M" uniqKey="Kawato M">M Kawato</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kelso, Jas" uniqKey="Kelso J">JAS Kelso</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kozak, Jj" uniqKey="Kozak J">JJ Kozak</name>
</author>
<author>
<name sortKey="Hancock, Pa" uniqKey="Hancock P">PA Hancock</name>
</author>
<author>
<name sortKey="Arthur, Ej" uniqKey="Arthur E">EJ Arthur</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
<author>
<name sortKey="Ghez, C" uniqKey="Ghez C">C Ghez</name>
</author>
<author>
<name sortKey="Ghilardi, Mf" uniqKey="Ghilardi M">MF Ghilardi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
<author>
<name sortKey="Ghilardi, Mf" uniqKey="Ghilardi M">MF Ghilardi</name>
</author>
<author>
<name sortKey="Ghez, C" uniqKey="Ghez C">C Ghez</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
<author>
<name sortKey="Mazzoni, P" uniqKey="Mazzoni P">P Mazzoni</name>
</author>
<author>
<name sortKey="Ghazizadeh, A" uniqKey="Ghazizadeh A">A Ghazizadeh</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
<author>
<name sortKey="Pine, Zm" uniqKey="Pine Z">ZM Pine</name>
</author>
<author>
<name sortKey="Ghilardi, Mf" uniqKey="Ghilardi M">MF Ghilardi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lotter, Ws" uniqKey="Lotter W">WS Lotter</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Malone, La" uniqKey="Malone L">LA Malone</name>
</author>
<author>
<name sortKey="Bastian, Aj" uniqKey="Bastian A">AJ Bastian</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Martin, Ta" uniqKey="Martin T">TA Martin</name>
</author>
<author>
<name sortKey="Keating, Jg" uniqKey="Keating J">JG Keating</name>
</author>
<author>
<name sortKey="Goodkin, Hp" uniqKey="Goodkin H">HP Goodkin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Martin, Ta" uniqKey="Martin T">TA Martin</name>
</author>
<author>
<name sortKey="Keating, Jg" uniqKey="Keating J">JG Keating</name>
</author>
<author>
<name sortKey="Goodkin, Hp" uniqKey="Goodkin H">HP Goodkin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mazzoni, P" uniqKey="Mazzoni P">P Mazzoni</name>
</author>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Morton, Sm" uniqKey="Morton S">SM Morton</name>
</author>
<author>
<name sortKey="Bastian, Aj" uniqKey="Bastian A">AJ Bastian</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Nagasaki, H" uniqKey="Nagasaki H">H Nagasaki</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Patton, Jl" uniqKey="Patton J">JL Patton</name>
</author>
<author>
<name sortKey="Mussa Ivaldi, Fa" uniqKey="Mussa Ivaldi F">FA Mussa-Ivaldi</name>
</author>
<author>
<name sortKey="Rymer, Wz" uniqKey="Rymer W">WZ Rymer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pine, Zm" uniqKey="Pine Z">ZM Pine</name>
</author>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
<author>
<name sortKey="Gordon, J" uniqKey="Gordon J">J Gordon</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Poggio, T" uniqKey="Poggio T">T Poggio</name>
</author>
<author>
<name sortKey="Girosi, F" uniqKey="Girosi F">F Girosi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Proteau, L" uniqKey="Proteau L">L Proteau</name>
</author>
<author>
<name sortKey="Marteniuk, Rg" uniqKey="Marteniuk R">RG Marteniuk</name>
</author>
<author>
<name sortKey="Levesque, L" uniqKey="Levesque L">L Lévesque</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rose, Fd" uniqKey="Rose F">FD Rose</name>
</author>
<author>
<name sortKey="Attree, Ea" uniqKey="Attree E">EA Attree</name>
</author>
<author>
<name sortKey="Johnson, Da" uniqKey="Johnson D">DA Johnson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sanger, Td" uniqKey="Sanger T">TD Sanger</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sanger, Td" uniqKey="Sanger T">TD Sanger</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sanner, Rm" uniqKey="Sanner R">RM Sanner</name>
</author>
<author>
<name sortKey="Slotine, Jje" uniqKey="Slotine J">JJE Slotine</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Schmidt, Ra" uniqKey="Schmidt R">RA Schmidt</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Schmidt, Ra" uniqKey="Schmidt R">RA Schmidt</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Schweighofer, N" uniqKey="Schweighofer N">N Schweighofer</name>
</author>
<author>
<name sortKey="Arbib, Ma" uniqKey="Arbib M">MA Arbib</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
<author>
<name sortKey="Moussavi, Zmk" uniqKey="Moussavi Z">ZMK Moussavi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
<author>
<name sortKey="Mussa Ivaldi, Fa" uniqKey="Mussa Ivaldi F">FA Mussa-Ivaldi</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
<author>
<name sortKey="Wise, Sp" uniqKey="Wise S">SP Wise</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Smith, Ma" uniqKey="Smith M">MA Smith</name>
</author>
<author>
<name sortKey="Ghazizadeh, A" uniqKey="Ghazizadeh A">A Ghazizadeh</name>
</author>
<author>
<name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Simon, Da" uniqKey="Simon D">DA Simon</name>
</author>
<author>
<name sortKey="Bjork, Ra" uniqKey="Bjork R">RA Bjork</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sing, Gc" uniqKey="Sing G">GC Sing</name>
</author>
<author>
<name sortKey="Smith, Ma" uniqKey="Smith M">MA Smith</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sveistrup, H" uniqKey="Sveistrup H">H Sveistrup</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Tanaka, H" uniqKey="Tanaka H">H Tanaka</name>
</author>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
<author>
<name sortKey="Sejnowski, Tj" uniqKey="Sejnowski T">TJ Sejnowski</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Thoroughman, Ka" uniqKey="Thoroughman K">KA Thoroughman</name>
</author>
<author>
<name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Tseng, Yw" uniqKey="Tseng Y">YW Tseng</name>
</author>
<author>
<name sortKey="Diedrichsen, J" uniqKey="Diedrichsen J">J Diedrichsen</name>
</author>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Vetter, P" uniqKey="Vetter P">P Vetter</name>
</author>
<author>
<name sortKey="Goodbody, Sj" uniqKey="Goodbody S">SJ Goodbody</name>
</author>
<author>
<name sortKey="Wolpert, Dm" uniqKey="Wolpert D">DM Wolpert</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Widrow, B" uniqKey="Widrow B">B Widrow</name>
</author>
<author>
<name sortKey="Hoff Me, Jr" uniqKey="Hoff Me J">Jr Hoff ME</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Widrow, B" uniqKey="Widrow B">B Widrow</name>
</author>
<author>
<name sortKey="Mccool, Jm" uniqKey="Mccool J">JM McCool</name>
</author>
<author>
<name sortKey="Larimore, Mg" uniqKey="Larimore M">MG Larimore</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wolpert, Dm" uniqKey="Wolpert D">DM Wolpert</name>
</author>
<author>
<name sortKey="Ghahramani, Z" uniqKey="Ghahramani Z">Z Ghahramani</name>
</author>
<author>
<name sortKey="Flanagan, Jr" uniqKey="Flanagan J">JR Flanagan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wulf, G" uniqKey="Wulf G">G Wulf</name>
</author>
<author>
<name sortKey="Shea, Ch" uniqKey="Shea C">CH Shea</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Zanone, Pg" uniqKey="Zanone P">PG Zanone</name>
</author>
<author>
<name sortKey="Kelso, Jas" uniqKey="Kelso J">JAS Kelso</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Zarahn, E" uniqKey="Zarahn E">E Zarahn</name>
</author>
<author>
<name sortKey="Weston, Gd" uniqKey="Weston G">GD Weston</name>
</author>
<author>
<name sortKey="Liang, J" uniqKey="Liang J">J Liang</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article">
<pmc-dir>properties open_access</pmc-dir>
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">F1000Res</journal-id>
<journal-id journal-id-type="iso-abbrev">F1000Res</journal-id>
<journal-id journal-id-type="pmc">F1000Research</journal-id>
<journal-title-group>
<journal-title>F1000Research</journal-title>
</journal-title-group>
<issn pub-type="epub">2046-1402</issn>
<publisher>
<publisher-name>F1000Research</publisher-name>
<publisher-loc>London, UK</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="pmid">26673417</article-id>
<article-id pub-id-type="pmc">4670007</article-id>
<article-id pub-id-type="doi">10.12688/f1000research.3676.2</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Research Article</subject>
</subj-group>
<subj-group>
<subject>Articles</subject>
<subj-group>
<subject>Cognitive Neuroscience</subject>
</subj-group>
<subj-group>
<subject>Motor Systems</subject>
</subj-group>
<subj-group>
<subject>Sensory Systems</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Two different motor learning mechanisms contribute to learning reaching movements in a rotated visual environment</article-title>
<fn-group content-type="pub-status">
<fn>
<p>[version 2; referees: 2 approved</p>
</fn>
</fn-group>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Chu</surname>
<given-names>Virginia Way Tong</given-names>
</name>
<xref ref-type="corresp" rid="c1">a</xref>
<xref ref-type="aff" rid="a1">1</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Sanger</surname>
<given-names>Terence David</given-names>
</name>
<xref ref-type="aff" rid="a2">2</xref>
</contrib>
<aff id="a1">
<label>1</label>
Department of Occupational Therapy, University of Illinois at Chicago, Chicago, IL 60612, USA</aff>
<aff id="a2">
<label>2</label>
Departments of Biomedical Engineering, Neurology, and Biokinesiology, University of Southern California, Los Angeles, CA 90089-1111, USA</aff>
</contrib-group>
<author-notes>
<corresp id="c1">
<label>a</label>
<email xlink:href="mailto:virginiawtchu@gmail.com">virginiawtchu@gmail.com</email>
</corresp>
<fn fn-type="con">
<p>Dr. Chu contributed to the conception, design, acquisition, analysis and interpretation of data; drafting and revising of the article; and final approval of the manuscript. Dr. Sanger contributed to the conception, design, and interpretation of data; drafting and revising of the article; and final approval of the manuscript.</p>
</fn>
<fn fn-type="conflict">
<p>
<bold>Competing interests: </bold>
No competing interests were disclosed.</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>10</day>
<month>12</month>
<year>2014</year>
</pub-date>
<pub-date pub-type="collection">
<year>2014</year>
</pub-date>
<volume>3</volume>
<elocation-id>72</elocation-id>
<history>
<date date-type="accepted">
<day>9</day>
<month>12</month>
<year>2014</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright: © 2014 Chu VWT and Sanger TD</copyright-statement>
<copyright-year>2014</copyright-year>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:type="simple" xlink:href="f1000research-3-6149.pdf"></self-uri>
<abstract>
<p>Practice of movement in virtual-reality and other artificially altered environments has been proposed as a method for rehabilitation following neurological injury and for training new skills in healthy humans.  For such training to be useful, there must be transfer of learning from the artificial environment to the performance of desired skills in the natural environment.  Therefore an important assumption of such methods is that practice in the altered environment engages the same learning and plasticity mechanisms that are required for skill performance in the natural environment.  We test the hypothesis that transfer of learning may fail because the learning and plasticity mechanism that adapts to the altered environment is different from the learning mechanism required for improvement of motor skill.  In this paper, we propose that a model that separates skill learning and environmental adaptation is necessary to explain the learning and aftereffects that are observed in virtual reality experiments.  In particular, we studied the condition where practice in the altered environment should lead to correct skill performance in the original environment. Our 2-mechanism model predicts that aftereffects will still be observed when returning to the original environment, indicating a lack of skill transfer from the artificial environment to the original environment. To illustrate the model prediction, we tested 10 healthy participants on the interaction between a simple overlearned motor skill (straight hand movements to targets in different directions) and an artificially altered visuomotor environment (rotation of visual feedback of the results of movement).  As predicted by the models, participants show adaptation to the altered environment and after-effects on return to the baseline environment even when practice in the altered environment should have led to correct skill performance.  The presence of aftereffect under all conditions that involved changes in environment demonstrates separation of environmental adaptation and skill learning. Our results support the existence of two distinct learning modules with different adaptation properties.  Therefore we suggest that adaptation to an altered environment may not be useful for training new skills.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>motor learning, adaptation, visual rotation, reaching</kwd>
</kwd-group>
<funding-group>
<award-group id="fund-1">
<funding-source>National Institute of Health</funding-source>
<award-id>1103725-100-PAAWK</award-id>
</award-group>
<award-group id="fund-2">
<funding-source>Stanford University BIOX bioengineering graduate student fellowship</funding-source>
</award-group>
<award-group id="fund-3">
<funding-source>Crowley-Carter Foundation</funding-source>
</award-group>
<award-group id="fund-4">
<funding-source>Don and Linda Carter Foundation</funding-source>
</award-group>
<funding-statement>This study was conducted as part of a graduate research work at Stanford University, supported by grant 1103725-100-PAAWK from the National Institute of Health to Dr. Sanger, as well as by the Stanford University BIOX bioengineering graduate student fellowship. We acknowledge additional funding from the Crowley-Carter Foundation and the Don and Linda Carter Foundation.</funding-statement>
</funding-group>
</article-meta>
<notes notes-type="version-changes">
<sec>
<label>Revised</label>
<title>Amendments from Version 1</title>
<p>A few sections have been changed in the new version, accommodating the recommendations made by the referees. We have addressed the issues raised by the reviewers in the discussion. Figures and equations were edited for additional clarity. Also, additional statistical analysis (between subjects comparison) was performed to provide more information.</p>
</sec>
</notes>
</front>
<body>
<sec sec-type="intro">
<title>Introduction</title>
<p>Experiments in haptic (
<xref rid="ref-11" ref-type="bibr">Gandolfo
<italic>et al.</italic>
, 1996</xref>
;
<xref rid="ref-33" ref-type="bibr">Patton
<italic>et al.</italic>
, 2001</xref>
;
<xref rid="ref-45" ref-type="bibr">Shadmehr & Mussa-Ivaldi, 1994</xref>
) and virtual-reality environments (
<xref rid="ref-23" ref-type="bibr">Krakauer
<italic>et al.</italic>
, 1999</xref>
;
<xref rid="ref-34" ref-type="bibr">Pine
<italic>et al.</italic>
, 1996</xref>
) have repeatedly shown that movement will be altered by changes in environment, and may remain altered for a short time after the original environment is restored (“motion aftereffect”). (
<xref rid="ref-8" ref-type="bibr">Della-Maggiore
<italic>et al.</italic>
, 2004</xref>
;
<xref rid="ref-52" ref-type="bibr">Thoroughman & Shadmehr, 2000</xref>
) This observation has led researchers to suggest that either the original adaptation or motion aftereffect could be used to train skills (
<xref rid="ref-37" ref-type="bibr">Rose
<italic>et al.</italic>
, 1996</xref>
;
<xref rid="ref-50" ref-type="bibr">Sveistrup, 2004</xref>
). Unfortunately, in most cases, the effect of the altered environment is only temporarily maintained, and thus there is no transfer of learning from the altered movement to normal skill performance (
<xref rid="ref-21" ref-type="bibr">Kozak
<italic>et al.</italic>
, 1993</xref>
). The lack of transfer between experimental conditions in virtual reality perturbations could be explained by the specificity of learning framework (
<xref rid="ref-15" ref-type="bibr">Henry, 1968</xref>
), which stated that transfer of learning depends on the specificity of the conditions of practice. Evidence supporting this framework stemmed from low correlations in skilled performance in similar tasks requiring similar motor skills (
<xref rid="ref-2" ref-type="bibr">Bachman, 1961</xref>
;
<xref rid="ref-26" ref-type="bibr">Lotter, 1960</xref>
). These studies suggested poor generalization of motor skills and conditions that facilitate transfer of learning appear to be very complex and task specific (
<xref rid="ref-36" ref-type="bibr">Proteau
<italic>et al.</italic>
, 1992</xref>
;
<xref rid="ref-58" ref-type="bibr">Wulf & Shea, 2002</xref>
). We hypothesize that the reason for the lack of transfer in adaptation tasks is that task learning and environment adaptation are performed by two separate learning systems.</p>
<p>Shadmehr and colleagues (
<xref rid="ref-47" ref-type="bibr">Smith
<italic>et al.</italic>
, 2006</xref>
) proposed that there are two learning systems of different time scales that underlie motor learning. These two learning systems are characterized by their time properties. The fast system responds strongly to error but also forgets rapidly, while the slow system responds weakly to error, but retains information. Recent evidence (
<xref rid="ref-6" ref-type="bibr">Chen-Harris
<italic>et al.</italic>
, 2008</xref>
) suggests that the fast system has the structure of a forward internal model and the slow system could be a motor command generator. The adaptation to visuo-motor perturbations has been shown to depend on the cerebellum, and is driven by the sensory prediction error rather than the motor error (
<xref rid="ref-53" ref-type="bibr">Tseng
<italic>et al.</italic>
, 2007</xref>
).</p>
<p>We suggest that these two systems can be separated based on their training signals rather than on their time scales. (
<xref rid="ref-30" ref-type="bibr">Mazzoni & Krakauer, 2006</xref>
) separated explicit cognitive strategies and implicit environmental adaptation in an experiment that tested the use of cognitive strategies to counter a visual rotation in a reaching task. Their results showed that implicit motor adaptations override explicit cognitive strategies, demonstrating the interactive nature of the two systems. In this paper, we present a mechanistic explanation through the use of a computational simulation. In particular, we suggest a system that responds to sensory prediction error and learns the structure of the sensory-motor dynamic environment (“fast system”), while another system responds to task performance error and learns the elements needed to perform a task (“slow system”). We further suggest that the two systems have very different generalization properties, so that while the sensory prediction error system can generalize broadly across the environment, the performance error system does not generalize to dissimilar tasks. These properties are consistent with two different and simultaneously-active learning systems, and we will simulate a simple model of this structure to compare with human data. The proposed structure is similar in spirit to a model originally proposed by Doya and colleagues, in which there are separate neuroanatomical regions for motor planning and for adaptation to changes in dynamics (
<xref rid="ref-9" ref-type="bibr">Doya
<italic>et al.</italic>
, 2001</xref>
).</p>
<p>Many experiments that use altered visuo-motor environments confound the two types of error, so that performance error is caused by sensory prediction error. In such cases it is not possible to distinguish the two learning systems. In order to distinguish the two systems we need to test the effect of sensory prediction error when performance error is zero, and the effect of performance error when sensory prediction error is zero. By doing so, we will show that the two systems have very different generalization properties, and therefore cannot be implemented by the same network. Recent studies have distinguished the two mechanisms into model-based learning and model-free learning (
<xref rid="ref-14" ref-type="bibr">Haith & Krakauer, 2013</xref>
;
<xref rid="ref-16" ref-type="bibr">Huang
<italic>et al.</italic>
, 2011</xref>
). Using modified visuomotor rotation experiments, Krakauer and colleagues showed the contribution of model-free learning in explaining faster relearning of visuomotor rotations. We build on this knowledge and further distinguish the two types of learning by the error that is used by each learning mechanism.</p>
<p>We use a very simple experimental paradigm. The “skill” that we test is the ability to make straight reaching movements to different targets on a pen tablet. This is a very simple and overlearned skill, but it provides a sufficient model for testing the hypothesis. Here we consider movements to different targets to represent different skills, since different movement directions require significant changes in the pattern and timing of muscles used. The “environment” that we test is the relation between hand movement on the pen tablet and the visual image of movement that is seen by the subject. Different rotations of the displayed hand movement with respect to the true hand movement are considered to be different sensory-motor environments.</p>
<p>We compare the results to three simple model structures for skill learning and environment adaptation (
<xref ref-type="fig" rid="f1">Figure 1</xref>
). Structure 1 consists of a single network, and structures 2 and 3 have increasingly more complex structure. Each has different generalization properties.
<bold>Structure 1</bold>
: Skill learning and environment adaptation are performed by a single shared network for all tasks (directions of hand movement) and all environments (visual rotations). This structure predicts that adaptation to a new environment will change performance on multiple targets. It also predicts that practice on one target will affect performance on other targets even without a change in environment. Thus both the environment and the task will generalize across multiple targets, and environment learning will have a broad effect on task learning.
<bold>Structure 2</bold>
: Task learning and environment adaptation are performed by a single distinct network for each target. This structure predicts that adaptation to a new environment will change performance only on the particular target practiced in that environment. Thus neither the environment nor the task will generalize across multiple targets, but environment learning will have a focused effect on task learning.
<bold>Structure 3</bold>
: Task learning is performed by a separate network for each target, but environment adaptation is performed by a single shared network. This structure predicts that adaptation to a new environment will change performance on multiple targets, but practice on one target will not affect performance of other targets. Thus the environment will generalize across multiple targets, but the task will not, and environment learning will have no effect on task learning because it is performed by a completely different subsystem. Note that we do not test the fourth implied possibility, in which the task generalizes across multiple targets but the environment does not, because this is not consistent with known previous results (
<xref rid="ref-13" ref-type="bibr">Goodbody & Wolpert, 1998</xref>
). Only structures 1 and 2 could permit environment adaptation to be useful for training tasks, since only in these structures are the parameters modified by environment adaptation also used for tasks (see
<xref ref-type="fig" rid="f1">Figure 1</xref>
).</p>
<fig fig-type="figure" id="f1" orientation="portrait" position="float">
<label>Figure 1. </label>
<caption>
<title>Different neural network models.</title>
<p>
<bold>A</bold>
. Structure (1) is a single learning network that adapts to both changes in skill and environment. The same system learns based on errors in the observed task.
<bold>B</bold>
. Structure (2) is a motor program model. Learning is performed by separate network for each task based again only on observed error.
<bold>C</bold>
. Structure (3) is a two system-learning model. This model splits into two groups of systems, where there is a separate system for each task, learning based on observed error, but a single inverse model for control of the environment, learning based on prediction errors.</p>
</caption>
<graphic xlink:href="f1000research-3-6149-g0000"></graphic>
</fig>
<p>In this study, we will reject structure 1 by showing that learning one task does not lead to aftereffects on a second task, and therefore show that sufficiently different tasks do not share parameters and are probably learned by distinct networks. Furthermore, we will reject structure 2 by showing that learning a new environment does lead to aftereffects when the environment returns to baseline, and therefore that multiple environments are learned by a single network with a single set of parameters. Our results support structure 3 by showing that learning one environment leads to aftereffects in a different environment, but learning one task does not affect learning of another task. Since adaptation to sensory-motor error generalizes broadly while task learning generalizes narrowly, we claim that environment learning and task learning cannot be implemented by the same network. An interesting consequence of the independence of the two systems is that when the task error is zero but the sensory-motor mismatch is nonzero, adaptation reduces the mismatch even at the expense of worsening the task error, confirming the results of (
<xref rid="ref-30" ref-type="bibr">Mazzoni & Krakauer, 2006</xref>
). Therefore adaptation to the environment is controlled independently of the task error, and our results will support the existence of two different learning systems that respond to two different types of error.</p>
<p>Motion aftereffect paradigms have provided useful results concerning generalization of adaptation to different task or environment parameters. (
<xref rid="ref-23" ref-type="bibr">Krakauer
<italic>et al.</italic>
, 1999</xref>
;
<xref rid="ref-44" ref-type="bibr">Shadmehr & Moussavi, 2000</xref>
;
<xref rid="ref-54" ref-type="bibr">Vetter
<italic>et al.</italic>
, 1999</xref>
;
<xref rid="ref-24" ref-type="bibr">Krakauer
<italic>et al.</italic>
, 2006</xref>
;
<xref rid="ref-17" ref-type="bibr">Hwang
<italic>et al.</italic>
, 2006</xref>
) Here, we show that the type of generalization depends on the type of error that drives learning, consistent with the hypothesis of two different learning systems that are distinguished by the error to which they respond and the way in which they generalize across the environment.</p>
</sec>
<sec>
<title>Simulations</title>
<p>One example of each of the three models was simulated. To do this, several assumptions were made. We assumed that the participants had already learnt the dynamics of their arm and know the motor commands for reaching movements. Therefore, the learning of the arm dynamics was not included in the model. Furthermore, we assumed that the participants would have already learnt what trajectory would solve the problem optimally from previous experience. Based on physiological studies, human movements are observed to have a bell-shaped velocity. (
<xref rid="ref-12" ref-type="bibr">Gordon
<italic>et al.</italic>
, 1991</xref>
;
<xref rid="ref-5" ref-type="bibr">Bizzi & Abend, 1983</xref>
). This type of velocity profile has been shown to be optimal for many cost criteria such as the minimum-jerk criterion in optimal controlled reaching (
<xref rid="ref-32" ref-type="bibr">Nagasaki, 1989</xref>
). For simplicity, the optimal controller (trajectory generator) was modeled with a desired trajectory generator, which generates a straight-line trajectory to the target with a bell-shaped velocity profile. The bell-shaped profile used is a normalized truncated Gaussian distribution function, which is lowered so that it has zero initial velocity.</p>
<sec>
<title>Model components</title>
<p>There were three components used in the models: the trajectory generator, the environment adapter and the online feedback controller. The use of these elements is illustrated in
<xref ref-type="fig" rid="f2">Figure 2</xref>
. From
<xref ref-type="fig" rid="f2">Figure 2</xref>
we see that in models A and B there is one environment adaptation module for every trajectory generation module. Therefore, in the simulations of models A and B we used the same network for trajectory generation and adaptation to the environment. Model A has a single network for trajectory generation and environment adaptation, while model B has a separate network for each task that learns both the trajectory and the environment. The separation of learning networks for each task is a simplification in modeling to replicate a task generator that generates a command trajectory for each desired target in a continuous fashion. With this simplification, we could use basis function networks to model task learning rather than other more complicated networks. In model C, there is a separate trajectory generator for each task but only a single environment adaptation module, so two different types of network must be used. In the trajectory generator module, the error signal is based on performance error, the error observed by the participant during each trial. For the environment adapter, the error that trains the network is based on the prediction error, the difference between the participant’s anticipation of movement and the actual observed movement.</p>
<fig fig-type="figure" id="f2" orientation="portrait" position="float">
<label>Figure 2. </label>
<caption>
<title>Block diagram of the three simulated models.</title>
<p>P (Plant) is the matrix that represents the rotation of the visual feedback. P
<sup>-1</sup>
is the internal inverse model of the plant. The desired trajectory generator uses a bell-shaped velocity profile to generate the desired trajectory. The “Time diff” block calculates the velocity sequence that would have produced the planned trajectory using the planned position sequence. Using the planned velocity sequence as the input command, the online correction takes the delayed error as a proportional correction term to give the new velocity to guide where the cursor should go relative to the current location. The learning networks in the models are basis function (BF) networks where each basis function is an increasing order monomial of time.
<bold>A</bold>
. Detailed simulation model for model
<bold>A</bold>
(simple learning model).
<bold>B</bold>
. Detailed structure for model
<bold>B</bold>
(motor program).
<bold>C</bold>
. Detailed structure for model
<bold>C</bold>
(two-system learning model).</p>
</caption>
<graphic xlink:href="f1000research-3-6149-g0001"></graphic>
</fig>
<p>For any task k, the desired trajectory generator creates a desired trajectory x
<sup>[k]</sup>
<sub>d</sub>
(t) and y
<sup>[k]</sup>
<sub>d</sub>
(t). This trajectory is compared with the observed feedback to generate the error signals x
<sub>e</sub>
(t) and y
<sub>e</sub>
(t). At each trial, the learning network produces the planned trajectory, x
<sub>p</sub>
(t) and y
<sub>p</sub>
(t). x
<sub>p</sub>
and y
<sub>p</sub>
are the input to a feedback controller. The feedback controller combines the planned trajectory and the error x
<sub>e</sub>
(t) and y
<sub>e</sub>
(t) at each point in movement in order to generate a motor command x
<sub>c</sub>
(t) and y
<sub>c</sub>
(t). The plant takes the motor command x
<sub>c</sub>
(t) and y
<sub>c</sub>
(t) (which is just a desired position on the pen tablet) and transforms it into the observed position x
<sub>s</sub>
(t) and y
<sub>s</sub>
(t) that is then available as sensory (visual) information. The plant transforms the motor command into the sensory output by rotating, so that
<mml:math id="math1">
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mfrac linethickness="0">
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>s</mml:mi>
</mml:msub>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>s</mml:mi>
</mml:msub>
</mml:mfrac>
<mml:mo>]</mml:mo>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mi>P</mml:mi>
<mml:mo>(</mml:mo>
<mml:mi>θ</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mfrac linethickness="0">
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>c</mml:mi>
</mml:msub>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>c</mml:mi>
</mml:msub>
</mml:mfrac>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
, where P(θ) is a 2×2 rotation matrix.</p>
<p>
<disp-formula>
<mml:math id="math2">
<mml:mrow>
<mml:mi>P</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>θ</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>c</mml:mi>
<mml:mi>o</mml:mi>
<mml:mi>s</mml:mi>
<mml:mi>θ</mml:mi>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
<mml:mi>n</mml:mi>
<mml:mi>θ</mml:mi>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
<mml:mo> </mml:mo>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mo>−</mml:mo>
<mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
<mml:mi>n</mml:mi>
<mml:mi>θ</mml:mi>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>c</mml:mi>
<mml:mi>o</mml:mi>
<mml:mi>s</mml:mi>
<mml:mi>θ</mml:mi>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>The sensory output is compared with the desired trajectory to generate the error signal x
<sub>e</sub>
= x
<sub>d</sub>
- x
<sub>s</sub>
, y
<sub>e</sub>
= y
<sub>d</sub>
- y
<sub>s</sub>
. The error signal is used in real-time for feedback control, and it is used at the end of each movement attempt to update the trajectory generator module. Assuming that the desired trajectory (x
<sub>d</sub>
, y
<sub>d</sub>
) is known, the goal of the trajectory generator is to minimize the cost function, ε, the norm of the error signal integrated over time.</p>
<p>
<disp-formula>
<mml:math id="math3">
<mml:mrow>
<mml:mi>ε</mml:mi>
<mml:mo>=</mml:mo>
<mml:mstyle displaystyle="true">
<mml:mrow>
<mml:mo>∫</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mo>‖</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>e</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>e</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>‖</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
<mml:mi>d</mml:mi>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>In addition to the above elements, model C includes a separate environment adaptation module that modifies the motor command x
<sub>c</sub>
y
<sub>c</sub>
and changes it to x′
<sub>c</sub>
y′
<sub>c</sub>
in order to compensate for changes in the plant (rotation). It performs this modification by using a plant inverse
<italic>P</italic>
<sup>–1</sup>
(
<italic>θ</italic>
) that predicts the correct motor command x′
<sub>c</sub>
y′
<sub>c</sub>
for any desired sensory output x
<sub>s</sub>
, y
<sub>s</sub>
. The plant inverse is learned by approximating the plant “forward model” from x′
<sub>c</sub>
y′
<sub>c</sub>
to x
<sub>s</sub>
, y
<sub>s</sub>
and then inverting the resulting 2×2 matrix. Note that in models A and B, a change in the environment results in a change in the trajectory generator because of the increased performance error x
<sub>e</sub>
and y
<sub>e</sub>
. In model C, a change in the environment will be compensated by the environment adaptation module and thus the trajectory generator module will not change.</p>
</sec>
<sec>
<title>Trajectory generator</title>
<p>The input to the trajectory generator was the x and y coordinates of the target location (x
<sub>t</sub>
, y
<sub>t</sub>
) as shown on the display. Using the given target (x
<sub>t</sub>
, y
<sub>t</sub>
), the desired trajectory generator generated a trajectory (x
<sub>d</sub>
(t), y
<sub>d</sub>
(t)) that it “hopes” to see on screen, based on the assumptions mentioned above (straight and bell shaped velocity).</p>
<p>The learning network was programmed as a basis function neural network. The basis functions used were polynomials of time up to degree n. Let W
<sub>x</sub>
∈ ℜ
<sup>n</sup>
and W
<sub>y</sub>
∈ ℜ
<sup>n</sup>
be unknown weight vectors. Then the output of the trajectory generator was written as</p>
<p>    x
<sub>p</sub>
(t) = Σ
<sub>i</sub>
W
<sub>xi</sub>
× Φ
<sub>i</sub>
(t)    and    y
<sub>p</sub>
(t) = Σ
<sub>i</sub>
W
<sub>yi</sub>
× Φ
<sub>i</sub>
(t)</p>
<p>where W
<sub>xi</sub>
and W
<sub>yi</sub>
were the i
<sup>th</sup>
elements of the W
<sub>x</sub>
and W
<sub>y</sub>
vectors and Φ
<sub>i</sub>
(t) is the i
<sup>th</sup>
degree monomial of t (Φ
<sub>i</sub>
(t) = t
<sup>i</sup>
). These weighted basis functions were passed through a summation operator to sum across all i
<sup>th</sup>
elements. The outputs x
<sub>p</sub>
(t) and y
<sub>p</sub>
(t) were then passed to the rest of the learning model. The outputs x
<sub>p</sub>
(t) and y
<sub>p</sub>
(t) specify the trajectory input provided to the feedback controller.</p>
<p>The weight vectors W
<sub>x</sub>
and W
<sub>y</sub>
were trained using the errors (x
<sub>e</sub>
(t), y
<sub>e</sub>
(t)) between the desired trajectory (x
<sub>d</sub>
(t), y
<sub>d</sub>
(t)) and the trajectory of the movement observed on the screen (x
<sub>s</sub>
(t), y
<sub>s</sub>
(t)). The training algorithm is the Widrow-Hoff “least mean squares” (LMS) training algorithm that is known to converge for stationary inputs. (
<xref rid="ref-55" ref-type="bibr">Widrow & Hoff, 1960</xref>
;
<xref rid="ref-56" ref-type="bibr">Widrow
<italic>et al.</italic>
, 1976</xref>
). Unfortunately, when used in a control system, the inputs are non-stationary and thus convergence of LMS is not guaranteed. Nevertheless, this is a commonly used algorithm that has been shown to perform well in adaptive control tasks (
<xref rid="ref-38" ref-type="bibr">Sanger, 1991</xref>
;
<xref rid="ref-39" ref-type="bibr">Sanger, 1994</xref>
;
<xref rid="ref-40" ref-type="bibr">Sanner & Slotine, 1992</xref>
) and it provides one of the simplest models of motor learning (
<xref rid="ref-4" ref-type="bibr">Berthier
<italic>et al.</italic>
, 1993</xref>
;
<xref rid="ref-43" ref-type="bibr">Schweighofer & Arbib, 1998</xref>
).</p>
<p>    x
<sub>e</sub>
(t) = x
<sub>d</sub>
(t) – x
<sub>s</sub>
(t)         and     y
<sub>e</sub>
(t) = y
<sub>d</sub>
(t) – y
<sub>s</sub>
(t)</p>
<p>    ∆W
<sub>xi</sub>
= λ Σ
<sub>j</sub>
x
<sub>e</sub>
(t
<sub>j</sub>
)Φ
<sub>i</sub>
(t
<sub>j</sub>
)   and    ∆W
<sub>yi</sub>
= λ Σ
<sub>j</sub>
y
<sub>e</sub>
(t
<sub>j</sub>
)Φ
<sub>i</sub>
(t
<sub>j</sub>
)    for all i</p>
<p>    W
<sub>x</sub>
= W
<sub>x</sub>
+ ∆W
<sub>x</sub>
            and     W
<sub>y</sub>
= W
<sub>y</sub>
+ ∆W
<sub>y</sub>
</p>
<p>λ was the learning rate of this system, i was the degree for the basis function described above, and j was the time index used for the summation of errors from the whole movement. Each weight (W
<sub>xi</sub>
and W
<sub>yi</sub>
) was updated after each trial, based on the errors from the whole movement. In models A and B, the output x
<sub>p</sub>
and y
<sub>p</sub>
represents both task learning and adaptation to the environment, since a change in the environment or the desired trajectory will lead to a change in error x
<sub>e</sub>
and y
<sub>e</sub>
that will modify the weights in the network. In model C, there is a separate stage of environment adaptation and thus this initial network is responsible only for adapting to changes in the task. In models B and C, the multiple neural network structure was simulated by storing multiple weight vectors W(k)
<sub>x</sub>
and W(k)
<sub>y</sub>
which can be trained or retrieved when needed for any particular task k.</p>
</sec>
<sec>
<title>Environment adapter</title>
<p>The environment adapter built an internal model of the environment,
<mml:math id="math4">
<mml:mover>
<mml:mi>P</mml:mi>
<mml:mo>ˆ</mml:mo>
</mml:mover>
</mml:math>
, giving predictions,
<mml:math id="math5">
<mml:msub>
<mml:mover>
<mml:mi>x</mml:mi>
<mml:mo>ˆ</mml:mo>
</mml:mover>
<mml:mi>s</mml:mi>
</mml:msub>
</mml:math>
,
<mml:math id="math6">
<mml:msub>
<mml:mover>
<mml:mi>y</mml:mi>
<mml:mo>ˆ</mml:mo>
</mml:mover>
<mml:mi>s</mml:mi>
</mml:msub>
</mml:math>
. The internal model was inverted to provide the environment inverse
<mml:math id="math7">
<mml:msup>
<mml:mover>
<mml:mi>P</mml:mi>
<mml:mo>ˆ</mml:mo>
</mml:mover>
<mml:mrow>
<mml:mo>–</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msup>
</mml:math>
. This gave the learning system a way to anticipate the rotational field and attempted to “undo” its effect. At each trial, the input to the environment inverse was the output from the feedback controller (x
<sub>c</sub>
(t), y
<sub>c</sub>
(t)). The model inverse produced the modified command trajectory (x′
<sub>c</sub>
(t), y′
<sub>c</sub>
(t)) that the system anticipated could invert the plant. This signal is then fed through both the plant and the plant model. By computing the error between the plant output and the plant model output (e
<sub>p</sub>
), the plant model
<mml:math id="math8">
<mml:mover accent="true">
<mml:mi>P</mml:mi>
<mml:mo>ˆ</mml:mo>
</mml:mover>
</mml:math>
, could be trained. Training of the plant model was done through the LMS algorithm. Since the posed problem was essentially solving a linear regression, the LMS is guaranteed to converge, assuming that the learning rate is not too large.</p>
<p>
<disp-formula>
<mml:math id="math9">
<mml:mrow>
<mml:msub>
<mml:mi>e</mml:mi>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>s</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>s</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
<mml:mo>−</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>x</mml:mi>
<mml:mo stretchy="true">^</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mi>s</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo stretchy="true">^</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mi>s</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
<mml:mo> </mml:mo>
<mml:mo> </mml:mo>
<mml:mo> </mml:mo>
<mml:mo> </mml:mo>
<mml:mi>Δ</mml:mi>
<mml:mover accent="true">
<mml:mi>P</mml:mi>
<mml:mo stretchy="true">^</mml:mo>
</mml:mover>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mi>α</mml:mi>
<mml:mi>e</mml:mi>
</mml:msub>
<mml:msub>
<mml:mi>e</mml:mi>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo> </mml:mo>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>x</mml:mi>
<mml:msub>
<mml:mo>'</mml:mo>
<mml:mi>c</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>y</mml:mi>
<mml:msub>
<mml:mo>'</mml:mo>
<mml:mi>c</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:msup>
</mml:mrow>
<mml:mo> </mml:mo>
<mml:mo> </mml:mo>
<mml:mo> </mml:mo>
<mml:mo> </mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>x</mml:mi>
<mml:msub>
<mml:mo>'</mml:mo>
<mml:mi>c</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>y</mml:mi>
<mml:msub>
<mml:mo>'</mml:mo>
<mml:mi>c</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>P</mml:mi>
</mml:mrow>
<mml:mo stretchy="true">^</mml:mo>
</mml:mover>
<mml:msup>
<mml:mo></mml:mo>
<mml:mrow>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msup>
<mml:mo> </mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>c</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>c</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>where α
<sub>e</sub>
was the learning rate of the system.</p>
</sec>
<sec>
<title>Online feedback correction</title>
<p>As a human participant would, the system in the simulation should also be allowed to correct errors online. Therefore, an online feedback correction controller was implemented. The planned trajectory (x
<sub>p</sub>
, y
<sub>p</sub>
) from the trajectory planner was used as input to the controller and it was also given a feedback of the error “observed” on screen (x
<sub>s</sub>
, y
<sub>s</sub>
). This error was calculated based on the desired trajectory (x
<sub>d</sub>
, y
<sub>d</sub>
). The online feedback is delayed by 100ms, the same order of magnitude of recorded human visual reaction time. (
<xref rid="ref-10" ref-type="bibr">Fischer & Ramsperger, 1984</xref>
) The controller output was proportional control using the delayed feedback with a feedback gain γ, added to the feedforward control generated using x
<sub>p</sub>
and y
<sub>p</sub>
.</p>
<p>    v
<sub>x</sub>
(t) = x
<sub>p</sub>
(t) – x
<sub>p</sub>
(t-1)       v
<sub>y</sub>
(t) = y
<sub>p</sub>
(t) – y
<sub>p</sub>
(t-1)</p>
<p>    v’
<sub>x</sub>
(t) = v
<sub>x</sub>
(t) + γx
<sub>e</sub>
(t-t
<sub>d</sub>
)       v’
<sub>y</sub>
(t) = v
<sub>y</sub>
(t) + γy
<sub>e</sub>
(t-t
<sub>d</sub>
)</p>
<p>    x
<sub>c</sub>
(t) = x
<sub>c</sub>
(t-1) + v’
<sub>x</sub>
(t)      y
<sub>c</sub>
(t) = y
<sub>c</sub>
(t-1) + v’
<sub>y</sub>
(t)</p>
</sec>
</sec>
<sec>
<title>Experimental methods</title>
<p>In a visual rotation (VR) setting, there are two aspects to any task: vision (what the participant sees) and motor (the participant’s actual movement). In our experiment, the participants observed the visual feedback of their movement on a LCD monitor and performed the movement using their unseen hand under the monitor. We manipulated the relationship between movement and visual feedback in order to force the participants to adapt to a new motor-sensory map (environment). We determined whether this adaptation interfered with performance of a previously-learned task (straight line movements in different directions). In one experimental manipulation, participants were asked to make a movement that appeared visually the same, for example, moving toward the same target on the screen, but required a different hand movement due to a change in the visual-motor map. We will refer to this as “same task (target) different environment (visuo-motor map)”. In a second experimental manipulation, we asked the participant to make a movement to a different target but without a change in the visual-motor map. This required a change in the actual (unseen) hand movement, so we refer to this as “different task same environment”. In a third experimental manipulation, we asked the participant to make a movement to a different target, but the visual-motor map was changed so that successful performance occurred for the same hand movement in both cases. In other words, the change in target and the change in visual-motor map were in exactly opposite directions and cancel each other out. We refer to this case as “different task different environment”, although the required hand movement did not change. The movements were recorded using a pen tablet (Wacom, Intuos 2 XD-0912-R, Saitama, Japan) connected to a personal computer (Fujitsu, Lifebook T4010, Tokyo, Japan). The participants were asked to complete four short experiments. In each experiment, there were three blocks of 20 reaching trials, reaching from the center of the screen to a target location on a circle. The first and third block were always under the same experimental condition and in the second block, we changed the vision and/or the motor aspect of the task. The experiment was designed to determine whether the condition in the second block interfered with performance of the skill attempted in the first block by causing aftereffects at the beginning of the third block. Thus the three blocks are namely, baseline, interference, and re-adaptation. The outcome measure was a comparison between baseline (before the interfering condition) and re-adaptation (after the interfering condition). The four experiments were carried out in a pseudorandom order for each subject, such that each subject completed all 4 experiments in a randomized order to minimize the effect of the familiarization of the task on any particular experimental condition.</p>
<p>Since straight-line reaching is a heavily practiced skill for most subjects, the visual environment was rotated 10 degrees clockwise in the baseline condition. The baseline condition was therefore no more familiar to subjects than the interference conditions, so subjects were unable to use their extensive prior experience with reaching to override errors induced by the adaptation. Changes in the rotation feedback (environment) were made relative to the baseline environment.</p>
<sec>
<title>Procedure</title>
<p>In experiment 1 (same task, different environment), the feedback of the movement in the interference block was rotated counterclockwise by 20° relative to baseline (see
<xref ref-type="fig" rid="f3">Figure 3</xref>
). The target location on the visual display was not changed. This was a typical aftereffects paradigm, where the subject was asked to perform the task with the same specification, but with a change in environment. Two things changed in the experimental condition between the first and second block of the experiment: the visuo-motor map and the movement the subject was required to make. In order to tease apart which is the main cause of the aftereffects, we designed experiment 2 and 3 to test each aspect. In experiment 2 (different task, same environment), the visual feedback was not rotated, but the target location moved in the interference block. This experiment was designed to look at interference between learning different hand movements. In experiment 3 (different task different environment), the feedback of the movement in the interference block was rotated counterclockwise by 20° relative to baseline. The target location (task) in state B was also rotated by the same amount in the opposite direction to keep the required arm movement the same. This experiment was designed to look at the effect of changes in the visuo-motor map (environment) without a change in the hand movement required to solve the problem. However, in order to test, the target location had to be different between the baseline and interference conditions. Therefore, a fourth experiment, Experiment 4 (different task, different environment) was designed as a control for experiment 3 where the visual display was not changed throughout the three blocks. The purpose of this control is to ensure that the effects in experiment 3 were not simply due to the altered sensory display. In the baseline condition, instead of asking the subjects to reach to the target location, we placed the target at 20°, and asked the participant to reach to 40°. Additional feedback was given in form of a score. The score was calculated as 100 - the target error (in degrees). The target error was calculated at the point when the subject’s hand/cursor crossed the circle where the target lies. In the interference block, the target was still kept at 20° and the feedback of the movement was rotated counterclockwise 20°. The participants were asked to reach to the target to keep the movement the same. Therefore, the visual display did not change although the target and environment did. We used this experiment to verify whether the results observed in experiment 3 could be explained by changes in the visual display and to separate the effects of changes in the intended movement from changes in sensory stimulus (visual display).</p>
<fig fig-type="figure" id="f3" orientation="portrait" position="float">
<label>Figure 3. </label>
<caption>
<title>Experimental procedure.</title>
<p>In each of the four experiments, there were three blocks, with 20 trials each. In the figure, the monitor represents what the participants saw during the experiment. The rectangle below represents the subjects’ arm movement. The dark circular dot represents the starting location, and the light colored dot represents the target presented to the participants during the experiment. The line in between the dots indicates the desired movement as observed on screen. Two striped marks on the side of the screen always indicate the “west” direction on the tablet, which was used as an indicator to the participants to let them know which environment they are in. Figures
<bold>A</bold>
,
<bold>B</bold>
,
<bold>C</bold>
and
<bold>D</bold>
show the experimental setup for experiment 1, 2, 3 and 4 respectively.
<bold>E</bold>
and
<bold>F</bold>
show details of each experimental block.</p>
</caption>
<graphic xlink:href="f1000research-3-6149-g0002"></graphic>
</fig>
<p>Because subjects may make large errors following an unexpected change in the visual rotation, they were provided with a visual indication of the environment, and this indication also served as a warning when a change occurred. The indicator on screen marked the “west” direction on the pen tablet. Therefore, when the visual feedback was rotated, the indicator moved on the screen according to the rotation field. The participants were instructed to reach out from the center as fast and as straight as possible. If they completed the movement and reached the target within a time limit (1 s), the target would flash orange to indicate a success. After each trial, the participant was guided to move the cursor back to the starting location without direct feedback of the cursor location. On the screen, the participants were shown a circle whose radius represents the distance between the subject’s cursor and the starting location. The participants were told to move their cursor to minimize the size of the circle in order to move the hidden cursor back to the starting point.</p>
</sec>
<sec>
<title>Participants</title>
<p>Ten participants with no history of neurological diseases were recruited from Stanford University. The participants were between the age of 23 and 27, six males and four females. All participants were right-handed and performed the experiments with their right hand. Follow-up tests with another group of participants were carried out after the conclusion of the first study. The follow-up study was on the same rotation paradigm only with larger changes in rotation angles. For the follow up study, eight adult participants (average age: 25.4, five females and three males) were recruited for further tests. These eight participants did not participate as a subject in the first group. All except one of the follow-up study participants were right handed. All participants performed the tasks with their dominant hand. All procedures were approved by the Stanford University Institutional Review Board. Participants signed written consent for the experiment and HIPAA authorization for the use of personal data.</p>
</sec>
<sec>
<title>Data analysis</title>
<p>Data analysis was performed in MATLAB. The primary data were the samples of the pen tablet position sampled at 50Hz. The initial direction of movement was calculated as the angle of the line connecting the start location to the point of maximum velocity (
<xref rid="ref-23" ref-type="bibr">Krakauer
<italic>et al.</italic>
, 1999</xref>
). For each trial, the average and standard deviation of the initial reach angle for all participants were calculated. The extent of an aftereffect in each experiment was determined by comparing the first trial in state C with the baseline statistics computed from the last ten trials of state A. The baseline statistics, means (μ) and standard deviations (σ), were calculated for each experiment per participant. Using the measurement from the first trial of state C (x
<sub>c1</sub>
), the magnitude of the aftereffect was calculated as a z-score.</p>
<p>
<disp-formula>
<mml:math id="math10">
<mml:mrow>
<mml:mi>Z</mml:mi>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mrow>
<mml:mi>c</mml:mi>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:mi>μ</mml:mi>
</mml:mrow>
<mml:mi>σ</mml:mi>
</mml:mfrac>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>A larger z value is associated with a greater aftereffect. The presence of an aftereffect was tested statistically by performing a hypothesis test with α = 0.05. When |z| > 1.96, the null hypothesis (x
<sub>c1</sub>
belongs to the baseline distribution) was rejected, and we asserted the presence of a statistically significant aftereffect. Furthermore, we compared the magnitude of the aftereffects to the baseline trials and between experiments. The last trial in state A was compared to the first trial in state C for all 4 experiments using repeated measures ANOVA. The initial direction was the dependent measure, and the experiment (1 to 4) and the state (A and C) were the independent measures. Post-hoc pairwise statistics were performed using Fisher protected least square difference tests.</p>
</sec>
</sec>
<sec sec-type="results">
<title>Results</title>
<sec>
<title>Simulation results</title>
<p>Before the simulation of the experiment, the model was allowed to “practice” straight lines from the center to the various target location, without the rotation of the “visual feedback” (not shown in the figure). The models practiced several hundred straight lines movements to targets at 0° (straight up), 20°, 40° and 60°. This allowed the model to have relatively similar experience as a human subject, where humans are assumed to already know how to make straight lines to the various targets in the normal environment. The learning rates in the models were tuned by starting with very small values, and increasing them until the system was able to learn in approximately the same speed as the human subjects (within 20 trials). The online feedback gain was tuned to adjust the trajectories such that the trajectories would end at the target location. The system was approximately overdamped even if there was large initial error.</p>
<p>The simulations showed a small learning curve at the beginning of experiment 1. This was because the model has to learn to adapt to the +10° rotational field. The simulation started with doing experiment 1 and we did not program a break in between the experiments, so the computer could retain the +10° field learnt from before and did not show a learning curve in the beginning of experiment 2 and 3.</p>
<p>Our simulation results highlighted the following model predictions for each structure: Model A (Structure 1) predicted that practice on one target will affect performance on other targets even without a change in environment (
<xref ref-type="fig" rid="f4">Figure 4D</xref>
). Model B (Structure 2) predicted that adaptation to a new environment will change performance only on the particular target practiced in that environment (
<xref ref-type="fig" rid="f4">Figure 4H</xref>
). Model C (Structure 3) predicted that adaptation to a new environment will change performance on multiple targets (
<xref ref-type="fig" rid="f4">Figure 4I</xref>
), but practice on one target will not affect performance of other targets (
<xref ref-type="fig" rid="f4">Figure 4F</xref>
).</p>
</sec>
<sec>
<title>Human participant experimental results</title>
<p>According to the calculations outlined earlier (results shown in
<xref ref-type="table" rid="T1">Table 1</xref>
, raw data in
<xref ref-type="other" rid="B1">dataset 1</xref>
), in experiments 1 and 3, ten participants showed significant aftereffects that reached statistical significance (≥ 0.05); in experiment 4, nine participants showed aftereffects. In experiment 2, only three participants showed a significant aftereffect. In experiment 1, all subjects showed transient aftereffects both at the onset of the altered environment (first few trials of state B) and at the return to the baseline environment (first few trials of state C). This agrees with previous results and shows that subjects adapted to the altered environment in a way that suggests the presence of an adaptive internal model (
<xref rid="ref-19" ref-type="bibr">Kawato, 1999</xref>
;
<xref rid="ref-57" ref-type="bibr">Wolpert
<italic>et al.</italic>
, 2001</xref>
). Aftereffects were also seen in experiment 3 and 4. Note however, that although subjects achieved the desired performance in the altered environment (at the end of state B), the return to the baseline environment caused worsening of performance (beginning of state C) that only gradually returned to its original baseline. Aftereffects were not observed in experiment 2.</p>
<table-wrap id="T1" orientation="portrait" position="anchor">
<label>Table 1. </label>
<caption>
<title>Statistics of the aftereffect.</title>
<p>Represented in the table are the aftereffect z scores calculated for each participant for the 4 experiments (Exp). The bolded numbers are the ones considered significant under the assumption of α=0.05 (|z| > 1.96). The significant column (Sig.) in the table represents the number of z scores (out of 10) that are significant in that experiment. The table also includes results from the three models: + indicates a presence of aftereffects prediction and – indicates an absence of aftereffects prediction.</p>
</caption>
<table frame="hsides" rules="groups" content-type="article-table">
<thead>
<tr>
<th align="left" rowspan="1" colspan="1">Exp</th>
<th align="center" colspan="11" valign="middle" rowspan="1">Human participants</th>
<th align="center" colspan="3" valign="middle" rowspan="1">Model prediction</th>
</tr>
<tr>
<th rowspan="1" colspan="1"></th>
<th align="left" rowspan="1" colspan="1">1</th>
<th align="left" rowspan="1" colspan="1">2</th>
<th align="left" rowspan="1" colspan="1">3</th>
<th align="left" rowspan="1" colspan="1">4</th>
<th align="left" rowspan="1" colspan="1">5</th>
<th align="left" rowspan="1" colspan="1">6</th>
<th align="left" rowspan="1" colspan="1">7</th>
<th align="left" rowspan="1" colspan="1">8</th>
<th align="left" rowspan="1" colspan="1">9</th>
<th align="left" rowspan="1" colspan="1">10</th>
<th align="left" rowspan="1" colspan="1">Sig.</th>
<th align="left" rowspan="1" colspan="1">A</th>
<th align="left" rowspan="1" colspan="1">B</th>
<th align="left" rowspan="1" colspan="1">C</th>
</tr>
</thead>
<tbody>
<tr>
<td rowspan="1" colspan="1">1</td>
<td rowspan="1" colspan="1">
<bold>6.30</bold>
</td>
<td rowspan="1" colspan="1">
<bold>4.85</bold>
</td>
<td rowspan="1" colspan="1">
<bold>4.64</bold>
</td>
<td rowspan="1" colspan="1">
<bold>9.82</bold>
</td>
<td rowspan="1" colspan="1">
<bold>2.50</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.66</bold>
</td>
<td rowspan="1" colspan="1">
<bold>6.91</bold>
</td>
<td rowspan="1" colspan="1">
<bold>10.9</bold>
</td>
<td rowspan="1" colspan="1">
<bold>8.05</bold>
</td>
<td rowspan="1" colspan="1">
<bold>15.4</bold>
</td>
<td rowspan="1" colspan="1">10</td>
<td rowspan="1" colspan="1">+</td>
<td rowspan="1" colspan="1">+</td>
<td rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">1.48</td>
<td rowspan="1" colspan="1">1.81</td>
<td rowspan="1" colspan="1">1.78</td>
<td rowspan="1" colspan="1">1.40</td>
<td rowspan="1" colspan="1">
<bold>5.71</bold>
</td>
<td rowspan="1" colspan="1">0.69</td>
<td rowspan="1" colspan="1">-0.28</td>
<td rowspan="1" colspan="1">0.31</td>
<td rowspan="1" colspan="1">
<bold>2.30</bold>
</td>
<td rowspan="1" colspan="1">
<bold>2.20</bold>
</td>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">+</td>
<td rowspan="1" colspan="1">-</td>
<td rowspan="1" colspan="1">-</td>
</tr>
<tr>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">
<bold>4.77</bold>
</td>
<td rowspan="1" colspan="1">
<bold>7.13</bold>
</td>
<td rowspan="1" colspan="1">
<bold>7.31</bold>
</td>
<td rowspan="1" colspan="1">
<bold>6.75</bold>
</td>
<td rowspan="1" colspan="1">
<bold>5.51</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.83</bold>
</td>
<td rowspan="1" colspan="1">
<bold>2.94</bold>
</td>
<td rowspan="1" colspan="1">
<bold>2.96</bold>
</td>
<td rowspan="1" colspan="1">
<bold>6.42</bold>
</td>
<td rowspan="1" colspan="1">
<bold>6.14</bold>
</td>
<td rowspan="1" colspan="1">10</td>
<td rowspan="1" colspan="1">-</td>
<td rowspan="1" colspan="1">-</td>
<td rowspan="1" colspan="1">+</td>
</tr>
<tr>
<td rowspan="1" colspan="1">4</td>
<td rowspan="1" colspan="1">
<bold>2.11</bold>
</td>
<td rowspan="1" colspan="1">
<bold>2.21</bold>
</td>
<td rowspan="1" colspan="1">
<bold>10.6</bold>
</td>
<td rowspan="1" colspan="1">
<bold>5.65</bold>
</td>
<td rowspan="1" colspan="1">0.33</td>
<td rowspan="1" colspan="1">
<bold>5.04</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.52</bold>
</td>
<td rowspan="1" colspan="1">
<bold>2.12</bold>
</td>
<td rowspan="1" colspan="1">
<bold>5.28</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.54</bold>
</td>
<td rowspan="1" colspan="1">9</td>
<td rowspan="1" colspan="1">-</td>
<td rowspan="1" colspan="1">-</td>
<td rowspan="1" colspan="1">+</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>These results were confirmed using repeated measures ANOVA, examining the difference between the last trial of state A (baseline) and the first trial of state C (aftereffect), with the initial direction as the dependent measure, and the experiment (1 to 4) and the state (A and C) as the independent measures. The initial direction was statistically different between the experiments (F(3,27) = 13.18, p<0.0001) and between baseline and aftereffect (F(1,27) = 376.76, p<0.0001). The interaction between the experiment and state was also statistically significant (F(3,27) = 10.703, p<0.0001). The post hoc Fisher PLSD test showed that initial direction measure in state C (aftereffects) were significantly higher in experiment 1, 3, and 4 compared to experiment 2 (exp 1-2: p < 0.0001, exp 2-3: p = 0.0002, exp 2-4: p = 0.0072, see
<xref ref-type="fig" rid="f5">Figure 5E</xref>
).</p>
<p>By comparing
<xref ref-type="fig" rid="f4">Figure 4</xref>
and
<xref ref-type="fig" rid="f5">Figure 5</xref>
, we see that models A and B do not match the experimental results. Only model C is consistent with human results in all of the experiments and predicts aftereffects in experiments 1, 3, and 4, but not 2.
<xref ref-type="fig" rid="f6">Figure 6</xref>
shows several typical trajectories from a participant and simulations of model C. The terminal “hook” is due (in the model) to the feedback controlling online correction.</p>
<fig fig-type="figure" id="f4" orientation="portrait" position="float">
<label>Figure 4. </label>
<caption>
<title>Results from one simulation run of each model.</title>
<p>Results plotted are the initial angle (in degrees) of the simulated movement observed on screen against the trial number in that experiment. The solid black line represents the computer simulation results; whereas the dotted grey line represents the target presented for that trial. Experiment 4 was not simulated due to the nature of the experiment being very similar to experiment 3. To a computer simulation, experiment 3 and experiment 4 are the same as the difference between the two experiments comes from difference in visual display. The first column (
<bold>A</bold>
,
<bold>D</bold>
,
<bold>G</bold>
) are the results from model
<bold>A</bold>
, second column (
<bold>B</bold>
,
<bold>E</bold>
,
<bold>H</bold>
) are results from model
<bold>B</bold>
and the third column (
<bold>C</bold>
,
<bold>F</bold>
,
<bold>I</bold>
) are from model
<bold>C</bold>
. The first row (
<bold>A</bold>
,
<bold>B</bold>
,
<bold>C</bold>
) are results for experiment 1, the second row (
<bold>D</bold>
,
<bold>E</bold>
,
<bold>F</bold>
) are results for experiment 2, and the third row (
<bold>G</bold>
,
<bold>H</bold>
,
<bold>I</bold>
) are results for experiment 3.</p>
</caption>
<graphic xlink:href="f1000research-3-6149-g0003"></graphic>
</fig>
<fig fig-type="figure" id="f5" orientation="portrait" position="float">
<label>Figure 5. </label>
<caption>
<title>Experimental results of human participants.</title>
<p>The initial direction measurement of the movement observed on screen. This is the trial by trial average of all ten subjects. The error bars mark the standard deviation amongst the subjects and the dotted grey line represents the desired target angle observed on screen. The vertical axis is the initial direction measured in degrees and the horizontal axis is the trial number.
<bold>A</bold>
. Experiment 1, same task different environment.
<bold>B</bold>
. Experiment 2, different task same environment.
<bold>C</bold>
. Experiment 3, different task different environment.
<bold>D</bold>
. Experiment 4, different task different environment (same display target).
<bold>E</bold>
. Group mean of the last trial in state A (baseline) compared to the first trial in state C (aftereffects) in a bar graph. Asterisks indicate statistical significant difference between groups (p < 0.05).</p>
</caption>
<graphic xlink:href="f1000research-3-6149-g0004"></graphic>
</fig>
<fig fig-type="figure" id="f6" orientation="portrait" position="float">
<label>Figure 6. </label>
<caption>
<title>Trajectories of participants along with trajectories from the simulation of model C.</title>
<p>The trajectories are taken from Experiment 3. The participants plot contains the trajectories from all ten participants for that particular trial.
<bold>A</bold>
,
<bold>C</bold>
, and
<bold>E</bold>
are from participants.
<bold>B</bold>
,
<bold>D</bold>
, and
<bold>F</bold>
are from simulations.
<bold>A</bold>
and
<bold>B</bold>
are one of the baseline trajectories.
<bold>C</bold>
and
<bold>D</bold>
are from the interference state.
<bold>E</bold>
and
<bold>F</bold>
are from the readaptation state. In figures
<bold>C</bold>
–
<bold>F</bold>
, the black lines are from the first trial of the state, and the grey lines are from the last trial of the state.</p>
</caption>
<graphic xlink:href="f1000research-3-6149-g0005"></graphic>
</fig>
<p>In the follow-up study, a second group of participants (8 in total) were recruited to study the generalization of aftereffects in larger rotation angles. We repeated our first experiment with a 90° rotation between environments. The targets were also further apart. The targets were located at 90°, 180° and 270° rather than 20°, 40°, and 60° respectively. We call this the 90 degrees experiment. The results in the 90 degrees experiment are presented in
<xref ref-type="fig" rid="f7">Figure 7</xref>
and the statistics in
<xref ref-type="table" rid="T2">Table 2</xref>
, with the raw data in
<xref ref-type="other" rid="B1">dataset 2</xref>
.</p>
<fig fig-type="figure" id="f7" orientation="portrait" position="float">
<label>Figure 7. </label>
<caption>
<title>Experimental results for the 90° experiment.</title>
<p>The figure shows initial direction measurement of the movement observed on screen. This is the trial by trial average of all eight subjects. The error bars mark the standard deviation amongst the subjects and the dotted grey line represents the desired target angle observed on screen. The vertical axis is the initial direction measured in degrees and the horizontal axis is the trial number.
<bold>A</bold>
. Experiment 1, same task different environment.
<bold>B</bold>
. Experiment 2, different task same environment.
<bold>C</bold>
. Experiment 3, different task different environment.
<bold>D</bold>
. Experiment 4, different task different environment (same display target).E. Group mean of the last trial in state A (baseline) compared to the first trial in state C (aftereffects) in a bar graph. Asterisks indicate statistical significant difference between groups (p < 0.05).</p>
</caption>
<graphic xlink:href="f1000research-3-6149-g0006"></graphic>
</fig>
<table-wrap id="T2" orientation="portrait" position="anchor">
<label>Table 2. </label>
<caption>
<title>Statistics of the aftereffect in the 90 degrees rotation experiment.</title>
<p>Represented in the table are the aftereffect z scores calculated for each participant for the 4 experiments (Exp). The bolded numbers are the ones considered significant under the assumption of α=0.05 (|z| > 1.96). The significant column (Sig.) in the table represents the number of z scores (out of 8) that are significant in that experiment.</p>
</caption>
<table frame="hsides" rules="groups" content-type="article-table">
<thead>
<tr>
<th align="left" rowspan="1" colspan="1">Exp</th>
<th align="center" colspan="9" valign="middle" rowspan="1">Human participants</th>
</tr>
<tr>
<th rowspan="1" colspan="1"></th>
<th align="left" rowspan="1" colspan="1">1</th>
<th align="left" rowspan="1" colspan="1">2</th>
<th align="left" rowspan="1" colspan="1">3</th>
<th align="left" rowspan="1" colspan="1">4</th>
<th align="left" rowspan="1" colspan="1">5</th>
<th align="left" rowspan="1" colspan="1">6</th>
<th align="left" rowspan="1" colspan="1">7</th>
<th align="left" rowspan="1" colspan="1">8</th>
<th align="left" rowspan="1" colspan="1">Sig.</th>
</tr>
</thead>
<tbody>
<tr>
<td rowspan="1" colspan="1">1</td>
<td rowspan="1" colspan="1">
<bold>21.0</bold>
</td>
<td rowspan="1" colspan="1">
<bold>15.0</bold>
</td>
<td rowspan="1" colspan="1">
<bold>12.6</bold>
</td>
<td rowspan="1" colspan="1">
<bold>6.51</bold>
</td>
<td rowspan="1" colspan="1">1.92</td>
<td rowspan="1" colspan="1">
<bold>11.3</bold>
</td>
<td rowspan="1" colspan="1">0.19</td>
<td rowspan="1" colspan="1">
<bold>3.43</bold>
</td>
<td rowspan="1" colspan="1">6</td>
</tr>
<tr>
<td rowspan="1" colspan="1">2</td>
<td rowspan="1" colspan="1">1.63</td>
<td rowspan="1" colspan="1">
<bold>3.07</bold>
</td>
<td rowspan="1" colspan="1">
<bold>5.05</bold>
</td>
<td rowspan="1" colspan="1">0.58</td>
<td rowspan="1" colspan="1">-0.32</td>
<td rowspan="1" colspan="1">
<bold>6.69</bold>
</td>
<td rowspan="1" colspan="1">-0.25</td>
<td rowspan="1" colspan="1">
<bold>3.30</bold>
</td>
<td rowspan="1" colspan="1">4</td>
</tr>
<tr>
<td rowspan="1" colspan="1">3</td>
<td rowspan="1" colspan="1">
<bold>2.48</bold>
</td>
<td rowspan="1" colspan="1">
<bold>4.35</bold>
</td>
<td rowspan="1" colspan="1">1.75</td>
<td rowspan="1" colspan="1">
<bold>6.33</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.64</bold>
</td>
<td rowspan="1" colspan="1">
<bold>1.98</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.99</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.12</bold>
</td>
<td rowspan="1" colspan="1">7</td>
</tr>
<tr>
<td rowspan="1" colspan="1">4</td>
<td rowspan="1" colspan="1">1.17</td>
<td rowspan="1" colspan="1">
<bold>3.52</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.18</bold>
</td>
<td rowspan="1" colspan="1">
<bold>2.78</bold>
</td>
<td rowspan="1" colspan="1">
<bold>4.62</bold>
</td>
<td rowspan="1" colspan="1">
<bold>3.51</bold>
</td>
<td rowspan="1" colspan="1">
<bold>9.67</bold>
</td>
<td rowspan="1" colspan="1">
<bold>4.22</bold>
</td>
<td rowspan="1" colspan="1">7</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The results in the 90 degrees experiment were not as strong when compared to the original 20 degrees experiment. However, the conclusion still stands that in experiment 1, 3, and 4, the participants showed stronger aftereffects than in experiment 2. The initial errors that occurred in the interference state of experiment 2 showed the environment learner’s limited ability to generalize to targets that are far away from the initial training. Yet the observation that training of a new target in the second environment did not interfere with the performance of the initial target upon return to the re-adaptation state reinforces the separation of task learning and environment adaptation. Aftereffects were observed in experiment 3 and 4 indicating that the training in a different environment at a target 90° away from the initial target interfered with the initial training. The statistical results using repeated measures ANOVA showed that the initial direction was statistically different between baseline and aftereffect (F(1,21) = 53.437, p=0.0002), but no statistical difference was observed between the experiments (F(3,21) = 1.739, p=0.1897, see
<xref ref-type="fig" rid="f7">Figure 7E</xref>
).</p>
<p id="B1">
<supplementary-material content-type="local-data">
<caption>
<title>Data from motor learning experiments</title>
<p>Dataset 1. Data from original experiment Each column is the initial angle (in degrees) of arm movements for each participant and the model simulation of each trial. The reach target was also shown in degrees. A., B., C. and D. contains data for experiment 1, 2, 3 and 4. Model simulations were only included for dataset 1A, 1B and 1C.</p>
<p>Dataset 2. Data from 90 degrees rotation experiment Each column is the initial angle (in degrees) of arm movements for each participant in the second experiment. The reach target was also shown in degrees. A., B., C. and D. contains data for experiment 1, 2, 3 and 4.</p>
</caption>
<media xlink:href="f1000research-3-6149-s0000.tgz">
<caption>
<p>Click here for additional data file.</p>
</caption>
</media>
<permissions>
<copyright-statement>Copyright: © 2014 Chu VWT and Sanger TD</copyright-statement>
<copyright-year>2014</copyright-year>
<license xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">
<license-p>Data associated with the article are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).</license-p>
</license>
</permissions>
</supplementary-material>
</p>
</sec>
</sec>
<sec sec-type="discussion">
<title>Discussion</title>
<p>Consistent with prior force and rotation field studies (
<xref rid="ref-11" ref-type="bibr">Gandolfo
<italic>et al.</italic>
, 1996</xref>
;
<xref rid="ref-28" ref-type="bibr">Martin
<italic>et al.</italic>
, 1996</xref>
;
<xref rid="ref-33" ref-type="bibr">Patton
<italic>et al.</italic>
, 2001</xref>
;
<xref rid="ref-45" ref-type="bibr">Shadmehr & Mussa-Ivaldi, 1994</xref>
), participants showed transient aftereffects when they returned to the original experimental condition after practicing in a different rotational field (experiment 1). However, aftereffects did not occur following a change in the task (experiment 2). Aftereffects did occur in a different rotational field even when the task was adjusted so that the required hand movement did not change between conditions (experiment 3). Aftereffects also occurred in a different rotational field when both the visual display and the required hand movement did not change (experiment 4).</p>
<p>Aftereffects can be considered a type of interference between conditions in which the prior condition affects the initial performance in the subsequent condition. Our results show that interference between conditions occurs if and only if there is a change in the rotational field (the environment). A change in the target task is not sufficient, by itself, to cause interference or aftereffects. Since changes to the environment interfere with each other (experiment 1, 3, and 4), the results suggest that there is only a single environment internal model that adapts and re-adapts (thereby showing aftereffects); whereas there are multiple independent modules for task performance (experiment 2). In this model simulation (Model B and C), we considered each reaching target to have independent but similar learning networks. In reality, this is not realistic as it would require a potentially infinite number of learning networks to model all possible reaching directions. There must be a balance between the ability to switch between tasks quickly and the resources needed for simultaneous storage of multiple learning networks. This is likely accomplished through a structure that is different from our current understanding and requires further research.</p>
<p>The most important observation comes from experiment 3, in which environment adaptation exactly compensated for errors in task performance. In this experiment, adaptation to the rotation of the visual environment caused the hand movement to solve the desired task. Immediately after the visual environment was returned to the baseline, the next attempted hand movement should have low error. If environment adaptation and task learning shared a common mechanism, then the low task error should have resulted in continued good performance. However, as soon as the environment returned to baseline, there was a higher than expected sensory-motor mismatch, and the subjects responded by adapting to the mismatch, even though this resulted in worsening task error. Therefore environment adaptation is not controlled by task performance error. This result is similar to the results of Mazzoni and Krakauer and probably is due to the same mechanism (
<xref rid="ref-30" ref-type="bibr">Mazzoni & Krakauer, 2006</xref>
). Our results strongly imply that the two systems use different learning mechanisms. An important consequence is that for this very simple set of tasks, adaptation to an altered environment does not lead to improvements in task performance.</p>
<p>This conclusion is supported by the model simulations. From
<xref ref-type="fig" rid="f4">Figure 4</xref>
and
<xref ref-type="fig" rid="f5">Figure 5</xref>
we see that model A is not consistent with the human data since there are aftereffects in experiment 2 in the model but not in the human data. Model B is not consistent since there are no aftereffects in experiment 3 in the model but there are in the human data. Only model C correctly predicts the presence of aftereffects in experiments 1 and 3 but not in experiment 2. Model C includes separate networks for each task, but a shared network that adapts to the environment. Thus the match between data and simulations of model C supports our hypothesis.</p>
<p>Although the focus of this study is on typical motor behavior, we can suggest hypotheses about patient deficits using our model simulations. Research has shown that patients with cerebellar disorders have difficulties with environmental adaptation and demonstrate perseverant behavior when switching between environments (
<xref rid="ref-3" ref-type="bibr">Baizer
<italic>et al.</italic>
, 1999</xref>
;
<xref rid="ref-28" ref-type="bibr">Martin
<italic>et al.</italic>
1996a</xref>
;
<xref rid="ref-31" ref-type="bibr">Morton & Bestian, 2006</xref>
). These patients demonstrate ability to learn a new movement but when introduced to a new environment, they show no adaptation, hence no aftereffects. In some circumstances, there has been early evidence that showed this inability to adapt to environmental differences can be used to temporarily improve movement patterns in these patients (
<xref rid="ref-27" ref-type="bibr">Malone & Bastian, 2014</xref>
). The lack of environmental adaptation is similar to the simulation results of model B, demonstrating a lack of aftereffects in Experiment 3. The other difference between our simulation and patients with cerebellar disorder is the learning rate. In our simulation, we used a relatively fast learning rate to simulate typical adult performance, but patients with any movement disorders often have a slower learning rate. Without a separate environmental learning network, there will be no adaptation to changes in the environment and a slower learning rate will require more trials for equivalent performance in this population.</p>
<p>These experimental results are consistent with prior results on generalization (
<xref rid="ref-25" ref-type="bibr">Krakauer
<italic>et al.</italic>
, 2000</xref>
;
<xref rid="ref-54" ref-type="bibr">Vetter
<italic>et al.</italic>
, 1999</xref>
). Previous studies concluded that environment adaptation to visuomotor rotation has good generalization properties for targets within 45°. This is consistent with the aftereffects the participants and the model simulations showed in our 20° rotation experiments. However, based on these previous results, aftereffects were not consistently observed for the targets were more than 45° apart from each other. In order to test the generalization of the model to targets more than 45° apart, we performed the 90 degree experiment. If there were no generalization of the environment adaptation to targets more than 45° apart, there should be no aftereffects in experiments 3 or 4, where the participants were trained in a different environment at a target that was 90° away from the target used in the first environment. Since aftereffects were observed in the human subject results in experiments 3 and 4, we infer that environmental adaptation can be generalized to targets larger than 45° apart although the effects are smaller than the 20° rotations. This is consistent with previous research showing that visual rotations between 75° and 120° had smaller facilitation effects, as the brain appears to use different strategies for rotations beyond 90° (
<xref rid="ref-1" ref-type="bibr">Abeele & Bock, 2001</xref>
).</p>
<p>An important consequence of these experiments is that training in the rotated environment may not be helpful for improving task performance, especially in undamaged motor systems, since the rotated environment leads to modification of the environment adaptation module but not the task generation module. This is directly seen in the human data for experiment 3, in which the motor task remained the same under all conditions. Performance transiently worsened when the rotation returned to baseline, even though no change in hand movement was required to achieve correct performance. In the simulation model, this occurs because there are two different types of error that are used to train the two learning modules. When the baseline rotation is restored in experiment 3, the performance error e
<sub>x</sub>
, e
<sub>y</sub>
is zero, since the initial hand movement is correct. However, the plant inverse error, e
<sub>p</sub>
, is nonzero and thus the plant inverse learns (and motor performance changes) even though there was no performance error. This is an important distinction between the two systems. Task learning is driven by performance error, while environment adaptation is driven by predictions of the environment response, independent of the desired task. Therefore this model suggests that virtual reality adaptation may be insufficient to train task performance.</p>
<p>Our results are consistent with the common observation that a skill can often be performed in a different environment with substantially less retraining than originally required to learn the skill, described by Krakauer and colleagues as task-specific savings (
<xref rid="ref-22" ref-type="bibr">Krakauer
<italic>et al.</italic>
, 2005</xref>
). Our results are also consistent with the observation of transient aftereffects after changing the mechanics of the environment. Our results are also consistent with the ability to learn multiple new skills without forgetting previously-learned skills. Although previous models have addressed skill learning or environment adaptation separately, our results and model simulations represent one of the first quantitative studies to examine their interaction. A recent study (
<xref rid="ref-30" ref-type="bibr">Mazzoni & Krakauer, 2006</xref>
) on rotational field experiments concluded that implicit adaptation to a visuomotor rotation overrides the explicit strategies given by the experimenters. Despite the use of explicit cognitive strategies that opposes the visual rotation, experiment participants unconsciously adapted to the rotational field, making increasing errors to the target. The rate of adaptation was the similar with and without the explicit cognitive strategies, showing that implicit adaptation occur independent of the use of explicit strategies. The “implicit adaptation” is equivalent to the environment learning network in our model, and “explicit strategies” are equivalent to task learning in our model. Their results are consistent with our model, showing that two types of learning interact for visuo-motor adaptations. Our model provides a good framework to capture these two types of sensory-motor learning.</p>
<p>Our two-systems model was also consistent with the fast and slow adapting systems as Shadmehr and colleagues proposed (
<xref rid="ref-47" ref-type="bibr">Smith
<italic>et al.</italic>
, 2006</xref>
). The two-rate learning model has been used to explain task interference (
<xref rid="ref-49" ref-type="bibr">Sing & Smith, 2010</xref>
), generalization (
<xref rid="ref-51" ref-type="bibr">Tanaka
<italic>et al.</italic>
, 2012</xref>
), savings (
<xref rid="ref-60" ref-type="bibr">Zarahn
<italic>et al.</italic>
, 2008</xref>
) and retention (
<xref rid="ref-18" ref-type="bibr">Joiner & Smith, 2008</xref>
). We believe that our two system model will offer another perspective in differentiating the two learning systems. Our environment adaptor would behave similarly to the fast adapting system, and the trajectory generator would behave like the slow adapting system.</p>
<p>There are several weaknesses of the current model that need to be addressed in future experiments. The model does not explain the observation that learning two very similar skills can generate interference. Such an observation could be incorporated in a model in which different tasks are represented not by a set of discrete motor programs but by a parameterized or “fuzzy” mixture of motor programs perhaps using a local basis function network (
<xref rid="ref-35" ref-type="bibr">Poggio & Girosi, 1990</xref>
). The model also does not explain the observation that after extensive practice it is possible to switch between two environments (e.g. prism glasses) almost instantly (
<xref rid="ref-29" ref-type="bibr">Martin
<italic>et al.</italic>
, 1996</xref>
;
<xref rid="ref-46" ref-type="bibr">Shadmehr & Wise, 2005</xref>
). This observation could be incorporated using an environment learning model that can learn to respond to cues indicating a change in the environment. Our model does not yet explain differences in performance following blocked or interleaved practice (
<xref rid="ref-48" ref-type="bibr">Simon & Bjork, 2001</xref>
). This would depend upon the details of the task learning and environment adaptation algorithms. For instance in certain neural network algorithms, blocked practice (as in our experiment) might be more likely to retrain existing weights to fit the most recent condition, while interleaved practice might be more likely to fit the network output so that it performs correctly in multiple different conditions. Furthermore, our models were limited to using errors in the visual domain and did not capture performance measures and errors in other domains important to motor performance such as proprioception. Incorporation of multi-dimensional sensory information is needed to fully capture human motor learning and to explain behaviors in proprioception-driven tasks.</p>
<p>The two learning systems proposed in the model are analogous to two types of control systems. The task learning system can be compared to an optimal controller that learns a desired trajectory that will achieve the task goal. The environment learning system can be compared to an adaptive controller that learns the motor commands required to achieve the desired trajectory in the current environment. This is similar to the differing neuro-anatomical modules in Doya’s proposed framework (
<xref rid="ref-9" ref-type="bibr">Doya
<italic>et al.</italic>
, 2001</xref>
). In this context, it is interesting to speculate whether errors in the adaptive controller could facilitate or interfere with learning in the optimal controller. If so, then it might be possible to use our model to redesign current virtual-reality training programs so that a change in the environment that leads to a change in the adaptive controller might also facilitate task learning. In future studies we plan to study this potential interaction, and we plan to investigate the interaction of the two learning systems for more complex tasks in which the dynamics of movement must be learned.</p>
<sec>
<title>Informed consent</title>
<p>Participants signed written consent for the experiment and HIPAA authorization for the use of personal data.</p>
</sec>
<sec>
<title>Data availability</title>
<p>The data referenced by this article are under copyright with the following copyright statement: Copyright: © 2014 Chu VWT and Sanger TD</p>
<p>Data associated with the article are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).
<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/"></ext-link>
</p>
<p>
<italic>figshare</italic>
: Data from motor learning experiments, doi:
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.6084/m9.figshare.957526">10.6084/m9.figshare.957526</ext-link>
(
<xref rid="ref-7" ref-type="bibr">Chu & Sanger, 2014</xref>
).</p>
</sec>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>The authors would like to thank Dr. Denise Y. P. Henriques for her invaluable comments and discussion.</p>
</ack>
<ref-list>
<ref id="ref-1">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Abeele</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Bock</surname>
<given-names>O</given-names>
</name>
</person-group>
:
<article-title>Sensorimotor adaptation to rotated visual input: different mechanisms for small versus large rotations.</article-title>
<source>
<italic>Exp Brain Res.</italic>
</source>
<year>2001</year>
;
<volume>140</volume>
(
<issue>4</issue>
):
<fpage>407</fpage>
–
<lpage>410</lpage>
.
<pub-id pub-id-type="doi">10.1007/s002210100846</pub-id>
<pub-id pub-id-type="pmid">11685393</pub-id>
</mixed-citation>
</ref>
<ref id="ref-2">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bachman</surname>
<given-names>JC</given-names>
</name>
</person-group>
:
<article-title>Specificity vs generality in learning and performing two large muscle motor tasks.</article-title>
<source>
<italic>Research Quarterly, Am Assoc for Health, Phys Ed and Recreation.</italic>
</source>
<year>1961</year>
;
<volume>32</volume>
(
<issue>1</issue>
):
<fpage>3</fpage>
–
<lpage>11</lpage>
.
<pub-id pub-id-type="doi">10.1080/10671188.1961.10762064</pub-id>
</mixed-citation>
</ref>
<ref id="ref-3">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baizer</surname>
<given-names>JS</given-names>
</name>
<name>
<surname>Kralj-Hans</surname>
<given-names>I</given-names>
</name>
<name>
<surname>Glickstein</surname>
<given-names>M</given-names>
</name>
</person-group>
:
<article-title>Cerebellar lesions and prism adaptation in macaque monkeys.</article-title>
<source>
<italic>J Neurophysiol.</italic>
</source>
<year>1999</year>
;
<volume>81</volume>
(
<issue>4</issue>
):
<fpage>1960</fpage>
–
<lpage>1965</lpage>
.
<pub-id pub-id-type="pmid">10200230</pub-id>
</mixed-citation>
</ref>
<ref id="ref-4">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Berthier</surname>
<given-names>NE</given-names>
</name>
<name>
<surname>Singh</surname>
<given-names>SP</given-names>
</name>
<name>
<surname>Barto</surname>
<given-names>AG</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Distributed representation of limb motor programs in arrays of adjustable pattern generators.</article-title>
<source>
<italic>J Cogn Neurosci.</italic>
</source>
<year>1993</year>
;
<volume>5</volume>
(
<issue>1</issue>
):
<fpage>56</fpage>
–
<lpage>78</lpage>
.
<pub-id pub-id-type="doi">10.1162/jocn.1993.5.1.56</pub-id>
<pub-id pub-id-type="pmid">23972120</pub-id>
</mixed-citation>
</ref>
<ref id="ref-5">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bizzi</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Abend</surname>
<given-names>W</given-names>
</name>
</person-group>
:
<article-title>Posture control and trajectory formation in single- and multi-joint arm movements.</article-title>
In: Motor control mechanisms in health and disease. New York: Raven Press.
<source>
<italic>Adv Neurol.</italic>
</source>
<year>1983</year>
;
<volume>39</volume>
:
<fpage>31</fpage>
–
<lpage>45</lpage>
.
<pub-id pub-id-type="pmid">6419552</pub-id>
</mixed-citation>
</ref>
<ref id="ref-6">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chen-Harris</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Joiner</surname>
<given-names>WM</given-names>
</name>
<name>
<surname>Ethier</surname>
<given-names>V</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Adaptive control of saccades via internal feedback.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>2008</year>
;
<volume>28</volume>
(
<issue>11</issue>
):
<fpage>2804</fpage>
–
<lpage>2813</lpage>
.
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5300-07.2008</pub-id>
<pmc-comment>2733833</pmc-comment>
<pub-id pub-id-type="pmid">18337410</pub-id>
</mixed-citation>
</ref>
<ref id="ref-7">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chu</surname>
<given-names>VWT</given-names>
</name>
<name>
<surname>Sanger</surname>
<given-names>TD</given-names>
</name>
</person-group>
:
<article-title>Data from motor learning experiments.</article-title>
<source>
<italic>figshare.</italic>
</source>
<year>2014</year>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.6084/m9.figshare.957526">Data Source</ext-link>
</mixed-citation>
</ref>
<ref id="ref-8">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Della-Maggiore</surname>
<given-names>V</given-names>
</name>
<name>
<surname>Malfait</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Ostry</surname>
<given-names>DJ</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Stimulation of the posterior parietal cortex interferes with arm trajectory adjustments during the learning of new dynamics.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>2004</year>
;
<volume>24</volume>
(
<issue>44</issue>
):
<fpage>9971</fpage>
–
<lpage>9976</lpage>
.
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.2833-04.2004</pub-id>
<pub-id pub-id-type="pmid">15525782</pub-id>
</mixed-citation>
</ref>
<ref id="ref-9">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Doya</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Kimura</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Miyamura</surname>
<given-names>A</given-names>
</name>
</person-group>
:
<article-title>Motor control: Neural models and systems theory.</article-title>
<source>
<italic>Int J Appl Math Comput Sci.</italic>
</source>
<year>2001</year>
;
<volume>11</volume>
(
<issue>1</issue>
):
<fpage>77</fpage>
–
<lpage>104</lpage>
.
<ext-link ext-link-type="uri" xlink:href="http://matwbn.icm.edu.pl/ksiazki/amc/amc11/amc1114.pdf">Reference Source</ext-link>
</mixed-citation>
</ref>
<ref id="ref-10">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fischer</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Ramsperger</surname>
<given-names>E</given-names>
</name>
</person-group>
:
<article-title>Human express saccades: extremely short reaction times of goal directed eye movements.</article-title>
<source>
<italic>Exp Brain Res.</italic>
</source>
<year>1984</year>
;
<volume>57</volume>
(
<issue>1</issue>
):
<fpage>191</fpage>
–
<lpage>195</lpage>
.
<pub-id pub-id-type="doi">10.1007/BF00231145</pub-id>
<pub-id pub-id-type="pmid">6519226</pub-id>
</mixed-citation>
</ref>
<ref id="ref-11">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gandolfo</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Mussa-Ivaldi</surname>
<given-names>FA</given-names>
</name>
<name>
<surname>Bizzi</surname>
<given-names>E</given-names>
</name>
</person-group>
:
<article-title>Motor Learning by field approximation.</article-title>
<source>
<italic>Proc Natl Acad Sci USA.</italic>
</source>
<year>1996</year>
;
<volume>93</volume>
(
<issue>9</issue>
):
<fpage>3843</fpage>
–
<lpage>3846</lpage>
.
<pub-id pub-id-type="doi">10.1073/pnas.93.9.3843</pub-id>
<pmc-comment>39446</pmc-comment>
<pub-id pub-id-type="pmid">8632977</pub-id>
</mixed-citation>
</ref>
<ref id="ref-12">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gordon</surname>
<given-names>AM</given-names>
</name>
<name>
<surname>Forssberg</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Johansson</surname>
<given-names>RS</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Visual size cues in the programming of manipulative forces during precision grip.</article-title>
<source>
<italic>Exp Brain Res.</italic>
</source>
<year>1991</year>
;
<volume>83</volume>
(
<issue>3</issue>
):
<fpage>477</fpage>
–
<lpage>482</lpage>
.
<pub-id pub-id-type="doi">10.1007/BF00229824</pub-id>
<pub-id pub-id-type="pmid">2026190</pub-id>
</mixed-citation>
</ref>
<ref id="ref-13">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Goodbody</surname>
<given-names>SJ</given-names>
</name>
<name>
<surname>Wolpert</surname>
<given-names>DM</given-names>
</name>
</person-group>
:
<article-title>Temporal and amplitude generalization in motor learning.</article-title>
<source>
<italic>J Neurophysiol.</italic>
</source>
<year>1998</year>
;
<volume>79</volume>
(
<issue>4</issue>
):
<fpage>1825</fpage>
–
<lpage>1838</lpage>
.
<pub-id pub-id-type="pmid">9535951</pub-id>
</mixed-citation>
</ref>
<ref id="ref-14">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Haith</surname>
<given-names>AM</given-names>
</name>
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
</person-group>
:
<article-title>Model-based and model-free mechanisms of human motor learning.</article-title>
<source>
<italic>Adv Exp Med Biol.</italic>
</source>
<year>2013</year>
;
<volume>782</volume>
:
<fpage>1</fpage>
–
<lpage>21</lpage>
.
<pub-id pub-id-type="doi">10.1007/978-1-4614-5465-6_1</pub-id>
<pmc-comment>3570165</pmc-comment>
<pub-id pub-id-type="pmid">23296478</pub-id>
</mixed-citation>
</ref>
<ref id="ref-15">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Henry</surname>
<given-names>FM</given-names>
</name>
</person-group>
:
<article-title>Specificity vs. generality in learning motor skill</article-title>
. In Classical studies in physical activity, Brown RC Jr., Kenyon GS (Eds.), Englewood Cliffs, NJ, Prentice-Hall.
<year>1968</year>
;
<fpage>328</fpage>
–
<lpage>331</lpage>
.</mixed-citation>
</ref>
<ref id="ref-16">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Huang</surname>
<given-names>VS</given-names>
</name>
<name>
<surname>Haith</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Mazzoni</surname>
<given-names>P</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models.</article-title>
<source>
<italic>Neuron.</italic>
</source>
<year>2011</year>
;
<volume>70</volume>
(
<issue>4</issue>
):
<fpage>787</fpage>
–
<lpage>801</lpage>
.
<pub-id pub-id-type="doi">10.1016/j.neuron.2011.04.012</pub-id>
<pmc-comment>3134523</pmc-comment>
<pub-id pub-id-type="pmid">21609832</pub-id>
</mixed-citation>
</ref>
<ref id="ref-17">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hwang</surname>
<given-names>EJ</given-names>
</name>
<name>
<surname>Smith</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
</person-group>
:
<article-title>Adaptation and generalization in acceleration-dependent force fields.</article-title>
<source>
<italic>Exp Brain Res.</italic>
</source>
<year>2006</year>
;
<volume>169</volume>
(
<issue>4</issue>
):
<fpage>496</fpage>
–
<lpage>506</lpage>
.
<pub-id pub-id-type="doi">10.1007/s00221-005-0163-2</pub-id>
<pmc-comment>1456064</pmc-comment>
<pub-id pub-id-type="pmid">16292640</pub-id>
</mixed-citation>
</ref>
<ref id="ref-18">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Joiner</surname>
<given-names>WM</given-names>
</name>
<name>
<surname>Smith</surname>
<given-names>MA</given-names>
</name>
</person-group>
:
<article-title>Long-term retention explained by a model of short-term learning in the adaptive control of reaching.</article-title>
<source>
<italic>J Neurophysiol.</italic>
</source>
<year>2008</year>
;
<volume>100</volume>
(
<issue>5</issue>
):
<fpage>2948</fpage>
–
<lpage>2955</lpage>
.
<pub-id pub-id-type="doi">10.1152/jn.90706.2008</pub-id>
<pmc-comment>2585394</pmc-comment>
<pub-id pub-id-type="pmid">18784273</pub-id>
</mixed-citation>
</ref>
<ref id="ref-19">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kawato</surname>
<given-names>M</given-names>
</name>
</person-group>
:
<article-title>Internal models for motor control and trajectory planning.</article-title>
<source>
<italic>Curr Opin Neurobiol.</italic>
</source>
<year>1999</year>
;
<volume>9</volume>
(
<issue>6</issue>
):
<fpage>718</fpage>
–
<lpage>727</lpage>
.
<pub-id pub-id-type="doi">10.1016/S0959-4388(99)00028-8</pub-id>
<pub-id pub-id-type="pmid">10607637</pub-id>
</mixed-citation>
</ref>
<ref id="ref-20">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kelso</surname>
<given-names>JAS</given-names>
</name>
</person-group>
:
<article-title>Dynamic patterns: The self-organization of brain and behaviour.</article-title>
Cambridge, MA: MIT Press,
<year>1995</year>
<ext-link ext-link-type="uri" xlink:href="http://books.google.co.in/books/about/Dynamic_Patterns.html?id=caGqQgAACAAJ&redir_esc=y">Reference Source</ext-link>
</mixed-citation>
</ref>
<ref id="ref-21">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kozak</surname>
<given-names>JJ</given-names>
</name>
<name>
<surname>Hancock</surname>
<given-names>PA</given-names>
</name>
<name>
<surname>Arthur</surname>
<given-names>EJ</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Transfer of training from virtual reality.</article-title>
<source>
<italic>Ergonomics.</italic>
</source>
<year>1993</year>
;
<volume>36</volume>
(
<issue>7</issue>
):
<fpage>777</fpage>
–
<lpage>84</lpage>
.
<ext-link ext-link-type="uri" xlink:href="http://peterhancock.cos.ucf.edu/transfer-of-training-from-virtual-reality/">Reference Source</ext-link>
</mixed-citation>
</ref>
<ref id="ref-22">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
<name>
<surname>Ghez</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Ghilardi</surname>
<given-names>MF</given-names>
</name>
</person-group>
:
<article-title>Adaptation to visuomotor transformations: consolidation, interference, and forgetting.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>2005</year>
;
<volume>25</volume>
(
<issue>2</issue>
):
<fpage>473</fpage>
–
<lpage>478</lpage>
.
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4218-04.2005</pub-id>
<pub-id pub-id-type="pmid">15647491</pub-id>
</mixed-citation>
</ref>
<ref id="ref-23">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
<name>
<surname>Ghilardi</surname>
<given-names>MF</given-names>
</name>
<name>
<surname>Ghez</surname>
<given-names>C</given-names>
</name>
</person-group>
:
<article-title>Independent learning of internal models for kinematic and dynamic control of reaching.</article-title>
<source>
<italic>Nat Neurosci.</italic>
</source>
<year>1999</year>
;
<volume>2</volume>
(
<issue>11</issue>
):
<fpage>1026</fpage>
–
<lpage>1031</lpage>
.
<pub-id pub-id-type="doi">10.1038/14826</pub-id>
<pub-id pub-id-type="pmid">10526344</pub-id>
</mixed-citation>
</ref>
<ref id="ref-24">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
<name>
<surname>Mazzoni</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Ghazizadeh</surname>
<given-names>A</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Generalization of motor learning depends on the history of prior action.</article-title>
<source>
<italic>PLoS Biol.</italic>
</source>
<year>2006</year>
;
<volume>4</volume>
(
<issue>10</issue>
):
<fpage>e316</fpage>
.
<pub-id pub-id-type="doi">10.1371/journal.pbio.0040316</pub-id>
<pmc-comment>1563496</pmc-comment>
<pub-id pub-id-type="pmid">16968135</pub-id>
</mixed-citation>
</ref>
<ref id="ref-25">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
<name>
<surname>Pine</surname>
<given-names>ZM</given-names>
</name>
<name>
<surname>Ghilardi</surname>
<given-names>MF</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Learning of visuomotor transformations for vectorial planning of reaching trajectories.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>2000</year>
;
<volume>20</volume>
(
<issue>23</issue>
):
<fpage>8916</fpage>
–
<lpage>8924</lpage>
.
<pub-id pub-id-type="pmid">11102502</pub-id>
</mixed-citation>
</ref>
<ref id="ref-26">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lotter</surname>
<given-names>WS</given-names>
</name>
</person-group>
:
<article-title>Interrelationships among reaction times and speeds of movement in different limbs.</article-title>
<source>
<italic>Research Quarterly, Am Assoc for Health, Phys Ed and Recreation.</italic>
</source>
<year>1960</year>
;
<volume>31</volume>
(
<issue>2</issue>
):
<fpage>147</fpage>
–
<lpage>155</lpage>
.
<ext-link ext-link-type="uri" xlink:href="http://www.tandfonline.com/doi/abs/10.1080/10671188.1960.10613090?journalCode=urqe17#.VIFKEWdAYwo">Reference Source</ext-link>
</mixed-citation>
</ref>
<ref id="ref-27">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Malone</surname>
<given-names>LA</given-names>
</name>
<name>
<surname>Bastian</surname>
<given-names>AJ</given-names>
</name>
</person-group>
:
<article-title>Spatial and temporal asymmetries in gait predict split-belt adaptation behavior in stroke.</article-title>
<source>
<italic>Neurorehabil Neural Repair.</italic>
</source>
<year>2014</year>
;
<volume>28</volume>
(
<issue>3</issue>
):
<fpage>230</fpage>
–
<lpage>240</lpage>
.
<pub-id pub-id-type="doi">10.1177/1545968313505912</pub-id>
<pub-id pub-id-type="pmid">24243917</pub-id>
</mixed-citation>
</ref>
<ref id="ref-28">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Martin</surname>
<given-names>TA</given-names>
</name>
<name>
<surname>Keating</surname>
<given-names>JG</given-names>
</name>
<name>
<surname>Goodkin</surname>
<given-names>HP</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Throwing while looking through prisms. I. Focal olivocerebellar lesions impair adaptation.</article-title>
<source>
<italic>Brain.</italic>
</source>
<year>1996a</year>
;
<volume>119</volume>
(
<issue>Pt 4</issue>
):
<fpage>1183</fpage>
–
<lpage>1198</lpage>
.
<pub-id pub-id-type="doi">10.1093/brain/119.4.1183</pub-id>
<pub-id pub-id-type="pmid">8813282</pub-id>
</mixed-citation>
</ref>
<ref id="ref-29">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Martin</surname>
<given-names>TA</given-names>
</name>
<name>
<surname>Keating</surname>
<given-names>JG</given-names>
</name>
<name>
<surname>Goodkin</surname>
<given-names>HP</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Throwing while looking through prisms II. Specificity and storage of multiple gaze-throw calibrations.</article-title>
<source>
<italic>Brain.</italic>
</source>
<year>1996</year>
;
<volume>119</volume>
(
<issue>Pt 4</issue>
):
<fpage>1199</fpage>
–
<lpage>1211</lpage>
.
<pub-id pub-id-type="doi">10.1093/brain/119.4.1199</pub-id>
<pub-id pub-id-type="pmid">8813283</pub-id>
</mixed-citation>
</ref>
<ref id="ref-30">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mazzoni</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
</person-group>
:
<article-title>An implicit plan overrides an explicit strategy during visuomotor adaptation.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>2006</year>
;
<volume>26</volume>
(
<issue>14</issue>
):
<fpage>3642</fpage>
–
<lpage>3645</lpage>
.
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5317-05.2006</pub-id>
<pub-id pub-id-type="pmid">16597717</pub-id>
</mixed-citation>
</ref>
<ref id="ref-31">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Morton</surname>
<given-names>SM</given-names>
</name>
<name>
<surname>Bastian</surname>
<given-names>AJ</given-names>
</name>
</person-group>
:
<article-title>Cerebellar contributions to locomotor adaptations during splitbelt treadmill walking.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>2006</year>
;
<volume>26</volume>
(
<issue>36</issue>
):
<fpage>9107</fpage>
–
<lpage>9116</lpage>
.
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.2622-06.2006</pub-id>
<pub-id pub-id-type="pmid">16957067</pub-id>
</mixed-citation>
</ref>
<ref id="ref-32">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nagasaki</surname>
<given-names>H</given-names>
</name>
</person-group>
:
<article-title>Asymmetric velocity and acceleration profiles of human arm movements.</article-title>
<source>
<italic>Exp Brain Res.</italic>
</source>
<year>1989</year>
;
<volume>74</volume>
(
<issue>2</issue>
):
<fpage>319</fpage>
–
<lpage>326</lpage>
.
<pub-id pub-id-type="pmid">2924852</pub-id>
</mixed-citation>
</ref>
<ref id="ref-33">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Patton</surname>
<given-names>JL</given-names>
</name>
<name>
<surname>Mussa-Ivaldi</surname>
<given-names>FA</given-names>
</name>
<name>
<surname>Rymer</surname>
<given-names>WZ</given-names>
</name>
</person-group>
:
<article-title>Altering movement patterns in healthy and brain-injured subjects via custom designed robotic forces.</article-title>
<source>
<italic>Proceedings of the 23rd Annual EMBS International Conference.</italic>
</source>
<year>2001</year>
;
<volume>2</volume>
:
<fpage>1356</fpage>
–
<lpage>1359</lpage>
.
<pub-id pub-id-type="doi">10.1109/IEMBS.2001.1020448</pub-id>
</mixed-citation>
</ref>
<ref id="ref-34">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pine</surname>
<given-names>ZM</given-names>
</name>
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
<name>
<surname>Gordon</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Learning of scaling factors and reference axes for reaching movements.</article-title>
<source>
<italic>Neuroreport.</italic>
</source>
<year>1996</year>
;
<volume>7</volume>
(
<issue>14</issue>
):
<fpage>2357</fpage>
–
<lpage>61</lpage>
.
<pub-id pub-id-type="doi">10.1097/00001756-199610020-00016</pub-id>
<pub-id pub-id-type="pmid">8951852</pub-id>
</mixed-citation>
</ref>
<ref id="ref-35">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Poggio</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Girosi</surname>
<given-names>F</given-names>
</name>
</person-group>
:
<article-title>Networks for approximation and learning.</article-title>
<source>
<italic>Proc IEEE.</italic>
</source>
<year>1990</year>
;
<volume>78</volume>
(
<issue>9</issue>
):
<fpage>1481</fpage>
–
<lpage>1497</lpage>
.
<pub-id pub-id-type="doi">10.1109/5.58326</pub-id>
</mixed-citation>
</ref>
<ref id="ref-36">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Proteau</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Marteniuk</surname>
<given-names>RG</given-names>
</name>
<name>
<surname>Lévesque</surname>
<given-names>L</given-names>
</name>
</person-group>
:
<article-title>A sensorimotor basis for motor learning: evidence indicating specificity of practice.</article-title>
<source>
<italic>Q J Exp Psychol A.</italic>
</source>
<year>1992</year>
;
<volume>44</volume>
(
<issue>3</issue>
):
<fpage>557</fpage>
–
<lpage>575</lpage>
.
<pub-id pub-id-type="doi">10.1080/14640749208401298</pub-id>
<pub-id pub-id-type="pmid">1631322</pub-id>
</mixed-citation>
</ref>
<ref id="ref-37">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rose</surname>
<given-names>FD</given-names>
</name>
<name>
<surname>Attree</surname>
<given-names>EA</given-names>
</name>
<name>
<surname>Johnson</surname>
<given-names>DA</given-names>
</name>
</person-group>
:
<article-title>Virtual reality: an assistive technology in neurological rehabilitation.</article-title>
<source>
<italic>Curr Opin Neurol.</italic>
</source>
<year>1996</year>
;
<volume>9</volume>
:
<fpage>461</fpage>
–
<lpage>467</lpage>
.
<pub-id pub-id-type="doi">10.1097/00019052-199612000-00012</pub-id>
<pub-id pub-id-type="pmid">9007406</pub-id>
</mixed-citation>
</ref>
<ref id="ref-38">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sanger</surname>
<given-names>TD</given-names>
</name>
</person-group>
:
<article-title>A tree-structured adaptive network for function approximation in high-dimensional spaces.</article-title>
<source>
<italic>IEEE Trans Neural Netw.</italic>
</source>
<year>1991</year>
;
<volume>2</volume>
(
<issue>2</issue>
):
<fpage>285</fpage>
–
<lpage>293</lpage>
.
<pub-id pub-id-type="doi">10.1109/72.80339</pub-id>
<pub-id pub-id-type="pmid">18276382</pub-id>
</mixed-citation>
</ref>
<ref id="ref-39">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sanger</surname>
<given-names>TD</given-names>
</name>
</person-group>
:
<article-title>Neural network learning control of robot manipulators using gradually increasing task difficulty.</article-title>
<source>
<italic>IEEE Trans Robotics Automation.</italic>
</source>
<year>1994</year>
;
<volume>10</volume>
(
<issue>3</issue>
):
<fpage>323</fpage>
–
<lpage>333</lpage>
.
<pub-id pub-id-type="doi">10.1109/70.294207</pub-id>
</mixed-citation>
</ref>
<ref id="ref-40">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sanner</surname>
<given-names>RM</given-names>
</name>
<name>
<surname>Slotine</surname>
<given-names>JJE</given-names>
</name>
</person-group>
:
<article-title>Gaussian networks for direct adaptive control.</article-title>
<source>
<italic>IEEE Trans Neural Netw.</italic>
</source>
<year>1992</year>
;
<volume>3</volume>
(
<issue>6</issue>
):
<fpage>837</fpage>
–
<lpage>863</lpage>
.
<pub-id pub-id-type="doi">10.1109/72.165588</pub-id>
<pub-id pub-id-type="pmid">18276483</pub-id>
</mixed-citation>
</ref>
<ref id="ref-41">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schmidt</surname>
<given-names>RA</given-names>
</name>
</person-group>
:
<article-title>A schema theory of discrete motor skill learning.</article-title>
<source>
<italic>Psychol Review.</italic>
</source>
<year>1975</year>
;
<volume>82</volume>
(
<issue>4</issue>
):
<fpage>225</fpage>
–
<lpage>260</lpage>
.
<pub-id pub-id-type="doi">10.1037/h0076770</pub-id>
</mixed-citation>
</ref>
<ref id="ref-42">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schmidt</surname>
<given-names>RA</given-names>
</name>
</person-group>
:
<article-title>Motor schema theory after 27 years: reflections and implications for a new theory.</article-title>
<source>
<italic>Res Q Exerc Sport.</italic>
</source>
<year>2003</year>
;
<volume>74</volume>
(
<issue>4</issue>
):
<fpage>366</fpage>
–
<lpage>375</lpage>
.
<pub-id pub-id-type="doi">10.1080/02701367.2003.10609106</pub-id>
<pub-id pub-id-type="pmid">14768837</pub-id>
</mixed-citation>
</ref>
<ref id="ref-43">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schweighofer</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Arbib</surname>
<given-names>MA</given-names>
</name>
</person-group>
:
<article-title>A model of cerebellar metaplasticity.</article-title>
<source>
<italic>Learn Mem.</italic>
</source>
<year>1998</year>
;
<volume>4</volume>
(
<issue>5</issue>
):
<fpage>421</fpage>
–
<lpage>428</lpage>
.
<pub-id pub-id-type="doi">10.1101/lm.4.5.421</pub-id>
<pub-id pub-id-type="pmid">10701881</pub-id>
</mixed-citation>
</ref>
<ref id="ref-44">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Moussavi</surname>
<given-names>ZMK</given-names>
</name>
</person-group>
:
<article-title>Spatial generalization from learning dynamics of reaching movements.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>2000</year>
;
<volume>20</volume>
(
<issue>20</issue>
):
<fpage>7807</fpage>
–
<lpage>7815</lpage>
.
<pub-id pub-id-type="pmid">11027245</pub-id>
</mixed-citation>
</ref>
<ref id="ref-45">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Mussa-Ivaldi</surname>
<given-names>FA</given-names>
</name>
</person-group>
:
<article-title>Adaptive representation of dynamics during learning of a motor task.</article-title>
<source>
<italic>J Neurosci.</italic>
</source>
<year>1994</year>
;
<volume>14</volume>
(
<issue>5 Pt 2</issue>
):
<fpage>3208</fpage>
–
<lpage>3224</lpage>
.
<pub-id pub-id-type="pmid">8182467</pub-id>
</mixed-citation>
</ref>
<ref id="ref-46">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Wise</surname>
<given-names>SP</given-names>
</name>
</person-group>
:
<article-title>Aligning vision and proprioception I: Adaptation and context.</article-title>
In:
<italic>The computational neurobiology of reaching and pointing – A foundation for motor learning.</italic>
Cambridge: MIT press,
<year>2005</year>
;
<fpage>271</fpage>
–
<lpage>294</lpage>
.</mixed-citation>
</ref>
<ref id="ref-47">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Smith</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Ghazizadeh</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
</person-group>
:
<article-title>Interacting adaptive processes with different timescales underlie short-term motor learning.</article-title>
<source>
<italic>PLoS Biol.</italic>
</source>
<year>2006</year>
;
<volume>4</volume>
(
<issue>6</issue>
):
<fpage>e179</fpage>
.
<pub-id pub-id-type="doi">10.1371/journal.pbio.0040179</pub-id>
<pmc-comment>1463025</pmc-comment>
<pub-id pub-id-type="pmid">16700627</pub-id>
</mixed-citation>
</ref>
<ref id="ref-48">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Simon</surname>
<given-names>DA</given-names>
</name>
<name>
<surname>Bjork</surname>
<given-names>RA</given-names>
</name>
</person-group>
:
<article-title>Metacognition in motor learning.</article-title>
<source>
<italic>J Exp Psychol Learn Mem Cogn.</italic>
</source>
<year>2001</year>
;
<volume>27</volume>
(
<issue>4</issue>
):
<fpage>907</fpage>
–
<lpage>912</lpage>
.
<pub-id pub-id-type="doi">10.1037/0278-7393.27.4.907</pub-id>
<pub-id pub-id-type="pmid">11486923</pub-id>
</mixed-citation>
</ref>
<ref id="ref-49">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sing</surname>
<given-names>GC</given-names>
</name>
<name>
<surname>Smith</surname>
<given-names>MA</given-names>
</name>
</person-group>
:
<article-title>Reduction in learning rates associated with anterograde interference results from interactions between different timescales in motor adaptation.</article-title>
<source>
<italic>PLoS Comput Biol.</italic>
</source>
<year>2010</year>
;
<volume>6</volume>
(
<issue>8</issue>
):
<fpage>e1000893</fpage>
.
<pub-id pub-id-type="doi">10.1371/journal.pcbi.1000893</pub-id>
<pmc-comment>2924244</pmc-comment>
<pub-id pub-id-type="pmid">20808880</pub-id>
</mixed-citation>
</ref>
<ref id="ref-50">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sveistrup</surname>
<given-names>H</given-names>
</name>
</person-group>
:
<article-title>Motor rehabilitation using virtual reality.</article-title>
<source>
<italic>J Neuroeng Rehabil.</italic>
</source>
<year>2004</year>
;
<volume>1</volume>
(
<issue>1</issue>
):
<fpage>10</fpage>
.
<pub-id pub-id-type="doi">10.1186/1743-0003-1-10</pub-id>
<pmc-comment>546406</pmc-comment>
<pub-id pub-id-type="pmid">15679945</pub-id>
</mixed-citation>
</ref>
<ref id="ref-51">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tanaka</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
<name>
<surname>Sejnowski</surname>
<given-names>TJ</given-names>
</name>
</person-group>
:
<article-title>Generalization and multirate models of motor adaptation.</article-title>
<source>
<italic>Neural Comput.</italic>
</source>
<year>2012</year>
;
<volume>24</volume>
(
<issue>4</issue>
):
<fpage>939</fpage>
–
<lpage>966</lpage>
.
<pub-id pub-id-type="doi">10.1162/NECO_a_00262</pub-id>
<pmc-comment>3420803</pmc-comment>
<pub-id pub-id-type="pmid">22295980</pub-id>
</mixed-citation>
</ref>
<ref id="ref-52">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Thoroughman</surname>
<given-names>KA</given-names>
</name>
<name>
<surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
</person-group>
:
<article-title>Learning of action through adaptive combination of motor primitives.</article-title>
<source>
<italic>Nature.</italic>
</source>
<year>2000</year>
;
<volume>407</volume>
(
<issue>6805</issue>
):
<fpage>742</fpage>
–
<lpage>747</lpage>
.
<pub-id pub-id-type="doi">10.1038/35037588</pub-id>
<pmc-comment>2556237</pmc-comment>
<pub-id pub-id-type="pmid">11048720</pub-id>
</mixed-citation>
</ref>
<ref id="ref-53">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tseng</surname>
<given-names>YW</given-names>
</name>
<name>
<surname>Diedrichsen</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Sensory prediction errors drive cerebellum-dependent adaptation of reaching.</article-title>
<source>
<italic>J Neurophysiol.</italic>
</source>
<year>2007</year>
;
<volume>98</volume>
(
<issue>1</issue>
):
<fpage>54</fpage>
–
<lpage>62</lpage>
.
<pub-id pub-id-type="doi">10.1152/jn.00266.2007</pub-id>
<pub-id pub-id-type="pmid">17507504</pub-id>
</mixed-citation>
</ref>
<ref id="ref-54">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vetter</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Goodbody</surname>
<given-names>SJ</given-names>
</name>
<name>
<surname>Wolpert</surname>
<given-names>DM</given-names>
</name>
</person-group>
:
<article-title>Evidence for an eye-centered spherical representation of the visuomotor map.</article-title>
<source>
<italic>J Neurophysiol.</italic>
</source>
<year>1999</year>
;
<volume>81</volume>
(
<issue>2</issue>
):
<fpage>935</fpage>
–
<lpage>939</lpage>
.
<pub-id pub-id-type="pmid">10036291</pub-id>
</mixed-citation>
</ref>
<ref id="ref-55">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Widrow</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Hoff ME</surname>
<given-names>Jr</given-names>
</name>
</person-group>
:
<article-title>Adaptive switching circuits.</article-title>
<source>
<italic>IRE Western Electric Show and Convention Record.</italic>
</source>
<year>1960</year>
;
<volume>4</volume>
:
<fpage>96</fpage>
–
<lpage>104</lpage>
.
<ext-link ext-link-type="uri" xlink:href="http://isl-www.stanford.edu/~widrow/papers/c1960adaptiveswitching.pdf">Reference Source</ext-link>
</mixed-citation>
</ref>
<ref id="ref-56">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Widrow</surname>
<given-names>B</given-names>
</name>
<name>
<surname>McCool</surname>
<given-names>JM</given-names>
</name>
<name>
<surname>Larimore</surname>
<given-names>MG</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Stationary and nonstationary learning characteristics of the LMS adaptive filter.</article-title>
<source>
<italic>Proc IEEE.</italic>
</source>
<year>1976</year>
;
<volume>64</volume>
(
<issue>8</issue>
):
<fpage>1151</fpage>
–
<lpage>1162</lpage>
.
<pub-id pub-id-type="doi">10.1109/PROC.1976.10286</pub-id>
</mixed-citation>
</ref>
<ref id="ref-57">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wolpert</surname>
<given-names>DM</given-names>
</name>
<name>
<surname>Ghahramani</surname>
<given-names>Z</given-names>
</name>
<name>
<surname>Flanagan</surname>
<given-names>JR</given-names>
</name>
</person-group>
:
<article-title>Perspectives and problems in motor learning.</article-title>
<source>
<italic>Trends Cogn Sci.</italic>
</source>
<year>2001</year>
;
<volume>5</volume>
(
<issue>11</issue>
):
<fpage>487</fpage>
–
<lpage>494</lpage>
.
<pub-id pub-id-type="doi">10.1016/S1364-6613(00)01773-3</pub-id>
<pub-id pub-id-type="pmid">11684481</pub-id>
</mixed-citation>
</ref>
<ref id="ref-58">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wulf</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Shea</surname>
<given-names>CH</given-names>
</name>
</person-group>
:
<article-title>Principles derived from the study of simple skills do not generalize to complex skill learning.</article-title>
<source>
<italic>Psychon Bull Rev.</italic>
</source>
<year>2002</year>
;
<volume>9</volume>
(
<issue>2</issue>
):
<fpage>185</fpage>
–
<lpage>211</lpage>
.
<pub-id pub-id-type="doi">10.3758/BF03196276</pub-id>
<pub-id pub-id-type="pmid">12120783</pub-id>
</mixed-citation>
</ref>
<ref id="ref-59">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zanone</surname>
<given-names>PG</given-names>
</name>
<name>
<surname>Kelso</surname>
<given-names>JAS</given-names>
</name>
</person-group>
:
<article-title>Evolution of behavioral attractors with learning: nonequilibrium phase transitions.</article-title>
<source>
<italic>J Exp Psychol Hum Percept Perform.</italic>
</source>
<year>1992</year>
;
<volume>18</volume>
(
<issue>2</issue>
):
<fpage>403</fpage>
–
<lpage>421</lpage>
.
<pub-id pub-id-type="doi">10.1037/0096-1523.18.2.403</pub-id>
<pub-id pub-id-type="pmid">1593227</pub-id>
</mixed-citation>
</ref>
<ref id="ref-60">
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zarahn</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Weston</surname>
<given-names>GD</given-names>
</name>
<name>
<surname>Liang</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
:
<article-title>Explaining savings for visuomotor adaptation: linear time-invariant state-space models are not sufficient.</article-title>
<source>
<italic>J Neurophysiol.</italic>
</source>
<year>2008</year>
;
<volume>100</volume>
(
<issue>5</issue>
):
<fpage>2537</fpage>
–
<lpage>2548</lpage>
.
<pub-id pub-id-type="doi">10.1152/jn.90529.2008</pub-id>
<pmc-comment>2585408</pmc-comment>
<pub-id pub-id-type="pmid">18596178</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
<sub-article id="report11102" article-type="peer-review">
<front-stub>
<article-id pub-id-type="doi">10.5256/f1000research.6149.r11102</article-id>
<title-group>
<article-title>Referee response for version 2</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Lew</surname>
<given-names>Eileen</given-names>
</name>
<xref ref-type="aff" rid="r11102a1">1</xref>
<role>Referee</role>
</contrib>
<aff id="r11102a1">
<label>1</label>
Faculty of Engineering, Computing and Science, Swinburne University of Technology-Sarawak, Kuching, Malaysia</aff>
</contrib-group>
<author-notes>
<fn fn-type="conflict">
<p>
<bold>Competing interests: </bold>
No competing interests were disclosed.</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>23</day>
<month>11</month>
<year>2015</year>
</pub-date>
<related-article id="d36e5057" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.3676.2">Version 2</related-article>
<custom-meta-group>
<custom-meta>
<meta-name>recommendation</meta-name>
<meta-value>approve</meta-value>
</custom-meta>
</custom-meta-group>
</front-stub>
<body>
<p>The paper has been revised based on the concerns addressed by previous reviewers where clarity has improved greatly. A few minor points as follows:
<list list-type="order">
<list-item>
<p>The title could be improved to highlight differences in transfer of learning from artificial to natural environment instead of focusing only about rotated visual environment (artificial environment), as the title appears misleading. The use of the keywords, such as environment adaptation and skill learning could better highlight the content and outcome of the paper as author has done extensive analysis on the interactions of the two environments.</p>
</list-item>
<list-item>
<p>There is no mention about the follow-up study (8 participants) in the abstract, which is could be interesting to put forward the intention to study generalization and the outcome.</p>
</list-item>
<list-item>
<p>In terms of future work, as this study focused on simple task, the next question will be on complex task. Authors could elaborate further on the hypothesis of the learning systems for more complex tasks and proposition on how the dynamics of the movements can be learned. </p>
</list-item>
</list>
</p>
<p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
</body>
</sub-article>
<sub-article id="report7050" article-type="peer-review">
<front-stub>
<article-id pub-id-type="doi">10.5256/f1000research.6149.r7050</article-id>
<title-group>
<article-title>Referee response for version 2</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Ranganathan</surname>
<given-names>Rajiv</given-names>
</name>
<xref ref-type="aff" rid="r7050a1">1</xref>
<role>Referee</role>
</contrib>
<aff id="r7050a1">
<label>1</label>
Department of Kinesiology, Michigan State University, East Lansing, MI, USA</aff>
</contrib-group>
<author-notes>
<fn fn-type="conflict">
<p>
<bold>Competing interests: </bold>
No competing interests were disclosed.</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>24</day>
<month>2</month>
<year>2015</year>
</pub-date>
<related-article id="d36e5116" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.3676.2">Version 2</related-article>
<custom-meta-group>
<custom-meta>
<meta-name>recommendation</meta-name>
<meta-value>approve</meta-value>
</custom-meta>
</custom-meta-group>
</front-stub>
<body>
<p>The authors have satisfactorily addressed my concerns from the previous review. I only have a couple of minor points:
<list list-type="order">
<list-item>
<p>It seems that the same 10 participants were used in all 4 experiments (and a further 8 were used for bigger angles). Was the order of the experiments randomized or did participants do the experiments in sequence? Also, what was the time gap between experiments? This detail could be included under the "Participants" section.</p>
</list-item>
<list-item>
<p>There seems to be a problem in Figure 3D - On the monitor, the movements in A and C are not aimed toward the target</p>
</list-item>
</list>
</p>
<p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
</body>
</sub-article>
<sub-article id="report5806" article-type="peer-review">
<front-stub>
<article-id pub-id-type="doi">10.5256/f1000research.3940.r5806</article-id>
<title-group>
<article-title>Referee response for version 1</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Ranganathan</surname>
<given-names>Rajiv</given-names>
</name>
<xref ref-type="aff" rid="r5806a1">1</xref>
<role>Referee</role>
</contrib>
<aff id="r5806a1">
<label>1</label>
Department of Kinesiology, Michigan State University, East Lansing, MI, USA</aff>
</contrib-group>
<author-notes>
<fn fn-type="conflict">
<p>
<bold>Competing interests: </bold>
No competing interests were disclosed.</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>9</day>
<month>9</month>
<year>2014</year>
</pub-date>
<related-article id="d36e5172" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.3676.1">Version 1</related-article>
<custom-meta-group>
<custom-meta>
<meta-name>recommendation</meta-name>
<meta-value>approve-with-reservations</meta-value>
</custom-meta>
</custom-meta-group>
</front-stub>
<body>
<p>
<bold>Summary:</bold>
</p>
<p>The goal of this paper by Chu and Sanger is to examine the hypothesis that learning mechanisms that adapt to altered environments (like visuomotor rotation) is different from learning mechanisms that are required for improvement of motor skills.  Using both experiments and model simulations, the authors make the argument that there are indeed two learning mechanisms --  a learning mechanism for each task (which accounts for the specificity of learning of different skills) but a single learning mechanism for learning the environment (which accounts for generalization within a single environment).</p>
<p>The topic addressed in the paper is of great interest to readers in the motor control community. Overall the paper is well-written and the experiments/modeling are well done.</p>
<p>
<bold>Major concerns:</bold>
<list list-type="order">
<list-item>
<p>The paper does not seem to make reference to a very similar idea of “model-based” and “model-free” learning (
<ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3134523/">Huang
<italic> et al., </italic>
2011</ext-link>
,
<ext-link ext-link-type="uri" xlink:href="http://link.springer.com/chapter/10.1007/978-1-4614-5465-6_1#page-1">Haith & Krakauer, 2013</ext-link>
). Those papers make almost the exact same distinction where model-based learning accounts for tasks like adaptation, whereas model-free mechanisms account for “skill learning” tasks.  It would be useful for the authors to look at this distinction and discuss these ideas in relation to the current paper.</p>
</list-item>
<list-item>
<p>
<ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3134523/">Huang
<italic>et al.</italic>
 (2011)</ext-link>
 also used a similar paradigm to Experiment 3 to show that practicing in an “opposite” visuomotor rotation could lead to savings (faster re-learning) if the hand-direction was the same (due to model-free learning). Therefore, the authors may want to use caution before making statements such as “adaptation to an altered environment is not useful for training task performance”.</p>
</list-item>
<list-item>
<p>While the statistics are used in a “within-subject” kind of way with the z-statistic, I have a couple of concerns:</p>
</list-item>
</list>
<list list-type="bullet">
<list-item>
<p>The sample standard deviation is estimated from only 10 trials  - therefore the use of a t-distribution may be more appropriate than a z-distribution.</p>
</list-item>
<list-item>
<p>The sign of the after-effect is masked by this analysis – i.e. both undershoots and overshoots would count as being significant since only the absolute value is being taken into account.</p>
</list-item>
<list-item>
<p>It would therefore be useful to do a typical "between-subjects" analysis (like a paired t-test) which would also help the reader know the actual magnitudes of the after-effects across the 4 experiments (and not merely whether they were significant or  not). </p>
</list-item>
</list>
<bold>Minor:</bold>
<list list-type="order">
<list-item>
<p>I do not understand how the two stripes are representing “West”. Does one stripe represent West in visual space, and the other in hand space? If so, how did the participants distinguish the two stripes? Also it seems that in Figure 3B, the middle panel “Interference:B1” has the directions marked incorrectly.</p>
</list-item>
<list-item>
<p>Figure 2 is a little hard to digest and has repetition of the same blocks across multiple panels – it would help the readers if the authors could omit the equations (or use them just once if they are repeated) so that readers could clearly grasp the critical differences between the 3 models.</p>
</list-item>
<list-item>
<p>The rationale behind Experiment 4 is a little unclear to me. What do the authors mean when they say “we had to change the visual display”(do they mean target position?). There also seems to some discrepancy between Figure 3D and the table in Figure 3 (e.g. figure 3D should show Baseline "A2" and Readaptation A2, not A1). Also the titles for each experiment condition in Figures 3A-D are all labeled the same "Baselne A1 Interference B1 and Re-Adaptation A1".</p>
</list-item>
<list-item>
<p>The lesser strength of effects in the 90° experiments could be explained by different strategies used in small versus large visuomotor rotations (
<ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/11685393">Abeele & Bock, 2001</ext-link>
).</p>
</list-item>
<list-item>
<p>The ideas in the paper would also be helped by reference to older ideas of “task and practice specificity” of motor skills (Henry, 1959) – which suggest poor generalization of motor skills.</p>
</list-item>
<list-item>
<p>It would help to line up the experimental data in Figure 5 alongside  the model predictions in Figure 4 so that it is easier to identify the best predicting model.</p>
</list-item>
<list-item>
<p>Why is there a difference in the learning rate between the 3 models during adaptation to the first task (Figure 4, Experiment 1 trials 1-20)? Is it a fair comparison among the 3 models if the final performance of all models is not equivalent after this first block?</p>
</list-item>
<list-item>
<p>Since Experiment 3 is the real important finding that confirms the author's model of motor learning, it would help to show in a Figure the fact that participants actually increase the error in the first few trials (currently it is not possible to see this clearly because all 60 trials are all compressed into the figure).</p>
</list-item>
</list>
</p>
<p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
</body>
<sub-article id="comment1104" article-type="response">
<front-stub>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Chu</surname>
<given-names>Virginia</given-names>
</name>
<aff>University of Illinois at Chicago, USA</aff>
</contrib>
</contrib-group>
<author-notes>
<fn fn-type="conflict">
<p>
<bold>Competing interests: </bold>
No competing interests were disclosed.</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>1</day>
<month>12</month>
<year>2014</year>
</pub-date>
</front-stub>
<body>
<p>Thank you for your suggestion on additional discussion areas and statistical analysis. We have addressed your comments in our second version with the details highlighted below.
<list list-type="order">
<list-item>
<p>Thank you for your suggestion with the discussion on model-based and model free learning models, we have added a discussion on this topic in the manuscript.</p>
</list-item>
<list-item>
<p>Regarding the use of z-statistics as a measure in our study, we agree that this is not a conventional way of using this measure. What we call “z” is using a measure similar to the z-statistics, since our sample size was 1 (aftereffect trial) to be compared with a population size of 10 (baseline). In using a z-statistics-like measure, this allows us to use the baseline mean and standard deviation of the baseline trials as the population mean and standard deviation. However, if we use the t-statistics, it will require that we have the sample’s standard deviation (which is 0 for a sample size of 1). Therefore, we chose to use the z-statistics as the basis of for our statistical measure.</p>
</list-item>
<list-item>
<p>In order to show the sign of the after effect for readers to examine, we have changed the reported z value to be without the absolute value, and use |z| for statistical comparison. As shown in the new Table 1 and 2, only 3 values were affected, all insignificant z values for Experiment 2.</p>
</list-item>
<list-item>
<p>As requested by both reviewers, regarding information for typical “between-subject” analysis, we performed additional statistical analysis and they are reported in the text and in the new figures 5 and 7.</p>
</list-item>
<list-item>
<p>Thank you for pointing out the error in the notation in figure 3B. We have corrected that. The 2 stripes were used as 1 symbol. They are together used as an indicator for changes in the rotation environment. They were deliberately vague so that the participants would notice a change, but cannot clearly determine the amount of visual rotation.</p>
</list-item>
<list-item>
<p>We made Figure 2 simpler and changed the shading of the border markings to make the models easier to read.</p>
</list-item>
<list-item>
<p>Figure 3 has been corrected. We apologize for the mislabeling. We have also clarified the rationale for experiment 4 to make things clearer.</p>
</list-item>
<list-item>
<p>Thank you for pointing out two relevant references (Abeele & Bock, 2001) and (Henry, 1959). Unfortunately, we were not able to locate (Henry, 1959). Were you by chance referring to (Henry, 1958/1968)? We have added a discussion on the topics in the introduction and discussion.</p>
</list-item>
<list-item>
<p>We agree that comparison between Figure 4 and 5 is important in the identification of the best predicting model. Unfortunately, we feel that putting the subject data from Figure 5 within Figure 4 would make the figures too small to give. Instead, we re-arranged the order of the graphs in Figure 5, to facilitate comparison between the two figures.</p>
</list-item>
<list-item>
<p>The model simulations are meant for qualitative comparisons. Thank you for pointing out that the learning rate and final performance in the end of the first block was not the same. Our primary focus was to keep the model components to be as consistent as possible across the 3 models, so that the only difference between the models is the model structure. As an example, each learning network in the controller and the time update in the online correction (Figure 2) for all 3 models used the same model parameters. The differences observed in the simulation results, simply result from the difference in model structure. We felt that this was a more important comparison to examine from the simulation results, rather than tuning the model parameters so that the learning rates and final performance to be equal. It is important to note that the difference in simulation results stemmed simply from a difference in model structure using the exact same model components and parameters. Model C appear to have higher learning rate because it has an additional learning component (environment adaptation controller) compared to model A and B. Model A and B could be made to have the same learning rate and final performance in the baseline block by tuning λ, the learning rate of the system (using a faster rate). But this would not change the pattern of results we see in the simulation, and it is more important to us that the model parameters were kept the same.</p>
</list-item>
</list>
In order to demonstrate the errors in Experiment 3 more clearly, the trajectory errors were shown in Figure 6, where the last trial of baseline and the first trial of the remaining 2 blocks were shown. Further, the errors were also show numerically in Table 1.  With the new Figure 5E and Figure 7E, the group means of the errors in the first trial in state C are now shown clearly in a bar chart form.</p>
</body>
</sub-article>
</sub-article>
<sub-article id="report5345" article-type="peer-review">
<front-stub>
<article-id pub-id-type="doi">10.5256/f1000research.3940.r5345</article-id>
<title-group>
<article-title>Referee response for version 1</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Torres-Oviedo</surname>
<given-names>Gelsy</given-names>
</name>
<xref ref-type="aff" rid="r5345a1">1</xref>
<role>Referee</role>
</contrib>
<aff id="r5345a1">
<label>1</label>
Departments of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA</aff>
</contrib-group>
<author-notes>
<fn fn-type="conflict">
<p>
<bold>Competing interests: </bold>
No competing interests were disclosed.</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>4</day>
<month>7</month>
<year>2014</year>
</pub-date>
<related-article id="d36e5361" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.3676.1">Version 1</related-article>
<custom-meta-group>
<custom-meta>
<meta-name>recommendation</meta-name>
<meta-value>approve-with-reservations</meta-value>
</custom-meta>
</custom-meta-group>
</front-stub>
<body>
<p>The title is appropriate for the work. The abstract needs to be revised to improve its clarity. Specifically, the authors need 1) to include a brief definition for skill learning and 2) to clarify that after-effects equate to poor skill performance in their study since literature presents some other cases of after-effects leading to improved movements.Overall the article content is clearly explained and very well written. There are only a few general conceptual points that should be addressed. Authors should consider revising their conclusions based on these points.
<list list-type="order">
<list-item>
<p>It is unclear how different the reaching directions need to be, for them to be considered the same tasks or skills?</p>
</list-item>
<list-item>
<p>A common patients' deficit is their perseverant behavior from one situation to another (even when this is inappropriate). Literature shows this motor perseverance appears beneficial when experiencing environmental adaptations. Given that patients continue doing the adapted motion when the external perturbation is removed, it ultimately leads to long-term changes in their movements with repeated exposure. The authors are very adamant in their conclusions that environmental adaptation cannot be used as a rehabilitation intervention, yet their two-mechanism model does not seem to include this perseverance feature of patients' behavior. Kindly elaborate on this.</p>
</list-item>
<list-item>
<p>In their theoretical framework, authors present a single performance error and they do not seem to differentiate between self-generated and externally generated performance errors. Possibly this simplification limits their model to predicting behaviors during visual tasks but it would fail at explaining behaviors in proprioception-driven tasks, like reaching in a force field or walking on a split-belt treadmill.</p>
</list-item>
</list>
Other comments in order of appearance:
<list list-type="bullet">
<list-item>
<p>Page 4: Link description of model predictions to their visual representation on Fig 4.</p>
</list-item>
<list-item>
<p>Conceptual question in Figure 2: It is not clear why the desired trajectory generator is not part of the controller block in which all the trajectories are generated.  What are the learning network blocks computing? </p>
</list-item>
<list-item>
<p>Illustration points in Figure 2:</p>
<p> 
<list list-type="bullet">
<list-item>
<p>The "environment adaptation module" in Model C could be better indicated, since it is not very clear that it is missing in Model A and B.</p>
</list-item>
<list-item>
<p>The equations for the online correction on Fig. 2 do not match the ones on the text (page 7). Kindly add V and V' on the text or change equations on Fig. 2.</p>
</list-item>
</list>
</p>
</list-item>
<list-item>
<p>Page 6: x
<sub>c</sub>
' and y
<sub>c</sub>
' are missing the c.</p>
</list-item>
<list-item>
<p>Page 6, under Trajectory generator section: It is not well explained what j and i are on the equations.</p>
</list-item>
<list-item>
<p>Page 6 under environment adapter section: Authors should consider adding the equation in which x
<sub>c</sub>
' and y
<sub>c</sub>
' = Phat
<sup>-1</sup>
[x
<sub>c</sub>
y
<sub>c</sub>
] and the learning rule for P, as they do for indicating the update of W.</p>
</list-item>
<list-item>
<p>Page 7: Authors randomize the order of the 4 experiments to account for the order of the task. However, it is not very clear if repeated exposures of the adaptation task changes subjects behaviour.</p>
</list-item>
<list-item>
<p>Page 7, under procedure: In the explanation of experiment 4 it is unclear if subjects were able to see the cursor or not.</p>
</list-item>
<list-item>
<p>Page 7: Authors equate the intended movement to the target position. However, the intended movement could be different from the target position when subjects are told to aim at a different direction (as done by
<ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/16597717">Mazzoni and Krakauer, 2006</ext-link>
). Please clarify.</p>
</list-item>
<list-item>
<p>Page 9, under data analysis section: Authors perform z-score to determine if after-effects are statistically different from baseline. It is unclear whether similar results are obtained if means (baseline vs after-effect) are compared.  </p>
</list-item>
</list>
</p>
<p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
</body>
<sub-article id="comment1106" article-type="response">
<front-stub>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Chu</surname>
<given-names>Virginia</given-names>
</name>
<aff>University of Illinois at Chicago, USA</aff>
</contrib>
</contrib-group>
<author-notes>
<fn fn-type="conflict">
<p>
<bold>Competing interests: </bold>
No competing interest. </p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>1</day>
<month>12</month>
<year>2014</year>
</pub-date>
</front-stub>
<body>
<p>Thank you for your valuable comments and we have addressed them in our new revision in detail, listed below.
<list list-type="order">
<list-item>
<p>Thank you for your suggestion on the abstract. It has been edited accordingly.</p>
</list-item>
<list-item>
<p>You have raised a very interesting topic on the delineation between same and different tasks/skills. As there is no consensus in the scientific community regarding the criteria for defining tasks that are the same or different, this provides for an interested discussion. We have added a discussion on this topic</p>
</list-item>
<list-item>
<p>We agree with your assessment of patient deficits. Our simulation focused on understanding typical adult motor performance, and thus did not address motor performance in motor disorders. We believe that the type of perseverant behavior in patients can be also understood in our model frameworks. We have added a discussion on this topic.</p>
</list-item>
<list-item>
<p>Thank you for pointing out a limitation of our simulation. Although we did not clearly delineate the two errors as you have categorized them, we believe that we were able to capture some of that information. In models A and B, there was only a single performance error (difference between performance and desired trajectory). However, in model C, we had two different performance errors that drive the two networks: difference between performance and desired trajectory to drive the trajectory controller, and the difference between performance and the expected output to drive the plant estimator. Using your terminology, we believe that the trajectory error can provide information about self-generated errors, and the plant estimation error can give us information about externally generated performance errors. But since our models were not meant to simulate proprioceptive tasks, we do believe that further adjustments to the models will be needed to properly simulate proprioceptive tasks. A discussion has been added to the limitations.</p>
</list-item>
<list-item>
<p>Instead of adding the link between model predictions on page 4 to Figure 4, we have added a description in the results section. Since the experiments were not yet described in page 4, it may be premature to link to Figure 4 at that part of the manuscript.</p>
</list-item>
<list-item>
<p>In regards to Figure 2, whether the desired trajectory generator was included in the controller block was only a matter of notation. We chose not to include that in the controller block because no learning occurred in the desired trajectory generation as the desired trajectory was programmed to be a straight line with bell shape velocity from start to end point. The learning network blocks performed the computation for the neural networks described in paragraph 2 and 3 of “Trajectory generator” section of the Simulations.</p>
</list-item>
<list-item>
<p>We have updated Figure 2 to better indicate the environment adaptation module. In the text, we have combined the equations for online correction into one equation causing the confusion of the equation mismatch. We have changed the text to reflect the same notations used in the figure.</p>
</list-item>
<list-item>
<p>Page 6: Thank you for pointing out the missing c, which has been corrected. The i and j are dummy variables for the summations, we have added clarification for this in the text. The learning rule for P was shown as the equation with delta P. The equation indicated the output has been added for clarity.</p>
</list-item>
<list-item>
<p>Regarding the random order of experiments, we did not believe that the repeated exposure of the adaptation task changed subject behavior as the experiment was relatively short compared to most adaptation studies (20 trials per block). The randomization was used to safe guard against any potential adaptation towards the end of the experiment. After the experiment, we did not see any overall patterns of behavior change according to experimental order.</p>
</list-item>
<list-item>
<p>The cursor was visible to participants under all experimental conditions during the reach.</p>
</list-item>
<list-item>
<p>For the purpose of our study, the intended movement and the target position is essentially the same as long as the subjects were following our instructions. As you pointed out, there are circumstances where there may be disagreements between the two terms such as in Mazzoni and Krakauer paper where they examined the use of explicit strategies. I would argue that Mazzoni and Krakauer were essentially giving their participants another “invisible” target to aim for as we did for our experiment 4, and in that case, the new invisible target becomes the intended movement. But we agree that the particular sentence in question was poorly structured and had been rewritten for clarity.</p>
</list-item>
<list-item>
<p>As requested by both reviewers, we performed additional statistical analysis and they are reported in the text and in the new figures 5 and 7.</p>
</list-item>
</list>
</p>
</body>
</sub-article>
</sub-article>
</pmc>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation

HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000156 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000156 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Ticri/CIDE
   |area=    HapticV1
   |flux=    Pmc
   |étape=   Curation
   |type=    RBID
   |clé=     PMC:4670007
   |texte=   Two different motor learning mechanisms contribute to learning reaching movements in a rotated visual environment
}}

Pour générer des pages wiki

HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i   -Sk "pubmed:26673417" \
       | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd   \
       | NlmPubMed2Wicri -a HapticV1
Wicri

This area was generated with Dilib version V0.6.23.
Data generation: Mon Jun 13 01:09:46 2016. Site generation: Wed Mar 6 09:54:07 2024