A reinforcement learning approach to gait training improves retention
Identifieur interne : 000B45 ( Main/Merge ); précédent : 000B44; suivant : 000B46A reinforcement learning approach to gait training improves retention
Auteurs : Christopher J. Hasson [États-Unis] ; Julia Manczurowsky [États-Unis] ; Sheng-Che Yen [États-Unis]Source :
- Frontiers in Human Neuroscience [ 1662-5161 ] ; 2015.
Abstract
Many gait training programs are based on supervised learning principles: an individual is guided towards a desired gait pattern with directional error feedback. While this results in rapid adaptation, improvements quickly disappear. This study tested the hypothesis that a reinforcement learning approach improves retention and transfer of a new gait pattern. The results of a pilot study and larger experiment are presented. Healthy subjects were randomly assigned to either a supervised group, who received explicit instructions and directional error feedback while they learned a new gait pattern on a treadmill, or a reinforcement group, who was only shown whether they were close to or far from the desired gait. Subjects practiced for 10 min, followed by immediate and overnight retention and over-ground transfer tests. The pilot study showed that subjects could learn a new gait pattern under a reinforcement learning paradigm. The larger experiment, which had twice as many subjects (16 in each group) showed that the reinforcement group had better overnight retention than the supervised group (a 32% vs. 120% error increase, respectively), but there were no differences for over-ground transfer. These results suggest that encouraging participants to find rewarding actions through self-guided exploration is beneficial for retention.
Url:
DOI: 10.3389/fnhum.2015.00459
PubMed: 26379524
PubMed Central: 4550775
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000172
- to stream Pmc, to step Curation: 000172
- to stream Pmc, to step Checkpoint: 000766
- to stream Ncbi, to step Merge: 003C32
- to stream Ncbi, to step Curation: 003C32
- to stream Ncbi, to step Checkpoint: 003C32
Links to Exploration step
PMC:4550775Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">A reinforcement learning approach to gait training improves retention</title><author><name sortKey="Hasson, Christopher J" sort="Hasson, Christopher J" uniqKey="Hasson C" first="Christopher J." last="Hasson">Christopher J. Hasson</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Neuromotor Systems Laboratory, Department of Physical Therapy, Movement and Rehabilitation Sciences, Northeastern University</institution><country>Boston, MA, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author><author><name sortKey="Manczurowsky, Julia" sort="Manczurowsky, Julia" uniqKey="Manczurowsky J" first="Julia" last="Manczurowsky">Julia Manczurowsky</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Neuromotor Systems Laboratory, Department of Physical Therapy, Movement and Rehabilitation Sciences, Northeastern University</institution><country>Boston, MA, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author><author><name sortKey="Yen, Sheng Che" sort="Yen, Sheng Che" uniqKey="Yen S" first="Sheng-Che" last="Yen">Sheng-Che Yen</name><affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Laboratory for Locomotion Research, Department of Physical Therapy, Movement and Rehabilitation Sciences, Northeastern University</institution><country>Boston, MA, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">26379524</idno><idno type="pmc">4550775</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4550775</idno><idno type="RBID">PMC:4550775</idno><idno type="doi">10.3389/fnhum.2015.00459</idno><date when="2015">2015</date><idno type="wicri:Area/Pmc/Corpus">000172</idno><idno type="wicri:Area/Pmc/Curation">000172</idno><idno type="wicri:Area/Pmc/Checkpoint">000766</idno><idno type="wicri:Area/Ncbi/Merge">003C32</idno><idno type="wicri:Area/Ncbi/Curation">003C32</idno><idno type="wicri:Area/Ncbi/Checkpoint">003C32</idno><idno type="wicri:Area/Main/Merge">000B45</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">A reinforcement learning approach to gait training improves retention</title><author><name sortKey="Hasson, Christopher J" sort="Hasson, Christopher J" uniqKey="Hasson C" first="Christopher J." last="Hasson">Christopher J. Hasson</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Neuromotor Systems Laboratory, Department of Physical Therapy, Movement and Rehabilitation Sciences, Northeastern University</institution><country>Boston, MA, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author><author><name sortKey="Manczurowsky, Julia" sort="Manczurowsky, Julia" uniqKey="Manczurowsky J" first="Julia" last="Manczurowsky">Julia Manczurowsky</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Neuromotor Systems Laboratory, Department of Physical Therapy, Movement and Rehabilitation Sciences, Northeastern University</institution><country>Boston, MA, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author><author><name sortKey="Yen, Sheng Che" sort="Yen, Sheng Che" uniqKey="Yen S" first="Sheng-Che" last="Yen">Sheng-Che Yen</name><affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Laboratory for Locomotion Research, Department of Physical Therapy, Movement and Rehabilitation Sciences, Northeastern University</institution><country>Boston, MA, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author></analytic><series><title level="j">Frontiers in Human Neuroscience</title><idno type="eISSN">1662-5161</idno><imprint><date when="2015">2015</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Many gait training programs are based on supervised learning principles: an individual is guided towards a desired gait pattern with directional error feedback. While this results in rapid adaptation, improvements quickly disappear. This study tested the hypothesis that a reinforcement learning approach improves retention and transfer of a new gait pattern. The results of a pilot study and larger experiment are presented. Healthy subjects were randomly assigned to either a supervised group, who received explicit instructions and directional error feedback while they learned a new gait pattern on a treadmill, or a reinforcement group, who was only shown whether they were close to or far from the desired gait. Subjects practiced for 10 min, followed by immediate and overnight retention and over-ground transfer tests. The pilot study showed that subjects could learn a new gait pattern under a reinforcement learning paradigm. The larger experiment, which had twice as many subjects (16 in each group) showed that the reinforcement group had better overnight retention than the supervised group (a 32% vs. 120% error increase, respectively), but there were no differences for over-ground transfer. These results suggest that encouraging participants to find rewarding actions through self-guided exploration is beneficial for retention.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Abe, M" uniqKey="Abe M">M. Abe</name></author><author><name sortKey="Schambra, H" uniqKey="Schambra H">H. Schambra</name></author><author><name sortKey="Wassermann, E M" uniqKey="Wassermann E">E. M. Wassermann</name></author><author><name sortKey="Luckenbaugh, D" uniqKey="Luckenbaugh D">D. Luckenbaugh</name></author><author><name sortKey="Schweighofer, N" uniqKey="Schweighofer N">N. Schweighofer</name></author><author><name sortKey="Cohen, L G" uniqKey="Cohen L">L. G. Cohen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Amatachaya, S" uniqKey="Amatachaya S">S. Amatachaya</name></author><author><name sortKey="Amatachaya, P" uniqKey="Amatachaya P">P. Amatachaya</name></author><author><name sortKey="Keawsutthi, M" uniqKey="Keawsutthi M">M. Keawsutthi</name></author><author><name sortKey="Siritaratiwat, W" uniqKey="Siritaratiwat W">W. Siritaratiwat</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Anselme, P" uniqKey="Anselme P">P. Anselme</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Barto, A G" uniqKey="Barto A">A. G. Barto</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cohen, J" uniqKey="Cohen J">J. Cohen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ferster, C" uniqKey="Ferster C">C. Ferster</name></author><author><name sortKey="Skinner, B F" uniqKey="Skinner B">B. F. Skinner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fiorillo, C D" uniqKey="Fiorillo C">C. D. Fiorillo</name></author><author><name sortKey="Tobler, P N" uniqKey="Tobler P">P. N. Tobler</name></author><author><name sortKey="Schultz, W" uniqKey="Schultz W">W. Schultz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Galea, J M" uniqKey="Galea J">J. M. Galea</name></author><author><name sortKey="Mallia, E" uniqKey="Mallia E">E. Mallia</name></author><author><name sortKey="Rothwell, J" uniqKey="Rothwell J">J. Rothwell</name></author><author><name sortKey="Diedrichsen, J" uniqKey="Diedrichsen J">J. Diedrichsen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Green, D P" uniqKey="Green D">D. P. Green</name></author><author><name sortKey="Whitehead, J" uniqKey="Whitehead J">J. Whitehead</name></author><author><name sortKey="Sugden, D A" uniqKey="Sugden D">D. A. Sugden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hesse, S" uniqKey="Hesse S">S. Hesse</name></author><author><name sortKey="Bertelt, C" uniqKey="Bertelt C">C. Bertelt</name></author><author><name sortKey="Jahnke, M" uniqKey="Jahnke M">M. Jahnke</name></author><author><name sortKey="Schaffrin, A" uniqKey="Schaffrin A">A. Schaffrin</name></author><author><name sortKey="Baake, P" uniqKey="Baake P">P. Baake</name></author><author><name sortKey="Malezic, M" uniqKey="Malezic M">M. Malezic</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Howe, T E" uniqKey="Howe T">T. E. Howe</name></author><author><name sortKey="Lovgreen, B" uniqKey="Lovgreen B">B. Lövgreen</name></author><author><name sortKey="Cody, F" uniqKey="Cody F">F. Cody</name></author><author><name sortKey="Ashton, V" uniqKey="Ashton V">V. Ashton</name></author><author><name sortKey="Oldham, J" uniqKey="Oldham J">J. Oldham</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Huang, V S" uniqKey="Huang V">V. S. Huang</name></author><author><name sortKey="Haith, A" uniqKey="Haith A">A. Haith</name></author><author><name sortKey="Mazzoni, P" uniqKey="Mazzoni P">P. Mazzoni</name></author><author><name sortKey="Krakauer, J W" uniqKey="Krakauer J">J. W. Krakauer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Inglis, I R" uniqKey="Inglis I">I. R. Inglis</name></author><author><name sortKey="Forkman, B" uniqKey="Forkman B">B. Forkman</name></author><author><name sortKey="Lazarus, J" uniqKey="Lazarus J">J. Lazarus</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Israel, J F" uniqKey="Israel J">J. F. Israel</name></author><author><name sortKey="Campbell, D D" uniqKey="Campbell D">D. D. Campbell</name></author><author><name sortKey="Kahn, J H" uniqKey="Kahn J">J. H. Kahn</name></author><author><name sortKey="Hornby, T G" uniqKey="Hornby T">T. G. Hornby</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jenkins, W O" uniqKey="Jenkins W">W. O. Jenkins</name></author><author><name sortKey="Stanley, J C" uniqKey="Stanley J">J. C. Stanley</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kerr, R" uniqKey="Kerr R">R. Kerr</name></author><author><name sortKey="Booth, B" uniqKey="Booth B">B. Booth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lee, T D" uniqKey="Lee T">T. D. Lee</name></author><author><name sortKey="White, M A" uniqKey="White M">M. A. White</name></author><author><name sortKey="Carnahan, H" uniqKey="Carnahan H">H. Carnahan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Linnet, J" uniqKey="Linnet J">J. Linnet</name></author><author><name sortKey="Mouridsen, K" uniqKey="Mouridsen K">K. Mouridsen</name></author><author><name sortKey="Peterson, E" uniqKey="Peterson E">E. Peterson</name></author><author><name sortKey="M Ller, A" uniqKey="M Ller A">A. Møller</name></author><author><name sortKey="Doudet, D J" uniqKey="Doudet D">D. J. Doudet</name></author><author><name sortKey="Gjedde, A" uniqKey="Gjedde A">A. Gjedde</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Malone, L A" uniqKey="Malone L">L. A. Malone</name></author><author><name sortKey="Bastian, A J" uniqKey="Bastian A">A. J. Bastian</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Matsumoto, M" uniqKey="Matsumoto M">M. Matsumoto</name></author><author><name sortKey="Hikosaka, O" uniqKey="Hikosaka O">O. Hikosaka</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Morris, M E" uniqKey="Morris M">M. E. Morris</name></author><author><name sortKey="Iansek, R" uniqKey="Iansek R">R. Iansek</name></author><author><name sortKey="Matyas, T A" uniqKey="Matyas T">T. A. Matyas</name></author><author><name sortKey="Summers, J J" uniqKey="Summers J">J. J. Summers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Palmer, M L" uniqKey="Palmer M">M. L. Palmer</name></author><author><name sortKey="Epler, M E" uniqKey="Epler M">M. E. Epler</name></author><author><name sortKey="Epler, M F" uniqKey="Epler M">M. F. Epler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pekny, S E" uniqKey="Pekny S">S. E. Pekny</name></author><author><name sortKey="Criscimagna Hemminger, S E" uniqKey="Criscimagna Hemminger S">S. E. Criscimagna-Hemminger</name></author><author><name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R. Shadmehr</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Preuschoff, K" uniqKey="Preuschoff K">K. Preuschoff</name></author><author><name sortKey="Bossaerts, P" uniqKey="Bossaerts P">P. Bossaerts</name></author><author><name sortKey="Quartz, S R" uniqKey="Quartz S">S. R. Quartz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Reisman, D S" uniqKey="Reisman D">D. S. Reisman</name></author><author><name sortKey="Wityk, R" uniqKey="Wityk R">R. Wityk</name></author><author><name sortKey="Silver, K" uniqKey="Silver K">K. Silver</name></author><author><name sortKey="Bastian, A J" uniqKey="Bastian A">A. J. Bastian</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Reisman, D S" uniqKey="Reisman D">D. S. Reisman</name></author><author><name sortKey="Wityk, R" uniqKey="Wityk R">R. Wityk</name></author><author><name sortKey="Silver, K" uniqKey="Silver K">K. Silver</name></author><author><name sortKey="Bastian, A J" uniqKey="Bastian A">A. J. Bastian</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Salmoni, A W" uniqKey="Salmoni A">A. W. Salmoni</name></author><author><name sortKey="Schmidt, R A" uniqKey="Schmidt R">R. A. Schmidt</name></author><author><name sortKey="Walter, C B" uniqKey="Walter C">C. B. Walter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sherwood, D E" uniqKey="Sherwood D">D. E. Sherwood</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Shmuelof, L" uniqKey="Shmuelof L">L. Shmuelof</name></author><author><name sortKey="Huang, V S" uniqKey="Huang V">V. S. Huang</name></author><author><name sortKey="Haith, A M" uniqKey="Haith A">A. M. Haith</name></author><author><name sortKey="Delnicki, R J" uniqKey="Delnicki R">R. J. Delnicki</name></author><author><name sortKey="Mazzoni, P" uniqKey="Mazzoni P">P. Mazzoni</name></author><author><name sortKey="Krakauer, J W" uniqKey="Krakauer J">J. W. Krakauer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Suteerawattananon, M" uniqKey="Suteerawattananon M">M. Suteerawattananon</name></author><author><name sortKey="Morris, G" uniqKey="Morris G">G. Morris</name></author><author><name sortKey="Etnyre, B" uniqKey="Etnyre B">B. Etnyre</name></author><author><name sortKey="Jankovic, J" uniqKey="Jankovic J">J. Jankovic</name></author><author><name sortKey="Protas, E" uniqKey="Protas E">E. Protas</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sutton, R S" uniqKey="Sutton R">R. S. Sutton</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Winstein, C J" uniqKey="Winstein C">C. J. Winstein</name></author><author><name sortKey="Pohl, P S" uniqKey="Pohl P">P. S. Pohl</name></author><author><name sortKey="Lewthwaite, R" uniqKey="Lewthwaite R">R. Lewthwaite</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Winstein, C J" uniqKey="Winstein C">C. J. Winstein</name></author><author><name sortKey="Schmidt, R A" uniqKey="Schmidt R">R. A. Schmidt</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wrisberg, C A" uniqKey="Wrisberg C">C. A. Wrisberg</name></author><author><name sortKey="Liu, Z" uniqKey="Liu Z">Z. Liu</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Yen, S C" uniqKey="Yen S">S.-C. Yen</name></author><author><name sortKey="Schmit, B D" uniqKey="Schmit B">B. D. Schmit</name></author><author><name sortKey="Landry, J M" uniqKey="Landry J">J. M. Landry</name></author><author><name sortKey="Roth, H" uniqKey="Roth H">H. Roth</name></author><author><name sortKey="Wu, M" uniqKey="Wu M">M. Wu</name></author></analytic></biblStruct></listBibl></div1></back></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000B45 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 000B45 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Main
|étape= Merge
|type= RBID
|clé= PMC:4550775
|texte= A reinforcement learning approach to gait training improves retention
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Merge/RBID.i -Sk "pubmed:26379524" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Merge/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |