Effect of task-related continuous auditory feedback during learning of tracking motion exercises
Identifieur interne : 002274 ( Ncbi/Merge ); précédent : 002273; suivant : 002275Effect of task-related continuous auditory feedback during learning of tracking motion exercises
Auteurs : Giulio Rosati [Italie] ; Fabio Oscari [Italie] ; Simone Spagnol [Italie] ; Federico Avanzini [Italie] ; Stefano Masiero [Italie]Source :
- Journal of NeuroEngineering and Rehabilitation [ 1743-0003 ] ; 2012.
Abstract
This paper presents the results of a set of experiments in which we used continuous auditory feedback to augment motor training exercises. This feedback modality is mostly underexploited in current robotic rehabilitation systems, which usually implement only very basic auditory interfaces. Our hypothesis is that properly designed continuous auditory feedback could be used to represent temporal and spatial information that could in turn, improve performance and motor learning.
We implemented three different experiments on healthy subjects, who were asked to track a target on a screen by moving an input device (controller) with their hand. Different visual and auditory feedback modalities were envisaged. The first experiment investigated whether continuous task-related auditory feedback can help improve performance to a greater extent than error-related audio feedback, or visual feedback alone. In the second experiment we used sensory substitution to compare different types of auditory feedback with equivalent visual feedback, in order to find out whether mapping the same information on a different sensory channel (the visual channel) yielded comparable effects with those gained in the first experiment. The final experiment applied a continuously changing visuomotor transformation between the controller and the screen and mapped kinematic information, computed in either coordinate system (controller or video), to the audio channel, in order to investigate which information was more relevant to the user.
Task-related audio feedback significantly improved performance with respect to visual feedback alone, whilst error-related feedback did not. Secondly, performance in audio tasks was significantly better with respect to the equivalent sensory-substituted visual tasks. Finally, with respect to visual feedback alone, video-task-related sound feedback decreased the tracking error during the learning of a novel visuomotor perturbation, whereas controller-task-related sound feedback did not. This result was particularly interesting, as the subjects relied more on auditory augmentation of the visualized target motion (which was altered with respect to arm motion by the visuomotor perturbation), rather than on sound feedback provided in the controller space, i.e., information directly related to the effective target motion of their arm.
Our results indicate that auditory augmentation of visual feedback can be beneficial during the execution of upper limb movement exercises. In particular, we found that continuous task-related information provided through sound, in addition to visual feedback can improve not only performance but also the learning of a novel visuomotor perturbation. However, error-related information provided through sound did not improve performance and negatively affected learning in the presence of the visuomotor perturbation.
Url:
DOI: 10.1186/1743-0003-9-79
PubMed: 23046683
PubMed Central: 3554473
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 001258
- to stream Pmc, to step Curation: 001258
- to stream Pmc, to step Checkpoint: 001766
Links to Exploration step
PMC:3554473Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Effect of task-related continuous auditory feedback during learning of tracking motion exercises</title>
<author><name sortKey="Rosati, Giulio" sort="Rosati, Giulio" uniqKey="Rosati G" first="Giulio" last="Rosati">Giulio Rosati</name>
<affiliation wicri:level="1"><nlm:aff id="I1">Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Oscari, Fabio" sort="Oscari, Fabio" uniqKey="Oscari F" first="Fabio" last="Oscari">Fabio Oscari</name>
<affiliation wicri:level="1"><nlm:aff id="I1">Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Spagnol, Simone" sort="Spagnol, Simone" uniqKey="Spagnol S" first="Simone" last="Spagnol">Simone Spagnol</name>
<affiliation wicri:level="1"><nlm:aff id="I2">Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Avanzini, Federico" sort="Avanzini, Federico" uniqKey="Avanzini F" first="Federico" last="Avanzini">Federico Avanzini</name>
<affiliation wicri:level="1"><nlm:aff id="I2">Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Masiero, Stefano" sort="Masiero, Stefano" uniqKey="Masiero S" first="Stefano" last="Masiero">Stefano Masiero</name>
<affiliation wicri:level="1"><nlm:aff id="I3">Rehabilitation Unit, Dept. of Neurology, University of Padua, Via Giustiniani 2, I-35128 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Rehabilitation Unit, Dept. of Neurology, University of Padua, Via Giustiniani 2, I-35128 Padova</wicri:regionArea>
<wicri:noRegion>I-35128 Padova</wicri:noRegion>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">23046683</idno>
<idno type="pmc">3554473</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3554473</idno>
<idno type="RBID">PMC:3554473</idno>
<idno type="doi">10.1186/1743-0003-9-79</idno>
<date when="2012">2012</date>
<idno type="wicri:Area/Pmc/Corpus">001258</idno>
<idno type="wicri:Area/Pmc/Curation">001258</idno>
<idno type="wicri:Area/Pmc/Checkpoint">001766</idno>
<idno type="wicri:Area/Ncbi/Merge">002274</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Effect of task-related continuous auditory feedback during learning of tracking motion exercises</title>
<author><name sortKey="Rosati, Giulio" sort="Rosati, Giulio" uniqKey="Rosati G" first="Giulio" last="Rosati">Giulio Rosati</name>
<affiliation wicri:level="1"><nlm:aff id="I1">Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Oscari, Fabio" sort="Oscari, Fabio" uniqKey="Oscari F" first="Fabio" last="Oscari">Fabio Oscari</name>
<affiliation wicri:level="1"><nlm:aff id="I1">Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Spagnol, Simone" sort="Spagnol, Simone" uniqKey="Spagnol S" first="Simone" last="Spagnol">Simone Spagnol</name>
<affiliation wicri:level="1"><nlm:aff id="I2">Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Avanzini, Federico" sort="Avanzini, Federico" uniqKey="Avanzini F" first="Federico" last="Avanzini">Federico Avanzini</name>
<affiliation wicri:level="1"><nlm:aff id="I2">Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova</wicri:regionArea>
<wicri:noRegion>I-35131 Padova</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Masiero, Stefano" sort="Masiero, Stefano" uniqKey="Masiero S" first="Stefano" last="Masiero">Stefano Masiero</name>
<affiliation wicri:level="1"><nlm:aff id="I3">Rehabilitation Unit, Dept. of Neurology, University of Padua, Via Giustiniani 2, I-35128 Padova, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Rehabilitation Unit, Dept. of Neurology, University of Padua, Via Giustiniani 2, I-35128 Padova</wicri:regionArea>
<wicri:noRegion>I-35128 Padova</wicri:noRegion>
</affiliation>
</author>
</analytic>
<series><title level="j">Journal of NeuroEngineering and Rehabilitation</title>
<idno type="eISSN">1743-0003</idno>
<imprint><date when="2012">2012</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><sec><title>Background</title>
<p>This paper presents the results of a set of experiments in which we used continuous auditory feedback to augment motor training exercises. This feedback modality is mostly underexploited in current robotic rehabilitation systems, which usually implement only very basic auditory interfaces. Our hypothesis is that properly designed continuous auditory feedback could be used to represent temporal and spatial information that could in turn, improve performance and motor learning.</p>
</sec>
<sec><title>Methods</title>
<p>We implemented three different experiments on healthy subjects, who were asked to track a target on a screen by moving an input device (controller) with their hand. Different visual and auditory feedback modalities were envisaged. The first experiment investigated whether continuous task-related auditory feedback can help improve performance to a greater extent than error-related audio feedback, or visual feedback alone. In the second experiment we used sensory substitution to compare different types of auditory feedback with equivalent visual feedback, in order to find out whether mapping the same information on a different sensory channel (the visual channel) yielded comparable effects with those gained in the first experiment. The final experiment applied a continuously changing visuomotor transformation between the controller and the screen and mapped kinematic information, computed in either coordinate system (controller or video), to the audio channel, in order to investigate which information was more relevant to the user.</p>
</sec>
<sec><title>Results</title>
<p>Task-related audio feedback significantly improved performance with respect to visual feedback alone, whilst error-related feedback did not. Secondly, performance in audio tasks was significantly better with respect to the equivalent sensory-substituted visual tasks. Finally, with respect to visual feedback alone, video-task-related sound feedback decreased the tracking error during the learning of a novel visuomotor perturbation, whereas controller-task-related sound feedback did not. This result was particularly interesting, as the subjects relied more on auditory augmentation of the visualized target motion (which was altered with respect to arm motion by the visuomotor perturbation), rather than on sound feedback provided in the controller space, i.e., information directly related to the effective target motion of their arm.</p>
</sec>
<sec><title>Conclusions</title>
<p>Our results indicate that auditory augmentation of visual feedback can be beneficial during the execution of upper limb movement exercises. In particular, we found that continuous task-related information provided through sound, in addition to visual feedback can improve not only performance but also the learning of a novel visuomotor perturbation. However, error-related information provided through sound did not improve performance and negatively affected learning in the presence of the visuomotor perturbation.</p>
</sec>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Kwakkel, G" uniqKey="Kwakkel G">G Kwakkel</name>
</author>
<author><name sortKey="Wagenaar, Rc" uniqKey="Wagenaar R">RC Wagenaar</name>
</author>
<author><name sortKey="Twisk, Jw" uniqKey="Twisk J">JW Twisk</name>
</author>
<author><name sortKey="Lankhorst, Gj" uniqKey="Lankhorst G">GJ Lankhorst</name>
</author>
<author><name sortKey="Koetsier, Jc" uniqKey="Koetsier J">JC Koetsier</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Reinkensmeyer, Dj" uniqKey="Reinkensmeyer D">DJ Reinkensmeyer</name>
</author>
<author><name sortKey="Emken, Jl" uniqKey="Emken J">JL Emken</name>
</author>
<author><name sortKey="Cramer, Sc" uniqKey="Cramer S">SC Cramer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Riener, R" uniqKey="Riener R">R Riener</name>
</author>
<author><name sortKey="Nef, T" uniqKey="Nef T">T Nef</name>
</author>
<author><name sortKey="Colombo, G" uniqKey="Colombo G">G Colombo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hesse, S" uniqKey="Hesse S">S Hesse</name>
</author>
<author><name sortKey="Schmidt, H" uniqKey="Schmidt H">H Schmidt</name>
</author>
<author><name sortKey="Werner, C" uniqKey="Werner C">C Werner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Krebs, H" uniqKey="Krebs H">H Krebs</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Timmermans, Aa" uniqKey="Timmermans A">AA Timmermans</name>
</author>
<author><name sortKey="Seelen, Ha" uniqKey="Seelen H">HA Seelen</name>
</author>
<author><name sortKey="Willmann, Rd" uniqKey="Willmann R">RD Willmann</name>
</author>
<author><name sortKey="Kingma, H" uniqKey="Kingma H">H Kingma</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Marchal Crespo, L" uniqKey="Marchal Crespo L">L Marchal-Crespo</name>
</author>
<author><name sortKey="Reinkensmeyer, Dj" uniqKey="Reinkensmeyer D">DJ Reinkensmeyer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Masiero, S" uniqKey="Masiero S">S Masiero</name>
</author>
<author><name sortKey="Celia, A" uniqKey="Celia A">A Celia</name>
</author>
<author><name sortKey="Armani, M" uniqKey="Armani M">M Armani</name>
</author>
<author><name sortKey="Rosati, G" uniqKey="Rosati G">G Rosati</name>
</author>
<author><name sortKey="Tavolato, B" uniqKey="Tavolato B">B Tavolato</name>
</author>
<author><name sortKey="Ferraro, C" uniqKey="Ferraro C">C Ferraro</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kwakkel, G" uniqKey="Kwakkel G">G Kwakkel</name>
</author>
<author><name sortKey="Kollen, Bj" uniqKey="Kollen B">BJ Kollen</name>
</author>
<author><name sortKey="Krebs, Hi" uniqKey="Krebs H">HI Krebs</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mehrholz, J" uniqKey="Mehrholz J">J Mehrholz</name>
</author>
<author><name sortKey="T, Tp" uniqKey="T T">TP T</name>
</author>
<author><name sortKey="Kugler, J" uniqKey="Kugler J">J Kugler</name>
</author>
<author><name sortKey="Pohl, M" uniqKey="Pohl M">M Pohl</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Prange, G" uniqKey="Prange G">G Prange</name>
</author>
<author><name sortKey="Jannink, M" uniqKey="Jannink M">M Jannink</name>
</author>
<author><name sortKey="Groothuis Oudshoorn, C" uniqKey="Groothuis Oudshoorn C">C Groothuis-Oudshoorn</name>
</author>
<author><name sortKey="Hermens, H" uniqKey="Hermens H">H Hermens</name>
</author>
<author><name sortKey="Ijzerman, M" uniqKey="Ijzerman M">M IJzerman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Masiero, S" uniqKey="Masiero S">S Masiero</name>
</author>
<author><name sortKey="Armani, M" uniqKey="Armani M">M Armani</name>
</author>
<author><name sortKey="Rosati, G" uniqKey="Rosati G">G Rosati</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rosati, G" uniqKey="Rosati G">G Rosati</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Reinkensmeyer, Dj" uniqKey="Reinkensmeyer D">DJ Reinkensmeyer</name>
</author>
<author><name sortKey="Galvez, Ja" uniqKey="Galvez J">JA Galvez</name>
</author>
<author><name sortKey="Marchal, L" uniqKey="Marchal L">L Marchal</name>
</author>
<author><name sortKey="Wolbrecht, Et" uniqKey="Wolbrecht E">ET Wolbrecht</name>
</author>
<author><name sortKey="Bobrow, Je" uniqKey="Bobrow J">JE Bobrow</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nudo, Rj" uniqKey="Nudo R">RJ Nudo</name>
</author>
<author><name sortKey="Wise, Bm" uniqKey="Wise B">BM Wise</name>
</author>
<author><name sortKey="Sifuentes, F" uniqKey="Sifuentes F">F SiFuentes</name>
</author>
<author><name sortKey="Milliken, Gw" uniqKey="Milliken G">GW Milliken</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Liepert, J" uniqKey="Liepert J">J Liepert</name>
</author>
<author><name sortKey="Bauder, H" uniqKey="Bauder H">H Bauder</name>
</author>
<author><name sortKey="Wolfgang, Hr" uniqKey="Wolfgang H">HR Wolfgang</name>
</author>
<author><name sortKey="Miltner, Wh" uniqKey="Miltner W">WH Miltner</name>
</author>
<author><name sortKey="Taub, E" uniqKey="Taub E">E Taub</name>
</author>
<author><name sortKey="Weiller, C" uniqKey="Weiller C">C Weiller</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Thoroughman, Ka" uniqKey="Thoroughman K">KA Thoroughman</name>
</author>
<author><name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Emken, J" uniqKey="Emken J">J Emken</name>
</author>
<author><name sortKey="Reinkensmeyer, Dj" uniqKey="Reinkensmeyer D">DJ Reinkensmeyer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schmidt, Ra" uniqKey="Schmidt R">RA Schmidt</name>
</author>
<author><name sortKey="Lee, Td" uniqKey="Lee T">TD Lee</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Emken, Jl" uniqKey="Emken J">JL Emken</name>
</author>
<author><name sortKey="Benitez, R" uniqKey="Benitez R">R Benitez</name>
</author>
<author><name sortKey="Sideris, A" uniqKey="Sideris A">A Sideris</name>
</author>
<author><name sortKey="Bobrow, Je" uniqKey="Bobrow J">JE Bobrow</name>
</author>
<author><name sortKey="Reinkensmeyer, Dj" uniqKey="Reinkensmeyer D">DJ Reinkensmeyer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Scheidt, Ra" uniqKey="Scheidt R">RA Scheidt</name>
</author>
<author><name sortKey="Conditt, Ma" uniqKey="Conditt M">MA Conditt</name>
</author>
<author><name sortKey="Secco, El" uniqKey="Secco E">EL Secco</name>
</author>
<author><name sortKey="Mussa Ivaldi, Fa" uniqKey="Mussa Ivaldi F">FA Mussa-Ivaldi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sober, Sj" uniqKey="Sober S">SJ Sober</name>
</author>
<author><name sortKey="Sabes, Pn" uniqKey="Sabes P">PN Sabes</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Flash, T" uniqKey="Flash T">T Flash</name>
</author>
<author><name sortKey="Hogan, N" uniqKey="Hogan N">N Hogan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Morris, D" uniqKey="Morris D">D Morris</name>
</author>
<author><name sortKey="Tan, H" uniqKey="Tan H">H Tan</name>
</author>
<author><name sortKey="Barbagli, F" uniqKey="Barbagli F">F Barbagli</name>
</author>
<author><name sortKey="Chang, T" uniqKey="Chang T">T Chang</name>
</author>
<author><name sortKey="Salisbury, K" uniqKey="Salisbury K">K Salisbury</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Johnson, M" uniqKey="Johnson M">M Johnson</name>
</author>
<author><name sortKey="Der Loos, Hv" uniqKey="Der Loos H">HV der Loos</name>
</author>
<author><name sortKey="Burgar, C" uniqKey="Burgar C">C Burgar</name>
</author>
<author><name sortKey="Shor, P" uniqKey="Shor P">P Shor</name>
</author>
<author><name sortKey="Leifer, L" uniqKey="Leifer L">L Leifer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Boian, Rf" uniqKey="Boian R">RF Boian</name>
</author>
<author><name sortKey="Deutsch, Je" uniqKey="Deutsch J">JE Deutsch</name>
</author>
<author><name sortKey="Lee, Cs" uniqKey="Lee C">CS Lee</name>
</author>
<author><name sortKey="Burdea, Gc" uniqKey="Burdea G">GC Burdea</name>
</author>
<author><name sortKey="Lewis, J" uniqKey="Lewis J">J Lewis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nef, T" uniqKey="Nef T">T Nef</name>
</author>
<author><name sortKey="Mihelj, M" uniqKey="Mihelj M">M Mihelj</name>
</author>
<author><name sortKey="Kiefer, G" uniqKey="Kiefer G">G Kiefer</name>
</author>
<author><name sortKey="Perndl, C" uniqKey="Perndl C">C Perndl</name>
</author>
<author><name sortKey="Muller, R" uniqKey="Muller R">R Muller</name>
</author>
<author><name sortKey="Riener, R" uniqKey="Riener R">R Riener</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Masiero, S" uniqKey="Masiero S">S Masiero</name>
</author>
<author><name sortKey="Celia, A" uniqKey="Celia A">A Celia</name>
</author>
<author><name sortKey="Rosati, G" uniqKey="Rosati G">G Rosati</name>
</author>
<author><name sortKey="Armani, M" uniqKey="Armani M">M Armani</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Colombo, R" uniqKey="Colombo R">R Colombo</name>
</author>
<author><name sortKey="Pisano, F" uniqKey="Pisano F">F Pisano</name>
</author>
<author><name sortKey="Micera, S" uniqKey="Micera S">S Micera</name>
</author>
<author><name sortKey="Mazzone, A" uniqKey="Mazzone A">A Mazzone</name>
</author>
<author><name sortKey="Delconte, C" uniqKey="Delconte C">C Delconte</name>
</author>
<author><name sortKey="Carrozza, Mc" uniqKey="Carrozza M">MC Carrozza</name>
</author>
<author><name sortKey="Dario, P" uniqKey="Dario P">P Dario</name>
</author>
<author><name sortKey="Minuco, G" uniqKey="Minuco G">G Minuco</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Molier, Bi" uniqKey="Molier B">BI Molier</name>
</author>
<author><name sortKey="Prange, Gb" uniqKey="Prange G">GB Prange</name>
</author>
<author><name sortKey="Buurke, Jh" uniqKey="Buurke J">JH Buurke</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Maulucci, R" uniqKey="Maulucci R">R Maulucci</name>
</author>
<author><name sortKey="Eckhouse, R" uniqKey="Eckhouse R">R Eckhouse</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Robertson, Jvg" uniqKey="Robertson J">JVG Robertson</name>
</author>
<author><name sortKey="Hoellinger, T" uniqKey="Hoellinger T">T Hoellinger</name>
</author>
<author><name sortKey="Lindberg, P" uniqKey="Lindberg P">P Lindberg</name>
</author>
<author><name sortKey="Bensmail, D" uniqKey="Bensmail D">D Bensmail</name>
</author>
<author><name sortKey="Hanneton, S" uniqKey="Hanneton S">S Hanneton</name>
</author>
<author><name sortKey="Roby Brami, A" uniqKey="Roby Brami A">A Roby-Brami</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Taylor, Ja" uniqKey="Taylor J">JA Taylor</name>
</author>
<author><name sortKey="Thoroughman, Ka" uniqKey="Thoroughman K">KA Thoroughman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rath, M" uniqKey="Rath M">M Rath</name>
</author>
<author><name sortKey="Rocchesso, D" uniqKey="Rocchesso D">D Rocchesso</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Secoli, R" uniqKey="Secoli R">R Secoli</name>
</author>
<author><name sortKey="Milot, Mh" uniqKey="Milot M">MH Milot</name>
</author>
<author><name sortKey="Rosati, G" uniqKey="Rosati G">G Rosati</name>
</author>
<author><name sortKey="Reinkensmeyer, Dj" uniqKey="Reinkensmeyer D">DJ Reinkensmeyer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Seizova Cajic, T" uniqKey="Seizova Cajic T">T Seizova-Cajic</name>
</author>
<author><name sortKey="Azzi, R" uniqKey="Azzi R">R Azzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Massimino, M" uniqKey="Massimino M">M Massimino</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cenci, S" uniqKey="Cenci S">S Cenci</name>
</author>
<author><name sortKey="Rosati, G" uniqKey="Rosati G">G Rosati</name>
</author>
<author><name sortKey="Zanotto, D" uniqKey="Zanotto D">D Zanotto</name>
</author>
<author><name sortKey="Oscari, F" uniqKey="Oscari F">F Oscari</name>
</author>
<author><name sortKey="Rossi, A" uniqKey="Rossi A">A Rossi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ronsse, R" uniqKey="Ronsse R">R Ronsse</name>
</author>
<author><name sortKey="Miall, Rc" uniqKey="Miall R">RC Miall</name>
</author>
<author><name sortKey="Swinnen, Sp" uniqKey="Swinnen S">SP Swinnen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bedford, Fl" uniqKey="Bedford F">FL Bedford</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hemond, C" uniqKey="Hemond C">C Hemond</name>
</author>
<author><name sortKey="Brown, Rm" uniqKey="Brown R">RM Brown</name>
</author>
<author><name sortKey="Robertson, Em" uniqKey="Robertson E">EM Robertson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Molier, Bi" uniqKey="Molier B">BI Molier</name>
</author>
<author><name sortKey="Van Asseldonk, Ehf" uniqKey="Van Asseldonk E">EHF Van Asseldonk</name>
</author>
<author><name sortKey="Hermens, Hj" uniqKey="Hermens H">HJ Hermens</name>
</author>
<author><name sortKey="Jannink, Mja" uniqKey="Jannink M">MJA Jannink</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article" xml:lang="en"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">J Neuroeng Rehabil</journal-id>
<journal-id journal-id-type="iso-abbrev">J Neuroeng Rehabil</journal-id>
<journal-title-group><journal-title>Journal of NeuroEngineering and Rehabilitation</journal-title>
</journal-title-group>
<issn pub-type="epub">1743-0003</issn>
<publisher><publisher-name>BioMed Central</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">23046683</article-id>
<article-id pub-id-type="pmc">3554473</article-id>
<article-id pub-id-type="publisher-id">1743-0003-9-79</article-id>
<article-id pub-id-type="doi">10.1186/1743-0003-9-79</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Research</subject>
</subj-group>
</article-categories>
<title-group><article-title>Effect of task-related continuous auditory feedback during learning of tracking motion exercises</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" corresp="yes" id="A1"><name><surname>Rosati</surname>
<given-names>Giulio</given-names>
</name>
<xref ref-type="aff" rid="I1">1</xref>
<email>giulio.rosati@unipd.it</email>
</contrib>
<contrib contrib-type="author" id="A2"><name><surname>Oscari</surname>
<given-names>Fabio</given-names>
</name>
<xref ref-type="aff" rid="I1">1</xref>
<email>fabio.oscari@unipd.it</email>
</contrib>
<contrib contrib-type="author" id="A3"><name><surname>Spagnol</surname>
<given-names>Simone</given-names>
</name>
<xref ref-type="aff" rid="I2">2</xref>
<email>simone.spagnol@dei.unipd.it</email>
</contrib>
<contrib contrib-type="author" id="A4"><name><surname>Avanzini</surname>
<given-names>Federico</given-names>
</name>
<xref ref-type="aff" rid="I2">2</xref>
<email>federico.avanzini@unipd.it</email>
</contrib>
<contrib contrib-type="author" id="A5"><name><surname>Masiero</surname>
<given-names>Stefano</given-names>
</name>
<xref ref-type="aff" rid="I3">3</xref>
<email>stef.masiero@unipd.it</email>
</contrib>
</contrib-group>
<aff id="I1"><label>1</label>
Rehabrobotics Lab, Dept. of Management and Engineering, University of Padua, Via Venezia 1, I-35131 Padova, Italy</aff>
<aff id="I2"><label>2</label>
Sound and Music Computing Group, Dept. of Information Engineering, Univ. of Padua, Via Gradenigo 6/B, I-35131 Padova, Italy</aff>
<aff id="I3"><label>3</label>
Rehabilitation Unit, Dept. of Neurology, University of Padua, Via Giustiniani 2, I-35128 Padova, Italy</aff>
<pub-date pub-type="collection"><year>2012</year>
</pub-date>
<pub-date pub-type="epub"><day>10</day>
<month>10</month>
<year>2012</year>
</pub-date>
<volume>9</volume>
<fpage>79</fpage>
<lpage>79</lpage>
<history><date date-type="received"><day>23</day>
<month>11</month>
<year>2011</year>
</date>
<date date-type="accepted"><day>26</day>
<month>7</month>
<year>2012</year>
</date>
</history>
<permissions><copyright-statement>Copyright ©2012 Rosati et al.; licensee BioMed Central Ltd.</copyright-statement>
<copyright-year>2012</copyright-year>
<copyright-holder>Rosati et al.; licensee BioMed Central Ltd.</copyright-holder>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.0"><license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/2.0">http://creativecommons.org/licenses/by/2.0</ext-link>
), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri xlink:href="http://www.jneuroengrehab.com/content/9/1/79"></self-uri>
<abstract><sec><title>Background</title>
<p>This paper presents the results of a set of experiments in which we used continuous auditory feedback to augment motor training exercises. This feedback modality is mostly underexploited in current robotic rehabilitation systems, which usually implement only very basic auditory interfaces. Our hypothesis is that properly designed continuous auditory feedback could be used to represent temporal and spatial information that could in turn, improve performance and motor learning.</p>
</sec>
<sec><title>Methods</title>
<p>We implemented three different experiments on healthy subjects, who were asked to track a target on a screen by moving an input device (controller) with their hand. Different visual and auditory feedback modalities were envisaged. The first experiment investigated whether continuous task-related auditory feedback can help improve performance to a greater extent than error-related audio feedback, or visual feedback alone. In the second experiment we used sensory substitution to compare different types of auditory feedback with equivalent visual feedback, in order to find out whether mapping the same information on a different sensory channel (the visual channel) yielded comparable effects with those gained in the first experiment. The final experiment applied a continuously changing visuomotor transformation between the controller and the screen and mapped kinematic information, computed in either coordinate system (controller or video), to the audio channel, in order to investigate which information was more relevant to the user.</p>
</sec>
<sec><title>Results</title>
<p>Task-related audio feedback significantly improved performance with respect to visual feedback alone, whilst error-related feedback did not. Secondly, performance in audio tasks was significantly better with respect to the equivalent sensory-substituted visual tasks. Finally, with respect to visual feedback alone, video-task-related sound feedback decreased the tracking error during the learning of a novel visuomotor perturbation, whereas controller-task-related sound feedback did not. This result was particularly interesting, as the subjects relied more on auditory augmentation of the visualized target motion (which was altered with respect to arm motion by the visuomotor perturbation), rather than on sound feedback provided in the controller space, i.e., information directly related to the effective target motion of their arm.</p>
</sec>
<sec><title>Conclusions</title>
<p>Our results indicate that auditory augmentation of visual feedback can be beneficial during the execution of upper limb movement exercises. In particular, we found that continuous task-related information provided through sound, in addition to visual feedback can improve not only performance but also the learning of a novel visuomotor perturbation. However, error-related information provided through sound did not improve performance and negatively affected learning in the presence of the visuomotor perturbation.</p>
</sec>
</abstract>
</article-meta>
</front>
<body><sec><title>Background</title>
<p>Over the past two decades there has been a rapid increase in the number of research groups and companies developing robotic devices for assisting movement rehabilitation of persons with disabilities (see reviews [<xref ref-type="bibr" rid="B1">1</xref>
-<xref ref-type="bibr" rid="B6">6</xref>
]). A variety of assistive control strategies have been designed (see review [<xref ref-type="bibr" rid="B7">7</xref>
]), including: robots that move limbs rigidly along fixed paths, robots that assist only if the patient’s performance fails to stay within some spatial or temporal boundary, and soft robots that form a model of the patient’s weakness. Mechanical devices for rehabilitation are, in fact, designed to interact with the human guiding the upper limb through repetitive exercises based on a stereotyped pattern, and providing force feedback for sensorimotor type rehabilitative training [<xref ref-type="bibr" rid="B8">8</xref>
].</p>
<p>Recent reviews on the first Randomized Controlled Trials (RCTs) of upper-limb robot-assisted rehabilitation outlined that clinical results are still far from being fully satisfactory [<xref ref-type="bibr" rid="B9">9</xref>
-<xref ref-type="bibr" rid="B11">11</xref>
]. Indeed, even though motor recovery is usually greater in robot-assisted groups than in control groups, only a few studies on acute and sub-acute phase robotic rehabilitation reported higher gains with respect to controls at the functional level (i.e., in the activities of daily living) [<xref ref-type="bibr" rid="B12">12</xref>
]. These results suggest that the therapy devices, exercises and protocols developed so far still need to be improved and optimized [<xref ref-type="bibr" rid="B13">13</xref>
].</p>
<p>Probably the most fundamental problem that robotic movement therapy must address in order to progress, is the lack of knowledge on how motor learning during neuro-rehabilitation works [<xref ref-type="bibr" rid="B14">14</xref>
]. Many experimental results suggest that after local damage to the motor cortex, rehabilitative training with active engagement of the participant can shape subsequent reorganization in the adjacent intact cortex, and that the undamaged motor cortex may play an important role in motor recovery [<xref ref-type="bibr" rid="B15">15</xref>
,<xref ref-type="bibr" rid="B16">16</xref>
]. There is also evidence that kinematic error drives motor adaptation [<xref ref-type="bibr" rid="B17">17</xref>
-<xref ref-type="bibr" rid="B19">19</xref>
] and moreover, that humans adapt to robot-generated dynamic environments in a way that appears to minimize a cost function in terms of both error and effort [<xref ref-type="bibr" rid="B20">20</xref>
].</p>
<p>It is also still not clear how the central nervous system combines different kinds of simultaneous feedback, such as proprioceptive and visual information or haptic feedback. It is known that visual and proprioceptive feedback may be combined in fundamentally different ways during trajectory control and final position regulation of reaching movements [<xref ref-type="bibr" rid="B21">21</xref>
] and that when estimating the position of the arm, the brain selects different combinations of sensory inputs based on the computation in which the resulting estimate will be used [<xref ref-type="bibr" rid="B22">22</xref>
]. Moreover, people tend to make straight and smooth hand movements when reaching for an object [<xref ref-type="bibr" rid="B23">23</xref>
]. These trajectory features being resistant to perturbation, and proprioceptive, as well as visual feedback may guide the adaptive updating of motor commands enforcing this regularity. Morris et al. [<xref ref-type="bibr" rid="B24">24</xref>
] found that recall following visuohaptic training, is significantly more accurate than recall following visual or haptic training alone, although haptic training alone is inferior to visual training alone. However, the precise ways that mental engagement, repetition, kinematic error, and sensory information in general, translate into a pattern of recovery, is not well defined for rehabilitation [<xref ref-type="bibr" rid="B14">14</xref>
].</p>
<p>Audio is used in many rehabilitation systems with the purpose of motivating patients in their performance, either by reinforcing the realism of the virtual reality environment [<xref ref-type="bibr" rid="B25">25</xref>
-<xref ref-type="bibr" rid="B27">27</xref>
], or by providing information to guide the execution of the task [<xref ref-type="bibr" rid="B28">28</xref>
,<xref ref-type="bibr" rid="B29">29</xref>
]. However, the potential of auditory feedback in rehabilitation systems is largely underestimated in the current literature [<xref ref-type="bibr" rid="B30">30</xref>
]. Maulucci et al. [<xref ref-type="bibr" rid="B31">31</xref>
] used audio feedback to inform stroke subjects on the deviation of their hand from the ideal motion path and found that the auditory feedback training improved performance. There is also evidence that the effect of sound feedback in reaching tasks after chronic stroke, depends on the hemisphere which was damaged by the stroke [<xref ref-type="bibr" rid="B32">32</xref>
], and that a proper sound may help individuals in learning a motor task [<xref ref-type="bibr" rid="B33">33</xref>
,<xref ref-type="bibr" rid="B34">34</xref>
], or in remaining engaged during robot assisted training in the presence of distractions [<xref ref-type="bibr" rid="B35">35</xref>
].</p>
<p>The main goal of our research is to investigate the role of sound in motor learning and motor control, as additional sensory information to the visual and proprioceptive modalities, with the aim of incorporating optimized real-time auditory feedback related to one or more variables (i.e., position error or velocity) in augmented-feedback robotic rehabilitation systems. An incentive for this research is given by the observation that audio, just like video, is more direct and requires less attention than proprioception as an input modality [<xref ref-type="bibr" rid="B36">36</xref>
]. Thus, auditory feedback may be potentially relevant, not only as a stimulation to augment a patient’s engagement and motivation, but also as additional or straightforward substitutive information, with respect to video, to improve performance and learning.</p>
<p>In this paper we present the results of three experiments on healthy subjects, in which the effects of different auditory feedback modalities during the execution of tracking motion exercises were investigated. In the first experiment, we studied whether continuous task-related auditory feedback can help to improve performance more than error-related audio feedback, or visual feedback alone. In the second experiment, we used sensory substitution [<xref ref-type="bibr" rid="B37">37</xref>
] to compare different types of auditory feedback with equivalent visual feedback, in order to find out whether mapping the same information on a different sensory channel (the visual channel), yielded comparable effects with those gained in the first experiment. In the third experiment, we applied a continuously changing visuomotor transformation between the controller and the screen and mapped kinematic information, computed in either coordinate system (controller or video), to the audio channel, in order to investigate which information was more relevant to the user.</p>
</sec>
<sec><title>Experiment #1</title>
<sec><title>Methods</title>
<sec><title>Subjects</title>
<p>A total of 20 healthy subjects participated in the experiment. They were Caucasian, aged between 21 and 29 years old (mean age 22.95±1.99), 55% male and 45% female, and right-handed. All the participants had normal vision with no color blindness and self-reported no hearing problems. Written informed consent for publication of this report and any accompanying images was obtained from the subjects involved in all experiments. All experiments were performed with the ethical approval of the Scientific Commission of the University of Padua.</p>
</sec>
<sec><title>Experimental setup</title>
<p>The experimental apparatus consisted of a Wacom pen as the input device (controller), a pair of common headphones that presented audio feedback to the user, and a full HD screen backed by a blank wall for video feedback (see Figure <xref ref-type="fig" rid="F1">1</xref>
). A simple scheme of the system’s architecture is shown in Figure <xref ref-type="fig" rid="F2">2</xref>
; the Simulink model and the joystick were not used in this experiment. The main application was implemented in MatLab.</p>
<fig id="F1" position="float"><label>Figure 1</label>
<caption><p>Healthy subject during a trial of Experiment #1.</p>
</caption>
<graphic xlink:href="1743-0003-9-79-1"></graphic>
</fig>
<fig id="F2" position="float"><label>Figure 2</label>
<caption><p><bold>Scheme of the experimental setup representing the main functional elements and data exchange between subsystems. </bold>
<italic>The Wacom pen was used in Experiment #1; the joystick in Experiment #2 and Experiment #3.</italic>
</p>
</caption>
<graphic xlink:href="1743-0003-9-79-2"></graphic>
</fig>
<p>Two color-filled, 25-pixel-radius dots were displayed on the screen; one representing the controller’s position (green dot) and the other, the target’s position (red dot). The target’s motion consisted of a left-right-left horizontal movement with a minimum-jerk velocity profile. Two different types of target motion were envisaged: </p>
<p>• a <italic>fixed-length</italic>
profile where the length of each left-right-left movement cycle was set to 60% of the screen size for all iterations within the same session, corresponding to a range of motion for the subject’s hand of nearly 300 <italic>mm</italic>
;</p>
<p>• a <italic>random-length</italic>
profile, where for each iteration the length of the segment pseudo-randomly varied from 20 to 90% of the screen size. At the end of the session, the total distance traveled by the target was the same as in the first case.</p>
<p>Audio feedback was developed in Pure Data, a real-time audio synthesis platform. The target’s and subject’s data (positions and velocities in the <italic>X</italic>
and <italic>Y </italic>
directions) were sent in real-time to Pure Data using the OSC (Open Sound Control) protocol. Two different types of audio feedback were designed: </p>
<p>• <italic>task-related</italic>
audio feedback, simulating the sound of a rolling ball;</p>
<p>• <italic>error-related</italic>
audio feedback, performing formant synthesis of voice.</p>
<p>For the task-related feedback, the velocity of the target was applied as a simple gain factor onto the output of a pink noise generator filtered through a bandpass filter with a 200-Hz center frequency and Q factor equal to 7. For the error-related feedback, the position errors between the indicator and target in both axes were used to control the parameters of a formant synthesis patch. Specifically, the X-axis position error was mapped onto the amplitude and the fundamental frequency of a synthetic vocalized sound, whilst the Y-axis position error controlled the formants (i.e., the couple of frequencies that produce a vowel) of the sound. Both audio feedbacks were processed through a binaural spatialization filter, which renders the angular position of the sound source relative to the subject in the horizontal plane.</p>
</sec>
<sec><title>Experimental protocol</title>
<p>Each participant was asked to complete six different tasks. For each task, the subject had to draw a trajectory onto the tablet with the pen in order to follow the target on the screen. The six tasks were: </p>
<p>• Task A: fixed-length trajectory without sound feedback</p>
<p>• Task B: random-length trajectory without sound feedback</p>
<p>• Task C: fixed-length trajectory with task-related sound feedback</p>
<p>• Task D: random-length trajectory with task-related sound feedback</p>
<p>• Task E: fixed-length trajectory with error-related sound feedback</p>
<p>• Task F: random-length trajectory with error-related sound feedback</p>
<p>Each task lasted 80 seconds and consisted of 13 repetitions of the left-right-left movement cycle. During each task, the target and subject’s position and velocity were sampled at a frequency of 300 <italic>Hz</italic>
. After a first warm-up task showing no target, during which the subject could get acquainted with the tablet, she or he executed all tasks in a randomly-generated sequence. During the three seconds preceding the beginning of each task, a countdown was simulated through a sequence of three tonal beeps.</p>
</sec>
<sec><title>Data analysis</title>
<p>For each participant, the integral of the relative velocity (i.e., the difference between the subject’s and target’s velocities) and the weighted position error along the horizontal direction (X-axis) were measured. Each measure was calculated for every left-right and right-left segment, then it was averaged over the whole task.</p>
<p>The <italic>integral of relative velocity</italic>
for the <italic>k</italic>
−<italic>th</italic>
segment is defined as: </p>
<p><disp-formula id="bmcM1"><label>(1)</label>
<mml:math id="M1" name="1743-0003-9-79-i1" overflow="scroll"><mml:msub><mml:mrow><mml:mi>R</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>k</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow><mml:msub><mml:mrow><mml:mi>L</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:munderover><mml:mrow><mml:mo>∫</mml:mo>
</mml:mrow>
<mml:mrow><mml:msub><mml:mrow><mml:mi>t</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:msub><mml:mrow><mml:mi>t</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>k</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:munderover>
<mml:mo>|</mml:mo>
<mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mo>→</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow><mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>|</mml:mo>
<mml:mi>dt</mml:mi>
</mml:math>
</disp-formula>
</p>
<p>where: <inline-formula><mml:math id="M2" name="1743-0003-9-79-i2" overflow="scroll"><mml:mo>|</mml:mo>
<mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mo>→</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow><mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>|</mml:mo>
<mml:mo>=</mml:mo>
<mml:mo>|</mml:mo>
<mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mo>→</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow><mml:mi>s</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mo>→</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow><mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>|</mml:mo>
</mml:math>
</inline-formula>
is the norm of the relative velocity vector, <italic>L</italic>
<sub><italic>k</italic>
</sub>
is the length of segment <italic>k</italic>
, whereas <italic>t</italic>
<sub><italic>k</italic>
</sub>
and <italic>t</italic>
<sub><italic>k</italic>
+ 1</sub>
are the beginning and end times of the segment. <italic>R</italic>
<sub><italic>v</italic>
</sub>
was calculated using the rectangle method: </p>
<p><disp-formula id="bmcM2"><label>(2)</label>
<mml:math id="M3" name="1743-0003-9-79-i3" overflow="scroll"><mml:munderover><mml:mrow><mml:mo>∑</mml:mo>
</mml:mrow>
<mml:mrow><mml:mi>h</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow><mml:mi>N</mml:mi>
</mml:mrow>
</mml:munderover>
<mml:mfrac><mml:mrow><mml:msqrt><mml:mrow><mml:msup><mml:mrow><mml:mfenced open="(" close=")"><mml:mrow><mml:msub><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>x</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>h</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>−</mml:mo>
<mml:msub><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>x</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>h</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msup>
<mml:mo>+</mml:mo>
<mml:msup><mml:mrow><mml:mfenced open="(" close=")"><mml:mrow><mml:msub><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>y</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>h</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>−</mml:mo>
<mml:msub><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>y</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>h</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:msqrt>
<mml:mo>·</mml:mo>
<mml:mi>dt</mml:mi>
</mml:mrow>
<mml:mrow><mml:msub><mml:mrow><mml:mi>L</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:math>
</disp-formula>
</p>
<p>where N is the number of samples in the segment. The <italic>R</italic>
<sub><italic>v</italic>
</sub>
parameter measures the extra distance traveled by the subject while following the target, accounting for the movements made by the subject to correct tracking errors. A null value of this metric indicates that the velocity profile of the target has been exactly reproduced by the subject, even though the average position error (in terms of a constant offset measured by the second metric) may be not null.</p>
<p>The position error along the X-axis was weighted with the sign of target velocity and normalized to the target radius <italic>R</italic>
. The <italic>average weighted position error</italic>
for segment <italic>k</italic>
is defined as: </p>
<p><disp-formula id="bmcM3"><label>(3)</label>
<mml:math id="M4" name="1743-0003-9-79-i4" overflow="scroll"><mml:msub><mml:mrow><mml:mi>e</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>x</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>k</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow><mml:mi>N</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:munderover><mml:mrow><mml:mo>∑</mml:mo>
</mml:mrow>
<mml:mrow><mml:mi>h</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow><mml:mi>N</mml:mi>
</mml:mrow>
</mml:munderover>
<mml:mfrac><mml:mrow><mml:mfenced open="(" close=")"><mml:mrow><mml:msub><mml:mrow><mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>s</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>h</mml:mi>
<mml:mo>)</mml:mo>
<mml:mo>−</mml:mo>
<mml:msub><mml:mrow><mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>h</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mfenced>
<mml:mo>·</mml:mo>
<mml:mi>sign</mml:mi>
<mml:mfenced open="(" close=")"><mml:mrow><mml:msub><mml:mrow><mml:mi>v</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>x</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>(</mml:mo>
<mml:mi>h</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow><mml:mi>R</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mi>.</mml:mi>
</mml:math>
</disp-formula>
</p>
<p>This formula takes into account the direction of motion of the target, thus showing whether the subject leads (positive error) or lags (negative error) the target during the exercise. A null value in this metric indicates that the subject had an average null delay with respect to target motion, even though the distance traveled around the target (which is measured by the first metric) may be not null.</p>
<p>The D’Agostino and Pearson omnibus normality test revealed a Gaussian distribution for both the integral of relative velocity and the weighted position error. These performance measures were compared for initial differences in SPSS through a two-way within-subjects analysis of variance (ANOVA), with feedback and trajectory as within factors. When no interaction was found, pairwise post-hoc comparisons (Bonferroni’s test) were performed to evaluate the main effects more accurately. The significance level for the data analysis was set to <italic>α</italic>
=0.05.</p>
</sec>
</sec>
<sec><title>Experimental results</title>
<p>The measures of the subjects’ performance indicated a lack of interaction between the two factors (i.e., feedback and trajectory), allowing a separate analysis of the effects due to these parameters (integral of relative velocity: <italic>F</italic>
(2,38)=0.485, <italic>p</italic>
=0.540, <inline-formula><mml:math id="M5" name="1743-0003-9-79-i5" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>025</mml:mn>
</mml:math>
</inline-formula>
; average weighted position error: <italic>F</italic>
(2,38)=0.315, <italic>p</italic>
=0.661, <inline-formula><mml:math id="M6" name="1743-0003-9-79-i6" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>016</mml:mn>
</mml:math>
</inline-formula>
).</p>
<p>The main result of the statistical analysis on the integral of relative velocity was that, as one may expect, the fixed-length task is always better executed than the corresponding random-length task (<italic>F</italic>
(1,19)=44.095, <italic>p</italic>
<0.0001, <inline-formula><mml:math id="M7" name="1743-0003-9-79-i7" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>699</mml:mn>
</mml:math>
</inline-formula>
), regardless of the audio modality employed (see Figure <xref ref-type="fig" rid="F3">3</xref>
): the subjects made significantly greater corrections in the random-length tasks with respect to the corresponding fixed-length tasks for every modality.</p>
<fig id="F3" position="float"><label>Figure 3</label>
<caption><p><bold>Integral of relative velocity for the six tasks of Experiment #1.</bold>
Significant pairwise post-hoc comparisons (Bonferroni’s test) are indicated, after performing a two-way within-subjects ANOVA (feedback ∗ trajectory: <bold>F(2,38)=0.485</bold>
, <bold>p=0.540</bold>
, <inline-formula><mml:math id="M8" name="1743-0003-9-79-i8" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mstyle mathvariant="bold"><mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">025</mml:mn>
</mml:mstyle>
</mml:math>
</inline-formula>
; trajectory: <bold>F(1,19)=44.095</bold>
, <bold>p<0.0001</bold>
, <inline-formula><mml:math id="M9" name="1743-0003-9-79-i9" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mstyle mathvariant="bold"><mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">699</mml:mn>
</mml:mstyle>
</mml:math>
</inline-formula>
; feedback: <bold>F(2,38)=0.173</bold>
, <bold>p=0.734</bold>
, <inline-formula><mml:math id="M10" name="1743-0003-9-79-i10" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mstyle mathvariant="bold"><mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">009</mml:mn>
</mml:mstyle>
</mml:math>
</inline-formula>
).</p>
</caption>
<graphic xlink:href="1743-0003-9-79-3"></graphic>
</fig>
<p>On the other hand, no statistically significant difference was found, in terms of extra distance traveled around the target, when the audio modality was changed whilst keeping the same trajectory type (<italic>F</italic>
(2,38)=0.173, <italic>p</italic>
=0.734, <inline-formula><mml:math id="M11" name="1743-0003-9-79-i11" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>009</mml:mn>
</mml:math>
</inline-formula>
), indicating that the audio modality did not affect the number of corrections made by the subject whilst tracking the target.</p>
<p>The statistical analysis on the average weighted position error revealed that, in terms of tracking delay, there is no significant difference between the fixed and random length tasks within the same audio feedback modality (Figure <xref ref-type="fig" rid="F4">4</xref>
, <italic>F</italic>
(1,19)=0.635, <italic>p</italic>
=0.435, <inline-formula><mml:math id="M12" name="1743-0003-9-79-i12" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>032</mml:mn>
</mml:math>
</inline-formula>
), indicating that the trajectory type did not affect the average tracking delay.</p>
<fig id="F4" position="float"><label>Figure 4</label>
<caption><p><bold>Average weighted position-error for the six tasks of Experiment #1.</bold>
Significant pairwise post-hoc comparisons (Bonferroni’s test) are indicated, after performing a two-way within-subjects ANOVA (feedback ∗ trajectory: <bold>F(2,38)=0.315</bold>
, <bold>p=0.661</bold>
, <inline-formula><mml:math id="M13" name="1743-0003-9-79-i13" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">016</mml:mn>
</mml:math>
</inline-formula>
; trajectory: <bold>F(1,19)=0.635</bold>
, <bold>p=0.435</bold>
, <inline-formula><mml:math id="M14" name="1743-0003-9-79-i14" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn mathvariant="bold">032</mml:mn>
</mml:math>
</inline-formula>
; feedback: <bold>F(2,38)=11.207</bold>
, <bold>p<0.0001</bold>
, <inline-formula><mml:math id="M15" name="1743-0003-9-79-i15" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">371</mml:mn>
</mml:math>
</inline-formula>
).</p>
</caption>
<graphic xlink:href="1743-0003-9-79-4"></graphic>
</fig>
<p>However, in this case the feedback modality influenced performance (<italic>F</italic>
(2,38)=11.207, <italic>p</italic>
<0.0001, <inline-formula><mml:math id="M16" name="1743-0003-9-79-i16" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>371</mml:mn>
</mml:math>
</inline-formula>
). In fact, task C presented a significantly smaller negative error with respect to tasks A and E (both <italic>p</italic>
<0.01), whilst task D did the same with respect to B and F (both <italic>p</italic>
<0.05). In other words, task-related audio feedback (C and D) helped the subjects to significantly reduce average tracking delay when compared with error-related audio feedback (E and F) and to no audio (A and B), both in the easier (fixed length) and in the more complex (random length) tasks.</p>
</sec>
</sec>
<sec><title>Experiment #2</title>
<sec><title>Methods</title>
<sec><title>Subjects</title>
<p>A total of 22 healthy subjects participated to the experiment (mean age 23±1.66, 81.8<italic>%</italic>
male and 18.2<italic>%</italic>
female). They were caucasian and right-handed, except for one subject who was left-handed. All the participants had normal vision with no color blindness, and self-reported no hearing problems.</p>
</sec>
<sec><title>Experimental setup</title>
<p>The experimental setup, shown in Figure <xref ref-type="fig" rid="F5">5</xref>
, was identical to that of Experiment #1 except for the input device; a 2-degrees-of-freedom passive joystick [<xref ref-type="bibr" rid="B38">38</xref>
] monitored through a Sensoray data acquisition board and a Simulink model (see Figure <xref ref-type="fig" rid="F2">2</xref>
again).</p>
<fig id="F5" position="float"><label>Figure 5</label>
<caption><p>Healthy subject during a trial of Experiment #2.</p>
</caption>
<graphic xlink:href="1743-0003-9-79-5"></graphic>
</fig>
<p>As in the previous experiment, we represented on the screen two color-filled dots; one for the controller (green dot) and the other for the target (red dot), and we asked participants to perform a tracking exercise along the horizontal direction of the screen. In this experiment, all tasks shared a <italic>fixed-length</italic>
trajectory with a minimum-jerk velocity profile, corresponding to a range of motion for the subject’s hand of 150 <italic>mm</italic>
.</p>
<p>Three audio feedback modalities were implemented in Pure Data: </p>
<p>• <italic>task-related</italic>
audio feedback, simulating the sound of a rolling ball;</p>
<p>• <italic>error-related</italic>
audio feedback, performing formant synthesis of voice;</p>
<p>• <italic>velocity-error-related</italic>
audio feedback, simulating DJ scratching.</p>
<p>The first two modalities were identical to those of Experiment #1. Velocity-error-related audio feedback was designed as a cubic polynomial profile of the X-axis velocity error applied onto the output of a pink noise generator filtered through a bandpass filter, set up as in the task-related audio signal. In addition, a dead zone and a sign control were added to activate feedback only in the presence of medium-to-large errors, and when the controller was moving away from the target. This audio feedback was binaurally spatialized, as in the other two modalities.</p>
<p>Three alternate visual (color) feedback modalities, substituting each of the acoustic feedbacks, were also implemented. This was obtained by means of a progressive alteration of the screen’s background color, fading from black to light blue proportionally to the mapped quantity (i.e., X-axis target velocity, X-axis position error and X-axis velocity error).</p>
</sec>
<sec><title>Experimental protocol</title>
<p>Each participant was asked to complete seven different tasks. For each task, the participant had to move the joystick with the aim of following the target on the screen. The tasks were: </p>
<p>• Task A: fixed-length trajectory with no audio and no color feedback</p>
<p>• Task B: fixed-length trajectory with position-error-related color feedback</p>
<p>• Task C: fixed-length trajectory with velocity-error-related color feedback</p>
<p>• Task D: fixed-length trajectory with task-related color feedback</p>
<p>• Task E: fixed-length trajectory with position-error-related audio feedback</p>
<p>• Task F: fixed-length trajectory with velocity-error-related audio feedback</p>
<p>• Task G: fixed-length trajectory with task-related audio feedback</p>
<p>Each task lasted about 90 seconds and consisted of 15 repetitions of the left-right-left movement cycle.</p>
<p>Each subject executed all the tasks in a randomly-generated sequence, after an initial warm-up task without the target, where the subject could get acquainted with the device. During the three seconds preceding the beginning of each task, a countdown was simulated through a sequence of three tonal beeps.</p>
</sec>
<sec><title>Data analysis</title>
<p>For this experiment we calculated the same metrics as in Experiment #1. Four participants who misinterpreted one or more color feedback tasks, were excluded from the analysis.</p>
<p>The D’Agostino and Pearson omnibus normality test revealed a Gaussian distribution for all tasks and metrics, whereas a Grubbs’ test recognized 2 outliers that were discarded. These metrics were compared for initial differences in SPSS through a one-way repeated measures analysis of variance (ANOVA). When ANOVA indicated significant differences, post-hoc tests (Bonferroni’s test) were performed to examine them in detail. The significance level for the data analysis was set to <italic>α</italic>
=0.05.</p>
</sec>
</sec>
<sec><title>Experimental results</title>
<p>The measures of subjects’ performance differed depending on the feedback modality (integral of relative velocity: <italic>F</italic>
(6,90)=7.558, <italic>p</italic>
<0.0001, <inline-formula><mml:math id="M17" name="1743-0003-9-79-i17" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>335</mml:mn>
</mml:math>
</inline-formula>
; weighted position error: <italic>F</italic>
(6,90)=24.07, <italic>p</italic>
<0.0001, <inline-formula><mml:math id="M18" name="1743-0003-9-79-i18" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>616</mml:mn>
</mml:math>
</inline-formula>
).</p>
<p>The comparison of the integral of the relative velocity between tasks A and B in Figure <xref ref-type="fig" rid="F6">6</xref>
, shows that the addition of the error-related color feedback increases the extra total distance traveled by the subject (<italic>p</italic>
<0.001). Moreover, each color feedback modality (B, C and D) induces significantly greater trajectory corrections with respect to the corresponding substituted audio modality (E, F and G; <italic>p</italic>
<0.01, <italic>p</italic>
<0.001 and <italic>p</italic>
<0.05 respectively). Concerning audio tasks, the results confirmed those found in Experiment #1 (no significance on this metric if compared with the first task), including the new sound modality (velocity-error related audio): the audio feedbacks do not significantly alter the extra total distance traveled by the subject whilst tracking the target (<italic>p</italic>
>0.05).</p>
<fig id="F6" position="float"><label>Figure 6</label>
<caption><p><bold>Integral of relative velocity measure for the seven tasks of Experiment #2.</bold>
Significant pairwise post-hoc comparisons (Bonferroni’s test) are indicated, after performing a one-way repeated-measures ANOVA (<bold>F(6,90)=7.558</bold>
, <bold>p<0.0001</bold>
, <inline-formula><mml:math id="M19" name="1743-0003-9-79-i19" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">335</mml:mn>
</mml:math>
</inline-formula>
).</p>
</caption>
<graphic xlink:href="1743-0003-9-79-6"></graphic>
</fig>
<p>Figure <xref ref-type="fig" rid="F7">7</xref>
shows the results of average weighted position error. All background-color alterations increase tracking delay if compared with task A (<italic>p</italic>
<0.001 each), and with respect to the corresponding substituted audio modality (<italic>p</italic>
<0.001 each). Concerning audio tasks, the results confirmed those found in Experiment #1 for task-related and position-error-related audio (<italic>p</italic>
<0.05 and <italic>p</italic>
>0.05), whereas velocity-error-related audio yields comparable results to task A in terms of average tracking delay (<italic>p</italic>
>0.05), as position-error-related audio does.</p>
<fig id="F7" position="float"><label>Figure 7</label>
<caption><p><bold>Average weighted position-error for the seven tasks of Experiment #2.</bold>
Significant pairwise post-hoc comparisons (Bonferroni’s test) are indicated, after performing a one-way repeated-measures ANOVA (<bold>F(6,90)=24.070</bold>
, <bold>p<0.0001</bold>
, <inline-formula><mml:math id="M20" name="1743-0003-9-79-i20" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">616</mml:mn>
</mml:math>
</inline-formula>
).</p>
</caption>
<graphic xlink:href="1743-0003-9-79-7"></graphic>
</fig>
<p>One interesting point is that auditory feedback is effective independent of the controller used in the experiments: two very different input devices (pen tablet and joystick) yielded totally comparable results.</p>
</sec>
</sec>
<sec><title>Experiment #3</title>
<sec><title>Methods</title>
<sec><title>Subjects</title>
<p>A total of 47 healthy subjects participated in the experiment (mean age 24.04±2.77, 78.7<italic>%</italic>
male and 21.3<italic>%</italic>
female). They were caucasian and right-handed, except for two subjects who were left-handed. All the participants had normal vision and self-reported no hearing problems.</p>
</sec>
<sec><title>Experimental setup</title>
<p>In this experiment we employed the same hardware and software equipment used in Experiment #2. The target movement displayed on the screen had a minimum-jerk velocity profile, in which the length of each segment: </p>
<p>• in the first phase (<italic>warm-up task</italic>
) was kept constant as in Experiment #2;</p>
<p>• in the second phase (<italic>visuomotor transformation task</italic>
) pseudo-randomly varied from 20 to 90% of screen size; in addition, the scale between the video and the joystick changed at each iteration in such a way that the required motion of the joystick remained fixed along all segments (as in the warm-up task): owing to the alteration of the video-joystick scale introduced, the random-length motion of the target visualized in this phase corresponded to the same fixed-length target motion of the subject’s hand used in the warm-up.</p>
<p>Figure <xref ref-type="fig" rid="F8">8</xref>
depicts the X position versus time of the target (green line) and of the subject (blue line) in one representative run of the visuomotor transformation task. It is clearly shown in the figure that, despite the variable amplitude of target motion, the subject tends to make a fixed amplitude motion, due to the presence of the visuomotor transformation. We can summarize by saying that, in this modality the target motion of the arm had a fixed length, whilst the motion of the target displayed on the screen had a randomly-variable length.</p>
<fig id="F8" position="float"><label>Figure 8</label>
<caption><p><bold>X position versus time of target (green line) and subject (blue line) in one representative trial of the visuomotor transformation task of Experiment #3.</bold>
Subject position has been converted into pixels for the purpose of this chart. Dashed violet lines indicate the beginning of each trajectory segment. It can be seen that despite the variable amplitude of target motion, the subject tends to make a fixed amplitude motion due to the presence of the visuomotor transformation.</p>
</caption>
<graphic xlink:href="1743-0003-9-79-8"></graphic>
</fig>
<p>Three different audio feedbacks were used: </p>
<p>• <italic>error-related</italic>
audio feedback, performing formant synthesis of voice; in this modality, the mapped quantity was the position error on the X-axis, measured on the screen;</p>
<p>• <italic>video-task-related</italic>
audio feedback, simulating the sound of a rolling ball by mapping the target velocity in screen scale;</p>
<p>• <italic>joystick-task-related</italic>
audio feedback, simulating the sound of a rolling ball by mapping the target velocity in joystick scale.</p>
<p>By using the last two modalities, we intended to test whether the effectiveness of task-related audio in reducing the average tracking error, as observed in Experiment #1 and Experiment #2, was induced by an augmented description of the visualized task, or by audio rendering of the target motion of the arm.</p>
</sec>
<sec><title>Experimental protocol</title>
<p>Subjects were randomized into four groups, based on the kind of feedback provided during the experiment: 11 subjects received no sound feedback (NF), 12 subjects received error-related sound feedback (ER), 12 subjects received video-task-related sound feedback (TR-V), and 12 subjects received joystick-task-related sound feedback (TR-J). Subjects were asked to follow the target on the screen by moving the joystick. No information on the visuomotor transformation was provided to the subjects.</p>
<p>The warm-up task was made of 20 repetitions of the fixed-length, fixed scale target trajectory. After a 5 minute rest, a sequence of three tonal beeps signaled the beginning of the visuomotor transformation task. This task, which lasted about 80 seconds, consisted of 15 repetitions of the left-right-left movement cycle with random-length, visually altered trajectory.</p>
</sec>
<sec><title>Data analysis</title>
<p>We calculated the same metrics as in Experiment #1 and Experiment #2, using the visual scale, and performed a comparison between the groups in the visuomotor transformation task.</p>
<p>The D’Agostino and Pearson omnibus normality test revealed a Gaussian distribution for all groups and metrics. In addition, a total of 6 outliers (1 for NF and ER; 2 for TR-V and TR-J) were discarded after performing a Grubbs’ test. Thus, a one-way between-subjects analysis of variance (ANOVA) was performed in SPSS to compare each metric among the different groups (i.e., among different feedback modalities). When ANOVA indicated significant differences, pairwise post-hoc tests (Bonferroni’s test) were performed. The significance level for the data analysis was set to <italic>α</italic>
=0.05.</p>
</sec>
</sec>
<sec><title>Experimental results</title>
<p>The histogram of the integral of relative velocity, shown in Figure <xref ref-type="fig" rid="F9">9</xref>
, reports no statistically significant difference between groups (<italic>F</italic>
(3,37)=1.926, <italic>p</italic>
=0.142, <inline-formula><mml:math id="M21" name="1743-0003-9-79-i21" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>135</mml:mn>
</mml:math>
</inline-formula>
), i.e., the extra total distance traveled by the subject’s hand during the task is not influenced by the audio feedback provided, and is comparable with that of group NF (no audio feedback).</p>
<fig id="F9" position="float"><label>Figure 9</label>
<caption><p><bold>Integral of relative velocity for Experiment #3.</bold>
By performing a one-way between-subjects ANOVA, the feedback modality results in a way not affecting the traveled extra distance (<bold>F(3,37)=1.926</bold>
, <bold>p=0.142</bold>
, <inline-formula><mml:math id="M22" name="1743-0003-9-79-i22" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">135</mml:mn>
</mml:math>
</inline-formula>
).</p>
</caption>
<graphic xlink:href="1743-0003-9-79-9"></graphic>
</fig>
<p>Regarding the average weighted position error (Figure <xref ref-type="fig" rid="F10">10</xref>
), the tracking delay was influenced by the feedback modality (<italic>F</italic>
(3,37)=10.100, <italic>p</italic>
<0.0001, <inline-formula><mml:math id="M23" name="1743-0003-9-79-i23" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>450</mml:mn>
</mml:math>
</inline-formula>
). In particular, we can observe that in presence of the visuomotor transformation, the error-related audio feedback yields significantly greater average tracking delays with respect to all other modalities (<italic>p</italic>
<0.05, <italic>p</italic>
<0.001, <italic>p</italic>
<0.01, respectively compared with NF, TR-V and TR-J). In other words, providing position-error related information through sound, despite being substantially equivalent to the absence of audio feedback in #1 and #2, may be detrimental during the learning of a novel visuomotor transformation.</p>
<fig id="F10" position="float"><label>Figure 10</label>
<caption><p><bold>Average weighted position-error for Experiment #3.</bold>
Significant pairwise post-hoc comparisons (Bonferroni’s test) are indicated, after performing a one-way between-subjects ANOVA (<bold>F(3,37)=10.100</bold>
, <bold>p<0.0001</bold>
, <inline-formula><mml:math id="M24" name="1743-0003-9-79-i24" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi mathvariant="bold">p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn mathvariant="bold">2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mspace width=".1em"></mml:mspace>
<mml:mo mathvariant="bold">=</mml:mo>
<mml:mn mathvariant="bold">0</mml:mn>
<mml:mi mathvariant="bold">.</mml:mi>
<mml:mn mathvariant="bold">450</mml:mn>
</mml:math>
</inline-formula>
).</p>
</caption>
<graphic xlink:href="1743-0003-9-79-10"></graphic>
</fig>
<p>On the other hand, providing task-related information through sound during learning of a novel visuomotor transformation can be beneficial, if the auditory information is consistent with that provided by visual feedback, yielding reduced average tracking delay with respect to having no audio feedback (<italic>p</italic>
<0.05). In contrast, providing auditory information related to the expected arm movement is not likely to bring benefits in the presence of a novel visuomotor transformation (<italic>p</italic>
>0.05).</p>
<p>The statistics of all experiments are summarized in Table <xref ref-type="table" rid="T1">1</xref>
.</p>
<table-wrap position="float" id="T1"><label>Table 1</label>
<caption><p>Statistical analysis on both the integral of relative velocity (<italic>R</italic>
<sub><italic>v</italic>
</sub>
) and the weighted position error (<italic>e</italic>
<sub><italic>x</italic>
</sub>
) for the three experiments</p>
</caption>
<table frame="hsides" rules="groups" border="1"><colgroup><col></col>
<col></col>
<col></col>
<col></col>
<col></col>
<col></col>
<col></col>
</colgroup>
<thead valign="top"><tr><th align="left" valign="top"><bold>Exp.</bold>
</th>
<th align="left" valign="top"><bold>Metric</bold>
</th>
<th align="left" valign="top"><bold>Test</bold>
</th>
<th align="left" valign="top"><bold>Comparisons</bold>
</th>
<th align="center" valign="top"><bold>Statistical results</bold>
</th>
<td> </td>
<td> </td>
</tr>
</thead>
<tbody valign="top"><tr><td rowspan="9" align="left" valign="top">Exp. 1<hr></hr>
</td>
<td rowspan="3" align="left" valign="top"><italic>R</italic>
<sub><italic>v</italic>
</sub>
<hr></hr>
</td>
<td rowspan="3" align="left" valign="top">ANOVA<hr></hr>
</td>
<td align="left" valign="top">Fdbk ∗ Traj<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(2,38)=0.485<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=0.540<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M25" name="1743-0003-9-79-i25" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>025</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">Traj<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(1,19)=44.095<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.0001<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M26" name="1743-0003-9-79-i26" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>699</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">Fdbk<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(2,38)=0.173<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=0.734<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M27" name="1743-0003-9-79-i27" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>009</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td rowspan="6" align="left" valign="top"><italic>e</italic>
<sub><italic>x</italic>
</sub>
<hr></hr>
</td>
<td rowspan="3" align="left" valign="top">ANOVA<hr></hr>
</td>
<td align="left" valign="top">Fdbk ∗ Traj<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(2,38)=0.315<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=0.661<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M28" name="1743-0003-9-79-i28" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>016</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">Traj<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(1,19)=0.635<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=0.435<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M29" name="1743-0003-9-79-i29" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>032</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">Fdbk<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(2,38)=11.207<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.0001<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M30" name="1743-0003-9-79-i30" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>371</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td rowspan="3" align="left" valign="top">Bonferroni<hr></hr>
</td>
<td align="left" valign="top">NF-TR<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">NF-ER<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=1.000<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">TR-ER<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td rowspan="14" align="left" valign="top">Exp. 2<hr></hr>
</td>
<td rowspan="6" align="left" valign="top"><italic>R</italic>
<sub><italic>v</italic>
</sub>
<hr></hr>
</td>
<td align="left" valign="top">ANOVA<hr></hr>
</td>
<td align="left" valign="top">Fdbk<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(6,90)=7.558<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.0001<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M31" name="1743-0003-9-79-i31" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>335</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td rowspan="5" align="left" valign="top">Bonferroni<hr></hr>
</td>
<td align="left" valign="top">A-B<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">B-E<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.01<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">C-F<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">D-G<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.05<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">A-F<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
>0.05<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td rowspan="8" align="left" valign="top"><italic>e</italic>
<sub><italic>x</italic>
</sub>
<hr></hr>
</td>
<td align="left" valign="top">ANOVA<hr></hr>
</td>
<td align="left" valign="top">Fdbk<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(6,90)=24.070<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.0001<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M32" name="1743-0003-9-79-i32" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>616</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td rowspan="7" align="left" valign="top">Bonferroni<hr></hr>
</td>
<td align="left" valign="top">A-B<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">A-C<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">A-D<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">B-E<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">C-F<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">D-G<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">A-F<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
>0.05<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top">Exp. 3<hr></hr>
</td>
<td align="left" valign="top"><italic>R</italic>
<sub><italic>v</italic>
</sub>
<hr></hr>
</td>
<td align="left" valign="top">ANOVA<hr></hr>
</td>
<td align="left" valign="top">Fdbk<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(3,37)=1.926<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
=0.142<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M33" name="1743-0003-9-79-i33" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>135</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>e</italic>
<sub><italic>x</italic>
</sub>
<hr></hr>
</td>
<td align="left" valign="top">ANOVA<hr></hr>
</td>
<td align="left" valign="top">Fdbk<hr></hr>
</td>
<td align="left" valign="top"><italic>F</italic>
(3,37)=10.100<hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.0001<hr></hr>
</td>
<td align="left" valign="top"><inline-formula><mml:math id="M34" name="1743-0003-9-79-i34" overflow="scroll"><mml:msubsup><mml:mrow><mml:mi>η</mml:mi>
</mml:mrow>
<mml:mrow><mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow><mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mi>.</mml:mi>
<mml:mn>450</mml:mn>
</mml:math>
</inline-formula>
<hr></hr>
</td>
</tr>
<tr><td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top">Bonferroni<hr></hr>
</td>
<td align="left" valign="top">ER-NF<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.05<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top">ER-TR-V<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.001<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top">ER-TR-J<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.01<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top">NF-TR-V<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
<td align="left" valign="top"><italic>p</italic>
<0.05<hr></hr>
</td>
<td align="left" valign="top"> <hr></hr>
</td>
</tr>
<tr><td align="left" valign="top"> </td>
<td align="left" valign="top"> </td>
<td align="left" valign="top"> </td>
<td align="left" valign="top">NF-TR-j</td>
<td align="left" valign="top"> </td>
<td align="left" valign="top"><italic>p</italic>
>0.05</td>
<td align="left" valign="top"> </td>
</tr>
</tbody>
</table>
<table-wrap-foot><p>The factors investigated in these experiments are either the feedback modality (Fdbk) or the trajectory profile (Traj).</p>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec><title>Discussion and conclusion</title>
<p>The results of our experiments confirm that auditory augmentation of visual feedback can be beneficial to the user’s performance in upper limb movement tasks, even in the presence of a novel visuomotor transformation. In particular, the addition of a secondary sensory channel that faithfully represents the information provided by the visual channel helps the user in having a stronger perception of the task, allowing for improved sensory-motor coordination. This result lies in accordance with [<xref ref-type="bibr" rid="B39">39</xref>
], which states that coordination variability with more than one sensory modality is smaller than with one modality only; suggesting that the performer can easily manage the integration of visual and auditory information online during task execution, thus tending to optimize the signal statistics. However, providing the same information on task or error through vision does not bring about an upgrade in performance (Experiment #2), suggesting that visual information cannot be augmented through the same channel in the experienced motion tracking tasks. In fact, replacing auditory feedback with a background color transformation on the screen led to results that are even worse than having the original visual feedback alone. This finding indicates that, in our tests, the visual channel was already saturated by the target following task, so that the background color variation turned out to be a distraction, rather than useful additional information for the user. Instead, two separated information channels (visual and auditory in our experiments), if properly coordinated, work in a parallel fashion and can contribute to performance enhancement, even in the presence of visuomotor perturbations.</p>
<p>The rolling ball paradigm for the task-related audio used in the experiments, is obviously included in this class of continuous auditory cues, being a straightforward and intuitive means of providing velocity profiles through the auditory channel. Task-related auditory feedback proved to be effective in reducing the average tracking error, even though it did not affect the number of trajectory corrections made by the subject whilst attempting to follow the target (integral of relative velocity). Such a result is consistent with the observation that this audio modality can be considered as a feed-forward input for the subject’s motor control. Conversely, providing error-related information through sound in the presence of visual feedback (through both formant synthesis reflecting position error and scratching effects reflecting velocity error, as in Experiment #2) did not affect tracking performance. This result may be explained by considering that error-related audio presents redundant information with respect to the visual modality, rather than providing an augmentation of the visual information available to the user. In addition, one may argue that the subject may expect to receive, or elaborate error related information from video rather than from the auditory sensory channel, and this may lead the subject to disregard the information received through sound.</p>
<p>Task-related audio was also effective in the presence of a visuomotor transformation explicitly designed to confuse the user (Experiment #3). In this context, the audio related to the visual scale, that was consistent with what the user actually saw on the screen, was more effective in reducing tracking delay with respect to the joystick-scale audio, which provided information on the effective target motion of the arm. This result is particularly interesting, as more correct information on desired arm motion was provided in the joystick-related modality, which in turn yielded worse results. In contrast, performance was improved by enhancing task information that was inconsistent with the desired arm motion. This finding suggests that the subject tends to expect information on task, rather than on motor command from extrinsic feedback. Secondly, video-related audio provides additional information in accordance with the sensory channel onto which the user’s attention is already focused, following a visual dominance principle. In other words, the user manages to compensate for the mismatch between the two movement ranges by relying mostly on the visual feedback, yet the sensory augmentation given by the visual-scale auditory feedback contributes to increased performance with respect to the condition where the auditory channel is not used. Conversely, creating a conflict between the audio and video modalities leads the user to maintain attention focused onto the visual input [<xref ref-type="bibr" rid="B40">40</xref>
], obtaining results comparable with those gained in absence of the audio signal. This is in agreement with [<xref ref-type="bibr" rid="B39">39</xref>
], where it is stated that misleading or noisy feedback increases coordination variability, although saturating toward the level without feedback at most.</p>
<p>The results of the experiments presented in this paper indicate that the introduction of a straightforward and meaningful auditory signal can remarkably enhance performance during the execution of motion-tracking exercises. This is most likely due to the fact that provision of additional information through the auditory system allows parallel processing. Indeed, rather than acting as a confounding influence, sound feedback enhances visuo-motor control because it provides similar information [<xref ref-type="bibr" rid="B41">41</xref>
]. We studied such an influence on healthy subjects first in order to investigate the normative response of the human motor system to auditory feedback.</p>
<p>The improvement of performance obtained from video-task-related audio in the presence of a continuously varying visuomotor perturbation, indicates that sound can be effective in supporting continuous learning of novel visuomotor transformations. Consequently, we hypothesize that a properly designed task-related audio signal, provided continuously to the user, may lead to enhanced learning in robot-assisted rehabilitation. The effects of feedback on motor performance and learning have been extensively discussed in the literature [<xref ref-type="bibr" rid="B6">6</xref>
,<xref ref-type="bibr" rid="B42">42</xref>
]. According to Timmermans et al. [<xref ref-type="bibr" rid="B6">6</xref>
], rehabilitation technology should provide both knowledge of results, as well as knowledge of performance to the patient. In addition to this, we believe that the effects of providing task-related information through sound should be investigated more thoroughly. To date, although there have been attempts to use sound in a more sophisticated way, auditory feedback is underutilized in most robotic therapy systems, playing a role as background music or signifying only the task completion in most cases [<xref ref-type="bibr" rid="B30">30</xref>
]. Nonetheless, understanding the real potential of audio in the rehabilitation context requires further investigation that will be addressed in future research.</p>
</sec>
<sec><title>Competing interests</title>
<p>The authors declare that they have no competing interests.</p>
</sec>
<sec><title>Authors’ contributions</title>
<p>All authors contributed equally to the design of experiments. Spagnol and Avanzini implemented the sound synthesis software. Rosati and Oscari leaded the experimental testing phase and performed data processing and statistical analysis. All authors read and approved the final manuscript.</p>
</sec>
</body>
<back><sec><title>Acknowledgements</title>
<p>Thanks go to Mr. Battiston, Mr. Dazzi, Mr. Gazaneo, Ms. Lorenzin, Ms. Marcato and Mr. Milani for their help in implementing the experiments, and to all the volunteers that took part in the experiments. This work was partly supported by the University of Padua (grant no. CPDA098430).</p>
</sec>
<ref-list><ref id="B1"><mixed-citation publication-type="journal"><name><surname>Kwakkel</surname>
<given-names>G</given-names>
</name>
<name><surname>Wagenaar</surname>
<given-names>RC</given-names>
</name>
<name><surname>Twisk</surname>
<given-names>JW</given-names>
</name>
<name><surname>Lankhorst</surname>
<given-names>GJ</given-names>
</name>
<name><surname>Koetsier</surname>
<given-names>JC</given-names>
</name>
<article-title>Intensity of leg and arm training after primary middle-cerebral-artery stroke: a randomised trial</article-title>
<source>Lancet</source>
<year>1999</year>
<volume>354</volume>
<fpage>191</fpage>
<lpage>196</lpage>
<pub-id pub-id-type="doi">10.1016/S0140-6736(98)09477-X</pub-id>
<pub-id pub-id-type="pmid">10421300</pub-id>
</mixed-citation>
</ref>
<ref id="B2"><mixed-citation publication-type="journal"><name><surname>Reinkensmeyer</surname>
<given-names>DJ</given-names>
</name>
<name><surname>Emken</surname>
<given-names>JL</given-names>
</name>
<name><surname>Cramer</surname>
<given-names>SC</given-names>
</name>
<article-title>Post-stroke upper extremity rehabilitation: a review of robotic systems and clinical results</article-title>
<source>Annu Rev Biomed Eng</source>
<year>2004</year>
<volume>6</volume>
<fpage>497</fpage>
<lpage>525</lpage>
<pub-id pub-id-type="doi">10.1146/annurev.bioeng.6.040803.140223</pub-id>
<pub-id pub-id-type="pmid">15255778</pub-id>
</mixed-citation>
</ref>
<ref id="B3"><mixed-citation publication-type="journal"><name><surname>Riener</surname>
<given-names>R</given-names>
</name>
<name><surname>Nef</surname>
<given-names>T</given-names>
</name>
<name><surname>Colombo</surname>
<given-names>G</given-names>
</name>
<article-title>Robot-aided neurorehabilitation of the upper extremities</article-title>
<source>Med Biol Eng Comput</source>
<year>2005</year>
<volume>43</volume>
<fpage>2</fpage>
<lpage>10</lpage>
<pub-id pub-id-type="doi">10.1007/BF02345116</pub-id>
<pub-id pub-id-type="pmid">15742713</pub-id>
</mixed-citation>
</ref>
<ref id="B4"><mixed-citation publication-type="journal"><name><surname>Hesse</surname>
<given-names>S</given-names>
</name>
<name><surname>Schmidt</surname>
<given-names>H</given-names>
</name>
<name><surname>Werner</surname>
<given-names>C</given-names>
</name>
<article-title>Machines to support motor rehabilitation after stroke: 10 years of experience in Berlin</article-title>
<source>J Rehabil Res Dev</source>
<year>2006</year>
<volume>43</volume>
<fpage>671</fpage>
<lpage>678</lpage>
<pub-id pub-id-type="doi">10.1682/JRRD.2005.02.0052</pub-id>
<pub-id pub-id-type="pmid">17123207</pub-id>
</mixed-citation>
</ref>
<ref id="B5"><mixed-citation publication-type="other"><name><surname>Krebs</surname>
<given-names>H</given-names>
</name>
<article-title>Robot-mediated Movement Therapy: a Tool for Training and Evaluation</article-title>
<source>In Proceedings of the European Symposium on Technical Aids for Rehabilitation 2007</source>
<comment>Technical University of Berlin</comment>
</mixed-citation>
</ref>
<ref id="B6"><mixed-citation publication-type="journal"><name><surname>Timmermans</surname>
<given-names>AA</given-names>
</name>
<name><surname>Seelen</surname>
<given-names>HA</given-names>
</name>
<name><surname>Willmann</surname>
<given-names>RD</given-names>
</name>
<name><surname>Kingma</surname>
<given-names>H</given-names>
</name>
<article-title>Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design</article-title>
<source>J NeuroEng Rehabil</source>
<year>2009</year>
<volume>6</volume>
<fpage>1</fpage>
<pub-id pub-id-type="doi">10.1186/1743-0003-6-1</pub-id>
<pub-id pub-id-type="pmid">19154570</pub-id>
</mixed-citation>
</ref>
<ref id="B7"><mixed-citation publication-type="journal"><name><surname>Marchal-Crespo</surname>
<given-names>L</given-names>
</name>
<name><surname>Reinkensmeyer</surname>
<given-names>DJ</given-names>
</name>
<article-title>Review of control strategies for robotic movement training after neurologic injury</article-title>
<source>J NeuroEng Rehabil</source>
<year>2008</year>
<volume>6</volume>
<fpage>20</fpage>
<pub-id pub-id-type="pmid">19531254</pub-id>
</mixed-citation>
</ref>
<ref id="B8"><mixed-citation publication-type="journal"><name><surname>Masiero</surname>
<given-names>S</given-names>
</name>
<name><surname>Celia</surname>
<given-names>A</given-names>
</name>
<name><surname>Armani</surname>
<given-names>M</given-names>
</name>
<name><surname>Rosati</surname>
<given-names>G</given-names>
</name>
<name><surname>Tavolato</surname>
<given-names>B</given-names>
</name>
<name><surname>Ferraro</surname>
<given-names>C</given-names>
</name>
<article-title>Robot-aided intensive training in post-stroke recovery</article-title>
<source>Aging Clin Exp Res</source>
<year>2006</year>
<volume>18</volume>
<issue>3</issue>
<fpage>261</fpage>
<lpage>265</lpage>
<pub-id pub-id-type="pmid">16804374</pub-id>
</mixed-citation>
</ref>
<ref id="B9"><mixed-citation publication-type="journal"><name><surname>Kwakkel</surname>
<given-names>G</given-names>
</name>
<name><surname>Kollen</surname>
<given-names>BJ</given-names>
</name>
<name><surname>Krebs</surname>
<given-names>HI</given-names>
</name>
<article-title>Effects of Robot-Assisted Therapy on Upper Limb Recovery After Stroke: a Systematic Review</article-title>
<source>Neurorehab Neural Repair</source>
<year>2008</year>
<volume>22</volume>
<issue>2</issue>
<fpage>111</fpage>
<lpage>121</lpage>
</mixed-citation>
</ref>
<ref id="B10"><mixed-citation publication-type="journal"><name><surname>Mehrholz</surname>
<given-names>J</given-names>
</name>
<name><surname>T</surname>
<given-names>TP</given-names>
</name>
<name><surname>Kugler</surname>
<given-names>J</given-names>
</name>
<name><surname>Pohl</surname>
<given-names>M</given-names>
</name>
<article-title>Electromechanical and robot-assisted arm training for improving arm function and activities of daily living after stroke</article-title>
<source>Cochrane Database Syst Rev</source>
<year>2008</year>
<volume>4</volume>
<fpage>CD006876</fpage>
<pub-id pub-id-type="pmid">18843735</pub-id>
</mixed-citation>
</ref>
<ref id="B11"><mixed-citation publication-type="journal"><name><surname>Prange</surname>
<given-names>G</given-names>
</name>
<name><surname>Jannink</surname>
<given-names>M</given-names>
</name>
<name><surname>Groothuis-Oudshoorn</surname>
<given-names>C</given-names>
</name>
<name><surname>Hermens</surname>
<given-names>H</given-names>
</name>
<name><surname>IJzerman</surname>
<given-names>M</given-names>
</name>
<article-title>Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke</article-title>
<source>J Rehabil Res Dev</source>
<year>2006</year>
<volume>43</volume>
<issue>2</issue>
<fpage>171</fpage>
<lpage>183</lpage>
<pub-id pub-id-type="doi">10.1682/JRRD.2005.04.0076</pub-id>
<pub-id pub-id-type="pmid">16847784</pub-id>
</mixed-citation>
</ref>
<ref id="B12"><mixed-citation publication-type="journal"><name><surname>Masiero</surname>
<given-names>S</given-names>
</name>
<name><surname>Armani</surname>
<given-names>M</given-names>
</name>
<name><surname>Rosati</surname>
<given-names>G</given-names>
</name>
<article-title>Upper-limb robot-assisted therapy in rehabilitation of acute stroke patients: focused review and results of new randomized controlled trial</article-title>
<source>J Rehabil Res Dev</source>
<year>2011</year>
<volume>48</volume>
<issue>4</issue>
<fpage>355</fpage>
<lpage>366</lpage>
<pub-id pub-id-type="doi">10.1682/JRRD.2010.04.0063</pub-id>
<pub-id pub-id-type="pmid">21674388</pub-id>
</mixed-citation>
</ref>
<ref id="B13"><mixed-citation publication-type="journal"><name><surname>Rosati</surname>
<given-names>G</given-names>
</name>
<article-title>The place of robotics in post-stroke rehabilitation</article-title>
<source>Expert Rev Med Devices</source>
<year>2010</year>
<volume>7</volume>
<issue>6</issue>
<fpage>753</fpage>
<lpage>758</lpage>
<pub-id pub-id-type="doi">10.1586/erd.10.49</pub-id>
<pub-id pub-id-type="pmid">21050086</pub-id>
</mixed-citation>
</ref>
<ref id="B14"><mixed-citation publication-type="book"><name><surname>Reinkensmeyer</surname>
<given-names>DJ</given-names>
</name>
<name><surname>Galvez</surname>
<given-names>JA</given-names>
</name>
<name><surname>Marchal</surname>
<given-names>L</given-names>
</name>
<name><surname>Wolbrecht</surname>
<given-names>ET</given-names>
</name>
<name><surname>Bobrow</surname>
<given-names>JE</given-names>
</name>
<article-title>Some Key Problems for Robot-Assisted Movement Therapy Research: A perspective from the University of California at Irvine</article-title>
<source>Proceedings of IEEE 10th International Conference on Rehabilitation Robotics 2007</source>
<year>2007</year>
<publisher-name>Noordwijk, the Netherlands</publisher-name>
<fpage>1009</fpage>
<lpage>1015</lpage>
</mixed-citation>
</ref>
<ref id="B15"><mixed-citation publication-type="journal"><name><surname>Nudo</surname>
<given-names>RJ</given-names>
</name>
<name><surname>Wise</surname>
<given-names>BM</given-names>
</name>
<name><surname>SiFuentes</surname>
<given-names>F</given-names>
</name>
<name><surname>Milliken</surname>
<given-names>GW</given-names>
</name>
<article-title>Neural substrates for the effects of rehabilitative training on motor recovery after ischemic infarct</article-title>
<source>Science</source>
<year>1996</year>
<volume>272</volume>
<fpage>1791</fpage>
<lpage>1794</lpage>
<pub-id pub-id-type="doi">10.1126/science.272.5269.1791</pub-id>
<pub-id pub-id-type="pmid">8650578</pub-id>
</mixed-citation>
</ref>
<ref id="B16"><mixed-citation publication-type="journal"><name><surname>Liepert</surname>
<given-names>J</given-names>
</name>
<name><surname>Bauder</surname>
<given-names>H</given-names>
</name>
<name><surname>Wolfgang</surname>
<given-names>HR</given-names>
</name>
<name><surname>Miltner</surname>
<given-names>WH</given-names>
</name>
<name><surname>Taub</surname>
<given-names>E</given-names>
</name>
<name><surname>Weiller</surname>
<given-names>C</given-names>
</name>
<article-title>Treatment-induced cortical reorganization after stroke in humans</article-title>
<source>Stroke</source>
<year>2000</year>
<volume>31</volume>
<fpage>1210</fpage>
<lpage>6</lpage>
<pub-id pub-id-type="doi">10.1161/01.STR.31.6.1210</pub-id>
<pub-id pub-id-type="pmid">10835434</pub-id>
</mixed-citation>
</ref>
<ref id="B17"><mixed-citation publication-type="journal"><name><surname>Thoroughman</surname>
<given-names>KA</given-names>
</name>
<name><surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
<article-title>Learning of action through adaptive combination of motor primitives</article-title>
<source>Stroke</source>
<year>2000</year>
<volume>407</volume>
<fpage>742</fpage>
<lpage>7</lpage>
</mixed-citation>
</ref>
<ref id="B18"><mixed-citation publication-type="journal"><name><surname>Emken</surname>
<given-names>J</given-names>
</name>
<name><surname>Reinkensmeyer</surname>
<given-names>DJ</given-names>
</name>
<article-title>Robot-enhanced motor learning: Accelerating internal model formation during locomotion by transient dynamic amplification</article-title>
<source>IEEE Trans Neural Syst Rehabil Eng</source>
<year>2005</year>
<volume>99</volume>
<fpage>1</fpage>
<lpage>7</lpage>
</mixed-citation>
</ref>
<ref id="B19"><mixed-citation publication-type="book"><name><surname>Schmidt</surname>
<given-names>RA</given-names>
</name>
<name><surname>Lee</surname>
<given-names>TD</given-names>
</name>
<source>Motor control and Learning: A behavioral Emphasis. Champaign, IL</source>
<year>2005</year>
<publisher-name>USA: Human Kinetics Publishers</publisher-name>
</mixed-citation>
</ref>
<ref id="B20"><mixed-citation publication-type="journal"><name><surname>Emken</surname>
<given-names>JL</given-names>
</name>
<name><surname>Benitez</surname>
<given-names>R</given-names>
</name>
<name><surname>Sideris</surname>
<given-names>A</given-names>
</name>
<name><surname>Bobrow</surname>
<given-names>JE</given-names>
</name>
<name><surname>Reinkensmeyer</surname>
<given-names>DJ</given-names>
</name>
<article-title>Motor adaptation as a greedy optimization of error and effort</article-title>
<source>J Neurophys</source>
<year>2007</year>
<volume>97</volume>
<fpage>3997</fpage>
<lpage>4006</lpage>
<pub-id pub-id-type="doi">10.1152/jn.01095.2006</pub-id>
</mixed-citation>
</ref>
<ref id="B21"><mixed-citation publication-type="journal"><name><surname>Scheidt</surname>
<given-names>RA</given-names>
</name>
<name><surname>Conditt</surname>
<given-names>MA</given-names>
</name>
<name><surname>Secco</surname>
<given-names>EL</given-names>
</name>
<name><surname>Mussa-Ivaldi</surname>
<given-names>FA</given-names>
</name>
<article-title>Interaction of visual and proprioceptive feedback during adaptation of human reaching movements</article-title>
<source>J neurophys</source>
<year>2005</year>
<volume>93</volume>
<issue>6</issue>
<fpage>3200</fpage>
<lpage>13</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00947.2004</pub-id>
</mixed-citation>
</ref>
<ref id="B22"><mixed-citation publication-type="journal"><name><surname>Sober</surname>
<given-names>SJ</given-names>
</name>
<name><surname>Sabes</surname>
<given-names>PN</given-names>
</name>
<article-title>Multisensory integration during motor planning</article-title>
<source>J neurosci: off j Soc for Neurosci</source>
<year>2003</year>
<volume>23</volume>
<issue>18</issue>
<fpage>6982</fpage>
<lpage>92</lpage>
</mixed-citation>
</ref>
<ref id="B23"><mixed-citation publication-type="journal"><name><surname>Flash</surname>
<given-names>T</given-names>
</name>
<name><surname>Hogan</surname>
<given-names>N</given-names>
</name>
<article-title>The coordination of arm movements: an experimentally confirmed mathematical model</article-title>
<source>J neurosci: official j Soc Neurosci</source>
<year>1985</year>
<volume>5</volume>
<issue>7</issue>
<fpage>1688</fpage>
<lpage>703</lpage>
</mixed-citation>
</ref>
<ref id="B24"><mixed-citation publication-type="book"><name><surname>Morris</surname>
<given-names>D</given-names>
</name>
<name><surname>Tan</surname>
<given-names>H</given-names>
</name>
<name><surname>Barbagli</surname>
<given-names>F</given-names>
</name>
<name><surname>Chang</surname>
<given-names>T</given-names>
</name>
<name><surname>Salisbury</surname>
<given-names>K</given-names>
</name>
<article-title>Haptic Feedback Enhances Force Skill Learning</article-title>
<source>Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 2007</source>
<year>2007</year>
<publisher-name>Tsukuba, Japan</publisher-name>
<fpage>21</fpage>
<lpage>26</lpage>
</mixed-citation>
</ref>
<ref id="B25"><mixed-citation publication-type="journal"><name><surname>Johnson</surname>
<given-names>M</given-names>
</name>
<name><surname>der Loos</surname>
<given-names>HV</given-names>
</name>
<name><surname>Burgar</surname>
<given-names>C</given-names>
</name>
<name><surname>Shor</surname>
<given-names>P</given-names>
</name>
<name><surname>Leifer</surname>
<given-names>L</given-names>
</name>
<article-title>Design and evaluation of driver’s seat: a car steering simulation environment for upper limb stroke therapy</article-title>
<source>Robotica</source>
<year>2003</year>
<volume>21</volume>
<fpage>13</fpage>
<lpage>23</lpage>
</mixed-citation>
</ref>
<ref id="B26"><mixed-citation publication-type="journal"><name><surname>Boian</surname>
<given-names>RF</given-names>
</name>
<name><surname>Deutsch</surname>
<given-names>JE</given-names>
</name>
<name><surname>Lee</surname>
<given-names>CS</given-names>
</name>
<name><surname>Burdea</surname>
<given-names>GC</given-names>
</name>
<name><surname>Lewis</surname>
<given-names>J</given-names>
</name>
<article-title>Haptic Effects for Virtual Reality-Based Post-Stroke Rehabilitation</article-title>
<source>Haptics</source>
<year>2003</year>
<volume>00</volume>
<fpage>247</fpage>
</mixed-citation>
</ref>
<ref id="B27"><mixed-citation publication-type="book"><name><surname>Nef</surname>
<given-names>T</given-names>
</name>
<name><surname>Mihelj</surname>
<given-names>M</given-names>
</name>
<name><surname>Kiefer</surname>
<given-names>G</given-names>
</name>
<name><surname>Perndl</surname>
<given-names>C</given-names>
</name>
<name><surname>Muller</surname>
<given-names>R</given-names>
</name>
<name><surname>Riener</surname>
<given-names>R</given-names>
</name>
<article-title>ARMin - Exoskeleton for Arm Therapy in Stroke Patients</article-title>
<source>Proceedings of IEEE 10th International Conference on Rehabilitation Robotics 2007</source>
<year>2007</year>
<publisher-name>Noordwijk, the Netherlands</publisher-name>
<fpage>68</fpage>
<lpage>74</lpage>
</mixed-citation>
</ref>
<ref id="B28"><mixed-citation publication-type="journal"><name><surname>Masiero</surname>
<given-names>S</given-names>
</name>
<name><surname>Celia</surname>
<given-names>A</given-names>
</name>
<name><surname>Rosati</surname>
<given-names>G</given-names>
</name>
<name><surname>Armani</surname>
<given-names>M</given-names>
</name>
<article-title>Robotic-Assisted Rehabilitation of the Upper Limb After Acute Stroke</article-title>
<source>Arch Phys Med Rehabil</source>
<year>2007</year>
<volume>88</volume>
<issue>2</issue>
<fpage>142</fpage>
<lpage>149</lpage>
<pub-id pub-id-type="doi">10.1016/j.apmr.2006.10.032</pub-id>
<pub-id pub-id-type="pmid">17270510</pub-id>
</mixed-citation>
</ref>
<ref id="B29"><mixed-citation publication-type="journal"><name><surname>Colombo</surname>
<given-names>R</given-names>
</name>
<name><surname>Pisano</surname>
<given-names>F</given-names>
</name>
<name><surname>Micera</surname>
<given-names>S</given-names>
</name>
<name><surname>Mazzone</surname>
<given-names>A</given-names>
</name>
<name><surname>Delconte</surname>
<given-names>C</given-names>
</name>
<name><surname>Carrozza</surname>
<given-names>MC</given-names>
</name>
<name><surname>Dario</surname>
<given-names>P</given-names>
</name>
<name><surname>Minuco</surname>
<given-names>G</given-names>
</name>
<article-title>Robotic Techniques for Upper Limb Evaluation and Rehabilitation of Stroke Patients</article-title>
<source>TNSRE</source>
<year>2005</year>
<volume>13</volume>
<issue>3</issue>
<fpage>311</fpage>
<lpage>324</lpage>
</mixed-citation>
</ref>
<ref id="B30"><mixed-citation publication-type="book"><name><surname>Molier</surname>
<given-names>BI</given-names>
</name>
<name><surname>Prange</surname>
<given-names>GB</given-names>
</name>
<name><surname>Buurke</surname>
<given-names>JH</given-names>
</name>
<article-title>The role of visual feedback in conventional therapy and future research</article-title>
<source>Proceedings of the IEEE 12th International Conference on Virtual Rehabilitation 2011</source>
<publisher-name>Zurich, CH</publisher-name>
</mixed-citation>
</ref>
<ref id="B31"><mixed-citation publication-type="journal"><name><surname>Maulucci</surname>
<given-names>R</given-names>
</name>
<name><surname>Eckhouse</surname>
<given-names>R</given-names>
</name>
<article-title>Retraining reaching in chronic stroke with real-time auditory feedback</article-title>
<source>NeuroRehabil</source>
<year>2001</year>
<volume>16</volume>
<fpage>171</fpage>
<lpage>182</lpage>
</mixed-citation>
</ref>
<ref id="B32"><mixed-citation publication-type="journal"><name><surname>Robertson</surname>
<given-names>JVG</given-names>
</name>
<name><surname>Hoellinger</surname>
<given-names>T</given-names>
</name>
<name><surname>Lindberg</surname>
<given-names>P</given-names>
</name>
<name><surname>Bensmail</surname>
<given-names>D</given-names>
</name>
<name><surname>Hanneton</surname>
<given-names>S</given-names>
</name>
<name><surname>Roby-Brami</surname>
<given-names>A</given-names>
</name>
<article-title>Effect of auditory feedback differs according to side of hemiparesis: a comparative pilot study</article-title>
<source>J NeuroEng Rehabil</source>
<year>2009</year>
<volume>6</volume>
<fpage>45</fpage>
<pub-id pub-id-type="doi">10.1186/1743-0003-6-45</pub-id>
<pub-id pub-id-type="pmid">20017935</pub-id>
</mixed-citation>
</ref>
<ref id="B33"><mixed-citation publication-type="journal"><name><surname>Taylor</surname>
<given-names>JA</given-names>
</name>
<name><surname>Thoroughman</surname>
<given-names>KA</given-names>
</name>
<article-title>Divided Attention Impairs Human Motor Adaptation But Not Feedback Control</article-title>
<source>J Neurophys</source>
<year>2007</year>
<volume>98</volume>
<issue>1</issue>
<fpage>317</fpage>
<lpage>326</lpage>
<pub-id pub-id-type="doi">10.1152/jn.01070.2006</pub-id>
</mixed-citation>
</ref>
<ref id="B34"><mixed-citation publication-type="journal"><name><surname>Rath</surname>
<given-names>M</given-names>
</name>
<name><surname>Rocchesso</surname>
<given-names>D</given-names>
</name>
<article-title>Continuous sonic feedback from a rolling ball</article-title>
<source>Multimedia, IEEE</source>
<year>2005</year>
<volume>12</volume>
<issue>2</issue>
<fpage>60</fpage>
<lpage>69</lpage>
<pub-id pub-id-type="doi">10.1109/MMUL.2005.24</pub-id>
</mixed-citation>
</ref>
<ref id="B35"><mixed-citation publication-type="journal"><name><surname>Secoli</surname>
<given-names>R</given-names>
</name>
<name><surname>Milot</surname>
<given-names>MH</given-names>
</name>
<name><surname>Rosati</surname>
<given-names>G</given-names>
</name>
<name><surname>Reinkensmeyer</surname>
<given-names>DJ</given-names>
</name>
<article-title>Effect of visual distraction and auditory feedback on patient effort during robot-assisted movement training after stroke</article-title>
<source>J NeuroEng Rehabil</source>
<year>2011</year>
<volume>8</volume>
<fpage>21</fpage>
<pub-id pub-id-type="doi">10.1186/1743-0003-8-21</pub-id>
<pub-id pub-id-type="pmid">21513561</pub-id>
</mixed-citation>
</ref>
<ref id="B36"><mixed-citation publication-type="journal"><name><surname>Seizova-Cajic</surname>
<given-names>T</given-names>
</name>
<name><surname>Azzi</surname>
<given-names>R</given-names>
</name>
<article-title>A visual distracter task during adaptation reduces the proprioceptive movement aftereffect</article-title>
<source>Exp Brain Res</source>
<year>2010</year>
<volume>203</volume>
<fpage>213</fpage>
<lpage>219</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-010-2204-8</pub-id>
<pub-id pub-id-type="pmid">20221589</pub-id>
</mixed-citation>
</ref>
<ref id="B37"><mixed-citation publication-type="journal"><name><surname>Massimino</surname>
<given-names>M</given-names>
</name>
<article-title>Improved force perception through sensory substitution</article-title>
<source>Control Eng Pract</source>
<year>1995</year>
<volume>3</volume>
<issue>2</issue>
<fpage>215</fpage>
<lpage>222</lpage>
<pub-id pub-id-type="doi">10.1016/0967-0661(94)00079-V</pub-id>
</mixed-citation>
</ref>
<ref id="B38"><mixed-citation publication-type="book"><name><surname>Cenci</surname>
<given-names>S</given-names>
</name>
<name><surname>Rosati</surname>
<given-names>G</given-names>
</name>
<name><surname>Zanotto</surname>
<given-names>D</given-names>
</name>
<name><surname>Oscari</surname>
<given-names>F</given-names>
</name>
<name><surname>Rossi</surname>
<given-names>A</given-names>
</name>
<article-title>First test results of a haptic tele-operation system to enhance stability of telescopic handlers</article-title>
<source>Proceedings of the ASME 10th Biennial Conference on Engineering Systems Design and Analysis 2010</source>
<publisher-name>Istanbul, Turkey</publisher-name>
</mixed-citation>
</ref>
<ref id="B39"><mixed-citation publication-type="journal"><name><surname>Ronsse</surname>
<given-names>R</given-names>
</name>
<name><surname>Miall</surname>
<given-names>RC</given-names>
</name>
<name><surname>Swinnen</surname>
<given-names>SP</given-names>
</name>
<article-title>Multisensory integration in dynamical behaviors: maximum likelihood estimation across bimanual skill learning</article-title>
<source>J Neuroscience</source>
<year>2009</year>
<volume>29</volume>
<issue>26</issue>
<fpage>8419</fpage>
<lpage>28</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5734-08.2009</pub-id>
</mixed-citation>
</ref>
<ref id="B40"><mixed-citation publication-type="journal"><name><surname>Bedford</surname>
<given-names>FL</given-names>
</name>
<article-title>Can a space-perception conflict be solved with three sense modalities?</article-title>
<source>Perception</source>
<year>2007</year>
<volume>36</volume>
<fpage>508</fpage>
<lpage>515</lpage>
<pub-id pub-id-type="doi">10.1068/p5632</pub-id>
<pub-id pub-id-type="pmid">17564197</pub-id>
</mixed-citation>
</ref>
<ref id="B41"><mixed-citation publication-type="journal"><name><surname>Hemond</surname>
<given-names>C</given-names>
</name>
<name><surname>Brown</surname>
<given-names>RM</given-names>
</name>
<name><surname>Robertson</surname>
<given-names>EM</given-names>
</name>
<article-title>A Distraction Can Impair or Enhance Motor Performance</article-title>
<source>J Neurosci</source>
<year>2010</year>
<volume>30</volume>
<issue>2</issue>
<fpage>650</fpage>
<lpage>654</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4592-09.2010</pub-id>
<pub-id pub-id-type="pmid">20071529</pub-id>
</mixed-citation>
</ref>
<ref id="B42"><mixed-citation publication-type="journal"><name><surname>Molier</surname>
<given-names>BI</given-names>
</name>
<name><surname>Van Asseldonk</surname>
<given-names>EHF</given-names>
</name>
<name><surname>Hermens</surname>
<given-names>HJ</given-names>
</name>
<name><surname>Jannink</surname>
<given-names>MJA</given-names>
</name>
<article-title>Nature, timing, frequency and type of augmented feedback; does it influence motor relearning of the hemiparetic arm after stroke? A systematic review</article-title>
<source>Disabil Rehabil</source>
<year>2010</year>
<volume>32</volume>
<issue>22</issue>
<fpage>1799</fpage>
<lpage>809</lpage>
<pub-id pub-id-type="doi">10.3109/09638281003734359</pub-id>
<pub-id pub-id-type="pmid">20345249</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
<affiliations><list><country><li>Italie</li>
</country>
</list>
<tree><country name="Italie"><noRegion><name sortKey="Rosati, Giulio" sort="Rosati, Giulio" uniqKey="Rosati G" first="Giulio" last="Rosati">Giulio Rosati</name>
</noRegion>
<name sortKey="Avanzini, Federico" sort="Avanzini, Federico" uniqKey="Avanzini F" first="Federico" last="Avanzini">Federico Avanzini</name>
<name sortKey="Masiero, Stefano" sort="Masiero, Stefano" uniqKey="Masiero S" first="Stefano" last="Masiero">Stefano Masiero</name>
<name sortKey="Oscari, Fabio" sort="Oscari, Fabio" uniqKey="Oscari F" first="Fabio" last="Oscari">Fabio Oscari</name>
<name sortKey="Spagnol, Simone" sort="Spagnol, Simone" uniqKey="Spagnol S" first="Simone" last="Spagnol">Simone Spagnol</name>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Ncbi/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002274 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd -nk 002274 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Ncbi |étape= Merge |type= RBID |clé= PMC:3554473 |texte= Effect of task-related continuous auditory feedback during learning of tracking motion exercises }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/RBID.i -Sk "pubmed:23046683" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |