A synergy-based hand control is encoded in human motor cortical areas
Identifieur interne : 002828 ( Pmc/Checkpoint ); précédent : 002827; suivant : 002829A synergy-based hand control is encoded in human motor cortical areas
Auteurs : Andrea Leo [Italie] ; Giacomo Handjaras [Italie] ; Matteo Bianchi [Italie] ; Hamal Marino [Italie] ; Marco Gabiccini [Italie] ; Andrea Guidi [Italie] ; Enzo Pasquale Scilingo [Italie] ; Pietro Pietrini [Italie] ; Antonio Bicchi [Italie] ; Marco Santello [États-Unis] ; Emiliano Ricciardi [Italie]Source :
- eLife [ 2050-084X ] ; ????.
Abstract
How the human brain controls hand movements to carry out different tasks is still debated. The concept of
Url:
DOI: 10.7554/eLife.13420
PubMed: 26880543
PubMed Central: 4786436
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
PMC:4786436Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">A synergy-based hand control is encoded in human motor cortical areas</title>
<author><name sortKey="Leo, Andrea" sort="Leo, Andrea" uniqKey="Leo A" first="Andrea" last="Leo">Andrea Leo</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Handjaras, Giacomo" sort="Handjaras, Giacomo" uniqKey="Handjaras G" first="Giacomo" last="Handjaras">Giacomo Handjaras</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Bianchi, Matteo" sort="Bianchi, Matteo" uniqKey="Bianchi M" first="Matteo" last="Bianchi">Matteo Bianchi</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution content-type="dept">Advanced Robotics Department</institution>
,<institution>Istituto Italiano di Tecnologia</institution>
,<addr-line>Genova</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Marino, Hamal" sort="Marino, Hamal" uniqKey="Marino H" first="Hamal" last="Marino">Hamal Marino</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Gabiccini, Marco" sort="Gabiccini, Marco" uniqKey="Gabiccini M" first="Marco" last="Gabiccini">Marco Gabiccini</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution content-type="dept">Advanced Robotics Department</institution>
,<institution>Istituto Italiano di Tecnologia</institution>
,<addr-line>Genova</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff4"><institution content-type="dept">Department of Civil and Industrial Engineering</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Guidi, Andrea" sort="Guidi, Andrea" uniqKey="Guidi A" first="Andrea" last="Guidi">Andrea Guidi</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Scilingo, Enzo Pasquale" sort="Scilingo, Enzo Pasquale" uniqKey="Scilingo E" first="Enzo Pasquale" last="Scilingo">Enzo Pasquale Scilingo</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff5"><institution content-type="dept">Department of Information Engineering</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Pietrini, Pietro" sort="Pietrini, Pietro" uniqKey="Pietrini P" first="Pietro" last="Pietrini">Pietro Pietrini</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff6"><institution content-type="dept">Clinical Psychology Branch</institution>
,<institution>Pisa University Hospital</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff7"><institution>IMT School for Advanced Studies Lucca</institution>
,<addr-line>Lucca</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Bicchi, Antonio" sort="Bicchi, Antonio" uniqKey="Bicchi A" first="Antonio" last="Bicchi">Antonio Bicchi</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution content-type="dept">Advanced Robotics Department</institution>
,<institution>Istituto Italiano di Tecnologia</institution>
,<addr-line>Genova</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Santello, Marco" sort="Santello, Marco" uniqKey="Santello M" first="Marco" last="Santello">Marco Santello</name>
<affiliation wicri:level="1"><nlm:aff id="aff8"><institution content-type="dept">School of Biological and Health Systems Engineering</institution>
,<institution>Arizona State University</institution>
,<addr-line>Tempe</addr-line>
,<country>United States</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Ricciardi, Emiliano" sort="Ricciardi, Emiliano" uniqKey="Ricciardi E" first="Emiliano" last="Ricciardi">Emiliano Ricciardi</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">26880543</idno>
<idno type="pmc">4786436</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4786436</idno>
<idno type="RBID">PMC:4786436</idno>
<idno type="doi">10.7554/eLife.13420</idno>
<date when="????">????</date>
<idno type="wicri:Area/Pmc/Corpus">000584</idno>
<idno type="wicri:Area/Pmc/Curation">000584</idno>
<idno type="wicri:Area/Pmc/Checkpoint">002828</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">A synergy-based hand control is encoded in human motor cortical areas</title>
<author><name sortKey="Leo, Andrea" sort="Leo, Andrea" uniqKey="Leo A" first="Andrea" last="Leo">Andrea Leo</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Handjaras, Giacomo" sort="Handjaras, Giacomo" uniqKey="Handjaras G" first="Giacomo" last="Handjaras">Giacomo Handjaras</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Bianchi, Matteo" sort="Bianchi, Matteo" uniqKey="Bianchi M" first="Matteo" last="Bianchi">Matteo Bianchi</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution content-type="dept">Advanced Robotics Department</institution>
,<institution>Istituto Italiano di Tecnologia</institution>
,<addr-line>Genova</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Marino, Hamal" sort="Marino, Hamal" uniqKey="Marino H" first="Hamal" last="Marino">Hamal Marino</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Gabiccini, Marco" sort="Gabiccini, Marco" uniqKey="Gabiccini M" first="Marco" last="Gabiccini">Marco Gabiccini</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution content-type="dept">Advanced Robotics Department</institution>
,<institution>Istituto Italiano di Tecnologia</institution>
,<addr-line>Genova</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff4"><institution content-type="dept">Department of Civil and Industrial Engineering</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Guidi, Andrea" sort="Guidi, Andrea" uniqKey="Guidi A" first="Andrea" last="Guidi">Andrea Guidi</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Scilingo, Enzo Pasquale" sort="Scilingo, Enzo Pasquale" uniqKey="Scilingo E" first="Enzo Pasquale" last="Scilingo">Enzo Pasquale Scilingo</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff5"><institution content-type="dept">Department of Information Engineering</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Pietrini, Pietro" sort="Pietrini, Pietro" uniqKey="Pietrini P" first="Pietro" last="Pietrini">Pietro Pietrini</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff6"><institution content-type="dept">Clinical Psychology Branch</institution>
,<institution>Pisa University Hospital</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff7"><institution>IMT School for Advanced Studies Lucca</institution>
,<addr-line>Lucca</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Bicchi, Antonio" sort="Bicchi, Antonio" uniqKey="Bicchi A" first="Antonio" last="Bicchi">Antonio Bicchi</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution content-type="dept">Advanced Robotics Department</institution>
,<institution>Istituto Italiano di Tecnologia</institution>
,<addr-line>Genova</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Santello, Marco" sort="Santello, Marco" uniqKey="Santello M" first="Marco" last="Santello">Marco Santello</name>
<affiliation wicri:level="1"><nlm:aff id="aff8"><institution content-type="dept">School of Biological and Health Systems Engineering</institution>
,<institution>Arizona State University</institution>
,<addr-line>Tempe</addr-line>
,<country>United States</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Ricciardi, Emiliano" sort="Ricciardi, Emiliano" uniqKey="Ricciardi E" first="Emiliano" last="Ricciardi">Emiliano Ricciardi</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea># see nlm:aff country strict</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series><title level="j">eLife</title>
<idno type="eISSN">2050-084X</idno>
<imprint><date when="????">????</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>How the human brain controls hand movements to carry out different tasks is still debated. The concept of <italic>synergy</italic>
has been proposed to indicate functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. However, whether and to what extent synergic hand postures are encoded as such at a cortical level remains unknown. Here, we combined kinematic, electromyography, and brain activity measures obtained by functional magnetic resonance imaging while subjects performed a variety of movements towards virtual objects. Hand postural information, encoded through kinematic synergies, were represented in cortical areas devoted to hand motor control and successfully discriminated individual grasping movements, significantly outperforming alternative somatotopic or muscle-based models. Importantly, hand postural synergies were predicted by neural activation patterns within primary motor cortex. These findings support a novel cortical organization for hand movement control and open potential applications for brain-computer interfaces and neuroprostheses.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.001">http://dx.doi.org/10.7554/eLife.13420.001</ext-link>
</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Aflalo, T" uniqKey="Aflalo T">T Aflalo</name>
</author>
<author><name sortKey="Kellis, S" uniqKey="Kellis S">S Kellis</name>
</author>
<author><name sortKey="Klaes, C" uniqKey="Klaes C">C Klaes</name>
</author>
<author><name sortKey="Lee, B" uniqKey="Lee B">B Lee</name>
</author>
<author><name sortKey="Shi, Y" uniqKey="Shi Y">Y Shi</name>
</author>
<author><name sortKey="Pejsa, K" uniqKey="Pejsa K">K Pejsa</name>
</author>
<author><name sortKey="Shanfield, K" uniqKey="Shanfield K">K Shanfield</name>
</author>
<author><name sortKey="Hayes Jackson, S" uniqKey="Hayes Jackson S">S Hayes-Jackson</name>
</author>
<author><name sortKey="Aisen, M" uniqKey="Aisen M">M Aisen</name>
</author>
<author><name sortKey="Heck, C" uniqKey="Heck C">C Heck</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Aflalo, Tn" uniqKey="Aflalo T">TN Aflalo</name>
</author>
<author><name sortKey="Graziano, Ms" uniqKey="Graziano M">MS Graziano</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ahsan, Mr" uniqKey="Ahsan M">MR Ahsan</name>
</author>
<author><name sortKey="Ibrahimy, Mi" uniqKey="Ibrahimy M">MI Ibrahimy</name>
</author>
<author><name sortKey="Khalifa, Oo" uniqKey="Khalifa O">OO Khalifa</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Andersson, Jl" uniqKey="Andersson J">JL Andersson</name>
</author>
<author><name sortKey="Jenkinson, M" uniqKey="Jenkinson M">M Jenkinson</name>
</author>
<author><name sortKey="Smith, S" uniqKey="Smith S">S Smith</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Benjamini, Y" uniqKey="Benjamini Y">Y Benjamini</name>
</author>
<author><name sortKey="Hochberg, Y" uniqKey="Hochberg Y">Y Hochberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bernstein, Na" uniqKey="Bernstein N">NA Bernstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bilenko, M" uniqKey="Bilenko M">M Bilenko</name>
</author>
<author><name sortKey="Basu, S" uniqKey="Basu S">S Basu</name>
</author>
<author><name sortKey="Mooney, Rj" uniqKey="Mooney R">RJ Mooney</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bitzer, S" uniqKey="Bitzer S">S Bitzer</name>
</author>
<author><name sortKey="Van Der Smagt, P" uniqKey="Van Der Smagt P">P van der Smagt</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bizzi, E" uniqKey="Bizzi E">E Bizzi</name>
</author>
<author><name sortKey="Cheung, Vc" uniqKey="Cheung V">VC Cheung</name>
</author>
<author><name sortKey="D Avella, A" uniqKey="D Avella A">A d'Avella</name>
</author>
<author><name sortKey="Saltiel, P" uniqKey="Saltiel P">P Saltiel</name>
</author>
<author><name sortKey="Tresch, M" uniqKey="Tresch M">M Tresch</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bleichner, Mg" uniqKey="Bleichner M">MG Bleichner</name>
</author>
<author><name sortKey="Jansma, Jm" uniqKey="Jansma J">JM Jansma</name>
</author>
<author><name sortKey="Sellmeijer, J" uniqKey="Sellmeijer J">J Sellmeijer</name>
</author>
<author><name sortKey="Raemaekers, M" uniqKey="Raemaekers M">M Raemaekers</name>
</author>
<author><name sortKey="Ramsey, Nf" uniqKey="Ramsey N">NF Ramsey</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Brown, Ar" uniqKey="Brown A">AR Brown</name>
</author>
<author><name sortKey="Teskey, Gc" uniqKey="Teskey G">GC Teskey</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Castiello, U" uniqKey="Castiello U">U Castiello</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cheung, Vc" uniqKey="Cheung V">VC Cheung</name>
</author>
<author><name sortKey="D Avella, A" uniqKey="D Avella A">A d'Avella</name>
</author>
<author><name sortKey="Tresch, Mc" uniqKey="Tresch M">MC Tresch</name>
</author>
<author><name sortKey="Bizzi, E" uniqKey="Bizzi E">E Bizzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cheung, Vc" uniqKey="Cheung V">VC Cheung</name>
</author>
<author><name sortKey="Piron, L" uniqKey="Piron L">L Piron</name>
</author>
<author><name sortKey="Agostini, M" uniqKey="Agostini M">M Agostini</name>
</author>
<author><name sortKey="Silvoni, S" uniqKey="Silvoni S">S Silvoni</name>
</author>
<author><name sortKey="Turolla, A" uniqKey="Turolla A">A Turolla</name>
</author>
<author><name sortKey="Bizzi, E" uniqKey="Bizzi E">E Bizzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chowdhury, Rh" uniqKey="Chowdhury R">RH Chowdhury</name>
</author>
<author><name sortKey="Reaz, Mbi" uniqKey="Reaz M">MBI Reaz</name>
</author>
<author><name sortKey="Ali, Mab" uniqKey="Ali M">MAB Ali</name>
</author>
<author><name sortKey="Bakar, Aaa" uniqKey="Bakar A">AAA Bakar</name>
</author>
<author><name sortKey="Chellappan, K" uniqKey="Chellappan K">K Chellappan</name>
</author>
<author><name sortKey="Chang, Tg" uniqKey="Chang T">TG Chang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Connolly, Ac" uniqKey="Connolly A">AC Connolly</name>
</author>
<author><name sortKey="Guntupalli, Js" uniqKey="Guntupalli J">JS Guntupalli</name>
</author>
<author><name sortKey="Gors, J" uniqKey="Gors J">J Gors</name>
</author>
<author><name sortKey="Hanke, M" uniqKey="Hanke M">M Hanke</name>
</author>
<author><name sortKey="Halchenko, Yo" uniqKey="Halchenko Y">YO Halchenko</name>
</author>
<author><name sortKey="Wu, Yc" uniqKey="Wu Y">YC Wu</name>
</author>
<author><name sortKey="Abdi, H" uniqKey="Abdi H">H Abdi</name>
</author>
<author><name sortKey="Haxby, Jv" uniqKey="Haxby J">JV Haxby</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cox, Rw" uniqKey="Cox R">RW Cox</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Culham, Jc" uniqKey="Culham J">JC Culham</name>
</author>
<author><name sortKey="Danckert, Sl" uniqKey="Danckert S">SL Danckert</name>
</author>
<author><name sortKey="Desouza, Jf" uniqKey="Desouza J">JF DeSouza</name>
</author>
<author><name sortKey="Gati, Js" uniqKey="Gati J">JS Gati</name>
</author>
<author><name sortKey="Menon, Rs" uniqKey="Menon R">RS Menon</name>
</author>
<author><name sortKey="Goodale, Ma" uniqKey="Goodale M">MA Goodale</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="D Ausilio, A" uniqKey="D Ausilio A">A D'Ausilio</name>
</author>
<author><name sortKey="Bartoli, E" uniqKey="Bartoli E">E Bartoli</name>
</author>
<author><name sortKey="Maffongelli, L" uniqKey="Maffongelli L">L Maffongelli</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="D Avella, A" uniqKey="D Avella A">A d'Avella</name>
</author>
<author><name sortKey="Lacquaniti, F" uniqKey="Lacquaniti F">F Lacquaniti</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="D Avella, A" uniqKey="D Avella A">A d'Avella</name>
</author>
<author><name sortKey="Saltiel, P" uniqKey="Saltiel P">P Saltiel</name>
</author>
<author><name sortKey="Bizzi, E" uniqKey="Bizzi E">E Bizzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Devereux, Bj" uniqKey="Devereux B">BJ Devereux</name>
</author>
<author><name sortKey="Clarke, A" uniqKey="Clarke A">A Clarke</name>
</author>
<author><name sortKey="Marouchos, A" uniqKey="Marouchos A">A Marouchos</name>
</author>
<author><name sortKey="Tyler, Lk" uniqKey="Tyler L">LK Tyler</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Edelman, S" uniqKey="Edelman S">S Edelman</name>
</author>
<author><name sortKey="Grill Spector, K" uniqKey="Grill Spector K">K Grill-Spector</name>
</author>
<author><name sortKey="Kushnir, T" uniqKey="Kushnir T">T Kushnir</name>
</author>
<author><name sortKey="Malach, R" uniqKey="Malach R">R Malach</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ehrsson, Hh" uniqKey="Ehrsson H">HH Ehrsson</name>
</author>
<author><name sortKey="Fagergren, A" uniqKey="Fagergren A">A Fagergren</name>
</author>
<author><name sortKey="Jonsson, T" uniqKey="Jonsson T">T Jonsson</name>
</author>
<author><name sortKey="Westling, G" uniqKey="Westling G">G Westling</name>
</author>
<author><name sortKey="Johansson, Rs" uniqKey="Johansson R">RS Johansson</name>
</author>
<author><name sortKey="Forssberg, H" uniqKey="Forssberg H">H Forssberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ehrsson, Hh" uniqKey="Ehrsson H">HH Ehrsson</name>
</author>
<author><name sortKey="Fagergren, E" uniqKey="Fagergren E">E Fagergren</name>
</author>
<author><name sortKey="Forssberg, H" uniqKey="Forssberg H">H Forssberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ehrsson, Hh" uniqKey="Ehrsson H">HH Ehrsson</name>
</author>
<author><name sortKey="Kuhtz Buschbeck, Jp" uniqKey="Kuhtz Buschbeck J">JP Kuhtz-Buschbeck</name>
</author>
<author><name sortKey="Forssberg, H" uniqKey="Forssberg H">H Forssberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ejaz, N" uniqKey="Ejaz N">N Ejaz</name>
</author>
<author><name sortKey="Hamada, M" uniqKey="Hamada M">M Hamada</name>
</author>
<author><name sortKey="Diedrichsen, J" uniqKey="Diedrichsen J">J Diedrichsen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Feix, T" uniqKey="Feix T">T Feix</name>
</author>
<author><name sortKey="Pawlik, R" uniqKey="Pawlik R">R Pawlik</name>
</author>
<author><name sortKey="Schmiedmayer, H B" uniqKey="Schmiedmayer H">H-B Schmiedmayer</name>
</author>
<author><name sortKey="Romero, J" uniqKey="Romero J">J Romero</name>
</author>
<author><name sortKey="Kragic, D" uniqKey="Kragic D">D Kragic</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Flash, T" uniqKey="Flash T">T Flash</name>
</author>
<author><name sortKey="Hogan, N" uniqKey="Hogan N">N Hogan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Flint, Rd" uniqKey="Flint R">RD Flint</name>
</author>
<author><name sortKey="Wang, Pt" uniqKey="Wang P">PT Wang</name>
</author>
<author><name sortKey="Wright, Za" uniqKey="Wright Z">ZA Wright</name>
</author>
<author><name sortKey="King, Ce" uniqKey="King C">CE King</name>
</author>
<author><name sortKey="Krucoff, Mo" uniqKey="Krucoff M">MO Krucoff</name>
</author>
<author><name sortKey="Schuele, Su" uniqKey="Schuele S">SU Schuele</name>
</author>
<author><name sortKey="Rosenow, Jm" uniqKey="Rosenow J">JM Rosenow</name>
</author>
<author><name sortKey="Hsu, Fp" uniqKey="Hsu F">FP Hsu</name>
</author>
<author><name sortKey="Liu, Cy" uniqKey="Liu C">CY Liu</name>
</author>
<author><name sortKey="Lin, Jj" uniqKey="Lin J">JJ Lin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fonov, V" uniqKey="Fonov V">V Fonov</name>
</author>
<author><name sortKey="Evans, A" uniqKey="Evans A">A Evans</name>
</author>
<author><name sortKey="Mckinstry, R" uniqKey="Mckinstry R">R McKinstry</name>
</author>
<author><name sortKey="Almli, C" uniqKey="Almli C">C Almli</name>
</author>
<author><name sortKey="Collins, D" uniqKey="Collins D">D Collins</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Formisano, E" uniqKey="Formisano E">E Formisano</name>
</author>
<author><name sortKey="Kim, Ds" uniqKey="Kim D">DS Kim</name>
</author>
<author><name sortKey="Di Salle, F" uniqKey="Di Salle F">F Di Salle</name>
</author>
<author><name sortKey="Van De Moortele, Pf" uniqKey="Van De Moortele P">PF van de Moortele</name>
</author>
<author><name sortKey="Ugurbil, K" uniqKey="Ugurbil K">K Ugurbil</name>
</author>
<author><name sortKey="Goebel, R" uniqKey="Goebel R">R Goebel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gabiccini, M" uniqKey="Gabiccini M">M Gabiccini</name>
</author>
<author><name sortKey="Stillfried, G" uniqKey="Stillfried G">G Stillfried</name>
</author>
<author><name sortKey="Marino, H" uniqKey="Marino H">H Marino</name>
</author>
<author><name sortKey="Bianchi, M" uniqKey="Bianchi M">M Bianchi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gallivan, Jp" uniqKey="Gallivan J">JP Gallivan</name>
</author>
<author><name sortKey="Mclean, Da" uniqKey="Mclean D">DA McLean</name>
</author>
<author><name sortKey="Valyear, Kf" uniqKey="Valyear K">KF Valyear</name>
</author>
<author><name sortKey="Culham, Jc" uniqKey="Culham J">JC Culham</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gallivan, Jp" uniqKey="Gallivan J">JP Gallivan</name>
</author>
<author><name sortKey="Mclean, Da" uniqKey="Mclean D">DA McLean</name>
</author>
<author><name sortKey="Valyear, Kf" uniqKey="Valyear K">KF Valyear</name>
</author>
<author><name sortKey="Pettypiece, Ce" uniqKey="Pettypiece C">CE Pettypiece</name>
</author>
<author><name sortKey="Culham, Jc" uniqKey="Culham J">JC Culham</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ganesh, G" uniqKey="Ganesh G">G Ganesh</name>
</author>
<author><name sortKey="Burdet, E" uniqKey="Burdet E">E Burdet</name>
</author>
<author><name sortKey="Haruno, M" uniqKey="Haruno M">M Haruno</name>
</author>
<author><name sortKey="Kawato, M" uniqKey="Kawato M">M Kawato</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ganesh, G" uniqKey="Ganesh G">G Ganesh</name>
</author>
<author><name sortKey="Franklin, Dw" uniqKey="Franklin D">DW Franklin</name>
</author>
<author><name sortKey="Gassert, R" uniqKey="Gassert R">R Gassert</name>
</author>
<author><name sortKey="Imamizu, H" uniqKey="Imamizu H">H Imamizu</name>
</author>
<author><name sortKey="Kawato, M" uniqKey="Kawato M">M Kawato</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gazzoni, M" uniqKey="Gazzoni M">M Gazzoni</name>
</author>
<author><name sortKey="Celadon, N" uniqKey="Celadon N">N Celadon</name>
</author>
<author><name sortKey="Mastrapasqua, D" uniqKey="Mastrapasqua D">D Mastrapasqua</name>
</author>
<author><name sortKey="Paleari, M" uniqKey="Paleari M">M Paleari</name>
</author>
<author><name sortKey="Margaria, V" uniqKey="Margaria V">V Margaria</name>
</author>
<author><name sortKey="Ariano, P" uniqKey="Ariano P">P Ariano</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gentner, R" uniqKey="Gentner R">R Gentner</name>
</author>
<author><name sortKey="Classen, J" uniqKey="Classen J">J Classen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gentner, R" uniqKey="Gentner R">R Gentner</name>
</author>
<author><name sortKey="Gorges, S" uniqKey="Gorges S">S Gorges</name>
</author>
<author><name sortKey="Weise, D" uniqKey="Weise D">D Weise</name>
</author>
<author><name sortKey="Aufm Kampe, K" uniqKey="Aufm Kampe K">K aufm Kampe</name>
</author>
<author><name sortKey="Buttmann, M" uniqKey="Buttmann M">M Buttmann</name>
</author>
<author><name sortKey="Classen, J" uniqKey="Classen J">J Classen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Goodhill, Gj" uniqKey="Goodhill G">GJ Goodhill</name>
</author>
<author><name sortKey="Sejnowski, Tj" uniqKey="Sejnowski T">TJ Sejnowski</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Grafton, St" uniqKey="Grafton S">ST Grafton</name>
</author>
<author><name sortKey="Fagg, Ah" uniqKey="Fagg A">AH Fagg</name>
</author>
<author><name sortKey="Woods, Rp" uniqKey="Woods R">RP Woods</name>
</author>
<author><name sortKey="Arbib, Ma" uniqKey="Arbib M">MA Arbib</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Graziano, Ms" uniqKey="Graziano M">MS Graziano</name>
</author>
<author><name sortKey="Taylor, Cs" uniqKey="Taylor C">CS Taylor</name>
</author>
<author><name sortKey="Moore, T" uniqKey="Moore T">T Moore</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Graziano, Ms" uniqKey="Graziano M">MS Graziano</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Grefkes, C" uniqKey="Grefkes C">C Grefkes</name>
</author>
<author><name sortKey="Weiss, Ph" uniqKey="Weiss P">PH Weiss</name>
</author>
<author><name sortKey="Zilles, K" uniqKey="Zilles K">K Zilles</name>
</author>
<author><name sortKey="Fink, Gr" uniqKey="Fink G">GR Fink</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gustus, A" uniqKey="Gustus A">A Gustus</name>
</author>
<author><name sortKey="Stillfried, G" uniqKey="Stillfried G">G Stillfried</name>
</author>
<author><name sortKey="Visser, J" uniqKey="Visser J">J Visser</name>
</author>
<author><name sortKey="Jorntell, H" uniqKey="Jorntell H">H Jorntell</name>
</author>
<author><name sortKey="Van Der Smagt, P" uniqKey="Van Der Smagt P">P van der Smagt</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gutteling, Tp" uniqKey="Gutteling T">TP Gutteling</name>
</author>
<author><name sortKey="Petridou, N" uniqKey="Petridou N">N Petridou</name>
</author>
<author><name sortKey="Dumoulin, So" uniqKey="Dumoulin S">SO Dumoulin</name>
</author>
<author><name sortKey="Harvey, Bm" uniqKey="Harvey B">BM Harvey</name>
</author>
<author><name sortKey="Aarnoutse, Ej" uniqKey="Aarnoutse E">EJ Aarnoutse</name>
</author>
<author><name sortKey="Kenemans, Jl" uniqKey="Kenemans J">JL Kenemans</name>
</author>
<author><name sortKey="Neggers, Sfw" uniqKey="Neggers S">SFW Neggers</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Handjaras, G" uniqKey="Handjaras G">G Handjaras</name>
</author>
<author><name sortKey="Bernardi, G" uniqKey="Bernardi G">G Bernardi</name>
</author>
<author><name sortKey="Benuzzi, F" uniqKey="Benuzzi F">F Benuzzi</name>
</author>
<author><name sortKey="Nichelli, Pf" uniqKey="Nichelli P">PF Nichelli</name>
</author>
<author><name sortKey="Pietrini, P" uniqKey="Pietrini P">P Pietrini</name>
</author>
<author><name sortKey="Ricciardi, E" uniqKey="Ricciardi E">E Ricciardi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Haxby, Jv" uniqKey="Haxby J">JV Haxby</name>
</author>
<author><name sortKey="Connolly, Ac" uniqKey="Connolly A">AC Connolly</name>
</author>
<author><name sortKey="Guntupalli, Js" uniqKey="Guntupalli J">JS Guntupalli</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hermens, Hj" uniqKey="Hermens H">HJ Hermens</name>
</author>
<author><name sortKey="Freriks, B" uniqKey="Freriks B">B Freriks</name>
</author>
<author><name sortKey="Disselhorst Klug, C" uniqKey="Disselhorst Klug C">C Disselhorst-Klug</name>
</author>
<author><name sortKey="Rau, G" uniqKey="Rau G">G Rau</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hermens, Hj" uniqKey="Hermens H">HJ Hermens</name>
</author>
<author><name sortKey="Freriks, B" uniqKey="Freriks B">B Freriks</name>
</author>
<author><name sortKey="Merletti, R" uniqKey="Merletti R">R Merletti</name>
</author>
<author><name sortKey="Stegeman, D" uniqKey="Stegeman D">D Stegeman</name>
</author>
<author><name sortKey="Blok, J" uniqKey="Blok J">J Blok</name>
</author>
<author><name sortKey="Rau, G" uniqKey="Rau G">G Rau</name>
</author>
<author><name sortKey="Disselhorst Klug, C" uniqKey="Disselhorst Klug C">C Disselhorst-Klug</name>
</author>
<author><name sortKey="H Gg, G" uniqKey="H Gg G">G Hägg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hudgins, B" uniqKey="Hudgins B">B Hudgins</name>
</author>
<author><name sortKey="Parker, P" uniqKey="Parker P">P Parker</name>
</author>
<author><name sortKey="Scott, Rn" uniqKey="Scott R">RN Scott</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Huth, Ag" uniqKey="Huth A">AG Huth</name>
</author>
<author><name sortKey="Nishimoto, S" uniqKey="Nishimoto S">S Nishimoto</name>
</author>
<author><name sortKey="Vu, At" uniqKey="Vu A">AT Vu</name>
</author>
<author><name sortKey="Gallant, Jl" uniqKey="Gallant J">JL Gallant</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Indovina, I" uniqKey="Indovina I">I Indovina</name>
</author>
<author><name sortKey="Sanes, Jn" uniqKey="Sanes J">JN Sanes</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ingram, Jn" uniqKey="Ingram J">JN Ingram</name>
</author>
<author><name sortKey="Kording, Kp" uniqKey="Kording K">KP Kording</name>
</author>
<author><name sortKey="Howard, Is" uniqKey="Howard I">IS Howard</name>
</author>
<author><name sortKey="Wolpert, Dm" uniqKey="Wolpert D">DM Wolpert</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Iwamura, Y" uniqKey="Iwamura Y">Y Iwamura</name>
</author>
<author><name sortKey="Tanaka, M" uniqKey="Tanaka M">M Tanaka</name>
</author>
<author><name sortKey="Hikosaka, O" uniqKey="Hikosaka O">O Hikosaka</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kaas, Jh" uniqKey="Kaas J">JH Kaas</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="King, M" uniqKey="King M">M King</name>
</author>
<author><name sortKey="Rauch, Hg" uniqKey="Rauch H">HG Rauch</name>
</author>
<author><name sortKey="Stein, Dj" uniqKey="Stein D">DJ Stein</name>
</author>
<author><name sortKey="Brooks, Sj" uniqKey="Brooks S">SJ Brooks</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kirsch, E" uniqKey="Kirsch E">E Kirsch</name>
</author>
<author><name sortKey="Rivlis, G" uniqKey="Rivlis G">G Rivlis</name>
</author>
<author><name sortKey="Schieber, Mh" uniqKey="Schieber M">MH Schieber</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Klaes, C" uniqKey="Klaes C">C Klaes</name>
</author>
<author><name sortKey="Kellis, S" uniqKey="Kellis S">S Kellis</name>
</author>
<author><name sortKey="Aflalo, T" uniqKey="Aflalo T">T Aflalo</name>
</author>
<author><name sortKey="Lee, B" uniqKey="Lee B">B Lee</name>
</author>
<author><name sortKey="Pejsa, K" uniqKey="Pejsa K">K Pejsa</name>
</author>
<author><name sortKey="Shanfield, K" uniqKey="Shanfield K">K Shanfield</name>
</author>
<author><name sortKey="Hayes Jackson, S" uniqKey="Hayes Jackson S">S Hayes-Jackson</name>
</author>
<author><name sortKey="Aisen, M" uniqKey="Aisen M">M Aisen</name>
</author>
<author><name sortKey="Heck, C" uniqKey="Heck C">C Heck</name>
</author>
<author><name sortKey="Liu, C" uniqKey="Liu C">C Liu</name>
</author>
<author><name sortKey="Andersen, Ra" uniqKey="Andersen R">RA Andersen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Klein Breteler, Md" uniqKey="Klein Breteler M">MD Klein Breteler</name>
</author>
<author><name sortKey="Simura, Kj" uniqKey="Simura K">KJ Simura</name>
</author>
<author><name sortKey="Flanders, M" uniqKey="Flanders M">M Flanders</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kriegeskorte, N" uniqKey="Kriegeskorte N">N Kriegeskorte</name>
</author>
<author><name sortKey="Kievit, Ra" uniqKey="Kievit R">RA Kievit</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kriegeskorte, N" uniqKey="Kriegeskorte N">N Kriegeskorte</name>
</author>
<author><name sortKey="Mur, M" uniqKey="Mur M">M Mur</name>
</author>
<author><name sortKey="Bandettini, P" uniqKey="Bandettini P">P Bandettini</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kriegeskorte, N" uniqKey="Kriegeskorte N">N Kriegeskorte</name>
</author>
<author><name sortKey="Mur, M" uniqKey="Mur M">M Mur</name>
</author>
<author><name sortKey="Ruff, Da" uniqKey="Ruff D">DA Ruff</name>
</author>
<author><name sortKey="Kiani, R" uniqKey="Kiani R">R Kiani</name>
</author>
<author><name sortKey="Bodurka, J" uniqKey="Bodurka J">J Bodurka</name>
</author>
<author><name sortKey="Esteky, H" uniqKey="Esteky H">H Esteky</name>
</author>
<author><name sortKey="Tanaka, K" uniqKey="Tanaka K">K Tanaka</name>
</author>
<author><name sortKey="Bandettini, Pa" uniqKey="Bandettini P">PA Bandettini</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kruskal, Jb" uniqKey="Kruskal J">JB Kruskal</name>
</author>
<author><name sortKey="Wish, M" uniqKey="Wish M">M Wish</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kwan, Hc" uniqKey="Kwan H">HC Kwan</name>
</author>
<author><name sortKey="Mackay, Wa" uniqKey="Mackay W">WA MacKay</name>
</author>
<author><name sortKey="Murphy, Jt" uniqKey="Murphy J">JT Murphy</name>
</author>
<author><name sortKey="Wong, Yc" uniqKey="Wong Y">YC Wong</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Latash, Ml" uniqKey="Latash M">ML Latash</name>
</author>
<author><name sortKey="Scholz, Jp" uniqKey="Scholz J">JP Scholz</name>
</author>
<author><name sortKey="Schoner, G" uniqKey="Schoner G">G Schoner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Latash, Ml" uniqKey="Latash M">ML Latash</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mathiesen, Jr" uniqKey="Mathiesen J">JR Mathiesen</name>
</author>
<author><name sortKey="B G, Mf" uniqKey="B G M">MF Bøg</name>
</author>
<author><name sortKey="Erkocevic, E" uniqKey="Erkocevic E">E Erkocevic</name>
</author>
<author><name sortKey="Niemeier, Mj" uniqKey="Niemeier M">MJ Niemeier</name>
</author>
<author><name sortKey="Smidstrup, A" uniqKey="Smidstrup A">A Smidstrup</name>
</author>
<author><name sortKey="Kamavuako, En" uniqKey="Kamavuako E">EN Kamavuako</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mitchell, Tm" uniqKey="Mitchell T">TM Mitchell</name>
</author>
<author><name sortKey="Hutchinson, R" uniqKey="Hutchinson R">R Hutchinson</name>
</author>
<author><name sortKey="Niculescu, Rs" uniqKey="Niculescu R">RS Niculescu</name>
</author>
<author><name sortKey="Pereira, F" uniqKey="Pereira F">F Pereira</name>
</author>
<author><name sortKey="Wang, Xr" uniqKey="Wang X">XR Wang</name>
</author>
<author><name sortKey="Just, M" uniqKey="Just M">M Just</name>
</author>
<author><name sortKey="Newman, S" uniqKey="Newman S">S Newman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mitchell, Tm" uniqKey="Mitchell T">TM Mitchell</name>
</author>
<author><name sortKey="Shinkareva, Sv" uniqKey="Shinkareva S">SV Shinkareva</name>
</author>
<author><name sortKey="Carlson, A" uniqKey="Carlson A">A Carlson</name>
</author>
<author><name sortKey="Chang, Km" uniqKey="Chang K">KM Chang</name>
</author>
<author><name sortKey="Malave, Vl" uniqKey="Malave V">VL Malave</name>
</author>
<author><name sortKey="Mason, Ra" uniqKey="Mason R">RA Mason</name>
</author>
<author><name sortKey="Just, Ma" uniqKey="Just M">MA Just</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mollazadeh, M" uniqKey="Mollazadeh M">M Mollazadeh</name>
</author>
<author><name sortKey="Aggarwal, V" uniqKey="Aggarwal V">V Aggarwal</name>
</author>
<author><name sortKey="Thakor, Nv" uniqKey="Thakor N">NV Thakor</name>
</author>
<author><name sortKey="Schieber, Mh" uniqKey="Schieber M">MH Schieber</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Muceli, S" uniqKey="Muceli S">S Muceli</name>
</author>
<author><name sortKey="Jiang, N" uniqKey="Jiang N">N Jiang</name>
</author>
<author><name sortKey="Farina, D" uniqKey="Farina D">D Farina</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Napier, Jr" uniqKey="Napier J">JR Napier</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Naselaris, T" uniqKey="Naselaris T">T Naselaris</name>
</author>
<author><name sortKey="Kay, Kn" uniqKey="Kay K">KN Kay</name>
</author>
<author><name sortKey="Nishimoto, S" uniqKey="Nishimoto S">S Nishimoto</name>
</author>
<author><name sortKey="Gallant, Jl" uniqKey="Gallant J">JL Gallant</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Oldfield, Rc" uniqKey="Oldfield R">RC Oldfield</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Overduin, Sa" uniqKey="Overduin S">SA Overduin</name>
</author>
<author><name sortKey="D Avella, A" uniqKey="D Avella A">A d'Avella</name>
</author>
<author><name sortKey="Carmena, Jm" uniqKey="Carmena J">JM Carmena</name>
</author>
<author><name sortKey="Bizzi, E" uniqKey="Bizzi E">E Bizzi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Penfield, W" uniqKey="Penfield W">W Penfield</name>
</author>
<author><name sortKey="Boldrey, E" uniqKey="Boldrey E">E Boldrey</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Penfield, W" uniqKey="Penfield W">W Penfield</name>
</author>
<author><name sortKey="Rasmussen, T" uniqKey="Rasmussen T">T Rasmussen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Penfield, W" uniqKey="Penfield W">W Penfield</name>
</author>
<author><name sortKey="Welch, K" uniqKey="Welch K">K Welch</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Phinyomark, A" uniqKey="Phinyomark A">A Phinyomark</name>
</author>
<author><name sortKey="Limsakul, C" uniqKey="Limsakul C">C Limsakul</name>
</author>
<author><name sortKey="Phukpattaranont, P" uniqKey="Phukpattaranont P">P Phukpattaranont</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Pistohl, T" uniqKey="Pistohl T">T Pistohl</name>
</author>
<author><name sortKey="Schulze Bonhage, A" uniqKey="Schulze Bonhage A">A Schulze-Bonhage</name>
</author>
<author><name sortKey="Aertsen, A" uniqKey="Aertsen A">A Aertsen</name>
</author>
<author><name sortKey="Mehring, C" uniqKey="Mehring C">C Mehring</name>
</author>
<author><name sortKey="Ball, T" uniqKey="Ball T">T Ball</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Riehle, A" uniqKey="Riehle A">A Riehle</name>
</author>
<author><name sortKey="Requin, J" uniqKey="Requin J">J Requin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Saleh, M" uniqKey="Saleh M">M Saleh</name>
</author>
<author><name sortKey="Takahashi, K" uniqKey="Takahashi K">K Takahashi</name>
</author>
<author><name sortKey="Amit, Y" uniqKey="Amit Y">Y Amit</name>
</author>
<author><name sortKey="Hatsopoulos, Ng" uniqKey="Hatsopoulos N">NG Hatsopoulos</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Saleh, M" uniqKey="Saleh M">M Saleh</name>
</author>
<author><name sortKey="Takahashi, K" uniqKey="Takahashi K">K Takahashi</name>
</author>
<author><name sortKey="Hatsopoulos, Ng" uniqKey="Hatsopoulos N">NG Hatsopoulos</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Santello, M" uniqKey="Santello M">M Santello</name>
</author>
<author><name sortKey="Baud Bovy, G" uniqKey="Baud Bovy G">G Baud-Bovy</name>
</author>
<author><name sortKey="Jorntell, H" uniqKey="Jorntell H">H Jorntell</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Santello, M" uniqKey="Santello M">M Santello</name>
</author>
<author><name sortKey="Flanders, M" uniqKey="Flanders M">M Flanders</name>
</author>
<author><name sortKey="Soechting, Jf" uniqKey="Soechting J">JF Soechting</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Santello, M" uniqKey="Santello M">M Santello</name>
</author>
<author><name sortKey="Flanders, M" uniqKey="Flanders M">M Flanders</name>
</author>
<author><name sortKey="Soechting, Jf" uniqKey="Soechting J">JF Soechting</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Santello, M" uniqKey="Santello M">M Santello</name>
</author>
<author><name sortKey="Lang, Ce" uniqKey="Lang C">CE Lang</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schaffelhofer, S" uniqKey="Schaffelhofer S">S Schaffelhofer</name>
</author>
<author><name sortKey="Agudelo Toro, A" uniqKey="Agudelo Toro A">A Agudelo-Toro</name>
</author>
<author><name sortKey="Scherberger, H" uniqKey="Scherberger H">H Scherberger</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schieber, Mh" uniqKey="Schieber M">MH Schieber</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schieber, Mh" uniqKey="Schieber M">MH Schieber</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schreiber, K" uniqKey="Schreiber K">K Schreiber</name>
</author>
<author><name sortKey="Krekelberg, B" uniqKey="Krekelberg B">B Krekelberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schwartz, Ab" uniqKey="Schwartz A">AB Schwartz</name>
</author>
<author><name sortKey="Cui, Xt" uniqKey="Cui X">XT Cui</name>
</author>
<author><name sortKey="Weber, Dj" uniqKey="Weber D">DJ Weber</name>
</author>
<author><name sortKey="Moran, Dw" uniqKey="Moran D">DW Moran</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schwartz, Ab" uniqKey="Schwartz A">AB Schwartz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sereno, Mi" uniqKey="Sereno M">MI Sereno</name>
</author>
<author><name sortKey="Dale, Am" uniqKey="Dale A">AM Dale</name>
</author>
<author><name sortKey="Reppas, Jb" uniqKey="Reppas J">JB Reppas</name>
</author>
<author><name sortKey="Kwong, Kk" uniqKey="Kwong K">KK Kwong</name>
</author>
<author><name sortKey="Belliveau, Jw" uniqKey="Belliveau J">JW Belliveau</name>
</author>
<author><name sortKey="Brady, Tj" uniqKey="Brady T">TJ Brady</name>
</author>
<author><name sortKey="Rosen, Br" uniqKey="Rosen B">BR Rosen</name>
</author>
<author><name sortKey="Tootell, Rb" uniqKey="Tootell R">RB Tootell</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Siero, Jc" uniqKey="Siero J">JC Siero</name>
</author>
<author><name sortKey="Hermes, D" uniqKey="Hermes D">D Hermes</name>
</author>
<author><name sortKey="Hoogduin, H" uniqKey="Hoogduin H">H Hoogduin</name>
</author>
<author><name sortKey="Luijten, Pr" uniqKey="Luijten P">PR Luijten</name>
</author>
<author><name sortKey="Ramsey, Nf" uniqKey="Ramsey N">NF Ramsey</name>
</author>
<author><name sortKey="Petridou, N" uniqKey="Petridou N">N Petridou</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Soechting, Jf" uniqKey="Soechting J">JF Soechting</name>
</author>
<author><name sortKey="Flanders, M" uniqKey="Flanders M">M Flanders</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stillfried, G" uniqKey="Stillfried G">G Stillfried</name>
</author>
<author><name sortKey="Hillenbrand, U" uniqKey="Hillenbrand U">U Hillenbrand</name>
</author>
<author><name sortKey="Settles, M" uniqKey="Settles M">M Settles</name>
</author>
<author><name sortKey="Van Der Smagt, P" uniqKey="Van Der Smagt P">P van der Smagt</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tessitore, G" uniqKey="Tessitore G">G Tessitore</name>
</author>
<author><name sortKey="Sinigaglia, C" uniqKey="Sinigaglia C">C Sinigaglia</name>
</author>
<author><name sortKey="Prevete, R" uniqKey="Prevete R">R Prevete</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Thakur, Ph" uniqKey="Thakur P">PH Thakur</name>
</author>
<author><name sortKey="Bastian, Aj" uniqKey="Bastian A">AJ Bastian</name>
</author>
<author><name sortKey="Hsiao, Ss" uniqKey="Hsiao S">SS Hsiao</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tkach, D" uniqKey="Tkach D">D Tkach</name>
</author>
<author><name sortKey="Huang, H" uniqKey="Huang H">H Huang</name>
</author>
<author><name sortKey="Kuiken, Ta" uniqKey="Kuiken T">TA Kuiken</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Todorov, E" uniqKey="Todorov E">E Todorov</name>
</author>
<author><name sortKey="Jordan, Mi" uniqKey="Jordan M">MI Jordan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Todorov, E" uniqKey="Todorov E">E Todorov</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Turvey, Mt" uniqKey="Turvey M">MT Turvey</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Velliste, M" uniqKey="Velliste M">M Velliste</name>
</author>
<author><name sortKey="Perel, S" uniqKey="Perel S">S Perel</name>
</author>
<author><name sortKey="Spalding, Mc" uniqKey="Spalding M">MC Spalding</name>
</author>
<author><name sortKey="Whitford, As" uniqKey="Whitford A">AS Whitford</name>
</author>
<author><name sortKey="Schwartz, Ab" uniqKey="Schwartz A">AB Schwartz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vereijken, B" uniqKey="Vereijken B">B Vereijken</name>
</author>
<author><name sortKey="Whiting, Ht" uniqKey="Whiting H">HT Whiting</name>
</author>
<author><name sortKey="Beek, Wj" uniqKey="Beek W">WJ Beek</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Weiss, Ej" uniqKey="Weiss E">EJ Weiss</name>
</author>
<author><name sortKey="Flanders, M" uniqKey="Flanders M">M Flanders</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Woolsey, Cn" uniqKey="Woolsey C">CN Woolsey</name>
</author>
<author><name sortKey="Settlage, Ph" uniqKey="Settlage P">PH Settlage</name>
</author>
<author><name sortKey="Meyer, Dr" uniqKey="Meyer D">DR Meyer</name>
</author>
<author><name sortKey="Sencer, W" uniqKey="Sencer W">W Sencer</name>
</author>
<author><name sortKey="Pinto Hamuy, T" uniqKey="Pinto Hamuy T">T Pinto Hamuy</name>
</author>
<author><name sortKey="Travis, Am" uniqKey="Travis A">AM Travis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yarrow, S" uniqKey="Yarrow S">S Yarrow</name>
</author>
<author><name sortKey="Razak, Ka" uniqKey="Razak K">KA Razak</name>
</author>
<author><name sortKey="Seitz, Ar" uniqKey="Seitz A">AR Seitz</name>
</author>
<author><name sortKey="Series, P" uniqKey="Series P">P Series</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zecca, M" uniqKey="Zecca M">M Zecca</name>
</author>
<author><name sortKey="Micera, S" uniqKey="Micera S">S Micera</name>
</author>
<author><name sortKey="Carrozza, Mc" uniqKey="Carrozza M">MC Carrozza</name>
</author>
<author><name sortKey="Dario, P" uniqKey="Dario P">P Dario</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zecca, M" uniqKey="Zecca M">M Zecca</name>
</author>
<author><name sortKey="Micera, S" uniqKey="Micera S">S Micera</name>
</author>
<author><name sortKey="Carrozza, Mc" uniqKey="Carrozza M">MC Carrozza</name>
</author>
<author><name sortKey="Dario, P" uniqKey="Dario P">P Dario</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhang, J" uniqKey="Zhang J">J Zhang</name>
</author>
<author><name sortKey="Riehle, A" uniqKey="Riehle A">A Riehle</name>
</author>
<author><name sortKey="Requin, J" uniqKey="Requin J">J Requin</name>
</author>
<author><name sortKey="Kornblum, S" uniqKey="Kornblum S">S Kornblum</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">eLife</journal-id>
<journal-id journal-id-type="iso-abbrev">Elife</journal-id>
<journal-id journal-id-type="hwp">eLife</journal-id>
<journal-id journal-id-type="publisher-id">eLife</journal-id>
<journal-title-group><journal-title>eLife</journal-title>
</journal-title-group>
<issn pub-type="epub">2050-084X</issn>
<publisher><publisher-name>eLife Sciences Publications, Ltd</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">26880543</article-id>
<article-id pub-id-type="pmc">4786436</article-id>
<article-id pub-id-type="publisher-id">13420</article-id>
<article-id pub-id-type="doi">10.7554/eLife.13420</article-id>
<article-categories><subj-group subj-group-type="display-channel"><subject>Research Article</subject>
</subj-group>
<subj-group subj-group-type="heading"><subject>Neuroscience</subject>
</subj-group>
</article-categories>
<title-group><article-title>A synergy-based hand control is encoded in human motor cortical areas</article-title>
</title-group>
<contrib-group><contrib id="author-38657" contrib-type="author"><name><surname>Leo</surname>
<given-names>Andrea</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con1"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41757" contrib-type="author"><name><surname>Handjaras</surname>
<given-names>Giacomo</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con2"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41758" contrib-type="author"><name><surname>Bianchi</surname>
<given-names>Matteo</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="aff" rid="aff3">3</xref>
<xref ref-type="other" rid="par-1"></xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con3"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41759" contrib-type="author"><name><surname>Marino</surname>
<given-names>Hamal</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="other" rid="par-1"></xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con4"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41760" contrib-type="author"><name><surname>Gabiccini</surname>
<given-names>Marco</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="aff" rid="aff3">3</xref>
<xref ref-type="aff" rid="aff4">4</xref>
<xref ref-type="other" rid="par-1"></xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con5"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41761" contrib-type="author"><name><surname>Guidi</surname>
<given-names>Andrea</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="other" rid="par-1"></xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con6"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41762" contrib-type="author"><name><surname>Scilingo</surname>
<given-names>Enzo Pasquale</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="aff" rid="aff5">5</xref>
<xref ref-type="other" rid="par-1"></xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con7"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41763" contrib-type="author"><name><surname>Pietrini</surname>
<given-names>Pietro</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="aff" rid="aff6">6</xref>
<xref ref-type="aff" rid="aff7">7</xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con8"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41764" contrib-type="author"><name><surname>Bicchi</surname>
<given-names>Antonio</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="aff" rid="aff3">3</xref>
<xref ref-type="other" rid="par-1"></xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con9"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41765" contrib-type="author"><name><surname>Santello</surname>
<given-names>Marco</given-names>
</name>
<xref ref-type="aff" rid="aff8">8</xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con10"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<contrib id="author-41766" contrib-type="author"><name><surname>Ricciardi</surname>
<given-names>Emiliano</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="corresp" rid="cor1">*</xref>
<xref ref-type="other" rid="par-2"></xref>
<xref ref-type="fn" rid="con11"></xref>
<xref ref-type="fn" rid="conf1"></xref>
</contrib>
<aff id="aff1"><label>1</label>
<institution content-type="dept">Laboratory of Clinical Biochemistry and Molecular Biology</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</aff>
<aff id="aff2"><label>2</label>
<institution content-type="dept">Research Center 'E. Piaggio'</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</aff>
<aff id="aff3"><label>3</label>
<institution content-type="dept">Advanced Robotics Department</institution>
,<institution>Istituto Italiano di Tecnologia</institution>
,<addr-line>Genova</addr-line>
,<country>Italy</country>
</aff>
<aff id="aff4"><label>4</label>
<institution content-type="dept">Department of Civil and Industrial Engineering</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</aff>
<aff id="aff5"><label>5</label>
<institution content-type="dept">Department of Information Engineering</institution>
,<institution>University of Pisa</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</aff>
<aff id="aff6"><label>6</label>
<institution content-type="dept">Clinical Psychology Branch</institution>
,<institution>Pisa University Hospital</institution>
,<addr-line>Pisa</addr-line>
,<country>Italy</country>
</aff>
<aff id="aff7"><label>7</label>
<institution>IMT School for Advanced Studies Lucca</institution>
,<addr-line>Lucca</addr-line>
,<country>Italy</country>
</aff>
<aff id="aff8"><label>8</label>
<institution content-type="dept">School of Biological and Health Systems Engineering</institution>
,<institution>Arizona State University</institution>
,<addr-line>Tempe</addr-line>
,<country>United States</country>
</aff>
</contrib-group>
<contrib-group><contrib contrib-type="editor"><name><surname>Culham</surname>
<given-names>Jody C</given-names>
</name>
<role>Reviewing editor</role>
<aff id="aff9"><institution>University of Western Ontario</institution>
,<country>Canada</country>
</aff>
</contrib>
</contrib-group>
<author-notes><corresp id="cor1"><email>emiliano.ricciardi@bioclinica.unipi.it</email>
</corresp>
</author-notes>
<pub-date date-type="pub" publication-format="electronic"><day>15</day>
<month>2</month>
<year>2016</year>
</pub-date>
<pub-date pub-type="collection"><year>2016</year>
</pub-date>
<volume>5</volume>
<elocation-id>e13420</elocation-id>
<history><date date-type="received"><day>09</day>
<month>12</month>
<year>2015</year>
</date>
<date date-type="accepted"><day>13</day>
<month>2</month>
<year>2016</year>
</date>
</history>
<permissions><copyright-statement>© 2016, Leo et al</copyright-statement>
<copyright-year>2016</copyright-year>
<copyright-holder>Leo et al</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><license-p>This article is distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License</ext-link>
, which permits unrestricted use and redistribution provided that the original author and source are credited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="elife-13420.pdf"></self-uri>
<related-article id="d36e364" related-article-type="commentary" ext-link-type="doi" xlink:href="10.7554/eLife.11173"></related-article>
<abstract><p>How the human brain controls hand movements to carry out different tasks is still debated. The concept of <italic>synergy</italic>
has been proposed to indicate functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. However, whether and to what extent synergic hand postures are encoded as such at a cortical level remains unknown. Here, we combined kinematic, electromyography, and brain activity measures obtained by functional magnetic resonance imaging while subjects performed a variety of movements towards virtual objects. Hand postural information, encoded through kinematic synergies, were represented in cortical areas devoted to hand motor control and successfully discriminated individual grasping movements, significantly outperforming alternative somatotopic or muscle-based models. Importantly, hand postural synergies were predicted by neural activation patterns within primary motor cortex. These findings support a novel cortical organization for hand movement control and open potential applications for brain-computer interfaces and neuroprostheses.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.001">http://dx.doi.org/10.7554/eLife.13420.001</ext-link>
</p>
</abstract>
<abstract abstract-type="executive-summary"><title>eLife digest</title>
<p>The human hand can perform an enormous range of movements with great dexterity. Some common everyday actions, such as grasping a coffee cup, involve the coordinated movement of all four fingers and thumb. Others, such as typing, rely on the ability of individual fingers to move relatively independently of one another.</p>
<p>This flexibility is possible in part because of the complex anatomy of the hand, with its 27 bones and their connecting joints and muscles. But with this complexity comes a huge number of possibilities. Any movement-related task – such as picking up a cup – can be achieved via many different combinations of muscle contractions and joint positions. So how does the brain decide which muscles and joints to use?</p>
<p>One theory is that the brain simplifies this problem by encoding particularly useful patterns of joint movements as distinct units or “synergies”. A given task can then be performed by selecting from a small number of synergies, avoiding the need to choose between huge numbers of options every time movement is required.</p>
<p>Leo et al. now provide the first direct evidence for the encoding of synergies by the human brain. Volunteers lying inside a brain scanner reached towards virtual objects – from tennis rackets to toothpicks – while activity was recorded from the area of the brain that controls hand movements. As predicted, the scans showed specific and reproducible patterns of activity. Analysing these patterns revealed that each corresponded to a particular combination of joint positions. These activity patterns, or synergies, could even be ‘decoded’ to work out which type of movement a volunteer had just performed.</p>
<p>Future experiments should examine how the brain combines synergies with sensory feedback to allow movements to be adjusted as they occur. Such findings could help to develop brain-computer interfaces and systems for controlling the movement of artificial limbs.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.002">http://dx.doi.org/10.7554/eLife.13420.002</ext-link>
</p>
</abstract>
<kwd-group kwd-group-type="author-keywords"><title>Author Keywords</title>
<kwd>hand control</kwd>
<kwd>synergies</kwd>
<kwd>fMRI</kwd>
<kwd>encoding</kwd>
<kwd>decoding</kwd>
<kwd>motor cortex</kwd>
</kwd-group>
<kwd-group kwd-group-type="research-organism"><title>Research Organism</title>
<kwd>Human</kwd>
</kwd-group>
<funding-group><award-group id="par-1"><funding-source><institution-wrap><institution-id institution-id-type="FundRef">http://dx.doi.org/10.13039/501100000781</institution-id>
<institution>European Research Council</institution>
</institution-wrap>
</funding-source>
<award-id>ERC-291166 SoftHands</award-id>
<principal-award-recipient><name><surname>Bianchi</surname>
<given-names>Matteo</given-names>
</name>
<name><surname>Marino</surname>
<given-names>Hamal</given-names>
</name>
<name><surname>Gabiccini</surname>
<given-names>Marco</given-names>
</name>
<name><surname>Guidi</surname>
<given-names>Andrea</given-names>
</name>
<name><surname>Scilingo</surname>
<given-names>Enzo Pasquale</given-names>
</name>
<name><surname>Bicchi</surname>
<given-names>Antonio</given-names>
</name>
</principal-award-recipient>
</award-group>
<award-group id="par-2"><funding-source><institution-wrap><institution-id institution-id-type="FundRef">http://dx.doi.org/10.13039/501100000781</institution-id>
<institution>European Research Council</institution>
</institution-wrap>
</funding-source>
<award-id>ERC-291166 The Hand Embodied</award-id>
<principal-award-recipient><name><surname>Leo</surname>
<given-names>Andrea</given-names>
</name>
<name><surname>Handjaras</surname>
<given-names>Giacomo</given-names>
</name>
<name><surname>Bianchi</surname>
<given-names>Matteo</given-names>
</name>
<name><surname>Marino</surname>
<given-names>Hamal</given-names>
</name>
<name><surname>Gabiccini</surname>
<given-names>Marco</given-names>
</name>
<name><surname>Guidi</surname>
<given-names>Andrea</given-names>
</name>
<name><surname>Scilingo</surname>
<given-names>Enzo Pasquale</given-names>
</name>
<name><surname>Pietrini</surname>
<given-names>Pietro</given-names>
</name>
<name><surname>Bicchi</surname>
<given-names>Antonio</given-names>
</name>
<name><surname>Santello</surname>
<given-names>Marco</given-names>
</name>
<name><surname>Ricciardi</surname>
<given-names>Emiliano</given-names>
</name>
</principal-award-recipient>
</award-group>
<funding-statement>The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.</funding-statement>
</funding-group>
<custom-meta-group><custom-meta><meta-name>elife-xml-version</meta-name>
<meta-value>2.5</meta-value>
</custom-meta>
<custom-meta specific-use="meta-only"><meta-name>Author impact statement</meta-name>
<meta-value>The human brain encodes coordinated patterns of joint movements – synergies – to increase the efficiency with which it can control complex hand movements.</meta-value>
</custom-meta>
</custom-meta-group>
</article-meta>
</front>
<body><sec sec-type="intro" id="s1"><title>Introduction</title>
<p>Unique among primates, the human hand is capable of performing a strikingly wide range of movements, characterized by a high degree of adaptability and dexterity that enables complex interactions with the environment. This is exemplified by the hand’s ability to mold to objects and tools by combining motion and force in the individual digits so to reach a variety of hand postures. The multiple ways in which the hand can perform a given goal-directed movement arise from anatomical, functional, and kinematic redundancies, i.e., a large number of degrees of freedom (DoFs) (<xref rid="bib6" ref-type="bibr">Bernstein, 1967</xref>
). Such an organization results highly advantageous from an operational perspective, as redundant DoFs enable the hand to flexibly adapt to different task demands, or to switch among multiple postural configurations, while maintaining grasp stability (<xref rid="bib6" ref-type="bibr">Bernstein, 1967</xref>
; <xref rid="bib86" ref-type="bibr">Santello et al., 2013</xref>
). At the same time, this organization raises the question about how the central nervous system deals with these redundancies and selects a set of DoFs to accomplish a specific motor task (<xref rid="bib67" ref-type="bibr">Latash et al., 2007</xref>
). While some models propose the notion of “freezing” of redundant DoFs (<xref rid="bib107" ref-type="bibr">Vereijken et al., 1992</xref>
) or the implementation of optimization strategies (<xref rid="bib29" ref-type="bibr">Flash and Hogan, 1985</xref>
; <xref rid="bib103" ref-type="bibr">Todorov and Jordan, 2002</xref>
; <xref rid="bib104" ref-type="bibr">Todorov, 2004</xref>
), further studies have favored an alternative solution based on linear dimensionality reduction strategies or <italic>motor synergies</italic>
(<xref rid="bib68" ref-type="bibr">Latash, 2010</xref>
).</p>
<p>From a theoretical perspective, synergies represent functional sensorimotor modules that result from the combination of elementary variables and behave as single functional units (<xref rid="bib105" ref-type="bibr">Turvey, 2007</xref>
; <xref rid="bib68" ref-type="bibr">Latash, 2010</xref>
). From an experimental viewpoint, synergy-based models have been applied with success to electrophysiological and kinematic data acquired in frogs (<xref rid="bib21" ref-type="bibr">d'Avella and Lacquaniti, 2003</xref>
; <xref rid="bib13" ref-type="bibr">Cheung et al., 2005</xref>
), monkeys (<xref rid="bib77" ref-type="bibr">Overduin et al., 2012</xref>
) and humans (<xref rid="bib9" ref-type="bibr">Bizzi et al., 2008</xref>
).</p>
<p>With regard to hand control in humans, synergies have been defined at different levels. <italic>Kinematic</italic>
synergies correspond to covariation patterns in finger joint angles and are quantified through kinematic recordings (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
; <xref rid="bib33" ref-type="bibr">Gabiccini et al., 2013</xref>
; <xref rid="bib100" ref-type="bibr">Tessitore et al., 2013</xref>
). <italic>Muscle</italic>
synergies represent covariation patterns in finger muscle activations and are typically extracted from electromyography (EMG) signals (<xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
; <xref rid="bib20" ref-type="bibr">d'Avella and Lacquaniti, 2013</xref>
).</p>
<p>The first quantitative description of kinematic hand synergies was obtained by analyzing hand postures used by subjects for grasping imagined objects that varied in size and shape (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
). Three hand postural synergies were identified through a principal component analysis (PCA) that accounted for a high fraction (>84%) of variance in the kinematic data across all hand postures and characterized hand configurations as linear combinations of finger joints (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
). Notably, other studies achieved similar results using kinematic data acquired during grasping of real, recalled and virtual objects (<xref rid="bib88" ref-type="bibr">Santello et al., 2002</xref>
), exploratory procedures (<xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
), or during different movements, such as typing (<xref rid="bib98" ref-type="bibr">Soechting and Flanders, 1997</xref>
), as well as with EMG signals from finger muscles during hand shaping for grasping or finger spelling (<xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
).</p>
<p>Given that final hand postures can be described effectively as the linear combination of a small number of synergies, each one controlling a set of muscles and joints, the question arises whether kinematic or muscular hand synergies merely reflect a behavioral observation, or whether instead a synergy-based framework is grounded in the human brain as a code for the coordination of hand movements. According to the latter hypothesis, motor cortical areas and/or spinal modules may control the large number of DoFs of the hand through weighted combinations of synergies (<xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
; <xref rid="bib86" ref-type="bibr">Santello et al., 2013</xref>
; <xref rid="bib89" ref-type="bibr">Santello and Lang, 2014</xref>
), in a way similar to that demonstrated for other motor acts, such as gait, body posture, and arm movements (<xref rid="bib14" ref-type="bibr">Cheung et al., 2009</xref>
). Furthermore, the biomechanical constraints of the hand structure that group several joints in nature (e.g., multi-digit and multi-joint extrinsic finger muscles whose activity would generate coupled motion), are compatible with the synergistic control of hand movements.</p>
<p>Previous brain functional studies in humans are suggestive of a synergistic control of hand movements. For instance, in a functional magnetic resonance imaging (fMRI) study, synergistic/dexterous and non-synergistic hand movements elicited different neural responses in the premotor and parietal network that controls hand posture (<xref rid="bib26" ref-type="bibr">Ehrsson et al., 2002</xref>
). Equally, transcranial magnetic stimulation (TMS) induced hand movements encompassed within distinct postural synergies (<xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
). Despite all the above pieces of information, however, <italic>whether</italic>
and <italic>to what extent</italic>
the representation of hand movements is encoded at a cortical level in the human brain directly as postural synergies still remains an open question.</p>
<p>Alternative solutions to synergies for hand control have been proposed as well. Above all, classic <italic>somatotopic</italic>
theories postulated that distinct clusters of neuronal populations are associated with specific hand muscles, fingers, or finger movements (<xref rid="bib78" ref-type="bibr">Penfield and Boldrey, 1937</xref>
; <xref rid="bib79" ref-type="bibr">Penfield and Rasmussen, 1950</xref>
; <xref rid="bib109" ref-type="bibr">Woolsey et al., 1952</xref>
). However, whereas a coarse arrangement of body regions (e.g., hand, mouth, or face) has been shown within primary motor areas, the intrinsic topographic organization within limb-specific clusters remains controversial. In hand motor area, neurons controlling single fingers are organized in distributed, overlapping cortical patches without any detectable segregation (<xref rid="bib78" ref-type="bibr">Penfield and Boldrey, 1937</xref>
; <xref rid="bib91" ref-type="bibr">Schieber, 1991</xref>
, <xref rid="bib92" ref-type="bibr">Schieber, 2001</xref>
). In addition, it has been recently shown that fMRI neural activation patterns for individual digits in sensorimotor cortex are not somatotopically organized and their spatial arrangement is highly variable, while their representational structure (i.e., the pattern of distances between digit-specific activations) is invariant across individuals (<xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
).</p>
<p>The present study was designed to determine whether and to what extent synergistic information for hand postural control is encoded as such at a neural level in the human brain cortical regions.</p>
<p>An identical experimental paradigm was performed in two distinct sessions to acquire kinematic and electromyographic (EMG) data while participants performed grasp-to-use movements towards virtual objects. Kinematic data were analyzed according to a <italic>kinematic synergy</italic>
model and an <italic>individual-digit</italic>
model, based on the independent representation of each digit (<xref rid="bib59" ref-type="bibr">Kirsch et al., 2014</xref>
), while EMG data were analyzed according to a <italic>muscle synergy</italic>
model to obtain independent descriptions of each final hand posture. In a separate fMRI session, brain activity was measured in the same participants during an identical motor task.</p>
<p>Hence, encoding techniques (<xref rid="bib71" ref-type="bibr">Mitchell et al., 2008</xref>
) were applied to brain functional data to compare the synergy-based model with the alternative somatotopic and muscular models on the basis of their abilities to predict neural responses. Finally, to assess the specificity of the findings, we applied a decoding procedure to the fMRI data to predict hand postures based on patterns of fMRI activity.</p>
</sec>
<sec sec-type="results" id="s2"><title>Results</title>
<sec id="s2-1"><title>Motion capture and EMG sessions: discrimination accuracy of different models on behavioral data</title>
<p>The hand kinematic data, acquired from the motion capture experiment, provided a <italic>kinematic synergy</italic>
description, created using PCA on digit joint angles, and an <italic>individual digit</italic>
description, i.e., a somatotopic model based on the displacements of single digits, calculated as the average displacement of their joint angles. The EMG data provided a <italic>muscle synergy</italic>
description. To obtain comparable descriptions of hand posture, three five-dimensions models were chosen. A validation procedure based on a rank-accuracy measure was performed to assess the extent to which static hand postures could be reliably discriminated by each behavioral model, regardless of its fraction of variance accounted for. All the three models were able to significantly distinguish between individual hand postures (average accuracy ± standard deviation -SD-; chance level: 50%; <italic>kinematic synergy</italic>
: 91.1 ± 3.6%; <italic>individual digit</italic>
: 85.9 ± 5%; <italic>muscle synergy</italic>
: 72 ± 7.7%) (<xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1A</xref>
). Specifically, the <italic>kinematic synergy</italic>
model performed significantly better than both the <italic>individual digit</italic>
and <italic>muscle synergy</italic>
models while the <italic>individual digit</italic>
model was significantly more informative than the <italic>muscle synergy</italic>
model (Wilcoxon signed-rank test, <italic>p</italic>
<0.05, Bonferroni-Holm corrected).</p>
</sec>
<sec id="s2-2"><title>fMRI session: discrimination accuracy of different models in single-subject encoding of hand posture</title>
<p>Three independent encoding procedures (<xref rid="bib71" ref-type="bibr">Mitchell et al., 2008</xref>
) were performed on the fMRI data to assess to what extent each model (<italic>kinematic synergy, individual digit</italic>
or <italic>muscle synergy</italic>
) would predict brain activity. The discrimination accuracy was tested for significance against unique null distributions of accuracies for each participant and model obtained through permutation tests.</p>
<p>Overall, the encoding procedure based on the <italic>kinematic synergy</italic>
model was highly successful across all participants (average accuracy ± SD: 71.58 ± 5.52%) and always significantly above chance level (see <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1B</xref>
for single subject results). The encoding of the <italic>individual digit</italic>
model was successful in five of nine participants only (63.89 ± 6.86%). Finally, the <italic>muscle synergy</italic>
model successfully predicted brain activity in six out of eight participants, with an average accuracy that was comparable to the <italic>individual digit</italic>
model (63.9 ± 6.5%).</p>
<p>The <italic>kinematic synergy</italic>
model outperformed both the <italic>individual digit</italic>
and the <italic>muscle synergy</italic>
models (Wilcoxon signed-rank test, <italic>p</italic>
<0.05, Bonferroni-Holm corrected), whereas no significant difference was found between the <italic>individual digit</italic>
and <italic>muscle synergy</italic>
models (<italic>p</italic>
=0.95).</p>
<p>To obtain a measure of the overall fit between neural responses and behavioral performance, we computed the R<sup>2</sup>
coefficient between the fMRI data and each behavioral model across voxels, subjects, and acquisition modalities. The group averages were 0.41 ± 0.06 for the <italic>kinematic synergies</italic>
, 0.37 ± 0.03 for the <italic>individual digits</italic>
, and 0.37 ± 0.06 for the <italic>muscle synergies</italic>
. Therefore, 40.8% of the BOLD signal was accounted for by the <italic>kinematic synergies</italic>
, whereas the two other behavioral models explained a relatively smaller fraction of the total variance.</p>
</sec>
<sec id="s2-3"><title>Functional neuroanatomy of kinematic hand synergies</title>
<p>The group analysis was performed only on the encoding results obtained from kinematic synergies, as this was the most successful model and the only one that performed above chance level across participants. The single-subject encoding results maps – containing only the voxels recruited during the procedure – were merged, with a threshold of <italic>p</italic>
>0.33 to retain consistently informative voxels, overlapping in at least four participants.</p>
<p>The group-level probability map, which displays the voxels recruited in at least four subjects, consisted of a well-recognizable network of hand-related regions, specifically bilateral precentral cortex, supplementary motor area (SMA), ventral premotor and supramarginal areas, left inferior parietal and postcentral cortex (<xref ref-type="fig" rid="fig1">Figure 1</xref>
; coordinates in <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1C</xref>
).<fig id="fig1" orientation="portrait" position="float"><object-id pub-id-type="doi">10.7554/eLife.13420.003</object-id>
<label>Figure 1.</label>
<caption><title>This probability map shows the voxels that were consistently engaged by the encoding procedure across subjects, i.e., those voxels whose activity was predictable on the basis of the kinematic synergies.</title>
<p>A hand-posture- related network comprising the left primary and supplementary motor areas, the superior parietal lobe and the anterior part of intraparietal sulcus (bilaterally) was recruited with high overlap across subjects. Despite additional regions (i.e., Brodmann Area 6) resulted from the encoding analyses, they are not evident in the map due to their deep location.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.003">http://dx.doi.org/10.7554/eLife.13420.003</ext-link>
</p>
<p><supplementary-material content-type="local-data" id="SD1-data"><object-id pub-id-type="doi">10.7554/eLife.13420.004</object-id>
<label>Figure 1—source data 1.</label>
<caption><title>This compressed NIfTI file in MNI152 space represents the voxels that were recruited by the encoding procedure in more than three subjects.</title>
<p>The value of each individual voxel corresponds to the number of subjects in which that voxel was recruited.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.004">http://dx.doi.org/10.7554/eLife.13420.004</ext-link>
</p>
</caption>
<media mime-subtype="zip" mimetype="application" xlink:href="elife-13420-fig1-data1.zip" orientation="portrait" id="d36e888" position="anchor"></media>
</supplementary-material>
</p>
<p><supplementary-material content-type="local-data" id="SD2-data"><object-id pub-id-type="doi">10.7554/eLife.13420.005</object-id>
<label>Figure 1—source data 2.</label>
<caption><title>his compressed NIfTI file in MNI152 space represents the Region of Interest chosen for encoding brain activity from the visual region, defined on the basis of a t-test of the overall brain activity (i.e., task versus rest condition) five seconds after the visual stimulus onset, corrected for multiple comparisons with False Discovery Rate (q<0.01).</title>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.005">http://dx.doi.org/10.7554/eLife.13420.005</ext-link>
</p>
</caption>
<media mime-subtype="zip" mimetype="application" xlink:href="elife-13420-fig1-data2.zip" orientation="portrait" id="d36e904" position="anchor"></media>
</supplementary-material>
</p>
</caption>
<graphic xlink:href="elife-13420-fig1"></graphic>
</fig>
</p>
</sec>
<sec id="s2-4"><title>Behavioral and neurofunctional stability of kinematic synergies and synergy-topic mapping</title>
<p>Since postural synergies were obtained in each subject independently, a procedure to assess the stability of the principal components (PCs) across participants was performed (see Materials and methods section). For visualization purposes, we focused on the first three PCs, which could explain more than 80% of the variance across the entire hand kinematic dataset, and were also highly consistent across participants (<xref ref-type="other" rid="media1">Video 1</xref>
).<fig id="media1" position="anchor"><label>Video 1.</label>
<caption><title>This video shows the meaning of the kinematic synergies measured in this study, by presenting three movements from the minimum to the maximum values of kinematic synergies 1, 2, and 3, respectively, expressed as sets of twenty-four joint angles averaged across subjects.</title>
<p>It can be observed that the first synergy modulates abduction-adduction and flexion-extension of both the proximal and distal finger joints, while the second synergy reflects thumb opposition and flexion-extension of the distal joints only. Maximizing the first synergy leads, therefore, to a posture resembling a power grasp, while the second one is linked to pinch movements directed towards smaller objects, and the third one represents movements of flexion and thumb opposition (like in grasping a dish or a platter) (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
; <xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
; <xref rid="bib55" ref-type="bibr">Ingram et al., 2008</xref>
; <xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
).</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.006">http://dx.doi.org/10.7554/eLife.13420.006</ext-link>
</p>
</caption>
<media xlink:href="elife-13420-media1.mp4" mimetype="video" mime-subtype="mp4"><object-id pub-id-type="doi">10.7554/eLife.13420.006</object-id>
</media>
</fig>
</p>
<p>Accordingly to the aforementioned results, the first three kinematic PCs were mapped onto a flattened mesh of the cortical surface. This map displayed the fitting of each synergy within the voxels that were recruited by the encoding procedure across participants. <xref ref-type="fig" rid="fig2">Figure 2</xref>
shows that the group kinematic synergies are represented in the precentral and postcentral cortex in distinct clusters that are arranged in a topographical <italic>continuum</italic>
with smooth supero-inferior transitions. The procedure developed to assess the topographical arrangement of synergies (see Materials and methods) was statistically significant (C=0.19; <italic>p</italic>
=0.038), indicating that anatomically close voxels exhibited similar synergy coefficients (see <xref ref-type="fig" rid="fig2s1">Figure 2—figure supplement 1</xref>
).<fig id="fig2" position="float" orientation="portrait"><object-id pub-id-type="doi">10.7554/eLife.13420.007</object-id>
<label>Figure 2.</label>
<caption><title>Cortical flattened map depicting the topographical organization of the first three synergies across primary motor, somatosensory, and parietal regions.</title>
<p>The portion of cerebral cortex represented in the map corresponds to the area enclosed in the rectangle in the brain mesh (<italic>top, right</italic>
). M1: Primary Motor Cortex. CS: Central Sulcus. S1: Primary Somatosensory cortex (postcentral gyrus). aIPS: anterior intraparietal sulcus. SPL: Superior Parietal lobule.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.007">http://dx.doi.org/10.7554/eLife.13420.007</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig2"></graphic>
<p content-type="supplemental-figure"><fig id="fig2s1" specific-use="child-fig" orientation="portrait" position="anchor"><object-id pub-id-type="doi">10.7554/eLife.13420.008</object-id>
<label>Figure 2—figure supplement 1.</label>
<caption><title>Topography assessment: map and feature spaces.</title>
<p>The two maps represent the map space (upper image), which depicts the pairwise physical distance (i.e., standardized Euclidean distance) between the voxels of the results map, and the feature space (lower image), which depicts the distance (i.e., standardized Euclidean distance) between the goodness-of-fit (R2) of the first three kinematic PCs in each voxel. For further details, see Materials and methods and <xref rid="bib110" ref-type="bibr">Yarrow et al., 2014</xref>
. There was a significant similarity between the two spaces, assessed with the permutation test described in the Methods (C=0.192; p-value=0.0383). Voxels were reordered accordingly to their physical distance to improve readability of the two maps.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.008">http://dx.doi.org/10.7554/eLife.13420.008</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig2-figsupp1"></graphic>
</fig>
</p>
</fig>
</p>
</sec>
<sec id="s2-5"><title>Representational similarity analysis (RSA) and multidimensional scaling (MDS)</title>
<p>Representational Spaces, drawn separately for the three models and fMRI data (using the activity from a region consistently activated across all the grasping movements), were compared at a single subject and group level to assess the similarity between each behavioral model and the neural content represented at a cortical level. All group correlations, both between fMRI and behavioral data and between behavioral models were highly significant (<italic>p</italic>
<0.0001) (for details see <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1D,E</xref>
and <xref ref-type="fig" rid="fig3s1">Figure 3—figure supplement 1</xref>
). Moreover, a MDS procedure was performed to represent data from kinematic synergies and fMRI BOLD activity. <xref ref-type="fig" rid="fig3">Figure 3</xref>
shows the high similarity between these two spaces.<fig id="fig3" position="float" orientation="portrait"><object-id pub-id-type="doi">10.7554/eLife.13420.009</object-id>
<label>Figure 3.</label>
<caption><title>This picture displays the mMultidimensional sScaling (MDS) results for kinematic synergies (left) and fMRI brain activity (right).</title>
<p>With the exception of few postures (e.g., dinner plate, frisbee and espresso cup) that were misplaced in the fMRI data with respect to the kinematic synergies representation, the other object-related postures almost preserved their relative distances.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.009">http://dx.doi.org/10.7554/eLife.13420.009</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig3"></graphic>
<p content-type="supplemental-figure"><fig id="fig3s1" specific-use="child-fig" orientation="portrait" position="anchor"><object-id pub-id-type="doi">10.7554/eLife.13420.010</object-id>
<label>Figure 3—figure supplement 1.</label>
<caption><title>Average correlations between behavioral models and fMRI data.</title>
<p>The histogram reports the correlation values (transformed to z-scores and averaged across subjects) between each behavioral model and the fMRI data. Error bars represent the SEM. The noise ceiling, estimated using the procedure described by <xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
is also reported. The two dashed lines describe the upper and lower bounds, respectively. The single-subject correlation values are reported in <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1D</xref>
.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.010">http://dx.doi.org/10.7554/eLife.13420.010</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig3-figsupp1"></graphic>
</fig>
</p>
</fig>
</p>
</sec>
<sec id="s2-6"><title>From kinematic PCs to brain activity, and back: hand posture reconstruction from brain activity</title>
<p>To confirm the presence of a neural representation of hand synergies at a cortical level and that that this information can be used to specifically control hand postures based on brain activity, we applied decoding methods as complementary approaches to encoding analyses (<xref rid="bib75" ref-type="bibr">Naselaris et al., 2011</xref>
). Hand posture (expressed as a matrix of 24 joints angles by 20 hand postures) was therefore predicted with a multiple linear regression procedure from fMRI data. Specifically, this procedure could reliably reconstruct the different hand postures across participants. The goodness-of-fit (R<sup>2</sup>
) between the original and reconstructed joint angle patterns related to single movements, averaged across subjects, ranged between 0.51 and 0.90 (<xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1F</xref>
). Three hand plots displaying original and reconstructed postures from a representative subject are shown in <xref ref-type="fig" rid="fig4">Figure 4</xref>
. Notably, this decoding attempt reveals that brain activity elicited by our task can effectively be used to reconstruct the postural configuration of the hand. Moreover, the rank accuracy procedure specifically designed to test the extent to which each decoded posture could be discriminated from the original ones yielded significant results in six of nine participants (<xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1G</xref>
).<fig id="fig4" position="float" orientation="portrait"><object-id pub-id-type="doi">10.7554/eLife.13420.011</object-id>
<label>Figure 4.</label>
<caption><title>This picture represents the postures obtained from the fMRI data and those originally recorded through optical tracking.</title>
<p>The figure shows three pairs of hand plots corresponding to three postures from a representative subject, and the goodness-of-fit between the original and decoded sets of joint angles. In these plots, the two wrist angles are not rendered.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.011">http://dx.doi.org/10.7554/eLife.13420.011</ext-link>
</p>
<p><supplementary-material content-type="local-data" id="SD3-data"><object-id pub-id-type="doi">10.7554/eLife.13420.012</object-id>
<label>Figure 4—source data 1.</label>
<caption><title>This compressed NIfTI file in MNI152 space represents the Region of Interest chosen for RSA and posture decoding, defined on the basis of a t-test of the overall brain activity (i.e., task versus rest condition), corrected for multiple comparisons with False Discovery Rate (q<0.05).</title>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.012">http://dx.doi.org/10.7554/eLife.13420.012</ext-link>
</p>
</caption>
<media mime-subtype="zip" mimetype="application" xlink:href="elife-13420-fig4-data1.zip" orientation="portrait" id="d36e1108" position="anchor"></media>
</supplementary-material>
</p>
</caption>
<graphic xlink:href="elife-13420-fig4"></graphic>
<p content-type="supplemental-figure"><fig id="fig4s1" specific-use="child-fig" orientation="portrait" position="anchor"><object-id pub-id-type="doi">10.7554/eLife.13420.013</object-id>
<label>Figure 4—figure supplement 1.</label>
<caption><title>Marker placement for kinematic hand posture data acquisition: The picture depicts the hand of a subject with the complete set of optical markers used to define hand posture through optical tracking.</title>
<p>This set of markers corresponds to the joint and bones positions originally recorded; the rendering in <xref ref-type="fig" rid="fig4">Figure 4</xref>
was performed with reference to this acquisition protocol.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.013">http://dx.doi.org/10.7554/eLife.13420.013</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig4-figsupp1"></graphic>
</fig>
</p>
<p content-type="supplemental-figure"><fig id="fig4s2" specific-use="child-fig" orientation="portrait" position="anchor"><object-id pub-id-type="doi">10.7554/eLife.13420.014</object-id>
<label>Figure 4—figure supplement 2.</label>
<caption><title>ROI used for performing RSA and posture decoding: This map represents the Region of Interest which contained all the voxels used for performing Representational Similarity Analysis and hand posture decoding.</title>
<p>The region was obtained with a t-test of the overall brain activity (i.e., task versus rest condition), corrected for multiple comparisons with False Discovery Rate (q<0.05). The population of voxels represented here was subsequently reduced with a PCA accounting for most of the variance as described in the Methods.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.014">http://dx.doi.org/10.7554/eLife.13420.014</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig4-figsupp2"></graphic>
</fig>
</p>
</fig>
</p>
</sec>
<sec id="s2-7"><title>The possible role of visual object presentation: control analyses</title>
<p>Since motor and premotor regions supposedly contains neuronal populations that respond to visual stimuli (<xref rid="bib66" ref-type="bibr">Kwan et al., 1985</xref>
; <xref rid="bib12" ref-type="bibr">Castiello, 2005</xref>
; <xref rid="bib60" ref-type="bibr">Klaes et al., 2015</xref>
), one may argue that the visual presentation of objects in the current experiment contributes to the synergy-based encoding of BOLD activity in those regions. To exclude this possibility, an encoding procedure using the <italic>kinematic synergy</italic>
model was performed within the region of interest (ROI) chosen for RSA and posture reconstruction, using exclusively the neural activity related to visual object presentation, measured five seconds after the stimulus onset. The procedure was unsuccessful in all participants, thus indicating that the <italic>kinematic synergy</italic>
information in motor and premotor regions was purely related to motor activity (<xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1H</xref>
).</p>
<p>The encoding maps of kinematic synergies never included visual areas. Nonetheless, visual areas are likely to participate in the early stages of action preparation (<xref rid="bib47" ref-type="bibr">Gutteling et al., 2015</xref>
) and the motor imagery might have played a role during the task in the fMRI session. For this reason, we first defined a ROI by contrasting visual related activity after stimulus presentation and rest (<italic>q</italic>
<0.01, FDR corrected), thus to isolate regions of striate and extrastriate cortex within the occipital lobe. Subsequently, an encoding analysis was performed similarly to the above-mentioned procedures. The results were at the chance level in seven out of nine participants (see <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1I</xref>
), suggesting that visual imagery processes in the occipital cortex did not retain <italic>kinematic synergy</italic>
information.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s3"><title>Discussion</title>
<p>Scientists have debated for a long time how the human hand can attain the variety of postural configurations required to perform all the complex tasks that we encounter in activities of daily living. The concept of <italic>synergy</italic>
has been proposed to denote functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. In the present study, by combining kinematic, EMG, and brain activity measures using fMRI, we provide the first demonstration that hand postural information encoded through kinematic synergies is represented within the cortical network controlling hand movements. Importantly, we demonstrate that kinematic synergies strongly correlate with the neural responses in primary and supplementary motor areas, as well as movement-related parietal and premotor regions. Furthermore, we show that kinematic synergies are topographically arranged in the precentral and postcentral cortex and represent meaningful primitives of grasping. Finally, the neural responses in sensorimotor cortex allow for a highly successful decoding of complex hand postures. Therefore, we conclude that the human motor cortical areas are likely to represent hand posture by combining few elementary modules.</p>
<sec id="s3-1"><title>Kinematic synergies optimally predict behavioral outcomes and neurofunctional representations of distinct grasping-to-use motor acts</title>
<p>Validation of behavioral data was performed as the first stage of analysis to assess the information content and the discriminability of the postures from the kinematic or EMG data. This procedure showed that each posture could be successfully classified above chance level by <italic>kinematic synergy, individual digit,</italic>
and <italic>muscle synergy</italic>
models.</p>
<p>These results are highly consistent with the existent literature on synergies suggesting that just five PCs are sufficient to classify and reconstruct hand postures when computed only on hand kinematic data (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
, <xref rid="bib88" ref-type="bibr">Santello et al., 2002</xref>
; <xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
), or both kinematic and EMG data (<xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
; <xref rid="bib61" ref-type="bibr">Klein Breteler et al., 2007</xref>
). In the current work, we also demonstrate that kinematic synergies result in a higher discrimination accuracy of hand postures than individual digits and muscle synergies.</p>
<p>In addition, the encoding procedures on fMRI-based neural responses show that <italic>kinematic synergies</italic>
are the best predictor of brain activity, with a significantly higher discrimination accuracy across participants, indicating that <italic>kinematic synergies</italic>
are represented at a cortical level. Even if previous studies suggest that the brain might encode grasp movements as combinations of synergies in the monkey (<xref rid="bib77" ref-type="bibr">Overduin et al., 2012</xref>
), or indirectly in humans (<xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
; <xref rid="bib40" ref-type="bibr">Gentner et al., 2010</xref>
), to the best of our knowledge, no direct evidence has been presented to date for a functional validation and characterization of neural correlates of synergy-based models.</p>
<p>The results from RSA suggest that the three models used to predict brain activity may have similar, correlated spaces. However, each model provides a unique combination of weights for each posture across different dimensions (e.g., synergies or digits), thus resulting in distinct descriptions of the same hand postures. It should be noted that both the <italic>individual digit</italic>
model and the <italic>muscle synergy</italic>
model failed to predict brain activity in four and two participants, respectively. Thus, while they discriminated hand postures at a behavioral level, these models are clearly less efficient than the <italic>kinematic synergy model</italic>
in predicting neural activity.</p>
<p>Finally, the descriptive procedures (RSA and MDS) were performed to assess the differences between the fMRI representational space and the single-model spaces. The results indicate a high similarity between fMRI and kinematic synergies, as reflected in the largely overlapping representations obtained from kinematic data and fMRI as depicted in <xref ref-type="fig" rid="fig3">Figure 3</xref>
.</p>
<p>A recent study employed descriptive procedures (i.e., RSA) to demonstrate that similar movement patterns of individual fingers are reflected in highly correlated patterns of brain responses, that, in turn, are more correlated with kinematic joint velocities than to muscle activity, as recorded through high-density EMG (<xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
). Our paper introduces a methodological and conceptual advancement. While, in Ejaz et al., full matrices of postural, functional or muscle data have been considered in the RSA, here we focused on descriptions with lower dimensionality, which lose only minor portions of information. Consequently, by showing that brain activity in motor regions can be expressed as a function of a few meaningful motor primitives that group together multiple joints, rather than as combinations of individual digit positions, our results suggest that a modular organization represents the basis of hand posture control.</p>
</sec>
<sec id="s3-2"><title>The functional neuroanatomy of kinematic synergies is embedded in motor cortical areas</title>
<p>The group probability maps of our study indicate that the regions consistently modulated by kinematic synergies, that include bilateral precentral, SMA and supramarginal area, ventral premotor, left inferior parietal and postcentral cortex, overlapped with a network strongly associated with the control of hand posture (<xref rid="bib12" ref-type="bibr">Castiello, 2005</xref>
).</p>
<p>Specifically, we show that the combination of five synergies, expressed as PCs of hand joint angles, predicts neural activity of M1 and SMA, key areas for motor control. While previous studies in humans showed differential activations in M1 and SMA for power and precision grip tasks (<xref rid="bib24" ref-type="bibr">Ehrsson et al., 2000</xref>
) and for different complex movements (<xref rid="bib10" ref-type="bibr">Bleichner et al., 2014</xref>
), to date no brain imaging studies directly associated these regions with synergy-based hand control.</p>
<p>Beyond primary motor areas, regions within parietal cortex are involved in the control of motor acts (<xref rid="bib42" ref-type="bibr">Grafton et al., 1996</xref>
). Inferior parietal and postcentral areas are engaged in higher-level processing during object interaction (<xref rid="bib18" ref-type="bibr">Culham et al., 2003</xref>
). Since grasping, as opposed to reaching movements, requires integration of motor information with inputs related to the target object, these regions may integrate the sensorimotor features needed to preshape the hand correctly (<xref rid="bib45" ref-type="bibr">Grefkes et al., 2002</xref>
; <xref rid="bib18" ref-type="bibr">Culham et al., 2003</xref>
). Consistently, different tool-directed movements were decoded from brain activity in the intraparietal sulcus (<xref rid="bib34" ref-type="bibr">Gallivan et al., 2013</xref>
), and it has been reported that this region is sensitive to differences between precision and power grasps (<xref rid="bib24" ref-type="bibr">Ehrsson et al., 2000</xref>
; <xref rid="bib35" ref-type="bibr">Gallivan et al., 2011</xref>
). The current motor task, even if performed with the dominant right hand only, also recruited motor regions of the right hemisphere. Specifically, bilateral activations of SMA were often described during motor tasks (<xref rid="bib25" ref-type="bibr">Ehrsson et al., 2001</xref>
; <xref rid="bib26" ref-type="bibr">Ehrsson et al., 2002</xref>
) and a recent meta-analysis indicated a consistent recruitment of SMA in grasp type comparisons (<xref rid="bib58" ref-type="bibr">King et al., 2014</xref>
). Equally, a bilateral, but left dominant, involvement of intraparietal cortex for grasping has been reported (<xref rid="bib18" ref-type="bibr">Culham et al., 2003</xref>
).</p>
<p>Moreover, some authors have hypothesized recently that action recognition and mirror mechanisms may rely on the extraction of reduced representations of gestures, rather than on the observation of individual motor acts (<xref rid="bib19" ref-type="bibr">D'Ausilio et al., 2015</xref>
). The specific modulation of neural activity by kinematic synergies within the action recognition network seems in agreement with this proposition.</p>
<p>The map of voxels whose activity is modulated by postural synergies extends beyond the central sulcus to primary somatosensory cortex, suggesting a potential two-fold (sensory and motor) nature of hand synergies. Indeed, at least some subdomains (areas 2 and 3a) contain neurons that respond to multiple digits (<xref rid="bib56" ref-type="bibr">Iwamura et al., 1980</xref>
), despite the evidence supporting specific single finger representations in S1 (<xref rid="bib57" ref-type="bibr">Kaas, 1983</xref>
).</p>
<p>Finally, the width of our probability maps, measured on the cortical mesh, was ca. 1cm, which corresponds to the hand area, as defined by techniques with better spatial resolution, including ultra-high field fMRI or electrocorticography (ECoG) (<xref rid="bib97" ref-type="bibr">Siero et al., 2014</xref>
).</p>
</sec>
<sec id="s3-3"><title>Beyond the precision vs. power grasp dichotomy: synergy-based posture discrimination across participants</title>
<p>To exclude that the results from the encoding analysis can be driven by differences between classes of acts, i.e., precision or power grasps, rather than reflect the modulation of brain activity by kinematic synergies, the similarity between the 20 hand postures was evaluated in a pairwise manner. Specifically, the accuracy of the encoding model was estimated for each pair of distinct movements, unveiling the extent to which individual hand postures could be discriminated from each other based on their associated fMRI activity. In the result heat map (<xref ref-type="fig" rid="fig5">Figure 5</xref>
), two clusters can be identified: one composed mainly by precision grasps directed towards small objects, and a second one composed mainly by power grasps towards heavy tools. The remaining postures did not cluster, forming instead a non-homogeneous group of grasps towards objects that could be either small (e.g., espresso cup) or large (e.g., jar lid, PC mouse).<fig id="fig5" position="float" orientation="portrait"><object-id pub-id-type="doi">10.7554/eLife.13420.015</object-id>
<label>Figure 5.</label>
<caption><title>Discrimination accuracies for single postures as represented by kinematic synergies.</title>
<p>Two clusters of similar postures are easily identifiable (i.e., precision grip and power grasps). However, other postures were recognized without showing an evident clustering, suggesting that the encoding procedure was not biased by a coarse discrimination of motor acts.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.015">http://dx.doi.org/10.7554/eLife.13420.015</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig5"></graphic>
<p content-type="supplemental-figure"><fig id="fig5s1" specific-use="child-fig" orientation="portrait" position="anchor"><object-id pub-id-type="doi">10.7554/eLife.13420.016</object-id>
<label>Figure 5—figure supplement 1.</label>
<caption><title>Workflow of the encoding analysis.</title>
<p>This diagram depicts the workflow of the multiple linear regression procedure applied on fMRI data using the matrices obtained from the data acquired in the kinematic and EMG experiments as encoding models. The pairwise discrimination accuracy was estimated in the decoding phase, represented as the final step of this diagram.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.016">http://dx.doi.org/10.7554/eLife.13420.016</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig5-figsupp1"></graphic>
</fig>
</p>
</fig>
</p>
<p>These results indicate that goal-directed hand movements are represented in the brain in a way that goes beyond the standard distinction between precision and power grasps (<xref rid="bib74" ref-type="bibr">Napier, 1956</xref>
; <xref rid="bib24" ref-type="bibr">Ehrsson et al., 2000</xref>
). Other authors have proposed a possible 'grasp taxonomy' in which multiple, different types of grasps are described according to hierarchical criteria rooted on three main classes: precision, power and intermediate (<xref rid="bib28" ref-type="bibr">Feix et al., 2009</xref>
). By combining these three elementary grasps, it is possible to generate a wide number of postures. Notwithstanding the advancements of these taxonomies in describing hand posture, much less effort has been made to understand how the wide variety of human hand postures can be represented in the brain. Our results indicate that a synergy framework may predict brain activity patterns underlying the control of hand posture. Of note, the highest-ranked kinematic synergies can be clearly identified as grasping primitives: the first synergy modulates abduction-adduction and flexion-extension of both the proximal and distal finger joints, while a second synergy reflects thumb opposition and flexion-extension of the distal joints only. Maximizing the first synergy leads therefore to a posture resembling a power grasp, while the second one is linked to pinch movements directed towards smaller objects, and the third one represents movements of flexion and thumb opposition (like in grasping a dish or a platter) (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
; <xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
; <xref rid="bib55" ref-type="bibr">Ingram et al., 2008</xref>
; <xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
) (<xref ref-type="other" rid="media1">Video 1</xref>
). For this reason, the description of hand postures can benefit from reduction to combinations of few, meaningful synergies, which can provide more reliable results than clustering methods based on a small number of categories (<xref rid="bib88" ref-type="bibr">Santello et al., 2002</xref>
; <xref rid="bib55" ref-type="bibr">Ingram et al., 2008</xref>
; <xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
; <xref rid="bib100" ref-type="bibr">Tessitore et al., 2013</xref>
).</p>
</sec>
<sec id="s3-4"><title>How many hand synergies do humans have?</title>
<p>In the present study, we examined five hand postural synergies. This number was selected based on previous behavioral studies that showed that three and five PCs can account for at least 80% and 90% of the variance, respectively (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
, <xref rid="bib88" ref-type="bibr">Santello et al., 2002</xref>
; <xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
; <xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
; <xref rid="bib40" ref-type="bibr">Gentner et al., 2010</xref>
; <xref rid="bib77" ref-type="bibr">Overduin et al., 2012</xref>
). Indeed, a model with five synergies could successfully predict brain activation patterns. The first three synergies examined in the present study also show a high degree of stability as the order of the most relevant PCs is highly preserved across the nine participants. Moreover, the synergies described in the current study are consistent with those reported by other authors (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
, <xref rid="bib88" ref-type="bibr">Santello et al., 2002</xref>
; <xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
; <xref rid="bib55" ref-type="bibr">Ingram et al., 2008</xref>
; <xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
), although a larger number of both postures and subjects would be required for the definitive characterization of the stability of hand postural synergies.</p>
</sec>
<sec id="s3-5"><title>A challenge to individual digit cortical representations? The functional topography of hand synergies</title>
<p>The first three synergies are displayed on a flattened map of the cortical surface in <xref ref-type="fig" rid="fig2">Figure 2</xref>
. The map suggests that the PCs are topographically arranged, forming clusters with a preference for each of the three synergies, separated by smooth transitions. This organization resembles that observed in the retinotopy of early visual areas (<xref rid="bib96" ref-type="bibr">Sereno et al., 1995</xref>
) or in auditory cortex as studied with tonotopic mapping (<xref rid="bib32" ref-type="bibr">Formisano et al., 2003</xref>
). This observation strongly suggests that primary motor and somatosensory brain regions may show specific, organized representations of synergies across the cortical surface. Such an observation is unprecedented, since the large number of previous studies adopted techniques, such as single cell recording (<xref rid="bib83" ref-type="bibr">Riehle and Requin, 1989</xref>
; <xref rid="bib113" ref-type="bibr">Zhang et al., 1997</xref>
) or intracortical microstimulation (ICMS) (<xref rid="bib77" ref-type="bibr">Overduin et al., 2012</xref>
), which can observe the activity of single neurons but do not capture the functional organization of motor cortex as a whole. Motor cortex has historically been hypothesized to be somatotopically organized in a set of sub-regions that control different segments of the body (<xref rid="bib78" ref-type="bibr">Penfield and Boldrey, 1937</xref>
). However, whereas subsequent work confirmed this organization (<xref rid="bib80" ref-type="bibr">Penfield and Welch, 1951</xref>
), a major critical point remains the internal organization of the single subregions (e.g., hand, leg or face areas). To date, a somatotopy of fingers within the hand area appears unlikely: as each digit is controlled by multiple muscles, individual digits may be mapped in a distributed rather than discrete fashion (<xref rid="bib78" ref-type="bibr">Penfield and Boldrey, 1937</xref>
; <xref rid="bib92" ref-type="bibr">Schieber, 2001</xref>
; <xref rid="bib43" ref-type="bibr">Graziano et al., 2002</xref>
; <xref rid="bib2" ref-type="bibr">Aflalo and Graziano, 2006</xref>
). An alternative view posits that movements are represented in M1 as clusters of neurons coding for different action types or goals (<xref rid="bib44" ref-type="bibr">Graziano, 2016</xref>
). In fact, mouse motor cortex is organized in clusters that encode different motor acts (<xref rid="bib11" ref-type="bibr">Brown and Teskey, 2014</xref>
). Similarly, stimulation of motor cortex in monkeys produces movements directed to stable spatial end-points (<xref rid="bib43" ref-type="bibr">Graziano et al., 2002</xref>
; <xref rid="bib2" ref-type="bibr">Aflalo and Graziano, 2006</xref>
) and may have a synergistic organization (<xref rid="bib77" ref-type="bibr">Overduin et al., 2012</xref>
). Recently, it has been demonstrated in both monkeys and humans that complex movements can be recorded from parietal as well as premotor and motor areas (<xref rid="bib1" ref-type="bibr">Aflalo et al., 2015</xref>
; <xref rid="bib60" ref-type="bibr">Klaes et al., 2015</xref>
; <xref rid="bib90" ref-type="bibr">Schaffelhofer et al., 2015</xref>
). Interestingly, a successful decoding can be achieved in those regions both during motor planning and execution (<xref rid="bib90" ref-type="bibr">Schaffelhofer et al., 2015</xref>
). These observations about the internal organization of motor cortex were demonstrated also in humans, revealing that individual representations of digits within M1 show a high degree of overlap (<xref rid="bib54" ref-type="bibr">Indovina and Sanes, 2001</xref>
) and that, despite digits may be arranged in a coarse ventro-dorsal order in somatosensory cortex, their representations are intermingled so that the existence of digit specific voxels is unlikely (<xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
). In contrast, individual cortical voxels may contain enough information to encode specific gestures (<xref rid="bib10" ref-type="bibr">Bleichner et al., 2014</xref>
).</p>
</sec>
<sec id="s3-6"><title>Measuring synergies: back from brain signal to motor actions</title>
<p>Finally, we questioned whether the information encoded in M1 could be used to reconstruct hand postures. To this aim, each individual posture was expressed as a set of synergies that were derived from the fMRI activity on an independent cortical map. The results were reported as correlation values between the sets of joint angles originally tracked during kinematic recording and the joint angles derived from the reconstruction procedure. Overall, hand postures can be reconstructed with high accuracy based on the neural activity patterns. This result yields potential applications for the development of novel brain computer interfaces: for instance, previous studies demonstrated that neural spikes in primary motor cortex can be used to control robotic limbs used for performing simple or complex movements (<xref rid="bib94" ref-type="bibr">Schwartz et al., 2006</xref>
; <xref rid="bib95" ref-type="bibr">Schwartz, 2007</xref>
; <xref rid="bib106" ref-type="bibr">Velliste et al., 2008</xref>
). Previous studies in monkeys suggest that neural activity patterns associated with grasp trajectories can be predicted from single neuron activity in M1 (<xref rid="bib84" ref-type="bibr">Saleh et al., 2010</xref>
; <xref rid="bib85" ref-type="bibr">Saleh et al., 2012</xref>
; <xref rid="bib90" ref-type="bibr">Schaffelhofer et al., 2015</xref>
) and recently neuronal spikes have been associated with principal components (<xref rid="bib72" ref-type="bibr">Mollazadeh et al., 2014</xref>
). In humans, cortical activity obtained through intracranial recordings can be used to decode postural information (<xref rid="bib82" ref-type="bibr">Pistohl et al., 2012</xref>
) and proper techniques can even lead to decode EMG activity from fMRI patterns (<xref rid="bib36" ref-type="bibr">Ganesh et al., 2008</xref>
) or from ECoG signals (<xref rid="bib30" ref-type="bibr">Flint et al., 2014</xref>
). So far, decoding of actual posture from fMRI activity in M1 was possible at individual voxel level, albeit with simplified paradigms and supervised classifiers that identified only four different movements (<xref rid="bib10" ref-type="bibr">Bleichner et al., 2014</xref>
). In contrast, by proving that posture-specific sets of joint angles – expressed by synergy loadings – can be decoded from the fMRI activity, we show that information about hand synergies is present in functional data and can be even used to identify complex gestures. Other authors similarly demonstrated that a set of few synergies can describe hand posture in a reliable way, obtaining hand postures that correlated highly with those recorded with optical tracking (<xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
).</p>
</sec>
<sec id="s3-7"><title>Limitations and methodological considerations</title>
<p>While nine subjects may appear to be a relatively limited sample for a fMRI study, our study sample is comparable to that of most reports on motor control and posture (e.g., <xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
; <xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
; <xref rid="bib55" ref-type="bibr">Ingram et al., 2008</xref>
; <xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
; <xref rid="bib100" ref-type="bibr">Tessitore et al., 2013</xref>
; <xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
) as well as to the sample size of fMRI studies that use encoding techniques, rather than univariate analyses (<xref rid="bib71" ref-type="bibr">Mitchell et al., 2008</xref>
; <xref rid="bib53" ref-type="bibr">Huth et al., 2012</xref>
). In addition, the data of our multiple experimental procedures (i.e., kinematic tracking, EMG, and fMRI) were acquired within the same individuals, so to minimize the impact of inter-subject variability and to facilitate the comparison between different models of hand posture. Finally, robust descriptive and cross-validation methods complemented single-subject multivariate approaches, which are less hampered by the number of participants than univariate fMRI procedures at group level.</p>
<p>A further potential criticism may involve the use of imagined objects – instead of real objects – as targets for grasping movements. The use of imagined objects allows to avoid confounding variables including grasping forces, difficulty in handling objects within a restricting environments, that could play a role in modulating motor acts. In previous behavioral reports, synergies were evaluated using contact with real objects (<xref rid="bib88" ref-type="bibr">Santello et al., 2002</xref>
) and participants could also explore them in an unconstrained manner instead of concentrating on single actions (e.g., grasping) (<xref rid="bib101" ref-type="bibr">Thakur et al., 2008</xref>
). Another study tracked hand motion across many gestures performed in an everyday life setting (<xref rid="bib55" ref-type="bibr">Ingram et al., 2008</xref>
). Interestingly, the dimensionality reduction methods were adopted with high consistency in these reports, despite the wide variety of experimental settings, and the first few PCs could explain most of the variance across a very wide number of motor acts. Moreover, when motor acts were performed toward both real and imagined objects, the results obtained from synergy evaluation were highly similar (<xref rid="bib88" ref-type="bibr">Santello et al., 2002</xref>
).</p>
<p>It can be argued that the better performance for <italic>kinematic synergies</italic>
as compared to the other two alternative models may be due to the differences in the intrinsic signal and noise levels of the optical motion tracking and EMG acquisition techniques. Moreover, the <italic>muscle synergy</italic>
model is inevitably simplified, since only a fraction of the intrinsic and extrinsic muscles of the hand can be recorded with surface EMG. Since all these factors may impact our ability to predict brain activity, we tested whether and to what extent different processing methods and EMG channel configurations could affect the performance of the <italic>muscle synergy</italic>
model in discriminating single gestures and encoding brain activity. Therefore, we performed an additional analysis on an independent group of subjects, testing different processing methods and EMG channel configurations (up to 16 channels). The results, reported in the Appendix, demonstrate that EMG recordings with a higher dimensionality (<xref rid="bib38" ref-type="bibr">Gazzoni et al., 2014</xref>
; <xref rid="bib73" ref-type="bibr">Muceli et al., 2014</xref>
) or a different signal processing (<xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
) do not lead to better discrimination results. These findings are consistent with previous reports (<xref rid="bib73" ref-type="bibr">Muceli et al., 2014</xref>
), and indicate that, in the current study, the worst performance of the muscle model relates more to the signal-to-noise ratio of the EMG technique per se, rather than to shortcomings of either the acquisition device or the signal processing methods adopted here.</p>
<p>While our data suggest that synergies may be arranged topographically on the cortical surface, the assessment of such a mapping is currently limited to the first three unrotated PCs. Additional studies are needed to investigate how topographical organization may be affected by the rotation of the principal components. Indeed, such an assessment requires the definition of stable population-level synergies to allow for the identification of optimally rotated components and to test their topographical arrangements across subjects; for this reason, it falls beyond the aims of the current study. Our work demonstrates that the topography of synergies, as defined as a spatial map of the first three PCs, is resistant to different arrangements; however, alternative configurations (rotated solutions within the PCA) can be encoded as well in sensorimotor cortical areas. The relatively low C index obtained in the mapping procedure and the total variance explained by the <italic>kinematic synergy</italic>
model during the encoding procedure leave the door open to better models and different topographical arrangements.</p>
</sec>
<sec id="s3-8"><title>Beyond synergies: which pieces of information are also coded in the brain?</title>
<p>In summary, our results provide strong support for the representation of hand motor acts through postural synergies. However, this does not imply that synergies are the only way the brain encodes hand movements in primary motor cortex. In our data, only a portion (40%) of the total brain activity could be accounted for by kinematic synergies. Hand motor control results from complex interactions involving the integration of sensory feedback with the selection of motor commands to group of hand muscles. Similarly, motor planning is also a complex process, which requires selecting the desired final posture based on the contact forces required to grasp or manipulate an object. These elements must be continuously monitored to allow for on-line adaptation and corrections (<xref rid="bib12" ref-type="bibr">Castiello, 2005</xref>
). Previous studies demonstrated that only a small fraction of variance in M1 is related to arm posture (<xref rid="bib2" ref-type="bibr">Aflalo and Graziano, 2006</xref>
) and that grasping force can be efficiently decoded from electrical activity, suggesting that at least a subset of M1 neurons processes force-related information (<xref rid="bib30" ref-type="bibr">Flint et al., 2014</xref>
). In addition, motor areas can combine individual digit patterns on the basis of alternative non-synergistic or nonlinear combinations and the correlated activity patterns for adjacent fingers may depend on alternative mechanisms such as finger enslaving (<xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
). It is likely that sensorimotor areas encode also different combinations of synergies, based – for instance – on the rotated versions of kinematic PCs: the encoding of synergies and of their rotated counterparts may represent a wider repertoire of motor primitives which can improve the flexibility and adaptability of modular control. Moreover, the information encoded may be related to the grasping action as a whole, not only to its final posture. Dimensionality reduction criteria can also be applied to hand posture over time, leading to time-varying synergies that encode complete preshaping gestures without being limited to their final position (<xref rid="bib100" ref-type="bibr">Tessitore et al., 2013</xref>
). This is consistent with EMG studies, which actually track muscle activity over the entire grasping trajectory (<xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
; <xref rid="bib14" ref-type="bibr">Cheung et al., 2009</xref>
) and can add information about the adjustments performed during a motor act. Information about the temporal sequence of posture and movements may therefore be encoded in M1 and a different experimental setup is needed to test this hypothesis.</p>
<p>It should also be noted that studies in animal models bear strong evidence for a distributed coding of hand synergies beyond motor cortex, i.e., spinal cord (<xref rid="bib77" ref-type="bibr">Overduin et al., 2012</xref>
; <xref rid="bib86" ref-type="bibr">Santello et al., 2013</xref>
). The question about the role of M1 – i.e., whether it actually contains synergic information or simply act as a mere selector of motor primitives that are encoded elsewhere – still remains open. Our study provides a relatively coarse description of the role of M1 neurons. According to the redundancy principle, only a part of M1 neurons may be directly implied in movement or posture control (<xref rid="bib67" ref-type="bibr">Latash et al., 2007</xref>
), whereas the remaining neurons may deal with force production or posture adjustments and control over time, allowing for the high flexibility and adaptability which are peculiar features of human hand movements.</p>
<p>Altogether, the coding of motor acts through postural synergies may shed new light on the representation of hand motor acts in the brain and pave the way for further studies of neural correlates of hand synergies. The possibility to use synergies to reconstruct hand posture from functional activity may lead to important outcomes and advancements in prosthetics and brain-machine interfaces. These applications could eventually use synergy-based information from motor cortical areas to perform movements in a smooth and natural way, using the same dimensionality reduction strategies that the brain applies during motor execution.</p>
</sec>
</sec>
<sec sec-type="materials|methods" id="s4"><title>Materials and methods</title>
<sec id="s4-1"><title>Subjects</title>
<p>Nine healthy volunteers (5F, age 25 ± 3 yrs) participated in the study. The subjects were right-handed according to the Edinburgh Handedness Inventory (<xref rid="bib76" ref-type="bibr">Oldfield, 1971</xref>
). All participants had normal or corrected-to-normal visual acuity and received a medical examination, including a brain structural MRI scan, to exclude any disorder that could affect brain structure or function.</p>
</sec>
<sec id="s4-2"><title>Experimental setup</title>
<p>The kinematic, EMG, and fMRI data were acquired during three separate sessions that were performed on different days, in a randomly alternated manner across participants. Eight of nine subjects performed all the three sessions, while EMG data from one participant were not recorded due to hardware failure. Across the three sessions, participants were requested to perform the same task of grasp-to-use gestures towards 20 different virtual objects. A training phase was performed prior to the sessions to familiarize participants with the experimental task.</p>
<p>The kinematic and EMG experiments were performed to obtain accurate descriptions of the final hand posture. Three models of equal dimensions (i.e., five dimensions for each of the twenty postures) were derived from these two sessions: a <italic>kinematic synergy model</italic>
based on PCA on kinematic data, an additional kinematic description which considers separately the displacements of each <italic>individual digit</italic>
for each posture, and an EMG-based <italic>muscle synergy model</italic>
. The models were first assessed using a machine-learning approach to measure their ability to discriminate among individual postures. The models were then used in a comparable method (i.e., encoding procedure) aimed at predicting the fMRI activity while subjects performed the same hand grasping gestures. Finally, fMRI activity was used to reconstruct the hand postures (i.e., decoding procedure).</p>
</sec>
<sec id="s4-3"><title>Kinematic experiment</title>
<p>The first experimental session consisted of kinematic recording of hand postures during the execution of motor acts with common objects. More specifically, we focused on the postural (static) component at the end of reach-to-grasp movements. Kinematic postural information was acquired with the model described in a previous study (<xref rid="bib33" ref-type="bibr">Gabiccini et al., 2013</xref>
), which is a fully parameterized model, reconstructed from a structural magnetic resonance imaging of the hand across a large number of postures (<xref rid="bib99" ref-type="bibr">Stillfried et al., 2014</xref>
). Such a model can be adapted to different subjects through a suitable calibration procedure. This model is amenable to in vivo joint recordings via optical tracking of markers attached to the skin and is endowed with a mechanism for compensating soft tissue artifacts caused by the skin and marker movements with respect to the bones (<xref rid="bib46" ref-type="bibr">Gustus et al., 2012</xref>
).</p>
</sec>
<sec id="s4-4"><title>Kinematic data acquisition</title>
<p>During the recordings, participants were comfortably seated with their right hand in a resting position (semipronated) and were instructed to lift and shape their right hand as to grasp a visually-presented object. Stimuli presentation was organized into trials in which pictures of the target objects were shown on a computer screen for three seconds and were followed by an inter-stimulus pause (two seconds), followed by an auditory cue that prompted the grasping movements. The interval between two consecutive trials lasted seven seconds. In each trial, subjects were requested to grasp objects as if they were going to use them, and to place their hands in the resting position once the movement was over. Twenty different objects, chosen from our previous report (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
), were used in the current study (see <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1J</xref>
for a list).</p>
<p>The experiment was organized in five runs, each composed by twenty trials, in randomized order across participants. Therefore, all the grasp-to-use movements were performed five times. The experiment was preceded by a training session that was performed after the positioning of the markers. Hand posture was measured by an optical motion capture system (Phase Space, San Leandro, CA, USA), composed of ten stereocameras with a sampling frequency of 480 Hz. The cameras recorded the Cartesian positions of the markers and expressed them with reference to a global inertial frame and to a local frame of reference obtained by adding a bracelet equipped with optical markers and fastened to the participants’ forearm. This allowed marker coordinates to be expressed with reference to this local frame. To derive the joint angles of the hand, other markers were placed on each bone (from metacarpal bones to distal phalanxes) and on a selected group of joints: thumb carpo-metacarpal (CMC), metacarpophalangeal (MCP) and interphalangeal (IP); index and middle MCPs; and all proximal interphalangeals (PIPs). This protocol is shown in <xref ref-type="fig" rid="fig5s1">Figure 5—figure supplement 1</xref>
and a full list of markerized joints and their locations can be found in <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1K</xref>
and in <xref rid="bib33" ref-type="bibr">Gabiccini et al., 2013</xref>
.</p>
<p>The placement of the markers was performed according to the model described in <xref rid="bib33" ref-type="bibr">Gabiccini et al., 2013</xref>
, which consists of 26 Degrees of Freedom (DoFs), 24 pertaining to the hand and 2 to the wrist. The wrist markers were not used in subsequent analyses. The marker configuration resembles a kinematic tree, with a root node corresponding to the Cartesian reference frame, rigidly fastened to the forearm, and the leaves matching the frames fixed to the distal phalanxes (PDs) of the five digits, as depicted in the first report of the protocol (<xref rid="bib33" ref-type="bibr">Gabiccini et al., 2013</xref>
).</p>
</sec>
<sec id="s4-5"><title>Kinematic data preprocessing</title>
<p>First, the frame rate from the ten stereocameras was downsampled to 15 Hz. After a subject-specific calibration phase, which was performed to extract the geometric parameters of the model and the marker positions on the hand of each participant, movement reconstruction was performed by estimating all joint angles at each sample with an iterative extended Kalman filter (EKF) which takes into account both measurements explanation and closeness to the previous reconstructed pose (see <xref rid="bib33" ref-type="bibr">Gabiccini et al., 2013</xref>
for further details).</p>
<p>Once all trials were reconstructed, the posture representing the final grasping configuration was selected through direct inspection. The final outcome of this procedure was a 24 x 100 matrix for each subject, containing 24 joint angles for 20 objects repeated five times.</p>
</sec>
<sec id="s4-6"><title>Kinematic model</title>
<p>The kinematic data from each subject were analyzed independently. First, the hand postures were averaged across five repetitions for each object, after which the data matrix was centered by subtracting, from each of the 20 grasping movements, the mean posture calculated across all the motor acts. Two different models were obtained from the centered matrix. The first was a <italic>kinematic synergy</italic>
model, obtained by reducing the dimensionality with a PCA on the 20 (postures) by 24 (joint angles) matrix and retaining only the first five principal components (PCs). In this way, the postures were projected onto the components space, hence obtaining linear combinations of synergies.</p>
<p>To obtain an alternative individual digit model, defined on a somatotopic basis, the displacement of <italic>individual digits</italic>
was also measured (<xref rid="bib59" ref-type="bibr">Kirsch et al., 2014</xref>
). Briefly, the displacement of each finger for the twenty single postures was obtained by calculating the sum of the single joint angles within each digit and gesture, again excluding wrist DoFs.</p>
<p>The analyses of all the sessions were carried out using MATLAB (MathWorks, Natick, MA, USA), unless stated otherwise</p>
</sec>
<sec id="s4-7"><title>EMG experiment</title>
<p>The second session consisted of a surface electromyography acquisition (EMG) during the execution of grasp-to-use acts performed towards the same imagined objects presented during the kinematic experiment.</p>
</sec>
<sec id="s4-8"><title>EMG acquisition</title>
<p>EMG signals were acquired from five different muscles using self-adhesive surface electrodes. The muscles used for recording were: <italic>flexor digitorum superficialis</italic>
(FDS), <italic>extensor digitorum communis</italic>
(EDC), <italic>first dorsal interosseus</italic>
(FDI), <italic>abductor pollicis brevis</italic>
(APB), and <italic>abductor digiti minimi</italic>
(ADM). The individuation of the sites for the recording of each muscle was performed according to the standard procedures for EMG electrode placement (<xref rid="bib51" ref-type="bibr">Hermens et al., 1999</xref>
; <xref rid="bib50" ref-type="bibr">Hermens et al., 2000</xref>
). The skin was cleaned with alcohol before the placement of electrodes.</p>
<p>Participants performed the same tasks and protocol used in the kinematic experiment, i.e., visual presentation of the target object (three seconds), followed by an inter-stimulus interval (two seconds), an auditory cue to prompt movement, and an inter-trial interval (seven seconds). The experiment was divided into runs that comprised the execution of grasping actions towards all the 20 objects, in randomized order. Participants performed six runs. Each gesture was therefore repeated six times.</p>
<p>EMG signals were recorded using two devices (Biopac MP35 for four muscles; Biopac MP150 for the fifth muscle) and Kendall ARBO 24-mm surface electrodes, placed on the above-mentioned muscles of the participants’ right arm. EMG signals were sampled at 2 kHz.</p>
</sec>
<sec id="s4-9"><title>EMG model</title>
<p>First, EMG signals were resampled to 1 kHz and filtered with a bandpass (30–1000 Hz) and a notch (50 Hz) filter. For each channel, each trial (defined as a time window of 2500 samples) underwent the extraction of 22 primary time-domain features, chosen from those that are most commonly used in EMG-based gesture recognition studies (<xref rid="bib111" ref-type="bibr">Zecca et al., 2002</xref>
; <xref rid="bib69" ref-type="bibr">Mathiesen et al., 2010</xref>
; <xref rid="bib81" ref-type="bibr">Phinyomark et al., 2010</xref>
; <xref rid="bib102" ref-type="bibr">Tkach et al., 2010</xref>
; see <xref rid="bib15" ref-type="bibr">Chowdhury et al., 2013</xref>
for a review). Additional second-order features were obtained from the first features, computing their signal median, mean absolute deviation (MAD), skewness, and kurtosis. A complete list of the EMG features we used can be found in <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1L</xref>
.</p>
<p>A muscle model was derived from the chosen features as follows: first, the pool of 410 features (82 for 5 channels) was reduced to its five principal components. The 1 x 5 vectors describing each individual movement were averaged across the six repetitions. This 20 (movements) x 5 (synergies) matrix represented the <italic>muscle synergy</italic>
model for the subsequent analyses.</p>
</sec>
<sec id="s4-10"><title>Models validation</title>
<p>To verify that the three models (<italic>kinematic synergies, individual digit</italic>
, and <italic>muscle synergies</italic>
) were able to accurately describe hand posture, their capability to discriminate between individual gestures was tested. To this purpose, we developed a rank accuracy measure within a leave-one-out cross-validation procedure, as suggested by other authors to solve complex multiclass classification problems (<xref rid="bib70" ref-type="bibr">Mitchell et al., 2004</xref>
). For each iteration of the procedure, each repetition of each stimulus was left out (<italic>probe</italic>
), whereas all other repetitions (<italic>test set</italic>
) were averaged. Then, we computed PCA on the data from the <italic>test set</italic>
. The PCA transformation parameters were applied to transform the <italic>probe</italic>
data in a leave-one-repetition-out way. Subsequently, we computed the Euclidean distance between the <italic>probe</italic>
element and each element from <italic>test</italic>
dataset. These distances were sorted, generating an ordered list of the potential gestures from the most to the least similar. The rank of the <italic>probe</italic>
element in this sorted list was transformed in a percentage accuracy score. The procedure was iterated for each target gesture and repetition of the same grasping movement. The accuracy values were first averaged across repetitions and then across gestures, resulting in one averaged value for each subject. In this procedure, if an element is not discriminated above chance, it may fall in the middle of the ordered list (around position #10), which corresponds to an accuracy of 50%. For this reason, the chance level is always 50%, regardless of the number of gestures under consideration, while 100% of accuracy indicated that the correct gesture in the sorted list retained the highest score (i.e., the lowest distance, first ranked) across repetitions and participants.</p>
<p>The accuracy values were then tested for significance against the null distribution of ranks obtained from a permutation test. After averaging the four repetitions within the <italic>test</italic>
set, the labels of the elements were shuffled; then, the ranking procedure described above was applied. The procedure was repeated 10,000 times, generating a null distribution of accuracies; the single-subject accuracy value was compared against this null distribution (one-sided rank test). This procedure was applied to the three models extracted from kinematic and EMG data, obtaining a measure of noise and stability across repetitions and each posture, as described by the three different approaches. Such validation procedure was therefore a necessary step to measure the information content of these three models before testing their ability to predict the fMRI signal.</p>
</sec>
<sec id="s4-11"><title>Individuation of the optimal number of components</title>
<p>The extraction of postural or muscle synergies from kinematic and EMG data was based on a PCA applied to the matrices of sensor measures or signal features, respectively. For the analyses performed here, we chose models based on the first five principal components that were shown to explain more than 90% of the variance in previous reports, even if those models were applied on data with lower dimensionality (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
; <xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
; <xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
). Moreover, an additional model was obtained from the postural data, thus leading to three different models with the same dimensionality (five dimensions): a <italic>kinematic synergy</italic>
model (based on PCA applied to joint angles), an <italic>individual digit</italic>
model (based on the average displacement of the digits), and a <italic>muscle synergy</italic>
model (based on PCA applied to EMG features). However, to verify that the procedures applied here to reduce data dimensionality yielded the same results of those applied in previous works, we performed PCA by retaining variable numbers of components, from 1 to 10, and applied the above-described ranking procedure to test the accuracy of all data matrices. The plots of the accuracy values as a function of the number of PCs can be found in <xref ref-type="supplementary-material" rid="SD4-data">Supplementary files 1M</xref>
and in <xref ref-type="fig" rid="fig6">Figure 6</xref>
. The result of this analysis confirmed that the present data are consistent with the previous literature. The same testing procedure was also applied to the <italic>individual digit</italic>
model by computing the rank accuracies for the full model (five components) and for the reduced models with 1 to 4 PCs.<fig id="fig6" orientation="portrait" position="float"><object-id pub-id-type="doi">10.7554/eLife.13420.017</object-id>
<label>Figure 6.</label>
<caption><title>The three graphs display the rank accuracy values as a function of the dimensionality (i.e., the number of retained PCs) of each behavioral model.</title>
<p>The two models derived from kinematic and EMG data (upper and middle graphs, respectively) have a number of synergies ranging from 1 to 10 while the individual digit model (lower) had 1 to 5 retained PCs. Darker bar colors indicate the dimensionality chosen for encoding brain functional data.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.017">http://dx.doi.org/10.7554/eLife.13420.017</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-fig6"></graphic>
</fig>
</p>
</sec>
<sec id="s4-12"><title>fMRI experiment</title>
<p>In the third session, fMRI was used to record the brain activity during the execution of grasp-to-use acts with the objects presented during the previous experiments.</p>
</sec>
<sec id="s4-13"><title>fMRI acquisition</title>
<p>Functional data were acquired with a 3.0 Tesla GE Signa scanner (GE, Milwaukee, WI, USA), equipped with an 8-channel head-only coil. A Gradient-Echo echo-planar sequence was used, with an acquisition matrix of 128 x 128, FOV = 240 x 240 mm, Repetition Time (TR) = 2.5 s, Time of Echo (TE) = 40 ms, Flip Angle (FA) = 90°. Each volume comprised 43 3 mm-thick slices and the resulting voxel size was 1.875 x 1.875 x 3 mm. Additional anatomical images were also acquired with a high-resolution T1-weighted Fast Spoiled Gradient Recalled sequence (FSPGR) with 1 mm<sup>3</sup>
isotropic voxels and a 256 x 256 x 0.170 mm<sup>3</sup>
field-of-view; TR = 8.16 s, TE = 3.18 ms, FA = 12°. Head motion was minimized with foam pads.</p>
<p>The task design was identical to that used in previous sessions. Specifically, participants had to shape their hand as if grasping one of the twenty visually-presented objects. In the current session, the subjects were asked to perform only the hand preshaping, limiting the execution of reaching acts with their arm or shoulder, since those movements could easily cause head motion. The day before MRI, all subjects practiced movements in a training session.</p>
<p>The paradigm was composed of five runs, each consisting of 20 randomized trials. Each trial consisted of a visual presentation of the target object (2.5s), an inter-stimulus pause (5 s) followed by an auditory cue to prompt movements, and an inter-trial interval (12.5s). The functional runs had two periods of rest (15 s) at their beginning and end to measure baseline activity. The total duration was 6 min and 10 s (172 time points). The total scanning time was about 40 min.</p>
<p>In all sessions, visual stimuli were black and white pictures of the target objects, with a normalized width of 500 pixels. The auditory cue was an 800 Hz sound lasting 150 ms. The experimental paradigm was handled by the software package Presentation® (Neurobehavioral System, Berkeley, CA, <ext-link ext-link-type="uri" xlink:href="http://www.neurobs.com">http://www.neurobs.com</ext-link>
) using a MR-compatible visual stimulation device (VisuaStim, Resonance Technologies, Northridge, CA, USA; dual display system, 5”, 30° of horizontal visual field, 800x600 pixels, 60 Hz) and a set of MR-compatible headphones for stimuli delivery.</p>
</sec>
<sec id="s4-14"><title>fMRI preprocessing</title>
<p>The initial steps of fMRI data analysis were performed with the AFNI software package (<xref rid="bib17" ref-type="bibr">Cox, 1996</xref>
). All volumes within each run were temporally aligned (3dTshift), corrected for head motion by registering to the fifth volume of the run that was closer in time to the anatomical image (3dvolreg) and underwent a spike removal procedure to correct for scanner-associated noise (3dDespike). A spatial smoothing with a Gaussian kernel (3dmerge, 4 mm, Full Width at Half Maximum) and a percentage normalization of each time point in the run (dividing the intensity of each voxel for its mean over the time series) were subsequently performed. Normalized runs were then concatenated and a multiple regression analysis was performed (3dDeconvolve). Each trial was modeled by nine tent functions that covered its entire duration from its onset up to 20 s (beginning of the subsequent trial) with an interval of 2.5 s. The responses associated with each movement were modeled with separate regressors and the five repetitions of the same trial were averaged. Movement parameters and polynomial signal trends were included in the analysis as regressors of no interest. The <italic>t</italic>
-score response images at 2.5, 5, and 7.5 s after the auditory cue were averaged and used as estimate of the BOLD responses to each grasping movement compared to rest.</p>
<p>The choice to average three different time points for the evaluation of BOLD response was justified by the fact that such a procedure leads to simpler encoding models for subsequent analyses and that the usage of tent functions is a more explorative procedure that is not linked to an exact time point. For this reason, we could obtain an estimation of brain activity that is more linked to the motor act than to the visual presentation of the target object by concentrating only on a restricted, late time interval. This approach – or similar ones – has also been used by other fMRI studies (<xref rid="bib71" ref-type="bibr">Mitchell et al., 2008</xref>
; <xref rid="bib16" ref-type="bibr">Connolly et al., 2012</xref>
).</p>
<p>The coefficients, averaged related to the 20 stimuli of each subject, were transformed to the standard MNI 152 space. First FMRIB Nonlinear Image Registration Tool (FNIRT) was applied to the anatomical images to register them in the standard space with a resolution of 1 mm<sup>3</sup>
(<xref rid="bib4" ref-type="bibr">Andersson et al., 2007</xref>
). The matrix of nonlinear coefficients was then applied to the BOLD responses, which were also resampled to a resolution of 2 x 2 x 2 mm.</p>
</sec>
<sec id="s4-15"><title>fMRI single-subject encoding analysis</title>
<p>To identify the brain regions whose activity co-varied with the data obtained from the three models – kinematic, EMG synergies, and individual digits – a machine learning algorithm was developed, based on a modified version of the multiple linear regression encoding approach first proposed by Mitchell and colleagues (<xref rid="bib71" ref-type="bibr">Mitchell et al., 2008</xref>
). This procedure is aimed at predicting the activation pattern for a stimulus by computing a linear combination of synergy weights obtained from the behavioral models (i.e., Principal Components) with an algorithm previously trained on the activation images of a subset of stimuli (see <xref ref-type="fig" rid="fig5s1">Figure 5—figure supplement 1</xref>
). The procedure consisted in 190 iterations of a leave-two-out cross-validation in which the stimuli were first partitioned in a training set (18 stimuli) and a test set with the two left-out examples. The sample for the analysis was then restricted to the 5000 voxels with the best average BOLD response across the 18 stimuli in the training set (expressed by the highest <italic>t</italic>
-scores). For each iteration, the model was first trained with the vectorized patterns of fMRI coefficients of 18 stimuli associated with their known labels (i.e., the target objects). The training procedure employed a least-squares multiple linear regression to identify the set of parameters that, if applied to the five synergy weights, minimized the squared error in reconstructing the fMRI images from the training sample. After training the model, only the 1000 voxels that showed the highest R<sup>2</sup>
(a measure of fitting between the matrix of synergy weights and the training data) were retained. A cluster size correction (nearest neighbor, size = 50 voxels) was also applied to prune small, isolated clusters of voxels. The performance of the trained model was then assessed in a subsequent decoding stage by providing it with the fMRI images related to the two unseen gestures and their synergy weights, and requiring it to associate an fMRI pattern with the label of one of the left-out stimuli. The procedure was performed within the previously chosen 1000 voxels and accuracy was assessed by considering the correlation distance between the predicted and real fMRI patterns for each of the two unseen stimuli. This pairwise procedure led therefore to a number of correctly predicted fMRI patterns ranging from 0 to 2 with a chance level of 50%. This cross-validation loop was repeated 190 times, leaving out all the possible pairs of stimuli. Therefore, the results consisted of an overall accuracy value – the percentage of fMRI patterns correctly attributed, which is an expression of the success of the model in predicting brain signals – and a map of the voxels that were used in the procedure – i.e., the voxels whose signal was predictable on the basis of the synergy coefficients. Every voxel had a score ranging from 0 (if the voxel was never used) to a possible maximum of 380 (if the voxel was among the 1000 with the highest R<sup>2</sup>
and the two left-out patterns could be predicted in all the 190 iterations). The encoding analysis was performed in separate procedures for each model – i.e., <italic>kinematic</italic>
and <italic>muscle synergies</italic>
and <italic>individual digit</italic>
. We obtained, therefore, three sets of accuracy values and three maps of the most used voxels for each subject. These results, which displayed the brain regions whose activity was specifically modulated by the grasping action that was performed inside the scanner, were subsequently used for building the group-level probability maps (see below).</p>
</sec>
<sec id="s4-16"><title>Assessment of the accuracy of the encoding analysis</title>
<p>The single-subject accuracy was tested for significance against the distribution of accuracies generated with a permutation test within the above-defined encoding procedure. Permutation tests are the most reliable and correct method to assess statistical significance in multivariate fMRI studies (<xref rid="bib93" ref-type="bibr">Schreiber and Krekelberg, 2013</xref>
; <xref rid="bib48" ref-type="bibr">Handjaras et al., 2015</xref>
). The null distribution of accuracies was built with a loop in which the model was first trained with five randomly chosen synergy weights that were obtained by picking a random value out of the 18 (one for each gesture) in each column of the matrix of synergies. The trained model was subsequently tested on the two left-out images. The procedure was repeated 1000 times, leading to a null distribution of 1000 accuracy values against which we compared the value obtained from the above-described encoding method. Similarly to the encoding analysis, we did not use either the fMRI images or the synergy weights of the two test stimuli for training the model. The left-out examples were therefore tested by an algorithm that had been trained on a completely independent data sample. The weights were shuffled only <italic>within column</italic>
: this procedure yielded vectors of shuffled weights with the same variance as the actual kinematic PCs, even though those vectors were no longer orthogonal. Permutation tests were performed separately for each subject with the three data matrices. Each single-subject accuracy was therefore tested against the null distribution of accuracy values obtained from the same subject data (one-sided rank test).</p>
</sec>
<sec id="s4-17"><title>Group-level probability maps</title>
<p>A group map displaying the voxels that were consistently recruited across subjects was obtained for the <italic>kinematic synergy</italic>
model. The single-subject maps achieved from the encoding analysis, which display the voxels recruited by the encoding procedure in each subject, were first binarized by converting non-zero accuracy values to 1, then summed to obtain an across-subjects overlap image. Moreover, a probability threshold of these maps (<italic>p</italic>
>0.33) was applied on the maps to retain voxels in which the encoding procedure was successful in at least four out of the nine subjects (<xref ref-type="fig" rid="fig1">Figure 1</xref>
).</p>
</sec>
<sec id="s4-18"><title>Discrimination of single postures by fMRI data</title>
<p>The accuracies of pairwise discrimination of postures, achieved during the decoding stage of the encoding procedure, were combined across subjects, so to identify the postures that could be discriminated with the highest accuracy based on their associated BOLD activity. The results were displayed as a heat map (<xref ref-type="fig" rid="fig5">Figure 5</xref>
), with a threshold corresponding to the chance level of 50%.</p>
</sec>
<sec id="s4-19"><title>Assessment of kinematic synergies across subjects</title>
<p>To evaluate whether the synergies computed on kinematic data from our sample would allow for a reliable reconstruction of hand posture, we needed to verify that these synergies are consistently ranked across individuals. Therefore, we used Metric Pairwise Constrained K-Means (<xref rid="bib7" ref-type="bibr">Bilenko et al., 2004</xref>
), a method for semi-unsupervised clustering that integrates distance function and constrained classes. We used the weights of the first three kinematic synergies for the 20 gestures in each subjects as input data and arranged the set of 27 20-items vectors into three classes with nine synergies that showed the higher similarity (see <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1N</xref>
). This analysis was limited to the first three PCs since previous reports (<xref rid="bib87" ref-type="bibr">Santello et al., 1998</xref>
; <xref rid="bib39" ref-type="bibr">Gentner and Classen, 2006</xref>
) suggest that they may constitute a group of “core synergies”, with a cumulative explained variance greater than 80%. This analysis was performed only on the synergies obtained from the <italic>kinematic synergy</italic>
model, which was able to outperform both the <italic>individual digit</italic>
and <italic>muscle synergy</italic>
models in terms of encoding accuracy percentages on fMRI data.</p>
<p>To facilitate the interpretation of the first kinematic PCs as elementary grasps, we plotted the time course of the corresponding hand movements. The plots are 2s-long videos showing three movements from the minimum to the maximum values of PCs 1, 2 and 3, respectively, expressed as sets of 24-joint angles averaged across subjects (<xref ref-type="other" rid="media1">Video 1</xref>
).</p>
</sec>
<sec id="s4-20"><title>Cortical mapping of the three group synergies</title>
<p>The three group synergies were studied separately, computing the single correlations between each PC and the fMRI activation coefficient. This correlation estimated the similarity between the activity of every voxel for the 20 grasping acts and the weights of each single synergy. The coefficient of determination (R<sup>2</sup>
) for each synergy was averaged across participants to achieve a measurement of group-level goodness of fit. The overlap image between the group-level probability map and the goodness of fit for each synergy was then obtained and mapped onto a flattened mesh of the cortical surface (<xref ref-type="fig" rid="fig2">Figure 2</xref>
). The AFNI SUMA program, the BrainVISA package and the ICBM MNI 152 brain template (<xref rid="bib31" ref-type="bibr">Fonov et al., 2009</xref>
) were used to render results on the cortical surface (<xref ref-type="fig" rid="fig1">Figure 1</xref>
and <xref ref-type="fig" rid="fig2">2</xref>
).</p>
<p>To provide a statistical assessment of the orderly mapping of synergies across the regions recruited by the encoding procedure, a comparison between the map space and the feature space was performed (<xref rid="bib41" ref-type="bibr">Goodhill and Sejnowski, 1997</xref>
; <xref rid="bib110" ref-type="bibr">Yarrow et al., 2014</xref>
). The correlation of the two spaces is expressed by an index (C parameter) that reflects the similarity between the arrangement of voxels in space and the arrangement of their information content: high values indicate that voxels which contain similar information are also spatially close, suggesting a topographical organization. The map space was derived measuring the standardized Euclidean distance between each voxel position in the grid. The feature space was computed using the standardized Euclidean distance between the three synergy weights, as defined by their R<sup>2</sup>
, for each voxel and averaged across subjects according to the classes described in the sections <italic>Assessment of kinematic synergies across subjects</italic>
and <italic>Cortical mapping of the three group synergies</italic>
. The C parameter was achieved by computing the Pearson correlation between the map space and the feature space (<xref rid="bib110" ref-type="bibr">Yarrow et al., 2014</xref>
). An ad-hoc statistical test was developed to assess the existence of the topography. A permutation test was performed generating a null-distribution of C values by correlating the map space with feature spaces obtained by averaging the three synergies across subjects with different random combinations (10,000 iterations). The <italic>p</italic>
-value was calculated by comparing the null-distribution with the C parameter obtained with the cortical mapping (one-sided rank test).</p>
</sec>
<sec id="s4-21"><title>Representational similarity analysis (RSA) and multidimensional scaling (MDS)</title>
<p>Representational content measures (<xref rid="bib64" ref-type="bibr">Kriegeskorte et al., 2008a</xref>
; <xref rid="bib62" ref-type="bibr">Kriegeskorte and Kievit, 2013</xref>
) were carried out to explore the information that is coded in the regions activated during the execution of finalized motor acts. Representational spaces (RSs) are matrices that display the distances between all the possible pairs of neurofunctional or behavioral measures, informing us about the internal similarities and differences that can be evidenced within a stimulus space. By computing a second-order correlation between single model RSs we can evaluate both the similarity between the information carried by the single behavioral models (kinematic, individual digits and EMG) and between behavioral data and brain activity as measured by fMRI.</p>
<p>RSA was therefore performed within a subset of voxels that were consistently activated by the task. A Region of Interest (ROI) was derived from the fMRI data by performing a <italic>t</italic>
-test (AFNI program 3dttest++) that compared the mean brain activity at 2.5, 5, and 7.5 s after the auditory cue and the activity at rest. The results were corrected for False Discovery Rate (<xref rid="bib5" ref-type="bibr">Benjamini and Hochberg, 1995</xref>
; <italic>p</italic>
<0.05) (<xref ref-type="fig" rid="fig4s2">Figure 4—figure supplement 2</xref>
). Afterwards, the <italic>t</italic>
-scores relative to each voxel within the ROI were normalized by subtracting the mean across-stimulus activation of all the voxels in the ROI and dividing the value by the standard deviation (<italic>z</italic>
-score normalization). PCA was performed to reduce the BOLD activity of the voxels in the ROI to the first five principal components. Activation pattern RSs were then obtained for each subject by calculating the Euclidean distance between the PCs of all the possible pairs of stimuli (<xref rid="bib23" ref-type="bibr">Edelman et al., 1998</xref>
; <xref rid="bib63" ref-type="bibr">Kriegeskorte et al., 2008b</xref>
; <xref rid="bib49" ref-type="bibr">Haxby et al., 2014</xref>
). Model RSs were similarly computed for the three types of postural data. This procedure led to a set of brain activity RSs and three sets of model RSs for <italic>kinematic synergy</italic>
, individual digit, and <italic>muscle synergy</italic>
models, respectively. The single subject RSs were averaged to obtain a unique group RS for each model.</p>
<p>Since we were interested in identifying the similarities and differences between the information expressed by the behavioral models and the information encoded in the brain, we estimated Pearson correlation separately between the fMRI-based RS and each model RS (<xref rid="bib64" ref-type="bibr">Kriegeskorte et al., 2008a</xref>
, <xref rid="bib63" ref-type="bibr">2008b</xref>
; <xref rid="bib22" ref-type="bibr">Devereux et al., 2013</xref>
). Moreover, to study the possible specific relations between the behavioral models, additional pairwise correlations between the three model RSs were also performed.</p>
<p>These correlations were tested with the Mantel test by randomizing the twenty stimulus labels and computing the correlation. This step was repeated 10,000 times, yielding a null distribution of correlation coefficients. Subsequently, we derived the <italic>p</italic>
-value as the percent rank of each correlation within this null distribution (<xref rid="bib64" ref-type="bibr">Kriegeskorte et al., 2008a</xref>
). The correlations were also estimated between single-subject RSs.</p>
<p>In addition, a MDS procedure, using standardized Euclidean distance, metric stress criterion and Procrustes alignment (<xref rid="bib65" ref-type="bibr">Kruskal and Wish, 1978</xref>
) was performed to represent the kinematic synergies and the patterns of BOLD activity across subjects (<xref ref-type="fig" rid="fig3">Figure 3</xref>
).</p>
</sec>
<sec id="s4-22"><title>Decoding of hand posture from fMRI data</title>
<p>Additionally, the fMRI data were used to decode hand postures from stimulus-specific brain activity.</p>
<p>This procedure was performed using fMRI coefficients to obtain a set of 24 values, each representing the distances between adjacent hand joints, which could then be used to plot hand configuration. To this purpose, we first run a PCA on the fMRI data, using the voxels within the mask obtained for the RSA and MDS (see above and <xref ref-type="fig" rid="fig4s2">Figure 4—figure supplement 2</xref>
) to avoid any possible selection bias; with this procedure, the dimensionality of the data was reduced to the first five dimensions, as previously done for kinematic and EMG data.</p>
<p>Then, a multiple linear regression was performed within a leave-one-stimulus-out procedure by using the matrix of postural coefficients as predicted data and the reduced fMRI matrix as predictor. This allowed for the reconstruction of the coefficients of the left-out posture, yielding a matrix with 20 rows (postures) and 24 columns (joint angles). Finally, we estimated the goodness of fit (R<sup>2</sup>
) between the reconstructed data and the original postural matrices recorded with the optical tracking system, both subject-wise (i.e., computing the correlation of the whole matrices) and posture-wise (i.e., computing the correlation of each posture vector). In addition, the decoding performance was assessed using a rank accuracy procedure (similar to those performed in the behavioral analyses) in which each reconstructed posture was classified against those originally recorded during the kinematic experiment. The accuracy values were tested against the null distribution generated by a permutation test (10,000 iterations). The reconstructed data were then plotted, using custom code written in MATLAB and Mathematica 9.0 (Wolfram Research, Inc., Champaign, IL, USA) (<xref ref-type="fig" rid="fig4">Figure 4</xref>
).</p>
</sec>
</sec>
</body>
<back><sec sec-type="funding-information"><title>Funding Information</title>
<p>This paper was supported by the following grants:</p>
<list list-type="bullet"><list-item><p><funding-source><institution-wrap><institution-id institution-id-type="FundRef">http://dx.doi.org/10.13039/501100000781</institution-id>
<institution>European Research Council</institution>
</institution-wrap>
</funding-source>
<award-id>ERC-291166 SoftHands</award-id>
to Matteo Bianchi, Hamal Marino, Marco Gabiccini, Andrea Guidi, Enzo Pasquale Scilingo, Antonio Bicchi.</p>
</list-item>
<list-item><p><funding-source><institution-wrap><institution-id institution-id-type="FundRef">http://dx.doi.org/10.13039/501100000781</institution-id>
<institution>European Research Council</institution>
</institution-wrap>
</funding-source>
<award-id>ERC-291166 The Hand Embodied</award-id>
to Andrea Leo, Giacomo Handjaras, Matteo Bianchi, Hamal Marino, Marco Gabiccini, Andrea Guidi, Enzo Pasquale Scilingo, Pietro Pietrini, Antonio Bicchi, Marco Santello, Emiliano Ricciardi.</p>
</list-item>
</list>
</sec>
<ack id="ack"><title>Acknowledgements</title>
<p>We thank Mirco Cosottini and Luca Cecchetti for help with data collection, technical assistance, and critical discussions; Arash Ajoudani and Alessandro Altobelli for their help with additional experiments.</p>
</ack>
<sec id="s5" sec-type="additional-information"><title>Additional information</title>
<fn-group content-type="competing-interest"><title><bold>Competing interests</bold>
</title>
<fn fn-type="conflict" id="conf1"><p>The authors declare that no competing interests exist.</p>
</fn>
</fn-group>
<fn-group content-type="author-contribution"><title><bold>Author contributions</bold>
</title>
<fn fn-type="con" id="con1"><p>AL, Conception and design, Acquisition of data, Analysis and interpretation of data, Drafting or revising the article.</p>
</fn>
<fn fn-type="con" id="con2"><p>GH, Acquisition of data, Analysis and interpretation of data, Drafting or revising the article.</p>
</fn>
<fn fn-type="con" id="con3"><p>MB, Acquisition of data, Analysis and interpretation of data, Drafting or revising the article.</p>
</fn>
<fn fn-type="con" id="con4"><p>HM, Acquisition of data, Analysis and interpretation of data.</p>
</fn>
<fn fn-type="con" id="con5"><p>MG, Conception and design, Analysis and interpretation of data.</p>
</fn>
<fn fn-type="con" id="con6"><p>AG, Acquisition of data, Analysis and interpretation of data.</p>
</fn>
<fn fn-type="con" id="con7"><p>EPS, Conception and design, Analysis and interpretation of data.</p>
</fn>
<fn fn-type="con" id="con8"><p>PP, Conception and design, Analysis and interpretation of data, Drafting or revising the article.</p>
</fn>
<fn fn-type="con" id="con9"><p>AB, Conception and design, Drafting or revising the article.</p>
</fn>
<fn fn-type="con" id="con10"><p>MS, Conception and design, Analysis and interpretation of data, Drafting or revising the article.</p>
</fn>
<fn fn-type="con" id="con11"><p>ER, Conception and design, Analysis and interpretation of data, Drafting or revising the article.</p>
</fn>
</fn-group>
<fn-group content-type="ethics-information"><title><bold>Ethics</bold>
</title>
<fn fn-type="other"><p>Human subjects: This study was approved by the Ethical Committee at the University of Pisa, Italy. Participants received a detailed explanation of all the study procedures and risks and provided a written informed consent according to the protocol approved by the University of Pisa Ethical Committee (1616/2003). All participants retained the right to withdraw from the study at any moment.</p>
</fn>
</fn-group>
</sec>
<sec id="s6" sec-type="supplementary-material"><title>Additional files</title>
<supplementary-material content-type="local-data" id="SD4-data"><object-id pub-id-type="doi">10.7554/eLife.13420.018</object-id>
<label>Supplementary file 1.</label>
<caption><title>(<bold>A</bold>
) Single subject rank accuracy values.</title>
<p>Values of rank accuracy, measured with the leave-one-stimulus-out procedure, for the nine subjects, with the <italic>p</italic>
-value obtained from the permutation test (10000 iterations).</p>
<p>The comparison between the performance values indicate that the <italic>kinematic synergy</italic>
model was significantly better than both the <italic>individual digit</italic>
and <italic>muscle synergy</italic>
models (Wilcoxon signed-rank test, <italic>p</italic>
=0.0078), and the <italic>individual digit</italic>
model was significantly more informative than the <italic>muscle synergy</italic>
model (<italic>p</italic>
=0.0156).</p>
<p>(<bold>B</bold>
) Single subject encoding accuracy values. The accuracy of predicting brain activity from the behavioral models (<italic>kinematic synergy, individual digit</italic>
and <italic>muscle synergy</italic>
models), obtained with the cross-validation procedure, is reported here for each subject, along with the chance levels derived from the permutation tests, the threshold at <italic>p</italic>
=0.05 and the actual p-value obtained from the tests against the null distributions of accuracies. The accuracy values reported in red are not significant. The comparisons between individual accuracy values, performed using Wilcoxon signed-rank tests, show that the <italic>kinematic synergy</italic>
model outperformed both the <italic>individual digit (p</italic>
=0.0234) and the <italic>muscle synergy (p</italic>
=0.0391) models, whereas no significant difference was found between the <italic>individual digit</italic>
and <italic>muscle synergy</italic>
models (<italic>p</italic>
=0.9453).</p>
<p>(<bold>C</bold>
) Size and coordinates of the clusters of greatest overlap between subjects. This table reports the regions that were consistently recruited across subjects (p>0.33, 4 out of 9 subjects). The region names are reported alongside with their size and with the coordinates of the peak voxel in RAI orientation according to the MNI 152 atlas.</p>
<p>(<bold>D</bold>
) RSA results: single-subject and group correlations between RSs. The table contains the results from Representational Similarity Analysis (RSA). The single-subject correlation values are reported, along with the group-level correlation (i.e. obtained from the averaged RSs across subjects) and with the <italic>p</italic>
-values resulting from the Mantel test. Kinematic = <italic>kinematic synergy</italic>
model; EMG = <italic>muscle synergy</italic>
model; ID= <italic>Individual Digit</italic>
model. The accuracy values reported in red are not significant according to the Mantel test (10,000 iterations).</p>
<p>(<bold>E</bold>
) RSA results: single-subject and group correlations between behavioral and fMRI RSs. The table contains the results from Representational Similarity Analysis (RSA) between each behavioral model and fMRI data. The single-subject correlation values are reported, along with the group-level correlation (i.e. obtained from the averaged Representational Spaces – RSs – across subjects) and with the <italic>p</italic>
-values resulting from the Mantel test. Kinematic = <italic>kinematic synergy</italic>
model; EMG = <italic>muscle synergy</italic>
model; ID= <italic>Individual Digit</italic>
model. The accuracy values reported in red are not significant according to the Mantel test (10,000 iterations).</p>
<p>(<bold>F</bold>
) Goodness of fit between original and decoded hand postures. Average goodness-of-fit (R<sup>2</sup>
) values and Standard Deviations (STD) between original and reconstructed sets of joint angles related to specific hand postures across all subjects. The decoding procedure allowed us to obtain the set of synergies related to each grasping motor acts directly from fMRI activity, thus to reconstruct the different hand postures across participants.</p>
<p>(<bold>G</bold>
) Rank accuracy values between original and decoded hand postures. The table reports the rank accuracy values for the discrimination between the original and decoded sets of joint angles related to specific hand postures across all subjects. The decoding procedure allowed us to obtain the set of synergies related to each grasping motor acts directly from fMRI activity, thus to reconstruct the different hand postures across participants.</p>
<p>(<bold>H</bold>
) Encoding accuracy values for the picture-related brain activity. To assess to what extent the visual presentation of objects might have influenced the encoding of BOLD activity in motor regions, the encoding procedure was performed within the same ROI chosen for RSA and posture reconstruction and choosing BOLD activity at five seconds after the visual object presentation as an estimate of brain responses to the visual presentation of target objects. Only the <italic>kinematic synergy</italic>
model was used. The chance levels derived from the permutation tests (1000 iterations) are reported, as well as the threshold at <italic>p</italic>
=0.05 and the actual <italic>p</italic>
-value obtained from the tests against the null distributions of accuracies. The accuracy values reported in red are not significant. The results show that the procedure is unsuccessful in all subjects and do not account for a confounding role of image-related activity on the posture encoding results.</p>
<p>(<bold>I</bold>
) Encoding accuracy values for kinematic synergies in visual areas. To assess the impact of visual imagery on our results, the encoding procedure was performed within a Region of Interest selected based on the image-related activity (at 5 s after presentation) vs. rest (<italic>q</italic>
<0.01, FDR corrected). The encoding of postures (using the <italic>kinematic synergy</italic>
model only) was then tested in the voxels forming this ROI. The chance levels derived from the permutation tests (1000 iterations) are reported, as well as the threshold at <italic>p</italic>
=0.05 and the actual <italic>p</italic>
-value obtained from the tests against the null distributions of accuracies. The accuracy values reported in red are not significant. The results show that the procedure is unsuccessful in seven subjects and therefore it suggests a very limited impact of visual imagery on the posture encoding results.</p>
<p>(<bold>J</bold>
) List of objects. Table displaying the twenty common-use objects (chosen from the 57 in Santello et al., 1998) that were used in this study.</p>
<p>(<bold>K</bold>
) List of marked joints and bones. Complete list of hand joints and bones marked during the optical tracking experiment. Two additional markers were placed on the wrist, for a total of 26 optical markers. (<bold>L</bold>
) EMG features The features that were extracted from the EMG signals are listed above. <italic>Muscle synergies</italic>
were quantified through principal components analysis performed across features and EMG electrodes yielding a five-dimensional set of synergies.</p>
<p>(<bold>M</bold>
) Rank accuracy values for 1 to 10 PCs. The table displays the rank accuracy values for the two models derived from kinematic and EMG data, with a number of retained PCs ranging from 1 to 10 (kinematic and EMG synergies) or 1 to 5 (individual digits). The reported values are the accuracy scores averaged across subjects and their SD. Notably, the <italic>individual digit</italic>
model could explain only a moderate fraction of the total variance of the kinematic data (mean: 26.59%, range 14.46% to 34.97%). PCA dimensionality reduction was therefore successful as the first five synergies (later used for encoding fMRI activity) could explain a mean variance across subjects of 91.78% in the kinematic data and 72.64% in the EMG data. (N) Group synergies defined by constrained <italic>k</italic>
-means The three core kinematic synergies from each participant were grouped across participants with a semi-supervised clustering algorithm (Bilenko et al., 2004). The procedure showed that the first three synergies were highly consistent and had the same rank across almost all subjects (i.e., PC 1 was in the first position in most of the subjects). Overall, 77.78% of the single subject synergies were consistently labeled across subjects. The table represents the three “group synergies” and lists the single-subject synergies that compose each of them.</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.018">http://dx.doi.org/10.7554/eLife.13420.018</ext-link>
</p>
</caption>
<media mime-subtype="docx" mimetype="application" xlink:href="elife-13420-supp1.docx" orientation="portrait" id="d36e2482" position="anchor"></media>
</supplementary-material>
</sec>
<ref-list><title>References</title>
<ref id="bib1"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aflalo</surname>
<given-names>T</given-names>
</name>
<name><surname>Kellis</surname>
<given-names>S</given-names>
</name>
<name><surname>Klaes</surname>
<given-names>C</given-names>
</name>
<name><surname>Lee</surname>
<given-names>B</given-names>
</name>
<name><surname>Shi</surname>
<given-names>Y</given-names>
</name>
<name><surname>Pejsa</surname>
<given-names>K</given-names>
</name>
<name><surname>Shanfield</surname>
<given-names>K</given-names>
</name>
<name><surname>Hayes-Jackson</surname>
<given-names>S</given-names>
</name>
<name><surname>Aisen</surname>
<given-names>M</given-names>
</name>
<name><surname>Heck</surname>
<given-names>C</given-names>
</name>
</person-group>
<year>2015</year>
<article-title>Neurophysiology. decoding motor imagery from the posterior parietal cortex of a tetraplegic human</article-title>
<source>Science</source>
<volume>348</volume>
<fpage>906</fpage>
<lpage>910</lpage>
<pub-id pub-id-type="doi">10.1126/science.aaa5417</pub-id>
<pub-id pub-id-type="pmid">25999506</pub-id>
</element-citation>
</ref>
<ref id="bib2"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aflalo</surname>
<given-names>TN</given-names>
</name>
<name><surname>Graziano</surname>
<given-names>MS</given-names>
</name>
</person-group>
<year>2006</year>
<article-title>Partial tuning of motor cortex neurons to final posture in a free-moving paradigm</article-title>
<source>Proceedings of the National Academy of Sciences of the United States of America</source>
<volume>103</volume>
<fpage>2909</fpage>
<lpage>2914</lpage>
<pub-id pub-id-type="doi">10.1073/pnas.0511139103</pub-id>
<pub-id pub-id-type="pmid">16473936</pub-id>
</element-citation>
</ref>
<ref id="bib3"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ahsan</surname>
<given-names>MR</given-names>
</name>
<name><surname>Ibrahimy</surname>
<given-names>MI</given-names>
</name>
<name><surname>Khalifa</surname>
<given-names>OO</given-names>
</name>
</person-group>
<year>2011</year>
<article-title>Neural Network Classifier for Hand Motion Detection from EMG Signal</article-title>
<source>IFMBE Proceedings</source>
<volume>35</volume>
<fpage>536</fpage>
<lpage>541</lpage>
<pub-id pub-id-type="doi">10.1007/978-3-642-21729-6_135</pub-id>
</element-citation>
</ref>
<ref id="bib4"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Andersson</surname>
<given-names>JL</given-names>
</name>
<name><surname>Jenkinson</surname>
<given-names>M</given-names>
</name>
<name><surname>Smith</surname>
<given-names>S</given-names>
</name>
</person-group>
<year>2007</year>
<article-title>Non-linear optimisation. FMRIB technical report TR07JA1</article-title>
<source>Practice 2007a Jun</source>
</element-citation>
</ref>
<ref id="bib5"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Benjamini</surname>
<given-names>Y</given-names>
</name>
<name><surname>Hochberg</surname>
<given-names>Y</given-names>
</name>
</person-group>
<year>1995</year>
<article-title>Controlling the false discovery rate - a practical and powerful approach to multiple testing</article-title>
<source>Journal of the Royal Statistical Society Series B-Methodological</source>
<volume>57</volume>
<fpage>289</fpage>
<lpage>300</lpage>
</element-citation>
</ref>
<ref id="bib6"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Bernstein</surname>
<given-names>NA</given-names>
</name>
</person-group>
<year>1967</year>
<source>The Co-Ordination and Regulation of Movements</source>
<edition>1st English edn</edition>
<publisher-loc>Oxford, New York</publisher-loc>
<publisher-name>Pergamon Press</publisher-name>
</element-citation>
</ref>
<ref id="bib7"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bilenko</surname>
<given-names>M</given-names>
</name>
<name><surname>Basu</surname>
<given-names>S</given-names>
</name>
<name><surname>Mooney</surname>
<given-names>RJ</given-names>
</name>
</person-group>
<year>2004</year>
<article-title>Integrating constraints and metric learning in semi-supervised clustering</article-title>
<source>In Proceedings of the Twenty-First International Conference on Machine Learning (ACM)</source>
<fpage>11</fpage>
</element-citation>
</ref>
<ref id="bib8"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bitzer</surname>
<given-names>S</given-names>
</name>
<name><surname>van der Smagt</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2006</year>
<article-title>Learning EMG control of a robotic hand: towards active prostheses</article-title>
<source>2006 Ieee International Conference on Robotics and Automation (Icra)</source>
<volume>1-10</volume>
<fpage>2819</fpage>
<lpage>2823</lpage>
</element-citation>
</ref>
<ref id="bib9"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bizzi</surname>
<given-names>E</given-names>
</name>
<name><surname>Cheung</surname>
<given-names>VC</given-names>
</name>
<name><surname>d'Avella</surname>
<given-names>A</given-names>
</name>
<name><surname>Saltiel</surname>
<given-names>P</given-names>
</name>
<name><surname>Tresch</surname>
<given-names>M</given-names>
</name>
</person-group>
<year>2008</year>
<article-title>Combining modules for movement</article-title>
<source>Brain Research Reviews</source>
<volume>57</volume>
<fpage>125</fpage>
<lpage>133</lpage>
<pub-id pub-id-type="doi">10.1016/j.brainresrev.2007.08.004</pub-id>
<pub-id pub-id-type="pmid">18029291</pub-id>
</element-citation>
</ref>
<ref id="bib10"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bleichner</surname>
<given-names>MG</given-names>
</name>
<name><surname>Jansma</surname>
<given-names>JM</given-names>
</name>
<name><surname>Sellmeijer</surname>
<given-names>J</given-names>
</name>
<name><surname>Raemaekers</surname>
<given-names>M</given-names>
</name>
<name><surname>Ramsey</surname>
<given-names>NF</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Give me a sign: decoding complex coordinated hand movements using high-field fMRI</article-title>
<source>Brain Topography</source>
<volume>27</volume>
<fpage>248</fpage>
<lpage>257</lpage>
<pub-id pub-id-type="doi">10.1007/s10548-013-0322-x</pub-id>
<pub-id pub-id-type="pmid">24122368</pub-id>
</element-citation>
</ref>
<ref id="bib11"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname>
<given-names>AR</given-names>
</name>
<name><surname>Teskey</surname>
<given-names>GC</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Motor cortex is functionally organized as a set of spatially distinct representations for complex movements</article-title>
<source>The Journal of Neuroscience</source>
<volume>34</volume>
<fpage>13574</fpage>
<lpage>13585</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.2500-14.2014</pub-id>
<pub-id pub-id-type="pmid">25297087</pub-id>
</element-citation>
</ref>
<ref id="bib12"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Castiello</surname>
<given-names>U</given-names>
</name>
</person-group>
<year>2005</year>
<article-title>The neuroscience of grasping</article-title>
<source>Nature Reviews. Neuroscience</source>
<volume>6</volume>
<fpage>726</fpage>
<lpage>736</lpage>
<pub-id pub-id-type="doi">10.1038/nrn1744</pub-id>
<pub-id pub-id-type="pmid">16100518</pub-id>
</element-citation>
</ref>
<ref id="bib13"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cheung</surname>
<given-names>VC</given-names>
</name>
<name><surname>d'Avella</surname>
<given-names>A</given-names>
</name>
<name><surname>Tresch</surname>
<given-names>MC</given-names>
</name>
<name><surname>Bizzi</surname>
<given-names>E</given-names>
</name>
</person-group>
<year>2005</year>
<article-title>Central and sensory contributions to the activation and organization of muscle synergies during natural motor behaviors</article-title>
<source>The Journal of Neuroscience</source>
<volume>25</volume>
<fpage>6419</fpage>
<lpage>6434</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4904-04.2005</pub-id>
<pub-id pub-id-type="pmid">16000633</pub-id>
</element-citation>
</ref>
<ref id="bib14"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cheung</surname>
<given-names>VC</given-names>
</name>
<name><surname>Piron</surname>
<given-names>L</given-names>
</name>
<name><surname>Agostini</surname>
<given-names>M</given-names>
</name>
<name><surname>Silvoni</surname>
<given-names>S</given-names>
</name>
<name><surname>Turolla</surname>
<given-names>A</given-names>
</name>
<name><surname>Bizzi</surname>
<given-names>E</given-names>
</name>
</person-group>
<year>2009</year>
<article-title>Stability of muscle synergies for voluntary actions after cortical stroke in humans</article-title>
<source>Proceedings of the National Academy of Sciences of the United States of America</source>
<volume>106</volume>
<fpage>19563</fpage>
<lpage>19568</lpage>
<pub-id pub-id-type="doi">10.1073/pnas.0910114106</pub-id>
<pub-id pub-id-type="pmid">19880747</pub-id>
</element-citation>
</ref>
<ref id="bib15"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chowdhury</surname>
<given-names>RH</given-names>
</name>
<name><surname>Reaz</surname>
<given-names>MBI</given-names>
</name>
<name><surname>Ali</surname>
<given-names>MAB</given-names>
</name>
<name><surname>Bakar</surname>
<given-names>AAA</given-names>
</name>
<name><surname>Chellappan</surname>
<given-names>K</given-names>
</name>
<name><surname>Chang</surname>
<given-names>TG</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>Surface electromyography signal processing and classification techniques</article-title>
<source>Sensors</source>
<volume>13</volume>
<fpage>12431</fpage>
<lpage>12466</lpage>
<pub-id pub-id-type="doi">10.3390/s130912431</pub-id>
<pub-id pub-id-type="pmid">24048337</pub-id>
</element-citation>
</ref>
<ref id="bib16"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Connolly</surname>
<given-names>AC</given-names>
</name>
<name><surname>Guntupalli</surname>
<given-names>JS</given-names>
</name>
<name><surname>Gors</surname>
<given-names>J</given-names>
</name>
<name><surname>Hanke</surname>
<given-names>M</given-names>
</name>
<name><surname>Halchenko</surname>
<given-names>YO</given-names>
</name>
<name><surname>Wu</surname>
<given-names>YC</given-names>
</name>
<name><surname>Abdi</surname>
<given-names>H</given-names>
</name>
<name><surname>Haxby</surname>
<given-names>JV</given-names>
</name>
</person-group>
<year>2012</year>
<article-title>The representation of biological classes in the human brain</article-title>
<source>The Journal of Neuroscience</source>
<volume>32</volume>
<fpage>2608</fpage>
<lpage>2618</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5547-11.2012</pub-id>
<pub-id pub-id-type="pmid">22357845</pub-id>
</element-citation>
</ref>
<ref id="bib17"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cox</surname>
<given-names>RW</given-names>
</name>
</person-group>
<year>1996</year>
<article-title>AFNI: software for analysis and visualization of functional magnetic resonance neuroimages</article-title>
<source>Computers and Biomedical Research, an International Journal</source>
<volume>29</volume>
<fpage>162</fpage>
<lpage>173</lpage>
</element-citation>
</ref>
<ref id="bib18"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Culham</surname>
<given-names>JC</given-names>
</name>
<name><surname>Danckert</surname>
<given-names>SL</given-names>
</name>
<name><surname>DeSouza</surname>
<given-names>JF</given-names>
</name>
<name><surname>Gati</surname>
<given-names>JS</given-names>
</name>
<name><surname>Menon</surname>
<given-names>RS</given-names>
</name>
<name><surname>Goodale</surname>
<given-names>MA</given-names>
</name>
</person-group>
<year>2003</year>
<article-title>Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas</article-title>
<source>Experimental Brain Research</source>
<volume>153</volume>
<fpage>180</fpage>
<lpage>189</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-003-1591-5</pub-id>
<pub-id pub-id-type="pmid">12961051</pub-id>
</element-citation>
</ref>
<ref id="bib19"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>D'Ausilio</surname>
<given-names>A</given-names>
</name>
<name><surname>Bartoli</surname>
<given-names>E</given-names>
</name>
<name><surname>Maffongelli</surname>
<given-names>L</given-names>
</name>
</person-group>
<year>2015</year>
<article-title>Grasping synergies: a motor-control approach to the mirror neuron mechanism</article-title>
<source>Physics of Life Reviews</source>
<volume>12</volume>
<fpage>91</fpage>
<lpage>103</lpage>
<pub-id pub-id-type="doi">10.1016/j.plrev.2014.11.002</pub-id>
<pub-id pub-id-type="pmid">25465480</pub-id>
</element-citation>
</ref>
<ref id="bib20"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>d'Avella</surname>
<given-names>A</given-names>
</name>
<name><surname>Lacquaniti</surname>
<given-names>F</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>Control of reaching movements by muscle synergy combinations</article-title>
<source>Frontiers in Computational Neuroscience</source>
<volume>7</volume>
<fpage>42</fpage>
<pub-id pub-id-type="doi">10.3389/fncom.2013.00042</pub-id>
<pub-id pub-id-type="pmid">23626534</pub-id>
</element-citation>
</ref>
<ref id="bib21"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>d'Avella</surname>
<given-names>A</given-names>
</name>
<name><surname>Saltiel</surname>
<given-names>P</given-names>
</name>
<name><surname>Bizzi</surname>
<given-names>E</given-names>
</name>
</person-group>
<year>2003</year>
<article-title>Combinations of muscle synergies in the construction of a natural motor behavior</article-title>
<source>Nature Neuroscience</source>
<volume>6</volume>
<fpage>300</fpage>
<lpage>308</lpage>
<pub-id pub-id-type="doi">10.1038/nn1010</pub-id>
<pub-id pub-id-type="pmid">12563264</pub-id>
</element-citation>
</ref>
<ref id="bib22"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Devereux</surname>
<given-names>BJ</given-names>
</name>
<name><surname>Clarke</surname>
<given-names>A</given-names>
</name>
<name><surname>Marouchos</surname>
<given-names>A</given-names>
</name>
<name><surname>Tyler</surname>
<given-names>LK</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>Representational similarity analysis reveals commonalities and differences in the semantic processing of words and objects</article-title>
<source>The Journal of Neuroscience</source>
<volume>33</volume>
<fpage>18906</fpage>
<lpage>18916</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.3809-13.2013</pub-id>
<pub-id pub-id-type="pmid">24285896</pub-id>
</element-citation>
</ref>
<ref id="bib23"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Edelman</surname>
<given-names>S</given-names>
</name>
<name><surname>Grill-Spector</surname>
<given-names>K</given-names>
</name>
<name><surname>Kushnir</surname>
<given-names>T</given-names>
</name>
<name><surname>Malach</surname>
<given-names>R</given-names>
</name>
</person-group>
<year>1998</year>
<article-title>Toward direct visualization of the internal shape representation space by fMRI</article-title>
<source>Psychobiology</source>
<volume>26</volume>
<fpage>309</fpage>
<lpage>321</lpage>
</element-citation>
</ref>
<ref id="bib24"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ehrsson</surname>
<given-names>HH</given-names>
</name>
<name><surname>Fagergren</surname>
<given-names>A</given-names>
</name>
<name><surname>Jonsson</surname>
<given-names>T</given-names>
</name>
<name><surname>Westling</surname>
<given-names>G</given-names>
</name>
<name><surname>Johansson</surname>
<given-names>RS</given-names>
</name>
<name><surname>Forssberg</surname>
<given-names>H</given-names>
</name>
</person-group>
<year>2000</year>
<article-title>Cortical activity in precision- versus power-grip tasks: an fMRI study</article-title>
<source>Journal of Neurophysiology</source>
<volume>83</volume>
<fpage>528</fpage>
<lpage>536</lpage>
<pub-id pub-id-type="pmid">10634893</pub-id>
</element-citation>
</ref>
<ref id="bib25"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ehrsson</surname>
<given-names>HH</given-names>
</name>
<name><surname>Fagergren</surname>
<given-names>E</given-names>
</name>
<name><surname>Forssberg</surname>
<given-names>H</given-names>
</name>
</person-group>
<year>2001</year>
<article-title>Differential fronto-parietal activation depending on force used in a precision grip task: an fMRI study</article-title>
<source>Journal of Neurophysiology</source>
<volume>85</volume>
<fpage>2613</fpage>
<lpage>2623</lpage>
<pub-id pub-id-type="pmid">11387405</pub-id>
</element-citation>
</ref>
<ref id="bib26"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ehrsson</surname>
<given-names>HH</given-names>
</name>
<name><surname>Kuhtz-Buschbeck</surname>
<given-names>JP</given-names>
</name>
<name><surname>Forssberg</surname>
<given-names>H</given-names>
</name>
</person-group>
<year>2002</year>
<article-title>Brain regions controlling nonsynergistic versus synergistic movement of the digits: a functional magnetic resonance imaging study</article-title>
<source>The Journal of Neuroscience</source>
<volume>22</volume>
<fpage>5074</fpage>
<lpage>5080</lpage>
<pub-id pub-id-type="pmid">12077202</pub-id>
</element-citation>
</ref>
<ref id="bib27"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ejaz</surname>
<given-names>N</given-names>
</name>
<name><surname>Hamada</surname>
<given-names>M</given-names>
</name>
<name><surname>Diedrichsen</surname>
<given-names>J</given-names>
</name>
</person-group>
<year>2015</year>
<article-title>Hand use predicts the structure of representations in sensorimotor cortex</article-title>
<source>Nature Neuroscience</source>
<volume>18</volume>
<fpage>1034</fpage>
<lpage>1040</lpage>
<pub-id pub-id-type="doi">10.1038/nn.4038</pub-id>
<pub-id pub-id-type="pmid">26030847</pub-id>
</element-citation>
</ref>
<ref id="bib28"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Feix</surname>
<given-names>T</given-names>
</name>
<name><surname>Pawlik</surname>
<given-names>R</given-names>
</name>
<name><surname>Schmiedmayer</surname>
<given-names>H-B</given-names>
</name>
<name><surname>Romero</surname>
<given-names>J</given-names>
</name>
<name><surname>Kragic</surname>
<given-names>D</given-names>
</name>
</person-group>
<year>2009</year>
<chapter-title>A comprehensive grasp taxonomy</chapter-title>
<source>Robotics, Science and Systems: Workshop on Understanding the Human Hand for Advancing Robotic Manipulation</source>
<fpage>2</fpage>
<lpage>3</lpage>
</element-citation>
</ref>
<ref id="bib29"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Flash</surname>
<given-names>T</given-names>
</name>
<name><surname>Hogan</surname>
<given-names>N</given-names>
</name>
</person-group>
<year>1985</year>
<article-title>The coordination of arm movements: an experimentally confirmed mathematical model</article-title>
<source>The Journal of Neuroscience</source>
<volume>5</volume>
<fpage>1688</fpage>
<lpage>1703</lpage>
<pub-id pub-id-type="pmid">4020415</pub-id>
</element-citation>
</ref>
<ref id="bib30"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Flint</surname>
<given-names>RD</given-names>
</name>
<name><surname>Wang</surname>
<given-names>PT</given-names>
</name>
<name><surname>Wright</surname>
<given-names>ZA</given-names>
</name>
<name><surname>King</surname>
<given-names>CE</given-names>
</name>
<name><surname>Krucoff</surname>
<given-names>MO</given-names>
</name>
<name><surname>Schuele</surname>
<given-names>SU</given-names>
</name>
<name><surname>Rosenow</surname>
<given-names>JM</given-names>
</name>
<name><surname>Hsu</surname>
<given-names>FP</given-names>
</name>
<name><surname>Liu</surname>
<given-names>CY</given-names>
</name>
<name><surname>Lin</surname>
<given-names>JJ</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Extracting kinetic information from human motor cortical signals</article-title>
<source>NeuroImage</source>
<volume>101</volume>
<fpage>695</fpage>
<lpage>703</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuroimage.2014.07.049</pub-id>
<pub-id pub-id-type="pmid">25094020</pub-id>
</element-citation>
</ref>
<ref id="bib31"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fonov</surname>
<given-names>V</given-names>
</name>
<name><surname>Evans</surname>
<given-names>A</given-names>
</name>
<name><surname>McKinstry</surname>
<given-names>R</given-names>
</name>
<name><surname>Almli</surname>
<given-names>C</given-names>
</name>
<name><surname>Collins</surname>
<given-names>D</given-names>
</name>
</person-group>
<year>2009</year>
<article-title>Unbiased nonlinear average age-appropriate brain templates from birth to adulthood</article-title>
<source>NeuroImage</source>
<volume>47</volume>
<fpage>S102</fpage>
<pub-id pub-id-type="doi">10.1016/S1053-8119(09)70884-5</pub-id>
</element-citation>
</ref>
<ref id="bib32"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Formisano</surname>
<given-names>E</given-names>
</name>
<name><surname>Kim</surname>
<given-names>DS</given-names>
</name>
<name><surname>Di Salle</surname>
<given-names>F</given-names>
</name>
<name><surname>van de Moortele</surname>
<given-names>PF</given-names>
</name>
<name><surname>Ugurbil</surname>
<given-names>K</given-names>
</name>
<name><surname>Goebel</surname>
<given-names>R</given-names>
</name>
</person-group>
<year>2003</year>
<article-title>Mirror-symmetric tonotopic maps in human primary auditory cortex</article-title>
<source>Neuron</source>
<volume>40</volume>
<fpage>859</fpage>
<lpage>869</lpage>
<pub-id pub-id-type="doi">10.1016/S0896-6273(03)00669-X</pub-id>
<pub-id pub-id-type="pmid">14622588</pub-id>
</element-citation>
</ref>
<ref id="bib33"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gabiccini</surname>
<given-names>M</given-names>
</name>
<name><surname>Stillfried</surname>
<given-names>G</given-names>
</name>
<name><surname>Marino</surname>
<given-names>H</given-names>
</name>
<name><surname>Bianchi</surname>
<given-names>M</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>A data-driven kinematic model of the human hand with soft-tissue artifact compensation mechanism for grasp synergy analysis</article-title>
<source>2013 Ieee/Rsj International Conference on Intelligent Robots and Systems (Iros)</source>
<fpage>3738</fpage>
<lpage>3745</lpage>
</element-citation>
</ref>
<ref id="bib34"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gallivan</surname>
<given-names>JP</given-names>
</name>
<name><surname>McLean</surname>
<given-names>DA</given-names>
</name>
<name><surname>Valyear</surname>
<given-names>KF</given-names>
</name>
<name><surname>Culham</surname>
<given-names>JC</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>Decoding the neural mechanisms of human tool use</article-title>
<source>eLife</source>
<volume>2</volume>
<elocation-id>e13420</elocation-id>
<pub-id pub-id-type="doi">10.7554/eLife.00425</pub-id>
</element-citation>
</ref>
<ref id="bib35"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gallivan</surname>
<given-names>JP</given-names>
</name>
<name><surname>McLean</surname>
<given-names>DA</given-names>
</name>
<name><surname>Valyear</surname>
<given-names>KF</given-names>
</name>
<name><surname>Pettypiece</surname>
<given-names>CE</given-names>
</name>
<name><surname>Culham</surname>
<given-names>JC</given-names>
</name>
</person-group>
<year>2011</year>
<article-title>Decoding action intentions from preparatory brain activity in human parieto-frontal networks</article-title>
<source>The Journal of Neuroscience</source>
<volume>31</volume>
<fpage>9599</fpage>
<lpage>9610</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.0080-11.2011</pub-id>
<pub-id pub-id-type="pmid">21715625</pub-id>
</element-citation>
</ref>
<ref id="bib36"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ganesh</surname>
<given-names>G</given-names>
</name>
<name><surname>Burdet</surname>
<given-names>E</given-names>
</name>
<name><surname>Haruno</surname>
<given-names>M</given-names>
</name>
<name><surname>Kawato</surname>
<given-names>M</given-names>
</name>
</person-group>
<year>2008</year>
<article-title>Sparse linear regression for reconstructing muscle activity from human cortical fMRI</article-title>
<source>NeuroImage</source>
<volume>42</volume>
<fpage>1463</fpage>
<lpage>1472</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuroimage.2008.06.018</pub-id>
<pub-id pub-id-type="pmid">18634889</pub-id>
</element-citation>
</ref>
<ref id="bib37"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ganesh</surname>
<given-names>G</given-names>
</name>
<name><surname>Franklin</surname>
<given-names>DW</given-names>
</name>
<name><surname>Gassert</surname>
<given-names>R</given-names>
</name>
<name><surname>Imamizu</surname>
<given-names>H</given-names>
</name>
<name><surname>Kawato</surname>
<given-names>M</given-names>
</name>
</person-group>
<year>2007</year>
<article-title>Accurate Real-Time Feedback of Surface EMG During fMRI</article-title>
<source>Journal of Neurophysiology</source>
<volume>97</volume>
<fpage>912</fpage>
<lpage>920</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00679.2006</pub-id>
<pub-id pub-id-type="pmid">17005612</pub-id>
</element-citation>
</ref>
<ref id="bib38"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gazzoni</surname>
<given-names>M</given-names>
</name>
<name><surname>Celadon</surname>
<given-names>N</given-names>
</name>
<name><surname>Mastrapasqua</surname>
<given-names>D</given-names>
</name>
<name><surname>Paleari</surname>
<given-names>M</given-names>
</name>
<name><surname>Margaria</surname>
<given-names>V</given-names>
</name>
<name><surname>Ariano</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Quantifying forearm muscle activity during wrist and finger movements by means of multi-channel electromyography</article-title>
<source>PloS One</source>
<volume>9</volume>
<pub-id pub-id-type="doi">10.1371/journal.pone.0109943</pub-id>
</element-citation>
</ref>
<ref id="bib39"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gentner</surname>
<given-names>R</given-names>
</name>
<name><surname>Classen</surname>
<given-names>J</given-names>
</name>
</person-group>
<year>2006</year>
<article-title>Modular organization of finger movements by the human central nervous system</article-title>
<source>Neuron</source>
<volume>52</volume>
<fpage>731</fpage>
<lpage>742</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2006.09.038</pub-id>
<pub-id pub-id-type="pmid">17114055</pub-id>
</element-citation>
</ref>
<ref id="bib40"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gentner</surname>
<given-names>R</given-names>
</name>
<name><surname>Gorges</surname>
<given-names>S</given-names>
</name>
<name><surname>Weise</surname>
<given-names>D</given-names>
</name>
<name><surname>aufm Kampe</surname>
<given-names>K</given-names>
</name>
<name><surname>Buttmann</surname>
<given-names>M</given-names>
</name>
<name><surname>Classen</surname>
<given-names>J</given-names>
</name>
</person-group>
<year>2010</year>
<article-title>Encoding of motor skill in the corticomuscular system of musicians</article-title>
<source>Current Biology</source>
<volume>20</volume>
<fpage>1869</fpage>
<lpage>1874</lpage>
<pub-id pub-id-type="doi">10.1016/j.cub.2010.09.045</pub-id>
<pub-id pub-id-type="pmid">20951047</pub-id>
</element-citation>
</ref>
<ref id="bib41"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Goodhill</surname>
<given-names>GJ</given-names>
</name>
<name><surname>Sejnowski</surname>
<given-names>TJ</given-names>
</name>
</person-group>
<year>1997</year>
<article-title>A unifying objective function for topographic mappings</article-title>
<source>Neural Computation</source>
<volume>9</volume>
<fpage>1291</fpage>
<lpage>1303</lpage>
<pub-id pub-id-type="doi">10.1162/neco.1997.9.6.1291</pub-id>
</element-citation>
</ref>
<ref id="bib42"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grafton</surname>
<given-names>ST</given-names>
</name>
<name><surname>Fagg</surname>
<given-names>AH</given-names>
</name>
<name><surname>Woods</surname>
<given-names>RP</given-names>
</name>
<name><surname>Arbib</surname>
<given-names>MA</given-names>
</name>
</person-group>
<year>1996</year>
<article-title>Functional anatomy of pointing and grasping in humans</article-title>
<source>Cerebral Cortex</source>
<volume>6</volume>
<fpage>226</fpage>
<lpage>237</lpage>
<pub-id pub-id-type="doi">10.1093/cercor/6.2.226</pub-id>
<pub-id pub-id-type="pmid">8670653</pub-id>
</element-citation>
</ref>
<ref id="bib43"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Graziano</surname>
<given-names>MS</given-names>
</name>
<name><surname>Taylor</surname>
<given-names>CS</given-names>
</name>
<name><surname>Moore</surname>
<given-names>T</given-names>
</name>
</person-group>
<year>2002</year>
<article-title>Complex movements evoked by microstimulation of precentral cortex</article-title>
<source>Neuron</source>
<volume>34</volume>
<fpage>841</fpage>
<lpage>851</lpage>
<pub-id pub-id-type="doi">10.1016/S0896-6273(02)00698-0</pub-id>
<pub-id pub-id-type="pmid">12062029</pub-id>
</element-citation>
</ref>
<ref id="bib44"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Graziano</surname>
<given-names>MS</given-names>
</name>
</person-group>
<year>2016</year>
<article-title>Ethological action maps: a paradigm shift for the motor cortex</article-title>
<source>Trends in Cognitive Sciences</source>
<volume>20</volume>
<pub-id pub-id-type="doi">10.1016/j.tics.2015.10.008</pub-id>
</element-citation>
</ref>
<ref id="bib45"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grefkes</surname>
<given-names>C</given-names>
</name>
<name><surname>Weiss</surname>
<given-names>PH</given-names>
</name>
<name><surname>Zilles</surname>
<given-names>K</given-names>
</name>
<name><surname>Fink</surname>
<given-names>GR</given-names>
</name>
</person-group>
<year>2002</year>
<article-title>Crossmodal processing of object features in human anterior intraparietal cortex</article-title>
<source>Neuron</source>
<volume>35</volume>
<fpage>173</fpage>
<lpage>184</lpage>
<pub-id pub-id-type="doi">10.1016/S0896-6273(02)00741-9</pub-id>
<pub-id pub-id-type="pmid">12123617</pub-id>
</element-citation>
</ref>
<ref id="bib46"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gustus</surname>
<given-names>A</given-names>
</name>
<name><surname>Stillfried</surname>
<given-names>G</given-names>
</name>
<name><surname>Visser</surname>
<given-names>J</given-names>
</name>
<name><surname>Jorntell</surname>
<given-names>H</given-names>
</name>
<name><surname>van der Smagt</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2012</year>
<article-title>Human hand modelling: kinematics, dynamics, applications</article-title>
<source>Biological Cybernetics</source>
<volume>106</volume>
<fpage>741</fpage>
<lpage>755</lpage>
<pub-id pub-id-type="doi">10.1007/s00422-012-0532-4</pub-id>
<pub-id pub-id-type="pmid">23132432</pub-id>
</element-citation>
</ref>
<ref id="bib47"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gutteling</surname>
<given-names>TP</given-names>
</name>
<name><surname>Petridou</surname>
<given-names>N</given-names>
</name>
<name><surname>Dumoulin</surname>
<given-names>SO</given-names>
</name>
<name><surname>Harvey</surname>
<given-names>BM</given-names>
</name>
<name><surname>Aarnoutse</surname>
<given-names>EJ</given-names>
</name>
<name><surname>Kenemans</surname>
<given-names>JL</given-names>
</name>
<name><surname>Neggers</surname>
<given-names>SFW</given-names>
</name>
</person-group>
<year>2015</year>
<article-title>Action preparation shapes processing in early visual cortex</article-title>
<source>Journal of Neuroscience</source>
<volume>35</volume>
<fpage>6472</fpage>
<lpage>6480</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.1358-14.2015</pub-id>
<pub-id pub-id-type="pmid">25904798</pub-id>
</element-citation>
</ref>
<ref id="bib48"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Handjaras</surname>
<given-names>G</given-names>
</name>
<name><surname>Bernardi</surname>
<given-names>G</given-names>
</name>
<name><surname>Benuzzi</surname>
<given-names>F</given-names>
</name>
<name><surname>Nichelli</surname>
<given-names>PF</given-names>
</name>
<name><surname>Pietrini</surname>
<given-names>P</given-names>
</name>
<name><surname>Ricciardi</surname>
<given-names>E</given-names>
</name>
</person-group>
<year>2015</year>
<article-title>A topographical organization for action representation in the human brain</article-title>
<source>Human Brain Mapping</source>
<volume>36</volume>
<pub-id pub-id-type="doi">10.1002/hbm.22881</pub-id>
</element-citation>
</ref>
<ref id="bib49"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Haxby</surname>
<given-names>JV</given-names>
</name>
<name><surname>Connolly</surname>
<given-names>AC</given-names>
</name>
<name><surname>Guntupalli</surname>
<given-names>JS</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Decoding neural representational spaces using multivariate pattern analysis</article-title>
<source>Annual Review of Neuroscience</source>
<volume>37</volume>
<fpage>435</fpage>
<lpage>456</lpage>
<pub-id pub-id-type="doi">10.1146/annurev-neuro-062012-170325</pub-id>
</element-citation>
</ref>
<ref id="bib50"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hermens</surname>
<given-names>HJ</given-names>
</name>
<name><surname>Freriks</surname>
<given-names>B</given-names>
</name>
<name><surname>Disselhorst-Klug</surname>
<given-names>C</given-names>
</name>
<name><surname>Rau</surname>
<given-names>G</given-names>
</name>
</person-group>
<year>2000</year>
<article-title>Development of recommendations for SEMG sensors and sensor placement procedures</article-title>
<source>Journal of Electromyography and Kinesiology</source>
<volume>10</volume>
<fpage>361</fpage>
<lpage>374</lpage>
<pub-id pub-id-type="doi">10.1016/S1050-6411(00)00027-4</pub-id>
<pub-id pub-id-type="pmid">11018445</pub-id>
</element-citation>
</ref>
<ref id="bib51"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hermens</surname>
<given-names>HJ</given-names>
</name>
<name><surname>Freriks</surname>
<given-names>B</given-names>
</name>
<name><surname>Merletti</surname>
<given-names>R</given-names>
</name>
<name><surname>Stegeman</surname>
<given-names>D</given-names>
</name>
<name><surname>Blok</surname>
<given-names>J</given-names>
</name>
<name><surname>Rau</surname>
<given-names>G</given-names>
</name>
<name><surname>Disselhorst-Klug</surname>
<given-names>C</given-names>
</name>
<name><surname>Hägg</surname>
<given-names>G</given-names>
</name>
</person-group>
<year>1999</year>
<article-title>European recommendations for surface electromyography</article-title>
<source>Roessingh Research and Development</source>
<volume>8</volume>
<fpage>13</fpage>
<lpage>54</lpage>
</element-citation>
</ref>
<ref id="bib52"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hudgins</surname>
<given-names>B</given-names>
</name>
<name><surname>Parker</surname>
<given-names>P</given-names>
</name>
<name><surname>Scott</surname>
<given-names>RN</given-names>
</name>
</person-group>
<year>1993</year>
<article-title>A new strategy for multifunction myoelectric control</article-title>
<source>IEEE Transactions on Bio-Medical Engineering</source>
<volume>40</volume>
<fpage>82</fpage>
<lpage>94</lpage>
<pub-id pub-id-type="doi">10.1109/10.204774</pub-id>
<pub-id pub-id-type="pmid">8468080</pub-id>
</element-citation>
</ref>
<ref id="bib53"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Huth</surname>
<given-names>AG</given-names>
</name>
<name><surname>Nishimoto</surname>
<given-names>S</given-names>
</name>
<name><surname>Vu</surname>
<given-names>AT</given-names>
</name>
<name><surname>Gallant</surname>
<given-names>JL</given-names>
</name>
</person-group>
<year>2012</year>
<article-title>A continuous semantic space describes the representation of thousands of object and action categories across the human brain</article-title>
<source>Neuron</source>
<volume>76</volume>
<fpage>1210</fpage>
<lpage>1224</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2012.10.014</pub-id>
<pub-id pub-id-type="pmid">23259955</pub-id>
</element-citation>
</ref>
<ref id="bib54"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Indovina</surname>
<given-names>I</given-names>
</name>
<name><surname>Sanes</surname>
<given-names>JN</given-names>
</name>
</person-group>
<year>2001</year>
<article-title>On somatotopic representation centers for finger movements in human primary motor cortex and supplementary motor area</article-title>
<source>NeuroImage</source>
<volume>13</volume>
<fpage>1027</fpage>
<lpage>1034</lpage>
<pub-id pub-id-type="doi">10.1006/nimg.2001.0776</pub-id>
<pub-id pub-id-type="pmid">11352608</pub-id>
</element-citation>
</ref>
<ref id="bib55"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ingram</surname>
<given-names>JN</given-names>
</name>
<name><surname>Kording</surname>
<given-names>KP</given-names>
</name>
<name><surname>Howard</surname>
<given-names>IS</given-names>
</name>
<name><surname>Wolpert</surname>
<given-names>DM</given-names>
</name>
</person-group>
<year>2008</year>
<article-title>The statistics of natural hand movements</article-title>
<source>Experimental Brain Research</source>
<volume>188</volume>
<fpage>223</fpage>
<lpage>236</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-008-1355-3</pub-id>
<pub-id pub-id-type="pmid">18369608</pub-id>
</element-citation>
</ref>
<ref id="bib56"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Iwamura</surname>
<given-names>Y</given-names>
</name>
<name><surname>Tanaka</surname>
<given-names>M</given-names>
</name>
<name><surname>Hikosaka</surname>
<given-names>O</given-names>
</name>
</person-group>
<year>1980</year>
<article-title>Overlapping representation of fingers in the somatosensory cortex (area 2) of the conscious monkey</article-title>
<source>Brain Research</source>
<volume>197</volume>
<fpage>516</fpage>
<lpage>520</lpage>
<pub-id pub-id-type="doi">10.1016/0006-8993(80)91139-7</pub-id>
<pub-id pub-id-type="pmid">7407570</pub-id>
</element-citation>
</ref>
<ref id="bib57"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kaas</surname>
<given-names>JH</given-names>
</name>
</person-group>
<year>1983</year>
<article-title>What, if anything, is SI? organization of first somatosensory area of cortex</article-title>
<source>Physiological Reviews</source>
<volume>63</volume>
<fpage>206</fpage>
<lpage>231</lpage>
<pub-id pub-id-type="pmid">6401864</pub-id>
</element-citation>
</ref>
<ref id="bib58"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>King</surname>
<given-names>M</given-names>
</name>
<name><surname>Rauch</surname>
<given-names>HG</given-names>
</name>
<name><surname>Stein</surname>
<given-names>DJ</given-names>
</name>
<name><surname>Brooks</surname>
<given-names>SJ</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>The handyman's brain: a neuroimaging meta-analysis describing the similarities and differences between grip type and pattern in humans</article-title>
<source>NeuroImage</source>
<volume>102</volume>
<fpage>923</fpage>
<lpage>937</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuroimage.2014.05.064</pub-id>
<pub-id pub-id-type="pmid">24927986</pub-id>
</element-citation>
</ref>
<ref id="bib59"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kirsch</surname>
<given-names>E</given-names>
</name>
<name><surname>Rivlis</surname>
<given-names>G</given-names>
</name>
<name><surname>Schieber</surname>
<given-names>MH</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Primary motor cortex neurons during individuated finger and wrist movements: correlation of spike firing rates with the motion of individual digits versus their principal components</article-title>
<source>Frontiers in Neurology</source>
<volume>5</volume>
<fpage>70</fpage>
<pub-id pub-id-type="doi">10.3389/fneur.2014.00070</pub-id>
<pub-id pub-id-type="pmid">24904516</pub-id>
</element-citation>
</ref>
<ref id="bib60"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Klaes</surname>
<given-names>C</given-names>
</name>
<name><surname>Kellis</surname>
<given-names>S</given-names>
</name>
<name><surname>Aflalo</surname>
<given-names>T</given-names>
</name>
<name><surname>Lee</surname>
<given-names>B</given-names>
</name>
<name><surname>Pejsa</surname>
<given-names>K</given-names>
</name>
<name><surname>Shanfield</surname>
<given-names>K</given-names>
</name>
<name><surname>Hayes-Jackson</surname>
<given-names>S</given-names>
</name>
<name><surname>Aisen</surname>
<given-names>M</given-names>
</name>
<name><surname>Heck</surname>
<given-names>C</given-names>
</name>
<name><surname>Liu</surname>
<given-names>C</given-names>
</name>
<name><surname>Andersen</surname>
<given-names>RA</given-names>
</name>
</person-group>
<year>2015</year>
<article-title>Hand shape representations in the human posterior parietal cortex</article-title>
<source>The Journal of Neuroscience</source>
<volume>35</volume>
<fpage>15466</fpage>
<lpage>15476</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.2747-15.2015</pub-id>
<pub-id pub-id-type="pmid">26586832</pub-id>
</element-citation>
</ref>
<ref id="bib61"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Klein Breteler</surname>
<given-names>MD</given-names>
</name>
<name><surname>Simura</surname>
<given-names>KJ</given-names>
</name>
<name><surname>Flanders</surname>
<given-names>M</given-names>
</name>
</person-group>
<year>2007</year>
<article-title>Timing of muscle activation in a hand movement sequence</article-title>
<source>Cerebral Cortex</source>
<volume>17</volume>
<fpage>803</fpage>
<lpage>815</lpage>
<pub-id pub-id-type="doi">10.1093/cercor/bhk033</pub-id>
<pub-id pub-id-type="pmid">16699078</pub-id>
</element-citation>
</ref>
<ref id="bib62"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kriegeskorte</surname>
<given-names>N</given-names>
</name>
<name><surname>Kievit</surname>
<given-names>RA</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>Representational geometry: integrating cognition, computation, and the brain</article-title>
<source>Trends in Cognitive Sciences</source>
<volume>17</volume>
<fpage>401</fpage>
<lpage>412</lpage>
<pub-id pub-id-type="doi">10.1016/j.tics.2013.06.007</pub-id>
<pub-id pub-id-type="pmid">23876494</pub-id>
</element-citation>
</ref>
<ref id="bib63"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kriegeskorte</surname>
<given-names>N</given-names>
</name>
<name><surname>Mur</surname>
<given-names>M</given-names>
</name>
<name><surname>Bandettini</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2008b</year>
<article-title>Representational similarity analysis – connecting the branches of systems neuroscience</article-title>
<source>Frontiers in Systems Neuroscience</source>
<volume>2</volume>
<pub-id pub-id-type="doi">10.3389/neuro.06.004.2008</pub-id>
</element-citation>
</ref>
<ref id="bib64"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kriegeskorte</surname>
<given-names>N</given-names>
</name>
<name><surname>Mur</surname>
<given-names>M</given-names>
</name>
<name><surname>Ruff</surname>
<given-names>DA</given-names>
</name>
<name><surname>Kiani</surname>
<given-names>R</given-names>
</name>
<name><surname>Bodurka</surname>
<given-names>J</given-names>
</name>
<name><surname>Esteky</surname>
<given-names>H</given-names>
</name>
<name><surname>Tanaka</surname>
<given-names>K</given-names>
</name>
<name><surname>Bandettini</surname>
<given-names>PA</given-names>
</name>
</person-group>
<year>2008a</year>
<article-title>Matching categorical object representations in inferior temporal cortex of man and monkey</article-title>
<source>Neuron</source>
<volume>60</volume>
<fpage>1126</fpage>
<lpage>1141</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2008.10.043</pub-id>
<pub-id pub-id-type="pmid">19109916</pub-id>
</element-citation>
</ref>
<ref id="bib65"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Kruskal</surname>
<given-names>JB</given-names>
</name>
<name><surname>Wish</surname>
<given-names>M</given-names>
</name>
<collab>ebrary Inc</collab>
</person-group>
<year>1978</year>
<chapter-title>Multidimensional scaling</chapter-title>
<source>Sage University Papers Series Quantitative Applications in the Social Sciences No 07-011</source>
<publisher-name>Newbury Park Sage Publications</publisher-name>
</element-citation>
</ref>
<ref id="bib66"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kwan</surname>
<given-names>HC</given-names>
</name>
<name><surname>MacKay</surname>
<given-names>WA</given-names>
</name>
<name><surname>Murphy</surname>
<given-names>JT</given-names>
</name>
<name><surname>Wong</surname>
<given-names>YC</given-names>
</name>
</person-group>
<year>1985</year>
<article-title>Properties of visual cue responses in primate precentral cortex</article-title>
<source>Brain Research</source>
<volume>343</volume>
<fpage>24</fpage>
<lpage>35</lpage>
<pub-id pub-id-type="doi">10.1016/0006-8993(85)91154-0</pub-id>
<pub-id pub-id-type="pmid">3929999</pub-id>
</element-citation>
</ref>
<ref id="bib67"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Latash</surname>
<given-names>ML</given-names>
</name>
<name><surname>Scholz</surname>
<given-names>JP</given-names>
</name>
<name><surname>Schoner</surname>
<given-names>G</given-names>
</name>
</person-group>
<year>2007</year>
<article-title>Toward a new theory of motor synergies</article-title>
<source>Motor Control</source>
<volume>11</volume>
<fpage>276</fpage>
<lpage>308</lpage>
<pub-id pub-id-type="pmid">17715460</pub-id>
</element-citation>
</ref>
<ref id="bib68"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Latash</surname>
<given-names>ML</given-names>
</name>
</person-group>
<year>2010</year>
<article-title>Motor synergies and the equilibrium-point hypothesis</article-title>
<source>Motor Control</source>
<volume>14</volume>
<fpage>294</fpage>
<lpage>322</lpage>
<pub-id pub-id-type="pmid">20702893</pub-id>
</element-citation>
</ref>
<ref id="bib69"><element-citation publication-type="other"><person-group person-group-type="author"><name><surname>Mathiesen</surname>
<given-names>JR</given-names>
</name>
<name><surname>Bøg</surname>
<given-names>MF</given-names>
</name>
<name><surname>Erkocevic</surname>
<given-names>E</given-names>
</name>
<name><surname>Niemeier</surname>
<given-names>MJ</given-names>
</name>
<name><surname>Smidstrup</surname>
<given-names>A</given-names>
</name>
<name><surname>Kamavuako</surname>
<given-names>EN</given-names>
</name>
</person-group>
<year>2010</year>
<article-title>Prediction of grasping force based on features of surface and intramuscular EMG</article-title>
</element-citation>
</ref>
<ref id="bib70"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mitchell</surname>
<given-names>TM</given-names>
</name>
<name><surname>Hutchinson</surname>
<given-names>R</given-names>
</name>
<name><surname>Niculescu</surname>
<given-names>RS</given-names>
</name>
<name><surname>Pereira</surname>
<given-names>F</given-names>
</name>
<name><surname>Wang</surname>
<given-names>XR</given-names>
</name>
<name><surname>Just</surname>
<given-names>M</given-names>
</name>
<name><surname>Newman</surname>
<given-names>S</given-names>
</name>
</person-group>
<year>2004</year>
<article-title>Learning to decode cognitive states from brain images</article-title>
<source>Machine Learning</source>
<volume>57</volume>
<fpage>145</fpage>
<lpage>175</lpage>
<pub-id pub-id-type="doi">10.1023/B:Mach.0000035475.85309.1b</pub-id>
</element-citation>
</ref>
<ref id="bib71"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mitchell</surname>
<given-names>TM</given-names>
</name>
<name><surname>Shinkareva</surname>
<given-names>SV</given-names>
</name>
<name><surname>Carlson</surname>
<given-names>A</given-names>
</name>
<name><surname>Chang</surname>
<given-names>KM</given-names>
</name>
<name><surname>Malave</surname>
<given-names>VL</given-names>
</name>
<name><surname>Mason</surname>
<given-names>RA</given-names>
</name>
<name><surname>Just</surname>
<given-names>MA</given-names>
</name>
</person-group>
<year>2008</year>
<article-title>Predicting human brain activity associated with the meanings of nouns</article-title>
<source>Science</source>
<volume>320</volume>
<fpage>1191</fpage>
<lpage>1195</lpage>
<pub-id pub-id-type="doi">10.1126/science.1152876</pub-id>
<pub-id pub-id-type="pmid">18511683</pub-id>
</element-citation>
</ref>
<ref id="bib72"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mollazadeh</surname>
<given-names>M</given-names>
</name>
<name><surname>Aggarwal</surname>
<given-names>V</given-names>
</name>
<name><surname>Thakor</surname>
<given-names>NV</given-names>
</name>
<name><surname>Schieber</surname>
<given-names>MH</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Principal components of hand kinematics and neurophysiological signals in motor cortex during reach to grasp movements</article-title>
<source>Journal of Neurophysiology</source>
<volume>112</volume>
<fpage>1857</fpage>
<lpage>1870</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00481.2013</pub-id>
<pub-id pub-id-type="pmid">24990564</pub-id>
</element-citation>
</ref>
<ref id="bib73"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Muceli</surname>
<given-names>S</given-names>
</name>
<name><surname>Jiang</surname>
<given-names>N</given-names>
</name>
<name><surname>Farina</surname>
<given-names>D</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Extracting signals robust to electrode number and shift for online simultaneous and proportional myoelectric control by factorization algorithms</article-title>
<source>IEEE Transactions on Neural Systems and Rehabilitation Engineering</source>
<volume>22</volume>
<fpage>623</fpage>
<lpage>633</lpage>
<pub-id pub-id-type="doi">10.1109/TNSRE.2013.2282898</pub-id>
<pub-id pub-id-type="pmid">24132017</pub-id>
</element-citation>
</ref>
<ref id="bib74"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Napier</surname>
<given-names>JR</given-names>
</name>
</person-group>
<year>1956</year>
<article-title>The prehensile movements of the human hand</article-title>
<source>The Journal of Bone and Joint Surgery. British Volume</source>
<volume>38-B</volume>
<fpage>902</fpage>
<lpage>913</lpage>
<pub-id pub-id-type="pmid">13376678</pub-id>
</element-citation>
</ref>
<ref id="bib75"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Naselaris</surname>
<given-names>T</given-names>
</name>
<name><surname>Kay</surname>
<given-names>KN</given-names>
</name>
<name><surname>Nishimoto</surname>
<given-names>S</given-names>
</name>
<name><surname>Gallant</surname>
<given-names>JL</given-names>
</name>
</person-group>
<year>2011</year>
<article-title>Encoding and decoding in fMRI</article-title>
<source>NeuroImage</source>
<volume>56</volume>
<fpage>400</fpage>
<lpage>410</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuroimage.2010.07.073</pub-id>
<pub-id pub-id-type="pmid">20691790</pub-id>
</element-citation>
</ref>
<ref id="bib76"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oldfield</surname>
<given-names>RC</given-names>
</name>
</person-group>
<year>1971</year>
<article-title>The assessment and analysis of handedness: the edinburgh inventory</article-title>
<source>Neuropsychologia</source>
<volume>9</volume>
<fpage>97</fpage>
<lpage>113</lpage>
<pub-id pub-id-type="doi">10.1016/0028-3932(71)90067-4</pub-id>
<pub-id pub-id-type="pmid">5146491</pub-id>
</element-citation>
</ref>
<ref id="bib77"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Overduin</surname>
<given-names>SA</given-names>
</name>
<name><surname>d'Avella</surname>
<given-names>A</given-names>
</name>
<name><surname>Carmena</surname>
<given-names>JM</given-names>
</name>
<name><surname>Bizzi</surname>
<given-names>E</given-names>
</name>
</person-group>
<year>2012</year>
<article-title>Microstimulation activates a handful of muscle synergies</article-title>
<source>Neuron</source>
<volume>76</volume>
<fpage>1071</fpage>
<lpage>1077</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2012.10.018</pub-id>
<pub-id pub-id-type="pmid">23259944</pub-id>
</element-citation>
</ref>
<ref id="bib78"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Penfield</surname>
<given-names>W</given-names>
</name>
<name><surname>Boldrey</surname>
<given-names>E</given-names>
</name>
</person-group>
<year>1937</year>
<article-title>Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation</article-title>
<source>Brain</source>
<volume>60</volume>
<fpage>389</fpage>
<lpage>443</lpage>
<pub-id pub-id-type="doi">10.1093/brain/60.4.389</pub-id>
</element-citation>
</ref>
<ref id="bib79"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Penfield</surname>
<given-names>W</given-names>
</name>
<name><surname>Rasmussen</surname>
<given-names>T</given-names>
</name>
</person-group>
<year>1950</year>
<source>The Cerebral Cortex of Man; a Clinical Study of Localization of Function</source>
<publisher-loc>New York</publisher-loc>
<publisher-name>Macmillan</publisher-name>
</element-citation>
</ref>
<ref id="bib80"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Penfield</surname>
<given-names>W</given-names>
</name>
<name><surname>Welch</surname>
<given-names>K</given-names>
</name>
</person-group>
<year>1951</year>
<article-title>The supplementary motor area of the cerebral cortex</article-title>
<source>A.M.A. Archives of Neurology & Psychiatry</source>
<volume>66</volume>
<fpage>289</fpage>
<lpage>317</lpage>
<pub-id pub-id-type="doi">10.1001/archneurpsyc.1951.02320090038004</pub-id>
<pub-id pub-id-type="pmid">14867993</pub-id>
</element-citation>
</ref>
<ref id="bib81"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Phinyomark</surname>
<given-names>A</given-names>
</name>
<name><surname>Limsakul</surname>
<given-names>C</given-names>
</name>
<name><surname>Phukpattaranont</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2010</year>
<article-title>A novel feature extraction for robust EMG pattern recognition</article-title>
<source>Journal of Computing</source>
<volume>1</volume>
<fpage>71</fpage>
<lpage>80</lpage>
</element-citation>
</ref>
<ref id="bib82"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pistohl</surname>
<given-names>T</given-names>
</name>
<name><surname>Schulze-Bonhage</surname>
<given-names>A</given-names>
</name>
<name><surname>Aertsen</surname>
<given-names>A</given-names>
</name>
<name><surname>Mehring</surname>
<given-names>C</given-names>
</name>
<name><surname>Ball</surname>
<given-names>T</given-names>
</name>
</person-group>
<year>2012</year>
<article-title>Decoding natural grasp types from human ECoG</article-title>
<source>NeuroImage</source>
<volume>59</volume>
<fpage>248</fpage>
<lpage>260</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuroimage.2011.06.084</pub-id>
<pub-id pub-id-type="pmid">21763434</pub-id>
</element-citation>
</ref>
<ref id="bib83"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Riehle</surname>
<given-names>A</given-names>
</name>
<name><surname>Requin</surname>
<given-names>J</given-names>
</name>
</person-group>
<year>1989</year>
<article-title>Monkey primary motor and premotor cortex: single-cell activity related to prior information about direction and extent of an intended movement</article-title>
<source>Journal of Neurophysiology</source>
<volume>61</volume>
<fpage>534</fpage>
<lpage>549</lpage>
<pub-id pub-id-type="pmid">2709098</pub-id>
</element-citation>
</ref>
<ref id="bib84"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Saleh</surname>
<given-names>M</given-names>
</name>
<name><surname>Takahashi</surname>
<given-names>K</given-names>
</name>
<name><surname>Amit</surname>
<given-names>Y</given-names>
</name>
<name><surname>Hatsopoulos</surname>
<given-names>NG</given-names>
</name>
</person-group>
<year>2010</year>
<article-title>Encoding of coordinated grasp trajectories in primary motor cortex</article-title>
<source>The Journal of Neuroscience</source>
<volume>30</volume>
<fpage>17079</fpage>
<lpage>17090</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.2558-10.2010</pub-id>
<pub-id pub-id-type="pmid">21159978</pub-id>
</element-citation>
</ref>
<ref id="bib85"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Saleh</surname>
<given-names>M</given-names>
</name>
<name><surname>Takahashi</surname>
<given-names>K</given-names>
</name>
<name><surname>Hatsopoulos</surname>
<given-names>NG</given-names>
</name>
</person-group>
<year>2012</year>
<article-title>Encoding of coordinated reach and grasp trajectories in primary motor cortex</article-title>
<source>The Journal of Neuroscience</source>
<volume>32</volume>
<fpage>1220</fpage>
<lpage>1232</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.2438-11.2012</pub-id>
<pub-id pub-id-type="pmid">22279207</pub-id>
</element-citation>
</ref>
<ref id="bib86"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Santello</surname>
<given-names>M</given-names>
</name>
<name><surname>Baud-Bovy</surname>
<given-names>G</given-names>
</name>
<name><surname>Jorntell</surname>
<given-names>H</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>Neural bases of hand synergies</article-title>
<source>Frontiers in Computational Neuroscience</source>
<volume>7</volume>
<fpage>23</fpage>
<pub-id pub-id-type="doi">10.3389/fncom.2013.00023</pub-id>
<pub-id pub-id-type="pmid">23579545</pub-id>
</element-citation>
</ref>
<ref id="bib87"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Santello</surname>
<given-names>M</given-names>
</name>
<name><surname>Flanders</surname>
<given-names>M</given-names>
</name>
<name><surname>Soechting</surname>
<given-names>JF</given-names>
</name>
</person-group>
<year>1998</year>
<article-title>Postural hand synergies for tool use</article-title>
<source>The Journal of Neuroscience</source>
<volume>18</volume>
<fpage>10105</fpage>
<lpage>10115</lpage>
<pub-id pub-id-type="pmid">9822764</pub-id>
</element-citation>
</ref>
<ref id="bib88"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Santello</surname>
<given-names>M</given-names>
</name>
<name><surname>Flanders</surname>
<given-names>M</given-names>
</name>
<name><surname>Soechting</surname>
<given-names>JF</given-names>
</name>
</person-group>
<year>2002</year>
<article-title>Patterns of hand motion during grasping and the influence of sensory guidance</article-title>
<source>The Journal of Neuroscience</source>
<volume>22</volume>
<fpage>1426</fpage>
<lpage>1435</lpage>
<pub-id pub-id-type="pmid">11850469</pub-id>
</element-citation>
</ref>
<ref id="bib89"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Santello</surname>
<given-names>M</given-names>
</name>
<name><surname>Lang</surname>
<given-names>CE</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Are movement disorders and sensorimotor injuries pathologic synergies? when normal multi-joint movement synergies become pathologic</article-title>
<source>Frontiers in Human Neuroscience</source>
<volume>8</volume>
<fpage>1050</fpage>
<pub-id pub-id-type="doi">10.3389/fnhum.2014.01050</pub-id>
<pub-id pub-id-type="pmid">25610391</pub-id>
</element-citation>
</ref>
<ref id="bib90"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schaffelhofer</surname>
<given-names>S</given-names>
</name>
<name><surname>Agudelo-Toro</surname>
<given-names>A</given-names>
</name>
<name><surname>Scherberger</surname>
<given-names>H</given-names>
</name>
</person-group>
<year>2015</year>
<article-title>Decoding a wide range of hand configurations from macaque motor, premotor, and parietal cortices</article-title>
<source>The Journal of Neuroscience</source>
<volume>35</volume>
<fpage>1068</fpage>
<lpage>1081</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.3594-14.2015</pub-id>
<pub-id pub-id-type="pmid">25609623</pub-id>
</element-citation>
</ref>
<ref id="bib91"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schieber</surname>
<given-names>MH</given-names>
</name>
</person-group>
<year>1991</year>
<article-title>Individuated finger movements of rhesus monkeys: a means of quantifying the independence of the digits</article-title>
<source>Journal of Neurophysiology</source>
<volume>65</volume>
<fpage>1381</fpage>
<lpage>1391</lpage>
<pub-id pub-id-type="pmid">1875247</pub-id>
</element-citation>
</ref>
<ref id="bib92"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schieber</surname>
<given-names>MH</given-names>
</name>
</person-group>
<year>2001</year>
<article-title>Constraints on somatotopic organization in the primary motor cortex</article-title>
<source>Journal of Neurophysiology</source>
<volume>86</volume>
<fpage>2125</fpage>
<lpage>2143</lpage>
<pub-id pub-id-type="pmid">11698506</pub-id>
</element-citation>
</ref>
<ref id="bib93"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schreiber</surname>
<given-names>K</given-names>
</name>
<name><surname>Krekelberg</surname>
<given-names>B</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>The statistical analysis of multi-voxel patterns in functional imaging</article-title>
<source>PloS One</source>
<volume>8</volume>
<elocation-id>e13420</elocation-id>
<pub-id pub-id-type="doi">10.1371/journal.pone.0069328</pub-id>
</element-citation>
</ref>
<ref id="bib94"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schwartz</surname>
<given-names>AB</given-names>
</name>
<name><surname>Cui</surname>
<given-names>XT</given-names>
</name>
<name><surname>Weber</surname>
<given-names>DJ</given-names>
</name>
<name><surname>Moran</surname>
<given-names>DW</given-names>
</name>
</person-group>
<year>2006</year>
<article-title>Brain-controlled interfaces: movement restoration with neural prosthetics</article-title>
<source>Neuron</source>
<volume>52</volume>
<fpage>205</fpage>
<lpage>220</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2006.09.019</pub-id>
<pub-id pub-id-type="pmid">17015237</pub-id>
</element-citation>
</ref>
<ref id="bib95"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schwartz</surname>
<given-names>AB</given-names>
</name>
</person-group>
<year>2007</year>
<article-title>Useful signals from motor cortex</article-title>
<source>The Journal of Physiology</source>
<volume>579</volume>
<fpage>581</fpage>
<lpage>601</lpage>
<pub-id pub-id-type="doi">10.1113/jphysiol.2006.126698</pub-id>
<pub-id pub-id-type="pmid">17255162</pub-id>
</element-citation>
</ref>
<ref id="bib96"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sereno</surname>
<given-names>MI</given-names>
</name>
<name><surname>Dale</surname>
<given-names>AM</given-names>
</name>
<name><surname>Reppas</surname>
<given-names>JB</given-names>
</name>
<name><surname>Kwong</surname>
<given-names>KK</given-names>
</name>
<name><surname>Belliveau</surname>
<given-names>JW</given-names>
</name>
<name><surname>Brady</surname>
<given-names>TJ</given-names>
</name>
<name><surname>Rosen</surname>
<given-names>BR</given-names>
</name>
<name><surname>Tootell</surname>
<given-names>RB</given-names>
</name>
</person-group>
<year>1995</year>
<article-title>Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging</article-title>
<source>Science</source>
<volume>268</volume>
<fpage>889</fpage>
<lpage>893</lpage>
<pub-id pub-id-type="doi">10.1126/science.7754376</pub-id>
<pub-id pub-id-type="pmid">7754376</pub-id>
</element-citation>
</ref>
<ref id="bib97"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Siero</surname>
<given-names>JC</given-names>
</name>
<name><surname>Hermes</surname>
<given-names>D</given-names>
</name>
<name><surname>Hoogduin</surname>
<given-names>H</given-names>
</name>
<name><surname>Luijten</surname>
<given-names>PR</given-names>
</name>
<name><surname>Ramsey</surname>
<given-names>NF</given-names>
</name>
<name><surname>Petridou</surname>
<given-names>N</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>BOLD matches neuronal activity at the mm scale: a combined 7T fMRI and ECoG study in human sensorimotor cortex</article-title>
<source>NeuroImage</source>
<volume>101</volume>
<fpage>177</fpage>
<lpage>184</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuroimage.2014.07.002</pub-id>
<pub-id pub-id-type="pmid">25026157</pub-id>
</element-citation>
</ref>
<ref id="bib98"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Soechting</surname>
<given-names>JF</given-names>
</name>
<name><surname>Flanders</surname>
<given-names>M</given-names>
</name>
</person-group>
<year>1997</year>
<article-title>Flexibility and repeatability of finger movements during typing: analysis of multiple degrees of freedom</article-title>
<source>Journal of Computational Neuroscience</source>
<volume>4</volume>
<fpage>29</fpage>
<lpage>46</lpage>
<pub-id pub-id-type="doi">10.1023/A:1008812426305</pub-id>
<pub-id pub-id-type="pmid">9046450</pub-id>
</element-citation>
</ref>
<ref id="bib99"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stillfried</surname>
<given-names>G</given-names>
</name>
<name><surname>Hillenbrand</surname>
<given-names>U</given-names>
</name>
<name><surname>Settles</surname>
<given-names>M</given-names>
</name>
<name><surname>van der Smagt</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>MRI-based skeletal hand movement model</article-title>
<source>Human Hand as an Inspiration for Robot Hand Development</source>
<volume>95</volume>
<fpage>49</fpage>
<lpage>75</lpage>
<pub-id pub-id-type="doi">10.1007/978-3-319-03017-3_3</pub-id>
</element-citation>
</ref>
<ref id="bib100"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tessitore</surname>
<given-names>G</given-names>
</name>
<name><surname>Sinigaglia</surname>
<given-names>C</given-names>
</name>
<name><surname>Prevete</surname>
<given-names>R</given-names>
</name>
</person-group>
<year>2013</year>
<article-title>Hierarchical and multiple hand action representation using temporal postural synergies</article-title>
<source>Experimental Brain Research</source>
<volume>225</volume>
<fpage>11</fpage>
<lpage>36</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-012-3344-9</pub-id>
<pub-id pub-id-type="pmid">23229775</pub-id>
</element-citation>
</ref>
<ref id="bib101"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Thakur</surname>
<given-names>PH</given-names>
</name>
<name><surname>Bastian</surname>
<given-names>AJ</given-names>
</name>
<name><surname>Hsiao</surname>
<given-names>SS</given-names>
</name>
</person-group>
<year>2008</year>
<article-title>Multidigit movement synergies of the human hand in an unconstrained haptic exploration task</article-title>
<source>The Journal of Neuroscience</source>
<volume>28</volume>
<fpage>1271</fpage>
<lpage>1281</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4512-07.2008</pub-id>
<pub-id pub-id-type="pmid">18256247</pub-id>
</element-citation>
</ref>
<ref id="bib102"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tkach</surname>
<given-names>D</given-names>
</name>
<name><surname>Huang</surname>
<given-names>H</given-names>
</name>
<name><surname>Kuiken</surname>
<given-names>TA</given-names>
</name>
</person-group>
<year>2010</year>
<article-title>Study of stability of time-domain features for electromyographic pattern recognition</article-title>
<source>Journal of Neuroengineering and Rehabilitation</source>
<volume>7</volume>
<pub-id pub-id-type="doi">10.1186/1743-0003-7-21</pub-id>
</element-citation>
</ref>
<ref id="bib103"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Todorov</surname>
<given-names>E</given-names>
</name>
<name><surname>Jordan</surname>
<given-names>MI</given-names>
</name>
</person-group>
<year>2002</year>
<article-title>Optimal feedback control as a theory of motor coordination</article-title>
<source>Nature Neuroscience</source>
<volume>5</volume>
<fpage>1226</fpage>
<lpage>1235</lpage>
<pub-id pub-id-type="doi">10.1038/nn963</pub-id>
<pub-id pub-id-type="pmid">12404008</pub-id>
</element-citation>
</ref>
<ref id="bib104"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Todorov</surname>
<given-names>E</given-names>
</name>
</person-group>
<year>2004</year>
<article-title>Optimality principles in sensorimotor control</article-title>
<source>Nature Neuroscience</source>
<volume>7</volume>
<fpage>907</fpage>
<lpage>915</lpage>
<pub-id pub-id-type="doi">10.1038/nn1309</pub-id>
<pub-id pub-id-type="pmid">15332089</pub-id>
</element-citation>
</ref>
<ref id="bib105"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Turvey</surname>
<given-names>MT</given-names>
</name>
</person-group>
<year>2007</year>
<article-title>Action and perception at the level of synergies</article-title>
<source>Human Movement Science</source>
<volume>26</volume>
<fpage>657</fpage>
<lpage>697</lpage>
<pub-id pub-id-type="doi">10.1016/j.humov.2007.04.002</pub-id>
<pub-id pub-id-type="pmid">17604860</pub-id>
</element-citation>
</ref>
<ref id="bib106"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Velliste</surname>
<given-names>M</given-names>
</name>
<name><surname>Perel</surname>
<given-names>S</given-names>
</name>
<name><surname>Spalding</surname>
<given-names>MC</given-names>
</name>
<name><surname>Whitford</surname>
<given-names>AS</given-names>
</name>
<name><surname>Schwartz</surname>
<given-names>AB</given-names>
</name>
</person-group>
<year>2008</year>
<article-title>Cortical control of a prosthetic arm for self-feeding</article-title>
<source>Nature</source>
<volume>453</volume>
<fpage>1098</fpage>
<lpage>1101</lpage>
<pub-id pub-id-type="doi">10.1038/nature06996</pub-id>
<pub-id pub-id-type="pmid">18509337</pub-id>
</element-citation>
</ref>
<ref id="bib107"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vereijken</surname>
<given-names>B</given-names>
</name>
<name><surname>Whiting</surname>
<given-names>HT</given-names>
</name>
<name><surname>Beek</surname>
<given-names>WJ</given-names>
</name>
</person-group>
<year>1992</year>
<article-title>A dynamical systems approach to skill acquisition</article-title>
<source>The Quarterly Journal of Experimental Psychology Section A</source>
<volume>45</volume>
<fpage>323</fpage>
<lpage>344</lpage>
<pub-id pub-id-type="doi">10.1080/14640749208401329</pub-id>
</element-citation>
</ref>
<ref id="bib108"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Weiss</surname>
<given-names>EJ</given-names>
</name>
<name><surname>Flanders</surname>
<given-names>M</given-names>
</name>
</person-group>
<year>2004</year>
<article-title>Muscular and postural synergies of the human hand</article-title>
<source>Journal of Neurophysiology</source>
<volume>92</volume>
<fpage>523</fpage>
<lpage>535</lpage>
<pub-id pub-id-type="doi">10.1152/jn.01265.2003</pub-id>
<pub-id pub-id-type="pmid">14973321</pub-id>
</element-citation>
</ref>
<ref id="bib109"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Woolsey</surname>
<given-names>CN</given-names>
</name>
<name><surname>Settlage</surname>
<given-names>PH</given-names>
</name>
<name><surname>Meyer</surname>
<given-names>DR</given-names>
</name>
<name><surname>Sencer</surname>
<given-names>W</given-names>
</name>
<name><surname>Pinto Hamuy</surname>
<given-names>T</given-names>
</name>
<name><surname>Travis</surname>
<given-names>AM</given-names>
</name>
</person-group>
<year>1952</year>
<article-title>Patterns of localization in precentral and "supplementary" motor areas and their relation to the concept of a premotor area</article-title>
<source>Research Publications - Association for Research in Nervous and Mental Disease</source>
<volume>30</volume>
<fpage>238</fpage>
<lpage>264</lpage>
<pub-id pub-id-type="pmid">12983675</pub-id>
</element-citation>
</ref>
<ref id="bib110"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yarrow</surname>
<given-names>S</given-names>
</name>
<name><surname>Razak</surname>
<given-names>KA</given-names>
</name>
<name><surname>Seitz</surname>
<given-names>AR</given-names>
</name>
<name><surname>Series</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2014</year>
<article-title>Detecting and quantifying topography in neural maps</article-title>
<source>PloS One</source>
<volume>9</volume>
<elocation-id>e13420</elocation-id>
<pub-id pub-id-type="doi">10.1371/journal.pone.0087178</pub-id>
</element-citation>
</ref>
<ref id="bib111"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zecca</surname>
<given-names>M</given-names>
</name>
<name><surname>Micera</surname>
<given-names>S</given-names>
</name>
<name><surname>Carrozza</surname>
<given-names>MC</given-names>
</name>
<name><surname>Dario</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2002</year>
<article-title>Control of multifunctional prosthetic hands by processing the electromyographic signal</article-title>
<source>Critical Reviews? in Biomedical Engineering</source>
<volume>30</volume>
<fpage>459</fpage>
<lpage>485</lpage>
<pub-id pub-id-type="doi">10.1615/CritRevBiomedEng.v30.i456.80</pub-id>
<pub-id pub-id-type="pmid">12739757</pub-id>
</element-citation>
</ref>
<ref id="bib112"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zecca</surname>
<given-names>M</given-names>
</name>
<name><surname>Micera</surname>
<given-names>S</given-names>
</name>
<name><surname>Carrozza</surname>
<given-names>MC</given-names>
</name>
<name><surname>Dario</surname>
<given-names>P</given-names>
</name>
</person-group>
<year>2002</year>
<article-title>Control of multifunctional prosthetic hands by processing the electromyographic signal</article-title>
<source>Critical Reviews? in Biomedical Engineering</source>
<volume>30</volume>
<fpage>459</fpage>
<lpage>485</lpage>
<pub-id pub-id-type="doi">10.1615/CritRevBiomedEng.v30.i456.80</pub-id>
<pub-id pub-id-type="pmid">12739757</pub-id>
</element-citation>
</ref>
<ref id="bib113"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname>
<given-names>J</given-names>
</name>
<name><surname>Riehle</surname>
<given-names>A</given-names>
</name>
<name><surname>Requin</surname>
<given-names>J</given-names>
</name>
<name><surname>Kornblum</surname>
<given-names>S</given-names>
</name>
</person-group>
<year>1997</year>
<article-title>Dynamics of single neuron activity in monkey primary motor cortex related to sensorimotor transformation</article-title>
<source>The Journal of Neuroscience</source>
<volume>17</volume>
<fpage>2227</fpage>
<lpage>2246</lpage>
<pub-id pub-id-type="pmid">9045746</pub-id>
</element-citation>
</ref>
</ref-list>
<app-group><app id="app1"><title>Appendix: Impact of the number of channels on gesture discrimination from EMG data</title>
<boxed-text position="float" orientation="portrait"><sec id="s44" sec-type="appendix"><p>It could be hypothesized that the worse performance of the <italic>muscle synergy</italic>
model as compared to the alternative <italic>kinematic synergy</italic>
or <italic>individual digit</italic>
models could be related to its lower dimensionality (five muscles against 26 hand DoFs). Despite previous reports indicate that a reliable gesture discrimination can be achieved from seven (<xref rid="bib108" ref-type="bibr">Weiss and Flanders, 2004</xref>
) or fewer muscles (<xref rid="bib37" ref-type="bibr">Ganesh et al., 2007</xref>
; <xref rid="bib3" ref-type="bibr">Ahsan et al., 2011</xref>
), it is feasible to record a larger number of muscles using advanced EMG devices.</p>
<p>Hence, we verified the impact of the number of EMG channels on the <italic>muscle synergy</italic>
model in an independent sample of four healthy young subjects (4 M, age 34 ± 6) using the same experimental paradigm described in the Methods.</p>
<p>EMG data were acquired using a 16-channel Bagnoli 16 EMG recording device (Delsys Inc, Natick, MA, USA). Sixteen electrodes were placed on the hand and forearm using the same placement adopted in our protocol (see Materials and methods and <xref ref-type="fig" rid="fig1">Figure 1</xref>
below) as well as in two distinct protocols with different spatial resolutions (<xref rid="bib8" ref-type="bibr">Bitzer and van der Smagt, 2006</xref>
; <xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
). Six runs were acquired, each comprising twenty trials of delayed grasp-to-use motor acts towards visually-presented objects (see Materials and methods).<fig id="Afig1" orientation="portrait" position="anchor"><object-id pub-id-type="doi">10.7554/eLife.13420.019</object-id>
<label>Appendix figure 1.</label>
<caption><title>Placement of the sixteen electrodes on the right arm.</title>
<p>Four configurations were tested, either with five (1–5, see Materials and methods), ten (1–4, 6–8, 14–16, from <xref rid="bib8" ref-type="bibr">Bitzer and van der Smagt, 2006</xref>
), or fourteen channels (from <xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
).</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.019">http://dx.doi.org/10.7554/eLife.13420.019</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-app1-fig1"></graphic>
</fig>
</p>
<p>To estimate the impact of the number of EMG recording sites and the preprocessing methods, data were analyzed using two distinct procedures: a mean-based procedure (similarly to <xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
), and a feature-based procedure.</p>
<p>In the mean-based procedure, data from the sixteen EMG channels (acquired at 1000 Hz) were de-trended, rectified, and low-pass filtered (fourth-order Butterworth filter, 40 Hz). The time series from each gesture and channel were later averaged over a 2.5 s time window (2500 time points). From this preprocessing we obtained twenty 16x1 vectors for each run.</p>
<p>In the feature-based procedure, EMG signals were preprocessed and eighty-two features from each channel were extracted as described in the Methods section.</p>
<p>Subsequently, two procedures were developed to uncover the impact of different processing methods and EMG channel configurations. First, we generated all the possible configurations that could be obtained by choosing the channels randomly. Second, we selected three fixed configurations as subsamples of electrodes (displayed in <xref ref-type="fig" rid="fig1">Figure 1</xref>
), according to the Methods in this manuscript (electrodes 1-5) and previous reports that recorded ten (<xref rid="bib8" ref-type="bibr">Bitzer and van der Smagt, 2006</xref>
; electrodes 1-4, 6-8, 14-16), or fourteen channels (<xref rid="bib27" ref-type="bibr">Ejaz et al., 2015</xref>
; electrodes 1-14).</p>
<p>To allow comparisons across different channel configurations, the EMG matrix (i.e., the averaged EMG activity in the mean-based procedure and the extracted features in the feature-based procedure) was reduced to five dimensions using PCA. Then, both these procedures were assessed with a leave-one-out cross-validation algorithm based on the same rank accuracy measure described in the manuscript.</p>
<p>This additional experiment provides a measure of the quality of each channel configuration: the higher the accuracy, the more informative the configuration. The results are shown in <xref ref-type="fig" rid="fig2">Figure 2</xref>
as the average across combinations and subjects ± SEM. We tested all configurations that could be obtained by randomly selecting 5 to 16 electrodes (red and blue lines), as well as three fixed configurations according to the setups described above (orange and light blue dots). The red line represents the results using the mean-based procedure, while the blue line depicts the feature-based procedure. The orange and light blue dots represent the results of the three fixed configurations of channels in the two procedures.<fig id="Afig2" orientation="portrait" position="anchor"><object-id pub-id-type="doi">10.7554/eLife.13420.020</object-id>
<label>Appendix figure 2.</label>
<caption><title>Results of the rank accuracy procedure as a function of the number of EMG channels.</title>
<p>The red line shows the accuracy values for random configurations of 5 to 16 electrodes, using the mean-based preprocessing adopted by <xref rid="bib27" ref-type="bibr">Ejaz et al. (2015)</xref>
. The orange dots represent the accuracy values for three fixed configurations. The blue line shows the accuracy values for 5 to 16 channels using the feature-based preprocessing (see Materials and methods); the light blue dots show the accuracy for three fixed configurations. Values are reported as mean across subjects ± SEM (error bars and bands).</p>
<p><bold>DOI:</bold>
<ext-link ext-link-type="doi" xlink:href="10.7554/eLife.13420.020">http://dx.doi.org/10.7554/eLife.13420.020</ext-link>
</p>
</caption>
<graphic xlink:href="elife-13420-app1-fig2"></graphic>
</fig>
</p>
<p>The results show that, for the feature-based procedure, the accuracy increases as a function of the number of electrodes, reaching a peak with 16 channels (mean ± SEM: 81.6 ± 2%); the mean accuracy across all the possible configurations with five channels is 73.5 ± 2.5%. The accuracy obtained with the setup adopted in our current paper was 74.2 ± 6.4%. For the mean-based procedure described in <xref rid="bib27" ref-type="bibr">Ejaz et al. (2015)</xref>
, eleven channels yielded the highest accuracies among all the possible random configurations (value: 72.2 ± 3.2%); accuracy decreased when lower or higher numbers of electrodes were recorded. In these data, the accuracy for the configuration of five channels adopted in our paper was 69.5 ± 1.6%.</p>
<p>Overall, these results indicate that the extraction of features from the EMG signal proves to be a reliable procedure to a discriminate complex hand gestures. In addition, despite the fact that the feature-based approach seems to benefit from EMG recordings with more channels, the gain when raising the number of channel to 16 is low (5.5%). This result, along with the above-chance discrimination achieved when analyzing five channels clearly suggests that the number of muscles recorded in our paper represents the muscle space with a reasonable accuracy. Moreover, feature-based approaches are likely to be better descriptors of more complex gestures (as the ones considered in our study) with respect to the mean signal over time, as hypothesized and discussed in previous reports (<xref rid="bib52" ref-type="bibr">Hudgins et al., 1993</xref>
; <xref rid="bib112" ref-type="bibr">Zecca et al., 2002</xref>
).</p>
<p>In conclusion, the <italic>muscle synergy</italic>
model, even if based on many EMG channels, still underperforms relatively to the models obtained from kinematic data in encoding fMRI responses. For this reason, the worst performance of the <italic>muscle synergy</italic>
model is likely to represent an intrinsic limitation of surface EMG signals rather than a flaw of the recordings and analyses performed in our paper.</p>
</sec>
</boxed-text>
</app>
</app-group>
</back>
<sub-article id="SA1" article-type="article-commentary"><front-stub><article-id pub-id-type="doi">10.7554/eLife.13420.021</article-id>
<title-group><article-title>Decision letter</article-title>
</title-group>
<contrib-group><contrib contrib-type="editor"><name><surname>Culham</surname>
<given-names>Jody C</given-names>
</name>
<role>Reviewing editor</role>
<aff id="aff10"><institution>University of Western Ontario</institution>
,<country>Canada</country>
</aff>
</contrib>
</contrib-group>
</front-stub>
<body><boxed-text position="float" orientation="portrait"><p>In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.</p>
</boxed-text>
<p>[Editors’ note: a previous version of this study was rejected after peer review, but the authors submitted for reconsideration. The first decision letter after peer review is shown below.]</p>
<p>Thank you for submitting your work entitled "A synergy-based control is encoded in human motor cortical areas" for consideration by <italic>eLife</italic>
. Your article has been reviewed by three peer reviewers, and the evaluation has been overseen by Jody Culham as Reviewing Editor and Timothy Behrens as the Senior Editor. Our decision has been reached after consultation between the reviewers.</p>
<p>The following individuals involved in the review of your submission have agreed to reveal their identity: Joern Diedrichsen and Jason Gallivan (reviewers).</p>
<p>Based on these discussions and the individual reviews below, we regret to inform you that we are rejecting the manuscript. As it stands, the manuscript would require substantial revisions, including new data and analyses, to address reservations raised by the reviewers, particularly Reviewer #1. All three reviewers (like the editors in the initial evaluation) saw potential in the approach but their enthusiasm was tempered by a number of concerns. In post-review discussions, even Reviewers #2 and #3, who were largely positive, agreed that the manuscript should not be published unless the major concerns detailed below are addressed. Normally <italic>eLife</italic>
tries to avoid making authors go through a gauntlet of revisions if a positive final outcome is uncertain. As such, we are rejecting the current manuscript.</p>
<p>That said, we would be willing to consider a new manuscript that unequivocally addresses the concerns raised. In this case, we would aim to recruit the same reviewers. We must emphasize that, as with any new manuscript, there is no guarantee of publication, especially if you do not make the required changes or the new analyses do not support the conclusions. As such, you may decide instead to submit your manuscript to another journal, in which case we hope the reviewers' comments are helpful.</p>
<p>To be considered for publication in <italic>eLife</italic>
, the following changes would be essential (based on the specific reviewer comments detailed below):</p>
<p>1) The authors would need to test their synergy model against a more plausible "muscle model" based on better EMG recordings of more muscles (Reviewer #1, Point #1; though the other two reviewers were in close agreement during post-review discussion). Though the possibility of removing the muscle model from the paper was discussed, the consensus was that this would reduce the impact of the paper.</p>
<p>2) There was a clear consensus among all three reviewers and reviewing editor that the interpretation of principal components and their mapping needs to be unpacked better. One concern is that without any insight as to what the principal components represent, the demonstration that they show a topography is of limited value (Reviewer #2, first point). A second concern is whether the topography really reflects those components or would equally reflect components in other rotated versions of the space (Reviewer #1, Point #3). There may be some potential with the PCA data ameliorate some concerns at the initial review stage and from Reviewer #1 about whether the paper provides a sufficient advance beyond Ejaz et al. (2015). While Ejaz et al. limited their analyses to M1 and S1, the present manuscript shows potentially interesting patterns in other parietal and frontal regions. However, as it stands, the patterns and interpretation so vague that they do not provide any real insight into regional differences.</p>
<p>3) The authors need to clarify their discussion of their PCA-based methods against the RSA based method (as used both in their paper and in Ejaz et al. – see Reviewer #2's comment on RSA and Reviewer #1, Comment #2).</p>
<p>In addition, if the authors choose to resubmit the manuscript in a new form to <italic>eLife</italic>
, the other comments of the reviewers should be addressed. In post review discussion, all reviewers agreed with the suggestion that noise ceilings should be reported.</p>
<p>Reviewer #1:</p>
<p>The study "A synergy-based control is encoded in human motor cortical areas" provides an investigation of the MRI patterns associated with the execution of grasp-like hand shapes. The main finding is that the activity patterns of two left –out postures can be better discriminated when using 5 regressors extracted from kinematic synergies than 5 regressors reflecting the unsigned displacement of individual fingers or 5 regressors picked from features of EMG recording of 5 different hand muscles. The conclusion of the study are largely overlapping with that of an earlier paper from our lab (Ejaz et al., 2015), but the study adds a number of interesting extra aspects to this line of work, including testing the generalisation of the model to new postures and the investigation of the spatial arrangement of these synergies onto the cortical sheet (but see point 3). The current version of the paper, however, has a number of weaknesses that certainly would need addressing.</p>
<p>1) The alternative models (individual fingers and muscle) give the appearance of straw men. The individual finger uses the L1 norm of movement of each finger – so in contrast to the kinematic synergy model, it does not distinguish between finger flexion and finger extension. This decision appears to be somewhat arbitrary. So, it leaves the reader with the question of whether there is something special about taking the absolute value, or about the specific rotation of these 5 factors in representational space. A more convincing line of investigation would be to try to use optimisation to rotated the 5 linear factors in the kinematic space as to get the best possible decoding performance, and then test the closeness of this solution with the one provided by the kinematic synergy model.</p>
<p>Matters are worse with the muscle model. The authors recorded 5 muscles only, despite the fact that in our experience it is feasible to get 14 or more distinct signals from hand muscles from surface electrodes (Ejaz et al., 2015). These may not always reflect individual muscles, but that is hardly important if we only want to obtain a representative picture of the space of muscle activity. The extracted features from the EMG signals appear obscure to me; and ultimately, the ability to distinguish between postures based on this data is very bad, indicating that most of these numbers reflect noise. Given these large a-priori differences in the quality of the models, I think any subsequent difference in how well fMRI activity patterns can be predicted become utterly unconvincing. So I think the authors need to work harder on trying to equate the reliability of their models (for a possible method, see Ejaz et al. (2015), supplementary methods).</p>
<p>2) While I think that some of the techniques used in the paper are interesting and promising, I believe that they are currently not going beyond the RSA analysis presented in Ejaz et al. Unfortunately, in the discussion the authors misconstrue the previous evidence and perpetuate some misunderstandings that are all too common in the synergy field. For example the authors state that "these findings, however, provide no clue regarding the extent to which the brain may control the hand using functional modules" and "their model (hand usage model) was therefore similar to the individual digit model adopted in the present study", showing that they clearly do not appreciate the tight connection between RSA and the methods chosen here.</p>
<p>It is important to point out that the matrix of pairwise distances contains the same information as the covariance matrix between experimental conditions (and can easily be transformed into it). Extracting PCA factors from this covariance matrix provides a distribution of the same statistical quantity, only that it throws away a certain proportion of the information (and by just considering the principle vectors also disregards the relative importance of the factors). Therefore RSA and extraction of principal components from the covariance reflect highly related information – and I do not think that the authors have made any convincing case that anything can be learned from the PCA approach that cannot be learned from looking at the whole space. This boils down to the key question in the synergy field of whether there is something special about the principal vectors (or synergies) themselves, or just about the representational space they describe. With the current evidence, the difference between this paper and Ejaz et al. is purely superficial and methodological, but not conceptual.</p>
<p>Similarly, our hand use model is not equivalent to the individual finger model used in this paper, but is much closer to the kinematic synergy model (we present a single-finger model in the multi-finger experiment, which is much inferior to the natural statistics model). The authors choose to extract synergies by taking 20 postures that serve as ad-hoc samples of the natural statistics of movement. In our paper we chose to use data sets that are representative samples of the natural statistics of movement. Furthermore, we use the whole covariance matrix of the data to compare to the brain activity patterns, not just the first 5 factors.</p>
<p>Indeed, in the analysis of the multi-finger experiment in that paper, we started with very similar methods employed by the authors here, but ultimately decided to present only the RSA methods, as we believe that they show the main point of the similarity of representational space more concisely, than the extraction of some arbitrary number of main factors, which then serve as descriptors of the same space.</p>
<p>3) The mapping of synergies on the cortical sheet is an interesting addition and provides a real potential argument that the kinematic synergies are more that statistical descriptors of representation space, but that the factors themselves have special status. The problem, however, is that currently the one single mapping is not evaluated against many other possible mappings. Thus the authors have not shown that there is something special about the synergies extracted. For this, one would need to a) develop a measure of the "topological orderliness" of the mapping and b) compare the synergy map systematically against an exhaustive set of alternative rotations in the same space (again using optimisation). We actually attempted this analysis on our multi-finger experiment, but preliminary results were not terribly encouraging, as there seem to be rotations of these factors in the same rotational space which gave similarly orderly mappings. If the authors could show in a stringent and convincing fashion that the particular rotation chosen here is more orderly organised than any other possible rotation in the 3-dimensional space (or even conclude after careful evaluation that this is not the case), I think the paper would really increase in quality. Without such analysis <xref ref-type="fig" rid="fig2">Figure 2</xref>
remains merely suggestive and anecdotal and the claims not substantiated.</p>
<p>Reviewer #2:</p>
<p>This is excellent work. The study is well thought-out and executed, the paper is clearly written and the analyses are rigorous and appear to have been conducted with care. I suspect that the experimental question asked and results obtained will be of general interest to the sensorimotor research community and the authors do a good job of integrating and motivating their study based on what is currently known.</p>
<p>While I do not have any significant concerns about the work, there are a few points, summarized below, that I think should be considered in a revision.</p>
<p>1) Given the data-driven nature of the analyses used, I found some interpretation of the top 3 principal components, and their relation to the topography noted, lacking. Ultimately the insight provided by PCA in neurophysiology rests on being able to directly link the components to neural activity. While I agree that there is some general map of the components in sensorimotor cortex, their organization has no interpretation. Some interpretation of the components (PCs 1-3) and how they relate to cortex organization might be informative on this front. Otherwise, simply saying PCs are mapped onto cortex is fairly impenetrable for the reader.</p>
<p>2) I found the intermixing of results material into the Discussion section a bit disruptive (e.g., inclusion of <xref ref-type="fig" rid="fig5">Figure 5</xref>
and visual control analyses). I think that results material should be described and motivated in the Results section.</p>
<p>3) It was unclear to me why, after measuring from five muscles, and thus obtaining five measures (i.e., the same number of components in the synergy and individual digit models), the data was reduced through PCA and then up-sampled again (through cross-validation methods) to achieve 5 components. This should be fully explained, as no such manipulation was done to the individual digit data.</p>
<p>4) It might be interesting in the supplement to show the results of RSA/MDS for the other models (EMG and individual digit), allowing the reader to make comparisons between all 3 models.</p>
<p>5) I was initially confused in the Discussion why the authors referred to brain areas that were not apparent in the group maps shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>
(e.g., ventral premotor cortex). This became apparent, however, after I viewed the actual source data on the MNI-152 brain, as 2-3 subjects show overlap in some of these areas. In any case, the authors should only use the text to refer to what is actually shown in the paper, to avoid such confusion.</p>
<p>6) In the Discussion, I was hoping for some discussion of the bilaterality of the effects observed, which are interesting. I would suggest adding this in a revision.</p>
<p>7) In addition to the visual control used in the paper (i.e., analysis of visual stimulation evoked time points in the RSA mask), I was thinking that an equally good control to show the selectivity of effects to sensorimotor cortex would be to localize much of visual cortex (e.g., based on visual stimulation response vs. rest) and then perform the exact same encoding analyses on those voxels. Visual cortex is well known to be involved in imagery-a key component of the experimental task-and to see how the kinematic models performs in that area would be of interest. If it does fairly well, it would have some significant bearing on what is actually being measured in sensorimotor cortex as well as its underlying organization.</p>
<p>Reviewer #3:</p>
<p>This study investigates whether and to what extent kinematics or muscle synergies are represented in the human motor system during grasping toward virtual objects. To this aim, authors measured hand kinematics and electromiography (EMG) signals and used these information to create a kinematic synergy model, an individual-digit model and a muscle synergy model. By computing correlations between each of these models and brain activity during grasping of virtual objects, they found that the kinematic synergy model explained better the fMRI data than the other models in various motor areas. The authors concluded that the control of hand postures in the brain is based on kinematics synergies.</p>
<p>This study addressed a very interesting question in the motor control field by using the state of the art fMRI analyses and combining various measurements like kinematics, EMG and fMRI data. I find the results and the conclusions of this study highly relevant for the understanding of the motor control system and for the advance of neuroprosthetics.</p>
<p>[Editors’ note: what now follows is the decision letter after the authors submitted for further consideration.]</p>
<p>Thank you for resubmitting your work entitled "A synergy-based control is encoded in human motor cortical areas" for further consideration at <italic>eLife</italic>
. Your revised article has been favorably evaluated by Timothy Behrens (Senior editor), Reviewing editor Jody Culham, and by Joern Diedrichsen, one of the original reviewers.</p>
<p>The external reviewer has devoted a considerable amount of time to re-examining the revision and has had detailed conversations with the editors to make the point clear. We are now at the following position: Two of the original reviewers thought the manuscript was strong and we believe all of their concerns have been addressed. We also think the new manuscript is improved and remains of substantial interest but have several remaining concerns (see list below). Out of these concerns there is one point that is really essential and has a major impact on the interpretation of the study. Let us be clear, we think the manuscript is of interest and we intend to publish it, but we do not think that your current analyses support that claim that the synergies reflect actual cortical codes. The figure where you try to make this point (<xref ref-type="fig" rid="fig2">Figure 2</xref>
) is not subjected to the correct tests to make this point (as you concede in your response to Reviewer 1, point 3 in your response).</p>
<p><italic>eLife</italic>
tries not to subject authors to endless rounds of revision, but we would like to give you one more opportunity to revise the paper to take into account the new comments. Essentially we are asking you to either (a) to perform a proper analysis which shows that the synergies do a better job of representing the cortical patterns than other rotations of the covariance space, or (b) to be clear in the manuscript that this claim is not supported and that the claim that you can support is that there covariance space as a whole is well-represented.</p>
<p>There is also confusion as to how to interpret the text around this critical analysis, which you describe is "Resistant" to rotations in the covariance space. It is clear that the analysis is not invariant to such rotations as described in point 11 below. When we read the text surrounding this description, we read the exact opposite interpretation from each other. One of us thought you were saying the R<sup>2</sup>
value was invariant to rotations and therefore resistant. Another thought you were saying that the R<sup>2</sup>
value was NOT invariant, and therefore the overall analysis was resistant. The R<sup>2</sup>
values change with rotations, and it is important that manuscript is clear about this. However, it is also clear that this point is not sufficient to demonstrate that the particular eignenvectors that you arrive at via the PCA are the ones that are encoded topologically in cortex. To make this point, you would need to compare them to other rotations of covariance space as described above, and in the previous review.</p>
<p>For clarity for a broad readership, if indeed you can show that the three principal components are better than other rotations, the Reviewing Editor thought that some of your wording in the reply to reviewers would be helpful to include in the manuscript itself ("However, a remarkable body of literature indicate that the highest-ranked kinematic PCs correspond to strictly coded grasping primitives (Santello et al., 1998; Gentner and Classen, 2006; Ingram et al., 2008; Thakur et al., 2008; Gentner et al., 2010; Overduin et al., 2012), see Santello et al., 2013 for review). […] In our study, we examined the first two PCs, which were highly consistent with the literature, along with a third one representing a movement of flexion and thumb opposition (as to grasp a dish or a platter)."</p>
<p>Reviewer #1:</p>
<p>Upon reading the revision, I think the authors have addressed some points raised in the original critique, whereas in other areas I found the response and the changes to the manuscript not satisfactory. This may be partly due to a strong philosophical difference regarding what synergies are and how to interpret the evidence – where I seem to fundamentally disagree with the authors. But I agree that the paper provides an interesting additional and alternative viewpoint to Ejaz et al. (2015) – so I do not want to stay in the way and would recommend publication after a number of clarifications and corrections have been made.</p>
<p>Overall I still found the methods and analysis presented in the paper still somewhat obscure and relatively hard to follow. In interest of clarity and transparency, I would therefore urge the authors to clarify the remaining points in the manuscript. It is the policy of <italic>eLife</italic>
to not restrict length or supplimentary materials to allow the presentation of self-contained papers, and the authors should really try to be as clear as possible.</p>
<p>1) "Individual-digit model, based on a somatotopic criterion (Kirsch et al. 2014)" remains still as obscure as it was before. I urge you to clarify here in the Introduction. There is no notion of somatotopy in the individual-digit model as far as I can see. Somatotopy implies that it matters that the middle finger is closer to the ring than to the pinkie finger. The Individual-finger model treats all finger movements equally and independently – so it is not "somatotopic".</p>
<p>2) Results section, first paragraph: I found the analysis provided on the additional 4 subjects interesting and thank you for the additional clarification, but would ask you for two things: a) When using temporal averaging of the EMG signal (mean-based EMG analysis), you should use your dimensionality reduction to 5 PCA, as you did for the feature based analysis. This way we can clearly see that your temporal features, and not the dimensionality reduction provide the critical difference between the red and blue curve. Note also that you did not replicate exactly the analysis performed in Ejaz et al. (2011), as you skipped the critical prewhitening step. It is not clear whether this analysis would be sensible here, as your gestures are a ad-hoc sample from the natural statistics, not an equally-spaced sample of possible finger movements b) this analysis should be included as supplementary material and cited from the main text.</p>
<p>3) Supplementary file 15: I think the table should be supplemented by a one-sentence description for each feature that is detailed enough to be able to calculate these features without going onto a wild-goose chase in the cited papers. I urge the authors to start with a clear definition of symbols and then give a concise and unambiguous formula.</p>
<p>4) Section “A challenge to individual digit correction representations? The functional topography of hand synergies”: I find this section on functional topography overstated and do believe it requires a major change in tone. Your data shows that there is "some" topological organization of the first three synergies, not a "strict" one. Furthermore, some somatotopic clustering can also be shown for individual fingers or – most like for other rotations of the synergy vectors, and you have not provided a quantitative comparison with other possible organizations (see point 11).</p>
<p>5) Section “Limitations and methodological considerations”: The limitation section discusses relatively minor points. Two important weakness should be added: a) the point that while some clustered representation was shown in sensory-motor regions, you did not convincingly show that this specific set of synergies is more clustered than other rotation of the same vectors b) that in comparing the different models, the EMG-model had much less ability to discriminate different gestures and that the disadvantage of the muscle model may simply reflect noise levels on your measurement. These are important limitations that should be pointed out.</p>
<p>6) Paragraph two, “Models validation”: Please clarify in the text how the labels of the test set where shuffled. Specifically, if your test set contained 4 repetitions of each of the 20 gestures, did you shuffle the labels of all 80 trials completely randomly, or did you keep the 4 trials for the same gesture together and just give them together a new label (or equivalently shuffle the labels after averaging over the 4 trials)? This difference has important consequences for the variance of your reshuffling statistics.</p>
<p>7) “Every voxel had a score ranging from 0 (if the voxel was never used) to a possible maximum of 380 (if the two left-out patterns could be predicted, for that voxel, in all the 190 iterations).” Please explain this statement better. Do you mean to say the score was the number of times the voxel was included in the 1000 voxels AND got a specific gesture correct?</p>
<p>8) Section “Assessment of the accuracy of the encoding analysis”: Please clearly point out in the text that the weights were randomly shuffled within each column. Please also point out explicitly (I assume that this is true) that the new "PCA"s were now not orthogonal to each other anymore.</p>
<p>9) Now that I think that I understand what the single subject maps are, I think the group-level maps also needs some more explanation. The score for each voxel varied between 0 and 380 (as stated above). For each subject, which value was then considered as "successful"? Why was it called a "probability map"? Probability of what?</p>
<p>10) Section “Cortial mapping of the three group synergies”: I disagree that using R<sup>2</sup>
as a goodness of fit for each individual synergy makes the results invariant to rotations in synergy space. It does not. Maybe we fundamentally misunderstand each other, so I will make my point more concrete. Say, you have 2 "synergies" of 5 elements X1 and X2 and a 5-element data series Y.</p>
<p>x1=[-2 -1 0 1 2]';x2=[1 0 -2 0 1]';</p>
<p>Y=[-2 -2 1 2 2]';</p>
<p>Then the R2-values of each of the columns of X can be calculated as</p>
<p>R2_1 = Y'*x1*inv(x1'*x1)*x1'*Y/(Y'*Y) = 0.847</p>
<p>R2_2 = Y'*x2*inv(x2'*x2)*x2'*Y/(Y'*Y) = 0.039</p>
<p>Now I rotate</p>
<p>R=[cos(0.9) sin(0.9);-sin(0.9) cos(0.9)];</p>
<p>Z=[x1 x2]*R;z1 = Z(:,1);z2 = Z(:,2);</p>
<p>Now the individual R<sup>2</sup>
-values are changed, and hence a mapwise evaluation criterion would also be changed.</p>
<p>R2_1 = Y'*z1*inv(z1'*z1)*z1'*Y/(Y'*Y) = 0.6351</p>
<p>R2_2 = Y'*z2*inv(z2'*z2)*z2'*Y/(Y'*Y) = 0.4629</p>
<p>I hope that clarifies my point and why I think a) the sentence stating that individual R<sup>2</sup>
values are rotation invariant should be removed and b) any claims regarding a special organisation on the cortex should be made weaker – for stronger claims you would need to compare the C-metric (which I think would fit this purpose) across many different rotations of the same vectors or ways of picking encoding vectors from the 20-dimensional space.</p>
</body>
</sub-article>
<sub-article id="SA2" article-type="reply"><front-stub><article-id pub-id-type="doi">10.7554/eLife.13420.022</article-id>
<title-group><article-title>Author response</article-title>
</title-group>
</front-stub>
<body><p>[Editors’ note: the author responses to the first round of peer review follow.]</p>
<p><italic>In addition, if the authors choose to resubmit the manuscript in a new form to eLife, the other comments of the reviewers should be addressed. In post review discussion, all reviewers agreed with the suggestion that noise ceilings should be reported</italic>
.</p>
<p><italic>Reviewer #1:</italic>
</p>
<p><italic>The study "A synergy-based control is encoded in human motor cortical areas" provides an investigation of the MRI patterns associated with the execution of grasp-like hand shapes. The main finding is that the activity patterns of two left -out postures can be better discriminated when using 5 regressors extracted from kinematic synergies than 5 regressors reflecting the unsigned displacement of individual fingers or 5 regressors picked from features of EMG recording of 5 different hand muscles. The conclusion of the study are largely overlapping with that of an earlier paper from our lab (Ejaz</italic>
et al.<italic>, 2015), but the study adds a number of interesting extra aspects to this line of work, including testing the generalisation of the model to new postures and the investigation of the spatial arrangement of these synergies onto the cortical sheet (but see point 3). The current version of the paper, however, has a number of weaknesses that certainly would need addressing.</italic>
</p>
<p><italic>1) The alternative models (individual fingers and muscle) give the appearance of straw men. The individual finger uses the L1 norm of movement of each finger</italic>
– <italic>so in contrast to the kinematic synergy model, it does not distinguish between finger flexion and finger extension. This decision appears to be somewhat arbitrary. So, it leaves the reader with the question of whether there is something special about taking the absolute value, or about the specific rotation of these 5 factors in representational space. A more convincing line of investigation would be to try to use optimisation to rotated the 5 linear factors in the kinematic space as to get the best possible decoding performance, and then test the closeness of this solution with the one provided by the kinematic synergy model.</italic>
</p>
<p>The Reviewer is absolutely correct in stating that finger flexion and extension fully deserve to be kept as distinct as possible. As a matter of fact, our <italic>individual digit</italic>
model was actually obtained by summing the individual joint angles for each digit, though in the description in the text we erroneously reported that it was the L<sub>1</sub>
-norm of each digit. Consequently, our original individual digit model already distinguished positive and negative joint angles (with respect to the resting posture), thus preserving the difference between flexion and extension. We apologize for this erroneously reported piece of information.</p>
<p><italic>Matters are worse with the muscle model. The authors recorded 5 muscles only, despite the fact that in our experience it is feasible to get 14 or more distinct signals from hand muscles from surface electrodes (Ejaz</italic>
et al.<italic>, 2015). These may not always reflect individual muscles, but that is hardly important if we only want to obtain a representative picture of the space of muscle activity.</italic>
</p>
<p>Previous reports indicate that a reliable gesture discrimination can be achieved from seven (Weiss & Flanders, 2004; Shyu et al., 2002) or fewer muscles (Ganesh et al., 2007; Ahsan et al., 2011) and that, since EMG data are notoriously prone to artifacts such as cross-talk or amplitude cancellation (i.e., the masking of small or deep muscles by bigger or superficial ones), it is fairly important to place the electrodes as close as possible to individual muscles. In our study, both the number of recorded muscles and the analyses performed were able to guarantee a reliable discrimination between gestures, as indicated by the rank accuracy measure, which was well above the chance level for each subject (<xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1M</xref>
and <xref ref-type="fig" rid="fig6">Figure 6</xref>
).</p>
<p>In most advanced EMG devices, the number of acquisition sites on the forearm can raise dramatically up to 128 or 192 (Gazzoni et al., 2014; Muceli et al., 2014). However, due to the above mentioned cross-talk, the effect of the potential benefit that could derive from an increased number of EMG electrodes is still much debated: indeed multi-channel setups show a high collinearity, since many channels inevitably record the same muscles. As a matter of fact, a recent work that directly compared multiple channel setups – using either 6, 8, 16 or 192 channels – and extracted five synergies, found no significant differences among the 6, 16, 128 or 192 channel configurations (Muceli et al., 2014).</p>
<p>Nevertheless, in order to explore directly the Reviewer’s critique, we tested an independent sample of four healthy young subjects who performed the very same task used in our current paper to verify the impact of the number of EMG channels on the ‘muscle’ model. To this aim, for each subject we acquired six runs, each comprising twenty trials of delayed grasp-to-use motor acts towards visually-presented objects. Data were acquired using a Bagnoli 16 EMG recording device (Delsys Inc, Natick, MA, USA). Sixteen electrodes were placed on the hand and forearm using the same placement adopted in our protocol (see revised Methods and Appendix figure 1) as well as in three distinct protocols with different spatial resolutions (Bitzer and van der Smagt, 2006; Ganesh et al., 2007; Ejaz et al., 2015).</p>
<p>To obtain an overall estimation of the impact of the number of EMG recording sites and different preprocessing steps, data were analyzed using two distinct procedures: the first suggested by the Reviewer (Ejaz et al., 2015), and the other one based on feature extraction, as described in our Methods. Both preprocessing procedures were assessed with a leave-one-out cross-validation algorithm.</p>
<p>Using the first procedure (Ejaz et al., 2015), data from the sixteen EMG channels (acquired at 1,000 Hz) were de-trended, rectified, and low-pass filtered (fourth-order Butterworth filter, 40 Hz). The time series from each gesture and channel were later averaged over a 2.5 seconds time window (2,500 time points). We obtained twenty 16x1 vectors for each run. Then, we tested the discriminability of each individual movement (<italic>probe</italic>
element) from each run against all the movement vectors averaged across the five remaining runs (<italic>rest</italic>
dataset). This was performed with a leave-one-out rank accuracy procedure (Mitchell et al., 2004) in which the similarity between the <italic>probe</italic>
element and all the vectors in the <italic>rest</italic>
dataset were compared using the Mahalanobis distance. If the distance between the <italic>probe</italic>
element and the vector from the <italic>rest</italic>
dataset, which represents the same gesture, is lower than the distances between the <italic>probe</italic>
vector and the other elements of the <italic>rest</italic>
dataset, one may state that the element can be discriminated. The accuracies were tested against null distributions of 10,000 values, generated shuffling the labels in the <italic>rest</italic>
dataset. This rank accuracy procedure provides a measure of the quality of each individual channel configuration: the higher the accuracy, the more informative the configuration. Since we wanted to estimate the discriminability as a function of the number of channels, we performed two tests, whose results are shown in Appendix figure 2.</p>
<p>First, we generated all the possible configurations that could be obtained by choosing the channels randomly. The rank accuracy procedure was performed for each of these channel configurations. The result of this procedure is shown in Appendix figure 2 (red line).</p>
<p>Second, we selected four subsamples of electrodes (displayed in Appendix figure 1; electrodes 1-4, 6-8, 14-16), or fourteen channels (Ejaz et al., 2015; electrodes 1-14). Results for each configuration, averaged across subjects, are represented by the orange dots in Appendix figure 2.</p>
<p>In the feature-based procedure, we computed, for each trial, eighty-two features from each channel, as described in the Methods section of our manuscript. Each individual gesture was then described as a combination of five PCs (muscle synergies), extracted from the features pooled across channels. Subsequently, a machine learning procedure based on a rank accuracy measure was employed to test to what extent the gestures could be discriminated based on the five muscle synergies (see Methods). As done with the procedure previously described, we tested all configurations that could be obtained by randomly selecting 1 to 16 electrodes (Appendix figure 2, blue line), as well as four subsamples according to the setups described above (Appendix figure 2, light blue dots).</p>
<p>The results show that, for the feature-based procedure, the accuracy increases as a function of the number of electrodes, reaching a peak with 16 channels (mean ± SEM: 81.6 ± 2%); the mean accuracy across all the possible configurations with five channels is 73.5 ± 2.5%. The accuracy obtained with the setup adopted in our current paper was 74.2 ± 6.4%, while the electrode placement described in Ejaz et al. (2015) led to an accuracy value of 79.8 ± 2.4%. For the procedure described in Ejaz et al. (2015), five channels yielded the highest accuracies among all the possible random configurations (value: 65.9 ± 2.1%); accuracy decreased when lower or higher numbers of electrodes were recorded. In these data, the accuracy for the configuration of five channels adopted in our paper was 69 ± 1.6%, higher than the one adopted in Ejaz et al. (59.6 ± 2.4%).</p>
<p>In summary, these results indicate that:</p>
<p>1) The extraction of features from the EMG signal obtained using the methodological approach adopted in our paper leads to a better discrimination of complex hand gestures</p>
<p>2) While the feature-based approach seems to benefit from EMG recordings with more channels, the low gain (5.5%) when raising the number of channel to 16, as well as the above-chance discrimination achieved when analyzing five channels clearly suggests that the number of muscles recorded in our paper represents the muscle space with a reasonable accuracy.</p>
<p>3) The results from the electrode placement adopted by Ejaz et al. (2015) show a lower accuracy, despite its higher dimensionality. A possible explanation for this finding may be related to the different experimental designs: when more complex gestures are considered (as in our design), data are probably more prone to electrode shifts or amplitude cancellation artifacts, whose impact increases with the number of electrodes in the EMG acquisition setup. Moreover, the better results achieved by using the feature-based approach, as compared to the procedure suggested by the Reviewer, may indicate that feature extraction represent a better technique for exploiting the advantages of EMG setups with higher spatial resolution, consistent with the data already present in the literature (Hudgins et al., 1993; Zecca et al., 2002).</p>
<p>Despite the better discrimination accuracy obtained with the feature-based procedure using a higher number of channels, we found that the accuracy values using a ‘muscle’ model based on many EMG channels still underperforms relatively to the models obtained from kinematic data in encoding fMRI responses. Therefore, we conclude that the worst performance of the ‘muscle model' is likely to represent an intrinsic limitation of surface EMG signals rather than a flaw of the recordings and analyses performed in our paper. For the reasons detailed below (Point 1c), we would expect that even high-density EMG data may not guarantee a better fit to brain signals than electrode configurations with a lower dimensionality.</p>
<p><italic>The extracted features from the EMG signals appear obscure to me; and ultimately, the ability to distinguish between postures based on this data is very bad, indicating that most of these numbers reflect noise. Given these large a-priori differences in the quality of the models, I think any subsequent difference in how well fMRI activity patterns can be predicted become utterly unconvincing. So I think the authors need to work harder on trying to equate the reliability of their models (for a possible method, see Ejaz</italic>
et al. <italic>2015, supplementary methods).</italic>
</p>
<p>EMG data are complex signals, as they represent indirectly the activity of one or more underlying muscles (Farina et al., 2004; Reaz et al., 2006; Farina et al., 2014). However, a well-consolidated assumption is that the instantaneous value of the EMG signal contains little or no information (Zecca et al., 2002). In addition, during complex movements the temporal structure of the EMG signal varies to a great deal. This makes the most elementary frequency or amplitude-based parameters (e.g. mean absolute value, median frequency) not sufficient for the classification of complex movements: an accurate classification may instead benefit very much from a greater number of signal descriptors (Hudgins et al., 1993). For this reason, the extraction of time-domain or frequency domain features is widely applied when EMG signals are used to classify distinct hand gestures.</p>
<p>Consequently, the most commonly adopted approach relies on the extraction of a wide number of features, which are later analyzed through classification algorithms or neural networks for posture discrimination (Zardoshti-Kermani et al., 1995; Ahsan et al., 2011; Chowdhury et al., 2013). The features chosen in our study are commonly employed for classifying gestures from EMG recordings of hand muscles (for instance, see Zecca et al., 2002; Boostani and Moradi, 2003; Tkach et al., 2010; Kendell et al., 2012; Chowdhury et al., 2013). The matrix containing those features was subsequently reduced in dimensionality, retaining only the most relevant five components, which accounted for 72.64% of the variance (mean across subjects). In addition, the rank accuracy measure showed that the twenty gestures could be successfully discriminated by EMG data in all the subjects (average accuracy value across subjects: 72%; individual subject data are reported in Supplementary File 16).</p>
<p>Nonetheless, even if feature extraction is widely used, we followed the Reviewer’s suggestion and adopted the elegant RSA-based procedure performed by Ejaz and colleagues (Ejaz et al., 2015, Supplementary Methods). EMG signals from our five-channels setup were resampled at 1,000 Hz, de-trended, rectified and low-pass filtered with a fourth-order Butterworth filter at 40 Hz. The time series from each gesture and channel were later averaged over a 2.5 seconds time window (2,500 time points). As a result, we described each gesture using a 5x1 vector. A representational space (RS) was then obtained from the pairwise comparisons of all gestures, performed using the Mahalanobis distance. That RS turned out to be highly similar to our muscle model (Pearson’s <italic>r</italic>
: 0.78, <italic>p</italic>
<0.0001). This suggests that feature extraction is able to provide a reliable description of the muscle space and that a different data analysis would not have had a significant impact on the model we derived from EMG data.</p>
<p>We believe that two additional details should be pointed out. First, we described our EMG signals using a high number of features, subsequently reduced to the five most relevant dimensions with PCA. Ejaz et al., (2015) described the EMG signal for each movement exclusively through its average over time. While this is certainly suited for simpler single or multi-digit movements as the ones examined in their study, many pieces of evidence in the literature indicate that complex hand actions, including grasping movements, require a more detailed description (Hudgins & Parker, 1993; see Zecca et al., 2002 for review). Second, an analysis limited to a descriptive RSA-based approach would not have allowed us to perform the rank accuracy procedures to evaluate the discrimination of individual postures from the EMG data, which was an important and innovative aim of our study.</p>
<p><italic>2) While I think that some of the techniques used in the paper are interesting and promising, I believe that they are currently not going beyond the RSA analysis presented in Ejaz</italic>
et al. <italic>Unfortunately, in the discussion the authors misconstrue the previous evidence and perpetuate some misunderstandings that are all too common in the synergy field. For example the authors state that "these findings, however, provide no clue regarding the extent to which the brain may control the hand using functional modules" and "their model (hand usage model) was therefore similar to the individual digit model adopted in the present study", showing that they clearly do not appreciate the tight connection between RSA and the methods chosen here.</italic>
</p>
<p><italic>It is important to point out that the matrix of pairwise distances contains the same information as the covariance matrix between experimental conditions (and can easily be transformed into it). Extracting PCA factors from this covariance matrix provides a distribution of the same statistical quantity, only that it throws away a certain proportion of the information (and by just considering the principle vectors also disregards the relative importance of the factors). Therefore RSA and extraction of principal components from the covariance reflect highly related information – and I do not think that the authors have made any convincing case that anything can be learned from the PCA approach that cannot be learned from looking at the whole space. This boils down to the key question in the synergy field of whether there is something special about the principal vectors (or synergies) themselves, or just about the representational space they describe. With the current evidence, the difference between this paper and Ejaz</italic>
et al. <italic>is purely superficial and methodological, but not conceptual.</italic>
</p>
<p>The main finding of our paper is that synergies can be encoded as such in the human brain, and that they may represent functional modules through which the brain controls the hand to achieve a wide variety of flexible and stable postures. The extraction of Principal Components from the covariance matrix is therefore a cornerstone of our current work, since we were interested in demonstrating that a model based on synergies (or kinematic PCs) can predict brain activity in motor areas.</p>
<p>The Reviewer is right in pointing out that “<italic>the matrix of pairwise distances contains the same information as the covariance matrix between experimental conditions (and can easily be transformed into it)</italic>
” and that “<italic>RSA and extraction of principal components from the covariance reflect highly related information</italic>
”. The high fraction of variance explained by the <italic>kinematic synergy</italic>
model reflects a high degree of similarity between the whole space and its five principal dimensions. However, we can hardly see this as a limitation of our approach. On the contrary, we observed that a small number of PCs can describe complex postural configurations losing only a little portion of information, in line with a large body of literature (e.g., Santello et al., 1998, 2002; Gentner and Classen, 2006; Ingram et al., 2008; Thakur et al., 2008; Overduin et al., 2012). For this reason, the high similarity between the whole space and its PCs represents a <italic>success</italic>
of the dimensionality reduction procedure and a full validation of the reliability of synergies as descriptions of complex hand postures.</p>
<p>According to the synergy hypothesis, the kinematic Principal Components reflect clearly defined motor primitives and they are not simply quantitative descriptors of hand posture (Santello et al., 1998; Gentner and Classen, 2006; Ingram et al., 2008; Thakur et al., 2008). Following the suggestions made by the other Reviewers as well (see Reviewer #2, Comment #1 and Reviewer #3, Comment #3), we have shown that the first PCs represent elementary grasps (see response below, Methods and <xref ref-type="other" rid="media1">Video 1</xref>
). A direct link between kinematic PCs and motor primitives raises questions about whether hand postures are encoded in the brain as combinations of those elementary grasps, thus confirming modularity principles. To verify this hypothesis, our encoding analyses were purposely designed to predict brain activity as a function of kinematic synergies. In addition, the subsequent decoding procedure tested the reliability of synergies as models to decode hand postures from brain activity.</p>
<p>To conclude, we do appreciate the high quality of the analyses and the innovative results reported in the elegant study by Ejaz et al. (2015). As a matter of fact, we are convinced that our paper complements – rather than simply overlaps with – the findings by the Ejaz et al. (2015) study. Specifically, the complementary nature of our paper is due to significant differences between the objectives of the study by Ejaz et al. (2015) – aimed mainly at providing reliable descriptions of kinematic, muscle and brain activity spaces through RSA – and our work, aimed instead at assessing modularity in hand posture control using machine-learning procedures. Thus, our findings do possess a conceptual novelty as compared to the Ejaz et al. (2015) study.</p>
<p><italic>Similarly, our hand use model is not equivalent to the individual finger model used in this paper, but is much closer to the kinematic synergy model (we present a single-finger model in the multi-finger experiment, which is much inferior to the natural statistics model). The authors choose to extract synergies by taking 20 postures that serve as ad-hoc samples of the natural statistics of movement. In our paper we chose to use data sets that are representative samples of the natural statistics of movement. Furthermore, we use the whole covariance matrix of the data to compare to the brain activity patterns, not just the first 5 factors.</italic>
</p>
<p><italic>Indeed, in the analysis of the multi-finger experiment in that paper, we started with very similar methods employed by the authors here, but ultimately decided to present only the RSA methods, as we believe that they show the main point of the similarity of representational space more concisely, than the extraction of some arbitrary number of main factors, which then serve as descriptors of the same space.</italic>
</p>
<p>We agree with the Reviewer on this point: for descriptive purposes, considering the whole space has surely many benefits. In addition, RSA methods are seemingly more robust, as they allow to compare the postural or functional models and to take into account all the data without performing any reduction.</p>
<p>Nonetheless, as already stated above, we should point out that our paper has a different objective and a different approach. Specifically, we aim at showing that the first PCs of the posture space, in addition to being valid descriptors of that space, do actually modulate brain activity within motor areas, and thus they represent useful modules that can be exploited for prosthetic control and Brain Computer Interface (BCI) applications.</p>
<p>All the Reviewers raised the issue regarding the interpretation of such PCs, as – in the absence of a more detailed description – they could, at first, appear arbitrary. However, a remarkable body of literature indicate that the highest-ranked kinematic PCs correspond to strictly coded grasping primitives (Santello et al., 1998; Gentner and Classen, 2006; Ingram et al., 2008; Thakur et al., 2008; Gentner et al., 2010; Overduin et al., 2012), see Santello et al., 2013 for review). Consistently, in the above reports, a first synergy for grasping was identified, which modulates abduction-adduction and flexion-extension of all the finger joints (both proximal and distal), while a second synergy reflects thumb opposition and flexion-extension of the distal joints only. Maximizing the first synergy leads therefore to a posture resembling a power grasp, while the second one is linked to pinch movements directed towards smaller objects. In our study, we examined the first two PCs, which were highly consistent with the literature, along with a third one representing a movement of flexion and thumb opposition (as to grasp a dish or a platter). Since we thought that a graphical representation of the meaning of synergies could be a useful addition to the interpretation of such PCs, we plotted the time course of hand movements corresponding to these elementary grasps. The plots are 2s-long videos showing three movements from the minimum to the maximum values of PCs 1, 2 and 3, respectively, expressed as sets of twenty-four joint angles averaged across subjects (<xref ref-type="other" rid="media1">Video 1</xref>
).</p>
<p>As indicated above, synergies are meaningful combinations of digit movements: as elementary grasps, they can be considered higher-level representations with respect to single digit or multi-digit movements. For this reason, the kinematic synergy model was tested, in our paper, against an <italic>individual digit</italic>
model in which the five digits are considered independently.</p>
<p>In addition, we would like to point out that the hand movement statistics used in the paper by Ejaz et al. (2015) were taken from a previous study (i.e., Ingram et al., 2008) in which the kinematic PCs were later extracted. Notably, the plots from that report show that the first PCs were highly similar to ours (<xref ref-type="fig" rid="fig3">Figure 3b</xref>
in Ingram et al., 2008).</p>
<p><italic>3) The mapping of synergies on the cortical sheet is an interesting addition and provides a real potential argument that the kinematic synergies are more that statistical descriptors of representation space, but that the factors themselves have special status. The problem, however, is that currently the one single mapping is not evaluated against many other possible mappings. Thus the authors have not shown that there is something special about the synergies extracted. For this, one would need to a) develop a measure of the "topological orderliness" of the mapping and b) compare the synergy map systematically against an exhaustive set of alternative rotations in the same space (again using optimisation). We actually attempted this analysis on our multi-finger experiment, but preliminary results were not terribly encouraging, as there seem to be rotations of these factors in the same rotational space which gave similarly orderly mappings. If the authors could show in a stringent and convincing fashion that the particular rotation chosen here is more orderly organised than any other possible rotation in the 3-dimensional space (or even conclude after careful evaluation that this is not the case), I think the paper would really increase in quality. Without such analysis <xref ref-type="fig" rid="fig2">Figure 2</xref>
remains merely suggestive and anecdotal and the claims not substantiated.</italic>
</p>
<p>We completely agree with the Reviewer on this point: the assessment of the “topological orderliness” of hand synergies on the cortex should be an important addition to our paper, as it provides persuasive data towards a real encoding of synergies as the building blocks of hand control in the human brain. Nonetheless, we ought to notice that the demonstration of topological gradients is a major challenge of functional MRI. Since the very first studies which posited a topological organization of some brain regions, e.g., early visual or auditory areas (Sereno et al., 1995; DeYoe et al., 1996; Formisano et al., 2003), most of the reports discussed this type of organization just in a descriptive way, displayed the cortical activations in each experimental subject and described each map individually (DeYoe et al., 1996; Formisano et al., 2003). This approach is typically performed in many studies in which portions of cortex are mapped, often using ultra-high-field fMRI (Formisano et al., 2003; Olman et al., 2010; Sanchez-Panchuelo et al., 2014).</p>
<p>The papers which provide methods to measure topography are very scarce. For instance, Engel et al. (1997) correlated the visual field mapped by V1 as a function of the distance from the occipital pole, obtaining a value which represents the topographical organization of eccentricity maps.</p>
<p>In the present study, we used methods developed by other authors to analyze electrocortical recordings (Yarrow et al., 2014), to measure the orderly mapping of synergies across the regions recruited by the encoding procedure. The method is based on the comparison between the map space (the physical distance between voxels) to the feature space (the distance between voxels based on their information content). The two spaces can be correlated to each other, estimating an index (C parameter) which is, in fact, conceptually similar to the correlation coefficient between two RSs (Yarrow et al., 2014). The C coefficient reflects the similarity between the arrangement of voxels in space and the arrangement of their information content, high values indicate that voxels that contain similar information are also spatially close. This closeness can be considered as a demonstration of a topographical organization, as the distance between the content of voxels is reflected by their physical distance.</p>
<p>Here, we measured the physical distance (voxel space) as the distance (i.e., standardized Euclidean distance) between each voxel. The feature space was computed measuring the distance (i.e., standardized Euclidean distance) between the three synergy weights, as defined by their R<sup>2</sup>
, for each voxel. This analysis yielded a significant C coefficient (C=0.192; <italic>p</italic>
-value=0.0383), denoting high similarity between the feature space and the voxel space; this supports the existence of a topographical organization of synergies across the cortical surface.</p>
<p>We thank again the Reviewer for this comment, which gave us the opportunity to assess the synergy-based organization using a procedure that had not yet been applied to fMRI data.</p>
<p>The synergy map displayed in <xref ref-type="fig" rid="fig2">Figure 2</xref>
was obtained plotting the R<sup>2</sup>
coefficient between each synergy with the fMRI data. This is particularly important because, as R<sup>2</sup>
represents the goodness-of-fit of the model, is resistant to the possible rotations of the three components in the same space, while the β (the angular coefficient of the regression) can be altered by the possible alternate configurations (e.g., rotations) of the principal components. The choice of the goodness-of-fit better suits our task, as it can be divided into two sub-tasks with opposite sign (i.e., performing the grasping movement and returning back with the hand in its original position), which cannot be disentangled due to the low temporal resolution of fMRI.</p>
<p>Overall, our results show that each synergy coefficient, being expressed as a measure of the goodness-of-fit instead of an individual β value, represents a unique measure which can be mapped onto the cortical surface without the need for testing it against alternate rotated configurations. In addition, the test performed shows that the feature space is strongly connected to the voxel space, providing the demonstration of the topological arrangement of hand synergies in the fronto-parietal cortical network specifically recruited by the encoding procedure.</p>
<p><italic>Reviewer #2: 1) Given the data-driven nature of the analyses used, I found some interpretation of the top 3 principal components, and their relation to the topography noted, lacking. Ultimately the insight provided by PCA in neurophysiology rests on being able to directly link the components to neural activity. While I agree that there is some general map of the components in sensorimotor cortex, their organization has no interpretation. Some interpretation of the components (PCs 1-3) and how they relate to cortex organization might be informative on this front. Otherwise, simply saying PCs are mapped onto cortex is fairly impenetrable for the reader.</italic>
</p>
<p>Since the main aim of our work was to demonstrate that PC-based representation of hand postures are actually encoded as such in human motor cortical areas, it is particularly important to unveil <italic>what</italic>
those principal components may represent. The Reviewer’s request of an interpretation of the first PCs gives us an opportunity to clarify the meaning of synergies as the building blocks of hand postures.</p>
<p>Synergies are fundamental motor modules that are controlled as weighted combinations during hand movements. They are defined as Principal Component and usually ranked using the fraction of explained variance; the first paper on kinematic synergies (Santello et al. 1998, <xref ref-type="fig" rid="fig6">Figure 6</xref>
) identified a first synergy which modulates abduction-adduction and flexion-extension of all the finger joints (both proximal and distal), while a second synergy reflects thumb opposition and flexion-extension of the distal joints only. Consequently, a modulation of the first synergy leads to a posture resembling a power grasp, while the second one is linked to pinch movements directed towards small objects. It is noteworthy that a similar organization was also identified by subsequent independent studies (Gentner and Classen, 2006; Ingram et al., 2008; Thakur et al., 2008; Gentner et al., 2010).</p>
<p>In our study, we showed that the first three kinematic PCs, which account for a major fraction of variance, are topographically arranged on the cortical surface. We added a more detailed interpretation of those PCs in the Discussion. The first two synergies are highly consistent with those reported in the literature, representing power and pinch grasps, respectively, while the third one reflects movements of flexion and thumb opposition (as to grasp a dish or a platter).</p>
<p>Following the Reviewer’s suggestion, we developed a method to represent clearly the kinematic PCs. The video represents the whole course of a hand movement from the minimum to the maximum values of PCs 1, 2 and 3, respectively. Please refer also response to issue #2 by Reviewer #1.</p>
<p><italic>2) I found the intermixing of results material into the</italic>
Discussion section <italic>a bit disruptive (e.g., inclusion of <xref ref-type="fig" rid="fig5">Figure 5</xref>
and visual control analyses). I think that results material should be described and motivated in the</italic>
Results section.</p>
<p>We agree with this suggestion. The visual control analyses have been moved to a new paragraph, as described in the response to comment #7.</p>
<p><italic>3) It was unclear to me why, after measuring from five muscles, and thus obtaining five measures (i.e., the same number of components in the synergy and individual digit models), the data was reduced through PCA and then up-sampled again (through cross-validation methods) to achieve 5 components. This should be fully explained, as no such manipulation was done to the individual digit data.</italic>
</p>
<p>In accordance with the Reviewer’s suggestion and to strengthen our muscle model, we performed the EMG data analysis avoiding the reduction of the number of channels. Therefore, we were able to achieve a model with five dimensions, fully consistent with the alternative descriptions employed in the study. The features were extracted from the five channels separately; later, the five muscle synergies were obtained as linear combinations of features, by computing PCA on the overall set of features. In this way, we could avoid a great deal of data manipulation, achieving a muscle model built on simpler analyses. Changes have been described and reported in the revised version of the manuscript.</p>
<p><italic>4) It might be interesting in the supplement to show the results of RSA/MDS for the other models (EMG and individual digit), allowing the reader to make comparisons between all 3 models.</italic>
</p>
<p>The MDS procedure was performed on the representational spaces drawn during RSA. RSs from each of the three models (<italic>kinematic synergy, muscle synergy</italic>
and <italic>individual digit</italic>
) were significantly correlated (<italic>p</italic>
<0.0001, corrected for Mantel test, 10,000 iterations). Hence, as their MDS would be very similar, they were omitted for brevity.</p>
<p><italic>5) I was initially confused in the Discussion why the authors referred to brain areas that were not apparent in the group maps shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>
(e.g., ventral premotor cortex). This became apparent, however, after I viewed the actual source data on the MNI-152 brain, as 2-3 subjects show overlap in some of these areas. In any case, the authors should only use the text to refer to what is actually shown in the paper, to avoid such confusion.</italic>
</p>
<p>We thank the Reviewer for bringing up this potentially confusing passage which could lead to a misinterpretation of the findings. The analyses were conducted on 3D volume data, then the results were mapped onto the cortical surface using specific software (Brainvisa 4.4). Due to the interpolation which occurs during the mapping process, some clusters more associated to deeper brain regions did not appear on the surface view. However, as those regions (e.g., ventral premotor cortex) were actually recruited by the encoding procedure, they were referred to in the Discussion. We modified the figure legend accordingly.</p>
<p><italic>6) In the Discussion, I was hoping for some discussion of the bilaterality of the effects observed, which are interesting. I would suggest adding this in a revision.</italic>
</p>
<p>We are grateful to the Reviewer for this comment. Indeed, the bilateral recruitment of motor, supplementary motor and parietal areas is quite interesting and, previously, other authors have posited a bilateral engagement of those regions during complex hand movements. This aspect has now been discussed more extensively.</p>
<p><italic>7) In addition to the visual control used in the paper (i.e., analysis of visual stimulation evoked time points in the RSA mask), I was thinking that an equally good control to show the selectivity of effects to sensorimotor cortex would be to localize much of visual cortex (e.g., based on visual stimulation response vs. rest) and then perform the exact same encoding analyses on those voxels. Visual cortex is well known to be involved in imagery-a key component of the experimental task-and to see how the kinematic models performs in that area would be of interest. If it does fairly well, it would have some significant bearing on what is actually being measured in sensorimotor cortex as well as its underlying organization.</italic>
</p>
<p>We agree with the Reviewer that the role of visual cortex in motor imagery is significant and early visual areas likely participate to action preparation, as suggested by a very recent study (Gutteling et al., 2015), in which different actions were decoded based on brain activity in visual regions. To rule out such potential confounds and to verify that synergies modulate brain activity exclusively in sensorimotor regions, we considered visual activations vs. rest (measured five seconds after visual stimulus presentation) and performed the encoding procedure on the resulting mask. This procedure, along with the encoding of visual-related responses in sensorimotor regions originally included in the paper, has been described in a new section (Control analyses) in the Results section. The results show that both early activity in motor regions and activity in extrastriate visual regions do not encode kinematic synergies above-chance, excluding therefore those imagery-related confounds.</p>
<p>[Editors' note: the author responses to the re-review follow.]</p>
<p><italic>1) "Individual-digit model, based on a somatotopic criterion (Kirsch et al. 2014)" remains still as obscure as it was before. I urge you to clarify here in the Introduction. There is no notion of somatotopy in the individual-digit model as far as I can see. Somatotopy implies that it matters that the middle finger is closer to the ring than to the pinkie finger. The Individual-finger model treats all finger movements equally and independently – so it is not "somatotopic".</italic>
</p>
<p>The Reviewer is correct in pointing out that our individual digit model considered only the independence of digit representations, without taking into account their orderly somatotopic arrangement on the cortex. The individual digit model was based on the paper by Kirsch and colleagues (Kirsch et al., 2014), which compared the firing rate of M1 neurons with individual finger kinematics and with their Principal Components. In our paper, we described the individual digit model as somatotopic because a somatotopic arrangement requires the presence of discrete, independent single digit representations at a neuronal level. If the discharge pattern of a M1 neuron is correlated with individual digit kinematics, that neuron can be labeled as digit specific. Thus, following the Reviewer’s comment, we removed the potentially misleading references to somatotopy in the description of the individual digit model.</p>
<p><italic>2) Results section, first paragraph: I found the analysis provided on the additional 4 subjects interesting and thank you for the additional clarification, but would ask you for two things: a) When using temporal averaging of the EMG signal (mean-based EMG analysis), you should use your dimensionality reduction to 5 PCA, as you did for the feature based analysis. This way we can clearly see that your temporal features, and not the dimensionality reduction provide the critical difference between the red and blue curve. Note also that you did not replicate exactly the analysis performed in Ejaz et al. (2011), as you skipped the critical prewhitening step. It is not clear whether this analysis would be sensible here, as your gestures are a ad-hoc sample from the natural statistics, not an equally-spaced sample of possible finger movements b) this analysis should be included as supplementary material and cited from the main text.</italic>
</p>
<p>We thank the Reviewer for his comment and suggestions, which we have integrated into the manuscript. In the mean-based procedure (as we are currently labeling this pipeline, alternative to the ‘feature-based’ approach), we reduced the dimensionality of each model with a PCA, retaining only the first five dimensions, independently from the number of EMG channels initially considered (from 5 to 16). Hence, for each number of channels the data have the same dimensionality, making the comparison more reliable.</p>
<p>Following the request by the Reviewer, we have described the EMG analysis in a self-standing way and we have added this procedure to the article. Also, we have discussed the impact of EMG dimensionality in the Limitations section of the main text of the article (as requested also in Comment #5). The ‘prewhitening’ of EMG signals was not included in our analysis, as we did not find any mention of it in the EMG methods of the paper by Ejaz et al. (2015).</p>
<p><italic>3) Supplementary file 15: I think the table should be supplemented by a one-sentence description for each feature that is detailed enough to be able to calculate these features without going onto a wild-goose chase in the cited papers. I urge the authors to start with a clear definition of symbols and then give a concise and unambiguous formula.</italic>
</p>
<p>We agree with the Reviewer on the importance of such pieces of information to achieve the highest possible clarity and to provide all the necessary information for independent replication of the study. Hence, we have added a description of each feature to the list of features reported in <xref ref-type="supplementary-material" rid="SD4-data">Supplementary file 1L</xref>
.</p>
<p><italic>4) Section “A challenge to individual digit correction representations? The functional topography of hand synergies”: I find this section on functional topography overstated and do believe it requires a major change in tone. Your data shows that there is "some" topological organization of the first three synergies, not a "strict" one. Furthermore, some somatotopic clustering can also be shown for individual fingers or – most like for other rotations of the synergy vectors, and you have not provided a quantitative comparison with other possible organizations (see point 11).</italic>
</p>
<p>The Reviewer is right that, though our results indicate a topographical organization of the first three synergies which has been tested against random arrangements of the same synergies across the cortical surface (see Cortical mapping of the three group synergies), this organization should be properly tested against the possible rotations of the synergy vectors. This assessment, though, falls far beyond the aim of the current study, as we discussed in the response to Point #11 and in the Limitations and methodological considerations section of the main text of the manuscript. We have modified the Results accordingly, and indicated the need of additional studies to ascertain the topographical arrangement of motor primitives as indicated by our data.</p>
<p><italic>5) Section “Limitations and methodological considerations”: The limitation section discusses relatively minor points. Two important weakness should be added: a) the point that while some clustered representation was shown in sensory-motor regions, you did not convincingly show that this specific set of synergies is more clustered than other rotation of the same vectors b) that in comparing the different models, the EMG-model had much less ability to discriminate different gestures and that the disadvantage of the muscle model may simply reflect noise levels on your measurement. These are important limitations that should be pointed out.</italic>
</p>
<p>The Reviewer is right in pointing out that the impact of the rotation of synergy vectors deserves a deeper discussion. While the topographical arrangement of synergies across the cortical surface is suggested by our data, its demonstration against the possible rotated configurations of the synergy space needs novel and specific experiments, as we detailed in the Response to Comment #11. This has been discussed in a specific paragraph after the Limitations and Methodological considerations section.</p>
<p>The EMG analyses on the additional subjects suggest that the worse performance of the muscle model is likely to be related to the intrinsic signal and noise levels of surface EMG acquisition, as a much higher number of channels (up to 16) did not bring any significant benefit to gesture discrimination. This has been discussed in the “Limitations and methodological considerations” section.</p>
<p><italic>6) Paragraph two, “Models validation”: Please clarify in the text how the labels of the test set where shuffled. Specifically, if your test set contained 4 repetitions of each of the 20 gestures, did you shuffle the labels of all 80 trials completely randomly, or did you keep the 4 trials for the same gesture together and just give them together a new label (or equivalently shuffle the labels after averaging over the 4 trials)? This difference has important consequences for the variance of your reshuffling statistics.</italic>
</p>
<p>In the permutation test, we adopted the former procedure: the labels were shuffled after averaging the four trials of the rest dataset. For this reason, each permutation matrix still comprised twenty coherent postures. We clarified the description of the rank accuracy procedure in the Methods.</p>
<p><italic>7) “Every voxel had a score ranging from 0 (if the voxel was never used) to a possible maximum of 380 (if the two left-out patterns could be predicted, for that voxel, in all the 190 iterations).” Please explain this statement better. Do you mean to say the score was the number of times the voxel was included in the 1000 voxels AND got a specific gesture correct?</italic>
</p>
<p>Since the accuracy assessment (decoding stage) was performed only on the 1000 voxels with the highest R<sup>2</sup>
, the accuracy score for each voxel corresponds to the number of times the voxel was among the 1000 with the highest R<sup>2</sup>
and was successful in the pairwise discrimination of gestures. This was clarified in the text.</p>
<p><italic>8) Section “Assessment of the accuracy of the encoding analysis”: Please clearly point out in the text that the weights were randomly shuffled within each column. Please also point out explicitly (I assume that this is true) that the new "PCA"s were now not orthogonal to each other anymore.</italic>
</p>
<p>Following the Reviewer’s indication, this aspect has been specified in the Methods.</p>
<p><italic>9) Now that I think that I understand what the single subject maps are, I think the group-level maps also needs some more explanation. The score for each voxel varied between 0 and 380 (as stated above). For each subject, which value was then considered as "successful"? Why was it called a "probability map"? Probability of what?</italic>
</p>
<p>The group-level map expresses the probability for each voxel to successfully encode synergy-based representations of hand postures. The single subject maps were first binarized, converting the non-zero scores to 1. The nine binary maps, one for each subject, were then summed, obtaining a group map with values ranging from 0 (for a voxel which was never used) to 9 (for a voxel which was recruited in all subjects). This procedure has been better explained in the Methods and Results.</p>
<p><italic>10) Section “Cortial mapping of the three group synergies”: I disagree that using R<sup>2</sup>
as a goodness of fit for each individual synergy makes the results invariant to rotations in synergy space. It does not. Maybe we fundamentally misunderstand each other, so I will make my point more concrete. Say, you have 2 "synergies" of 5 elements X1 and X2 and a 5-element data series Y.</italic>
</p>
<p><italic>x1=[-2 -1 0 1 2]';x2=[1 0 -2 0 1]'; Y=[-2 -2 1 2 2]'; Then the R2-values of each of the columns of X can be calculated as R2_1 = Y'*x1*inv(x1'*x1)*x1'*Y/(Y'*Y) = 0.847 R2_2 = Y'*x2*inv(x2'*x2)*x2'*Y/(Y'*Y) = 0.039 Now I rotate R=[cos(0.9) sin(0.9);-sin(0.9) cos(0.9)]; Z=[x1 x2]*R;z1 = Z(:,1);z2 = Z(:,2);</italic>
</p>
<p><italic>Now the individual R<sup>2</sup>
-values are changed, and hence a mapwise evaluation criterion would also be changed.</italic>
</p>
<p><italic>R2_1 = Y'*z1*inv(z1'*z1)*z1'*Y/(Y'*Y) = 0.6351 R2_2 = Y'*z2*inv(z2'*z2)*z2'*Y/(Y'*Y) = 0.4629 I hope that clarifies my point and why I think a) the sentence stating that individual R<sup>2</sup>
values are rotation invariant should be removed and b) any claims regarding a special organisation on the cortex should be made weaker – for stronger claims you would need to compare the C-metric (which I think would fit this purpose) across many different rotations of the same vectors or ways of picking encoding vectors from the 20-dimensional space.</italic>
</p>
<p>In the encoding of fMRI data, the kinematic synergy model used in the multiple linear regression considered the first five synergies together, thereby fitting the combination of those synergies to brain activity patterns. For this reason, the results from the encoding analysis are resistant to the rotation of the synergy space as a whole and the estimation of the goodness-of-fit of the kinematic synergy model is reliable.</p>
<p>That said, the Reviewer is certainly right in noting that, if each synergy is fitted independently as done for the topographical mapping, its R<sup>2</sup>
coefficient may be affected by the possible rotated configurations of the synergy space. Actually, when mapping the synergies onto the cortical surface, the rotation of the PCs may lead to different R<sup>2</sup>
values and, consequently, will affect the topographical organization, as correctly pointed out by the Reviewer. However, the kinematic PCs that were examined in the present paper were identified and represented as elementary, meaningful grasping primitives (see Results and <xref ref-type="other" rid="media1">Video 1</xref>
). Hence, in our opinion, the topographical organization of those synergies (as reported and assessed with the procedure described in paragraph two section “Cortical mapping of the three group synergies”) may indicate that the cortex encodes functional modules.</p>
<p>While we agree with the Reviewer that a direct assessment of functional topography against other possible rotations is a very interesting issue that requires to be explored to achieve a deeper understanding of the cortical organization of hand movement control, we think that this falls beyond the scope of the current study, in primis for the following main reasons:</p>
<p>– The kinematic synergy model accounts for a portion (40%) of the variance of fMRI data. For this reason, we hypothesize that different rotations of the synergy space can actually be encoded in the brain, as well as additional pieces of information (force, temporal patterns of movements, action goals). Without a better model able to explain a larger amount of fMRI variance, the assessment of different rotations of the synergy space may have a limited validity. We discussed this aspect in the Beyond synergies paragraph.</p>
<p>– An encoding of different or rotated configurations of the synergy space is plausible in the motor system: synergies are flexible configurations (Turvey, 2007) and are therefore likely to modify or adapt to task demands rather than being rigid postural schemes (Latash et al., 2007). In addition, the solution to many distinct problems of motor control, including the Degrees of Freedom problem, is hardly unique (Bernstein, 1967). Hence, both synergies and their rotated versions may coexist in the brain, representing strategies adopted to solve the Degrees of Freedom problem in multiple possible ways, achieving the one-to-many organization that has been posited by some authors (Latash et al., 2007).</p>
<p>– Though the principal components obtained from the synergy space were encoded in each subject separately, we showed a highly consistent similarity of the first three synergies across subjects (<xref ref-type="other" rid="media1">Video 1</xref>
). However, with the current procedure, slight inter-subject differences in the principal components could not be considered during the assessment of the topographical mapping. We believe that the topographical assessment requires the definition of stable population-level synergies to allow for the identification of the optimal rotation of each component and to test their arrangements in an independent group of subjects.</p>
<p>– The present study focused only on hand-grasping movements. We expect that the addition of more action types, such as non-grasping object-directed movements or intransitive actions, may lead to the description of synergies that are different from those described here for grasping. For this reason, the cortical organization described in this study may reflect only in part the overall cortical organization of hand movement control.</p>
<p>In summary, in this paper we reported that the three synergies topographically arranged on the cortex are the best descriptors (as Principal Components) of posture space and correspond to meaningful grasping primitives. While certainly this may not be true in the case of the rotated versions of those synergies, theoretically they could fit as well, or even better, the brain activity patterns.</p>
<p>We have discussed these important aspects, the caution they warrant in the generalization of our results, the requirements for additional distinct studies with specific goals in the “Limitations” and in the “Beyond synergies” sections. Finally, in agreement with the suggestions by the Reviewer, we attenuated the description of the topographical organization of hand synergies and removed the sentence stating the invariance of individual R<sup>2</sup>
coefficients to rotation.</p>
</body>
</sub-article>
</pmc>
<affiliations><list><country><li>Italie</li>
<li>États-Unis</li>
</country>
</list>
<tree><country name="Italie"><noRegion><name sortKey="Leo, Andrea" sort="Leo, Andrea" uniqKey="Leo A" first="Andrea" last="Leo">Andrea Leo</name>
</noRegion>
<name sortKey="Bianchi, Matteo" sort="Bianchi, Matteo" uniqKey="Bianchi M" first="Matteo" last="Bianchi">Matteo Bianchi</name>
<name sortKey="Bianchi, Matteo" sort="Bianchi, Matteo" uniqKey="Bianchi M" first="Matteo" last="Bianchi">Matteo Bianchi</name>
<name sortKey="Bicchi, Antonio" sort="Bicchi, Antonio" uniqKey="Bicchi A" first="Antonio" last="Bicchi">Antonio Bicchi</name>
<name sortKey="Bicchi, Antonio" sort="Bicchi, Antonio" uniqKey="Bicchi A" first="Antonio" last="Bicchi">Antonio Bicchi</name>
<name sortKey="Gabiccini, Marco" sort="Gabiccini, Marco" uniqKey="Gabiccini M" first="Marco" last="Gabiccini">Marco Gabiccini</name>
<name sortKey="Gabiccini, Marco" sort="Gabiccini, Marco" uniqKey="Gabiccini M" first="Marco" last="Gabiccini">Marco Gabiccini</name>
<name sortKey="Gabiccini, Marco" sort="Gabiccini, Marco" uniqKey="Gabiccini M" first="Marco" last="Gabiccini">Marco Gabiccini</name>
<name sortKey="Guidi, Andrea" sort="Guidi, Andrea" uniqKey="Guidi A" first="Andrea" last="Guidi">Andrea Guidi</name>
<name sortKey="Handjaras, Giacomo" sort="Handjaras, Giacomo" uniqKey="Handjaras G" first="Giacomo" last="Handjaras">Giacomo Handjaras</name>
<name sortKey="Leo, Andrea" sort="Leo, Andrea" uniqKey="Leo A" first="Andrea" last="Leo">Andrea Leo</name>
<name sortKey="Marino, Hamal" sort="Marino, Hamal" uniqKey="Marino H" first="Hamal" last="Marino">Hamal Marino</name>
<name sortKey="Pietrini, Pietro" sort="Pietrini, Pietro" uniqKey="Pietrini P" first="Pietro" last="Pietrini">Pietro Pietrini</name>
<name sortKey="Pietrini, Pietro" sort="Pietrini, Pietro" uniqKey="Pietrini P" first="Pietro" last="Pietrini">Pietro Pietrini</name>
<name sortKey="Pietrini, Pietro" sort="Pietrini, Pietro" uniqKey="Pietrini P" first="Pietro" last="Pietrini">Pietro Pietrini</name>
<name sortKey="Pietrini, Pietro" sort="Pietrini, Pietro" uniqKey="Pietrini P" first="Pietro" last="Pietrini">Pietro Pietrini</name>
<name sortKey="Ricciardi, Emiliano" sort="Ricciardi, Emiliano" uniqKey="Ricciardi E" first="Emiliano" last="Ricciardi">Emiliano Ricciardi</name>
<name sortKey="Ricciardi, Emiliano" sort="Ricciardi, Emiliano" uniqKey="Ricciardi E" first="Emiliano" last="Ricciardi">Emiliano Ricciardi</name>
<name sortKey="Scilingo, Enzo Pasquale" sort="Scilingo, Enzo Pasquale" uniqKey="Scilingo E" first="Enzo Pasquale" last="Scilingo">Enzo Pasquale Scilingo</name>
<name sortKey="Scilingo, Enzo Pasquale" sort="Scilingo, Enzo Pasquale" uniqKey="Scilingo E" first="Enzo Pasquale" last="Scilingo">Enzo Pasquale Scilingo</name>
</country>
<country name="États-Unis"><noRegion><name sortKey="Santello, Marco" sort="Santello, Marco" uniqKey="Santello M" first="Marco" last="Santello">Marco Santello</name>
</noRegion>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002828 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd -nk 002828 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Checkpoint |type= RBID |clé= PMC:4786436 |texte= A synergy-based hand control is encoded in human motor cortical areas }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/RBID.i -Sk "pubmed:26880543" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |