Active tactile exploration enabled by a brain-machine-brain interface
Identifieur interne : 001C55 ( Pmc/Checkpoint ); précédent : 001C54; suivant : 001C56Active tactile exploration enabled by a brain-machine-brain interface
Auteurs : Joseph E. O Oherty [États-Unis] ; Mikhail A. Lebedev [États-Unis] ; Peter J. Ifft [États-Unis] ; Katie Z. Zhuang [États-Unis] ; Solaiman Shokur [Suisse] ; Hannes Bleuler [Suisse] ; Miguel A. L. Nicolelis [États-Unis, Brésil]Source :
- Nature [ 0028-0836 ] ; 2011.
Abstract
Brain-machine interfaces (BMIs)
Url:
DOI: 10.1038/nature10489
PubMed: 21976021
PubMed Central: 3236080
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
PMC:3236080Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Active tactile exploration enabled by a brain-machine-brain interface</title>
<author><name sortKey="O Oherty, Joseph E" sort="O Oherty, Joseph E" uniqKey="O Oherty J" first="Joseph E." last="O Oherty">Joseph E. O Oherty</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Lebedev, Mikhail A" sort="Lebedev, Mikhail A" uniqKey="Lebedev M" first="Mikhail A." last="Lebedev">Mikhail A. Lebedev</name>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A3">epartment of Neurobiology, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>epartment of Neurobiology, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Ifft, Peter J" sort="Ifft, Peter J" uniqKey="Ifft P" first="Peter J." last="Ifft">Peter J. Ifft</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Zhuang, Katie Z" sort="Zhuang, Katie Z" uniqKey="Zhuang K" first="Katie Z." last="Zhuang">Katie Z. Zhuang</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Shokur, Solaiman" sort="Shokur, Solaiman" uniqKey="Shokur S" first="Solaiman" last="Shokur">Solaiman Shokur</name>
<affiliation wicri:level="3"><nlm:aff id="A4">STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland</nlm:aff>
<country xml:lang="fr">Suisse</country>
<wicri:regionArea>STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne</wicri:regionArea>
<placeName><settlement type="city">Lausanne</settlement>
<region nuts="3" type="region">Canton de Vaud</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Bleuler, Hannes" sort="Bleuler, Hannes" uniqKey="Bleuler H" first="Hannes" last="Bleuler">Hannes Bleuler</name>
<affiliation wicri:level="3"><nlm:aff id="A4">STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland</nlm:aff>
<country xml:lang="fr">Suisse</country>
<wicri:regionArea>STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne</wicri:regionArea>
<placeName><settlement type="city">Lausanne</settlement>
<region nuts="3" type="region">Canton de Vaud</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Nicolelis, Miguel A L" sort="Nicolelis, Miguel A L" uniqKey="Nicolelis M" first="Miguel A. L." last="Nicolelis">Miguel A. L. Nicolelis</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A3">epartment of Neurobiology, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>epartment of Neurobiology, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A5">Department of Psychology and Neuroscience, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Psychology and Neuroscience, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="A6">Edmond and Lily Safra International Institute of Neuroscience, Natal, Brazil</nlm:aff>
<country xml:lang="fr">Brésil</country>
<wicri:regionArea>Edmond and Lily Safra International Institute of Neuroscience, Natal</wicri:regionArea>
<wicri:noRegion>Natal</wicri:noRegion>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">21976021</idno>
<idno type="pmc">3236080</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3236080</idno>
<idno type="RBID">PMC:3236080</idno>
<idno type="doi">10.1038/nature10489</idno>
<date when="2011">2011</date>
<idno type="wicri:Area/Pmc/Corpus">002547</idno>
<idno type="wicri:Area/Pmc/Curation">002547</idno>
<idno type="wicri:Area/Pmc/Checkpoint">001C55</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Active tactile exploration enabled by a brain-machine-brain interface</title>
<author><name sortKey="O Oherty, Joseph E" sort="O Oherty, Joseph E" uniqKey="O Oherty J" first="Joseph E." last="O Oherty">Joseph E. O Oherty</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Lebedev, Mikhail A" sort="Lebedev, Mikhail A" uniqKey="Lebedev M" first="Mikhail A." last="Lebedev">Mikhail A. Lebedev</name>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A3">epartment of Neurobiology, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>epartment of Neurobiology, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Ifft, Peter J" sort="Ifft, Peter J" uniqKey="Ifft P" first="Peter J." last="Ifft">Peter J. Ifft</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Zhuang, Katie Z" sort="Zhuang, Katie Z" uniqKey="Zhuang K" first="Katie Z." last="Zhuang">Katie Z. Zhuang</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Shokur, Solaiman" sort="Shokur, Solaiman" uniqKey="Shokur S" first="Solaiman" last="Shokur">Solaiman Shokur</name>
<affiliation wicri:level="3"><nlm:aff id="A4">STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland</nlm:aff>
<country xml:lang="fr">Suisse</country>
<wicri:regionArea>STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne</wicri:regionArea>
<placeName><settlement type="city">Lausanne</settlement>
<region nuts="3" type="region">Canton de Vaud</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Bleuler, Hannes" sort="Bleuler, Hannes" uniqKey="Bleuler H" first="Hannes" last="Bleuler">Hannes Bleuler</name>
<affiliation wicri:level="3"><nlm:aff id="A4">STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland</nlm:aff>
<country xml:lang="fr">Suisse</country>
<wicri:regionArea>STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne</wicri:regionArea>
<placeName><settlement type="city">Lausanne</settlement>
<region nuts="3" type="region">Canton de Vaud</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Nicolelis, Miguel A L" sort="Nicolelis, Miguel A L" uniqKey="Nicolelis M" first="Miguel A. L." last="Nicolelis">Miguel A. L. Nicolelis</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Department of Biomedical Engineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Biomedical Engineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A2">Center for Neuroengineering, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Center for Neuroengineering, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A3">epartment of Neurobiology, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>epartment of Neurobiology, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="2"><nlm:aff id="A5">Department of Psychology and Neuroscience, Duke University, Durham, NC, USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Department of Psychology and Neuroscience, Duke University, Durham, NC</wicri:regionArea>
<placeName><region type="state">Caroline du Nord</region>
</placeName>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="A6">Edmond and Lily Safra International Institute of Neuroscience, Natal, Brazil</nlm:aff>
<country xml:lang="fr">Brésil</country>
<wicri:regionArea>Edmond and Lily Safra International Institute of Neuroscience, Natal</wicri:regionArea>
<wicri:noRegion>Natal</wicri:noRegion>
</affiliation>
</author>
</analytic>
<series><title level="j">Nature</title>
<idno type="ISSN">0028-0836</idno>
<idno type="eISSN">1476-4687</idno>
<imprint><date when="2011">2011</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p id="P1">Brain-machine interfaces (BMIs)<sup><xref rid="R1" ref-type="bibr">1</xref>
,<xref rid="R2" ref-type="bibr">2</xref>
</sup>
use neuronal activity recorded from the brain to establish direct communication with external actuators, such as prosthetic arms. While BMIs aim to restore the normal sensorimotor functions of the limbs, so far they have lacked tactile sensation. Here we demonstrate the operation of a brain-machine-brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and enables the signalling of artificial tactile feedback through intracortical microstimulation (ICMS) of the primary somatosensory cortex (S1). Monkeys performed an active-exploration task in which an actuator (a computer cursor or a virtual-reality hand) was moved using a BMBI that derived motor commands from neuronal ensemble activity recorded in primary motor cortex (M1). ICMS feedback occurred whenever the actuator touched virtual objects. Temporal patterns of ICMS encoded the artificial tactile properties of each object. Neuronal recordings and ICMS epochs were temporally multiplexed to avoid interference. Two monkeys operated this BMBI to search and discriminate one out of three visually undistinguishable objects, using the virtual hand to identify the unique artificial texture (AT) associated with each. These results suggest that clinical motor neuroprostheses might benefit from the addition of ICMS feedback to generate artificial somatic perceptions associated with mechanical, robotic, or even virtual prostheses.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Lebedev, Ma" uniqKey="Lebedev M">MA Lebedev</name>
</author>
<author><name sortKey="Nicolelis, Ma" uniqKey="Nicolelis M">MA Nicolelis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nicolelis, Ma" uniqKey="Nicolelis M">MA Nicolelis</name>
</author>
<author><name sortKey="Lebedev, Ma" uniqKey="Lebedev M">MA Lebedev</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chapin, Jk" uniqKey="Chapin J">JK Chapin</name>
</author>
<author><name sortKey="Moxon, Ka" uniqKey="Moxon K">KA Moxon</name>
</author>
<author><name sortKey="Markowitz, Rs" uniqKey="Markowitz R">RS Markowitz</name>
</author>
<author><name sortKey="Nicolelis, Mal" uniqKey="Nicolelis M">MAL Nicolelis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Velliste, M" uniqKey="Velliste M">M Velliste</name>
</author>
<author><name sortKey="Perel, S" uniqKey="Perel S">S Perel</name>
</author>
<author><name sortKey="Spalding, Mc" uniqKey="Spalding M">MC Spalding</name>
</author>
<author><name sortKey="Whitford, As" uniqKey="Whitford A">AS Whitford</name>
</author>
<author><name sortKey="Schwartz, Ab" uniqKey="Schwartz A">AB Schwartz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Moritz, Ct" uniqKey="Moritz C">CT Moritz</name>
</author>
<author><name sortKey="Perlmutter, Si" uniqKey="Perlmutter S">SI Perlmutter</name>
</author>
<author><name sortKey="Fetz, Ee" uniqKey="Fetz E">EE Fetz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wessberg, J" uniqKey="Wessberg J">J Wessberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Taylor, Dm" uniqKey="Taylor D">DM Taylor</name>
</author>
<author><name sortKey="Helms Tillery, Si" uniqKey="Helms Tillery S">SI Helms-Tillery</name>
</author>
<author><name sortKey="Schwartz, Ab" uniqKey="Schwartz A">AB Schwartz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Serruya, Md" uniqKey="Serruya M">MD Serruya</name>
</author>
<author><name sortKey="Hatsopoulos, Ng" uniqKey="Hatsopoulos N">NG Hatsopoulos</name>
</author>
<author><name sortKey="Paninski, L" uniqKey="Paninski L">L Paninski</name>
</author>
<author><name sortKey="Fellows, Mr" uniqKey="Fellows M">MR Fellows</name>
</author>
<author><name sortKey="Donoghue, Jp" uniqKey="Donoghue J">JP Donoghue</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Carmena, Jm" uniqKey="Carmena J">JM Carmena</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Johansson, Rs" uniqKey="Johansson R">RS Johansson</name>
</author>
<author><name sortKey="Westling, G" uniqKey="Westling G">G Westling</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Flanagan, Jr" uniqKey="Flanagan J">JR Flanagan</name>
</author>
<author><name sortKey="Wing, Am" uniqKey="Wing A">AM Wing</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="James, Tw" uniqKey="James T">TW James</name>
</author>
<author><name sortKey="Kim, S" uniqKey="Kim S">S Kim</name>
</author>
<author><name sortKey="Fisher, Js" uniqKey="Fisher J">JS Fisher</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chatterjee" uniqKey="Chatterjee">Chatterjee</name>
</author>
<author><name sortKey="Aggarwal, V" uniqKey="Aggarwal V">V Aggarwal</name>
</author>
<author><name sortKey="Ramos" uniqKey="Ramos">Ramos</name>
</author>
<author><name sortKey="Acharya, S" uniqKey="Acharya S">S Acharya</name>
</author>
<author><name sortKey="Thakor, Nv" uniqKey="Thakor N">NV Thakor</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kaczmarek, K" uniqKey="Kaczmarek K">K Kaczmarek</name>
</author>
<author><name sortKey="Webster, J" uniqKey="Webster J">J Webster</name>
</author>
<author><name sortKey="Bach Y Rita, P" uniqKey="Bach Y Rita P">P Bach-y-Rita</name>
</author>
<author><name sortKey="Tompkins, W" uniqKey="Tompkins W">W Tompkins</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Marasco, Pd" uniqKey="Marasco P">PD Marasco</name>
</author>
<author><name sortKey="Schultz, Ae" uniqKey="Schultz A">AE Schultz</name>
</author>
<author><name sortKey="Kuiken, Ta" uniqKey="Kuiken T">TA Kuiken</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="O Oherty, Je" uniqKey="O Oherty J">JE O’Doherty</name>
</author>
<author><name sortKey="Lebedev, Ma" uniqKey="Lebedev M">MA Lebedev</name>
</author>
<author><name sortKey="Hanson, Tl" uniqKey="Hanson T">TL Hanson</name>
</author>
<author><name sortKey="Fitzsimmons, Na" uniqKey="Fitzsimmons N">NA Fitzsimmons</name>
</author>
<author><name sortKey="Nicolelis, Ma" uniqKey="Nicolelis M">MA Nicolelis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Richer, F" uniqKey="Richer F">F Richer</name>
</author>
<author><name sortKey="Martinez, M" uniqKey="Martinez M">M Martinez</name>
</author>
<author><name sortKey="Robert, M" uniqKey="Robert M">M Robert</name>
</author>
<author><name sortKey="Bouvier, G" uniqKey="Bouvier G">G Bouvier</name>
</author>
<author><name sortKey="Saint Hilaire, Jm" uniqKey="Saint Hilaire J">JM Saint-Hilaire</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="London, Bm" uniqKey="London B">BM London</name>
</author>
<author><name sortKey="Jordan, Lr" uniqKey="Jordan L">LR Jordan</name>
</author>
<author><name sortKey="Jackson, Cr" uniqKey="Jackson C">CR Jackson</name>
</author>
<author><name sortKey="Miller, Le" uniqKey="Miller L">LE Miller</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Romo, R" uniqKey="Romo R">R Romo</name>
</author>
<author><name sortKey="Hernandez, A" uniqKey="Hernandez A">A Hernandez</name>
</author>
<author><name sortKey="Zainos, A" uniqKey="Zainos A">A Zainos</name>
</author>
<author><name sortKey="Salinas, E" uniqKey="Salinas E">E Salinas</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fitzsimmons, Na" uniqKey="Fitzsimmons N">NA Fitzsimmons</name>
</author>
<author><name sortKey="Drake, W" uniqKey="Drake W">W Drake</name>
</author>
<author><name sortKey="Hanson, Tl" uniqKey="Hanson T">TL Hanson</name>
</author>
<author><name sortKey="Lebedev, Ma" uniqKey="Lebedev M">MA Lebedev</name>
</author>
<author><name sortKey="Nicolelis, Ma" uniqKey="Nicolelis M">MA Nicolelis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lederman, Sj" uniqKey="Lederman S">SJ Lederman</name>
</author>
<author><name sortKey="Klatzky, Rl" uniqKey="Klatzky R">RL Klatzky</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lebedev, Ma" uniqKey="Lebedev M">MA Lebedev</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Li, Z" uniqKey="Li Z">Z Li</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lebedev, Ma" uniqKey="Lebedev M">MA Lebedev</name>
</author>
<author><name sortKey="Denton, Jm" uniqKey="Denton J">JM Denton</name>
</author>
<author><name sortKey="Nelson, Rj" uniqKey="Nelson R">RJ Nelson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Liu, Y" uniqKey="Liu Y">Y Liu</name>
</author>
<author><name sortKey="Denton, Jm" uniqKey="Denton J">JM Denton</name>
</author>
<author><name sortKey="Nelson, Rj" uniqKey="Nelson R">RJ Nelson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cisek, P" uniqKey="Cisek P">P Cisek</name>
</author>
<author><name sortKey="Kalaska, Jf" uniqKey="Kalaska J">JF Kalaska</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Graziano, Ms" uniqKey="Graziano M">MS Graziano</name>
</author>
<author><name sortKey="Cooke, Df" uniqKey="Cooke D">DF Cooke</name>
</author>
<author><name sortKey="Taylor, Cs" uniqKey="Taylor C">CS Taylor</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Maravita, A" uniqKey="Maravita A">A Maravita</name>
</author>
<author><name sortKey="Iriki, A" uniqKey="Iriki A">A Iriki</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tkach, D" uniqKey="Tkach D">D Tkach</name>
</author>
<author><name sortKey="Reimer, J" uniqKey="Reimer J">J Reimer</name>
</author>
<author><name sortKey="Hatsopoulos, Ng" uniqKey="Hatsopoulos N">NG Hatsopoulos</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dushanova, J" uniqKey="Dushanova J">J Dushanova</name>
</author>
<author><name sortKey="Donoghue, J" uniqKey="Donoghue J">J Donoghue</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<pmc-dir>properties manuscript</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-journal-id">0410462</journal-id>
<journal-id journal-id-type="pubmed-jr-id">6011</journal-id>
<journal-id journal-id-type="nlm-ta">Nature</journal-id>
<journal-id journal-id-type="iso-abbrev">Nature</journal-id>
<journal-title-group><journal-title>Nature</journal-title>
</journal-title-group>
<issn pub-type="ppub">0028-0836</issn>
<issn pub-type="epub">1476-4687</issn>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">21976021</article-id>
<article-id pub-id-type="pmc">3236080</article-id>
<article-id pub-id-type="doi">10.1038/nature10489</article-id>
<article-id pub-id-type="manuscript">NIHMS319148</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Article</subject>
</subj-group>
</article-categories>
<title-group><article-title>Active tactile exploration enabled by a brain-machine-brain interface</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>O’Doherty</surname>
<given-names>Joseph E.</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Lebedev</surname>
<given-names>Mikhail A.</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
<xref ref-type="aff" rid="A3">3</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Ifft</surname>
<given-names>Peter J.</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Zhuang</surname>
<given-names>Katie Z.</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Shokur</surname>
<given-names>Solaiman</given-names>
</name>
<xref ref-type="aff" rid="A4">4</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Bleuler</surname>
<given-names>Hannes</given-names>
</name>
<xref ref-type="aff" rid="A4">4</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Nicolelis</surname>
<given-names>Miguel A. L.</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
<xref ref-type="aff" rid="A2">2</xref>
<xref ref-type="aff" rid="A3">3</xref>
<xref ref-type="aff" rid="A5">5</xref>
<xref ref-type="aff" rid="A6">6</xref>
</contrib>
</contrib-group>
<aff id="A1"><label>1</label>
Department of Biomedical Engineering, Duke University, Durham, NC, USA</aff>
<aff id="A2"><label>2</label>
Center for Neuroengineering, Duke University, Durham, NC, USA</aff>
<aff id="A3"><label>3</label>
epartment of Neurobiology, Duke University, Durham, NC, USA</aff>
<aff id="A4"><label>4</label>
STI IMT, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland</aff>
<aff id="A5"><label>5</label>
Department of Psychology and Neuroscience, Duke University, Durham, NC, USA</aff>
<aff id="A6"><label>6</label>
Edmond and Lily Safra International Institute of Neuroscience, Natal, Brazil</aff>
<pub-date pub-type="nihms-submitted"><day>2</day>
<month>9</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="epub"><day>05</day>
<month>10</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="collection"><day>10</day>
<month>11</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="pmc-release"><day>10</day>
<month>5</month>
<year>2012</year>
</pub-date>
<volume>479</volume>
<issue>7372</issue>
<fpage>228</fpage>
<lpage>231</lpage>
<pmc-comment>elocation-id from pubmed: 10.1038/nature10489</pmc-comment>
<permissions><license><license-p>Users may view, print, copy, download and text and data- mine the content in such documents, for the purposes of academic research, subject always to the full Conditions of use:
<uri xlink:type="simple" xlink:href="http://www.nature.com/authors/editorial_policies/license.html#terms">http://www.nature.com/authors/editorial_policies/license.html#terms</uri>
</license-p>
</license>
</permissions>
<abstract><p id="P1">Brain-machine interfaces (BMIs)<sup><xref rid="R1" ref-type="bibr">1</xref>
,<xref rid="R2" ref-type="bibr">2</xref>
</sup>
use neuronal activity recorded from the brain to establish direct communication with external actuators, such as prosthetic arms. While BMIs aim to restore the normal sensorimotor functions of the limbs, so far they have lacked tactile sensation. Here we demonstrate the operation of a brain-machine-brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and enables the signalling of artificial tactile feedback through intracortical microstimulation (ICMS) of the primary somatosensory cortex (S1). Monkeys performed an active-exploration task in which an actuator (a computer cursor or a virtual-reality hand) was moved using a BMBI that derived motor commands from neuronal ensemble activity recorded in primary motor cortex (M1). ICMS feedback occurred whenever the actuator touched virtual objects. Temporal patterns of ICMS encoded the artificial tactile properties of each object. Neuronal recordings and ICMS epochs were temporally multiplexed to avoid interference. Two monkeys operated this BMBI to search and discriminate one out of three visually undistinguishable objects, using the virtual hand to identify the unique artificial texture (AT) associated with each. These results suggest that clinical motor neuroprostheses might benefit from the addition of ICMS feedback to generate artificial somatic perceptions associated with mechanical, robotic, or even virtual prostheses.</p>
</abstract>
</article-meta>
</front>
<body><p id="P2">BMIs have evolved from one degree-of-freedom systems <sup><xref rid="R3" ref-type="bibr">3</xref>
</sup>
to many-degree-of-freedom robotic arms <sup><xref rid="R4" ref-type="bibr">4</xref>
</sup>
and muscle stimulators <sup><xref rid="R5" ref-type="bibr">5</xref>
</sup>
that enact complex limb movements, such as reaching <sup><xref rid="R6" ref-type="bibr">6</xref>
–<xref rid="R8" ref-type="bibr">8</xref>
</sup>
and grasping <sup><xref rid="R9" ref-type="bibr">9</xref>
</sup>
. However, somatosensory feedback, which is essential for dexterous control <sup><xref rid="R10" ref-type="bibr">10</xref>
–<xref rid="R12" ref-type="bibr">12</xref>
</sup>
, remains underdeveloped in BMIs. With the exception of a few studies combining BMIs with tactile stimuli applied to the body <sup><xref rid="R13" ref-type="bibr">13</xref>
</sup>
, existing systems rely almost exclusively on visual feedback. Prosthetic sensation has been studied in the context of sensory substitution <sup><xref rid="R14" ref-type="bibr">14</xref>
</sup>
and targeted reinnervation <sup><xref rid="R15" ref-type="bibr">15</xref>
</sup>
, however these approaches have limited application range and channel capacity. To provide a proof-of-concept method for sensorizing neuroprostheses, we implemented a BMBI that extracts movement commands from the motor areas of the brain while delivering ICMS feedback in somatosensory areas <sup><xref rid="R1" ref-type="bibr">1</xref>
,<xref rid="R2" ref-type="bibr">2</xref>
,<xref rid="R16" ref-type="bibr">16</xref>
</sup>
to evoke discriminable percepts <sup><xref rid="R17" ref-type="bibr">17</xref>
–<xref rid="R20" ref-type="bibr">20</xref>
</sup>
. This idea received support from our pilot study <sup><xref rid="R16" ref-type="bibr">16</xref>
</sup>
in which a monkey responded to ICMS cues with the movements of a BMI-controlled cursor. However the ICMS cue did not provide feedback of object-actuator interactions in this previous demonstration.</p>
<p id="P3">The BMBI developed here enabled active tactile exploration <sup><xref rid="R21" ref-type="bibr">21</xref>
</sup>
during BMI control (<xref rid="F1" ref-type="fig">Fig. 1a</xref>
). Two monkeys (M and N) received multielectrode implants in M1 and S1 (<xref rid="F1" ref-type="fig">Fig 1b</xref>
). They explored virtual objects with either a computer cursor or a virtual image of an arm (<xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 1a,b</xref>
). In hand control (HC), the monkeys moved a joystick with their left hands to position the actuator. They searched through a set of virtual objects, selected one with a particular artificial texture (AT) conveyed by ICMS, and held the actuator over that object to obtain reward (<xref rid="F1" ref-type="fig">Fig. 1a</xref>
; <xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 1c,d</xref>
). During brain control (BC), the joystick was disconnected and the actuator was controlled by the activity of right-hemisphere M1 neurons <sup><xref rid="R9" ref-type="bibr">9</xref>
,<xref rid="R22" ref-type="bibr">22</xref>
,<xref rid="R23" ref-type="bibr">23</xref>
</sup>
. The behavioural tasks varied in the number of objects on the screen, ATs employed, and the actuator type (<xref rid="F2" ref-type="fig">Fig. 2a</xref>
) and were more difficult than previously reported BMI tasks because of the presence of multiple objects in the workspace, a prolonged object selection period, and the necessity of interpreting ICMS feedback.</p>
<p id="P4">ICMS was delivered through two pairs of microwires to the hand representation area of S1 in monkey M, (<xref rid="F1" ref-type="fig">Fig. 1c</xref>
) and through one pair of microwires to the leg representation in monkey N. Each AT consisted of a high-frequency pulse train presented in packets at a lower secondary frequency (<xref rid="F1" ref-type="fig">Fig. 1d</xref>
; <xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 2a</xref>
). The rewarded AT (RAT) consisted of 200 Hz pulse trains delivered in 10 Hz packets. The comparison ATs were represented by 400 Hz pulse trains delivered in 5 Hz packets (unrewarded artificial texture, UAT) or by an absence of ICMS (null artificial texture, NAT).</p>
<p id="P5">The major challenge solved here was the real-time coupling of ICMS feedback with the BMI decoder. As ICMS artefacts masked neuronal activity for 5–10 ms after each pulse (<xref rid="F1" ref-type="fig">Fig. 1d, e</xref>
), we multiplexed neuronal recordings and ICMS with a 20 Hz clock rate (<xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 2a</xref>
). The interleaved intervals proved adequate for online motor control and artificial sensation—a result that was not clear <italic>a priori</italic>
since S1 stimulation could have affected M1 processing through the connections between these areas.</p>
<p id="P6">BMBI performance improved with training. In Task I (<xref rid="F2" ref-type="fig">Fig. 2a–I</xref>
), monkey M surpassed chance performance after nine sessions; monkey N after four (P < 0.001, one-sided binomial test). Improvement continued with more difficult tasks (Tasks II–V) (<xref rid="F2" ref-type="fig">Fig 2a,b</xref>
; <xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 3a</xref>
). In particular, the time spent exploring unrewarded ATs decreased (<xref rid="F2" ref-type="fig">Fig. 2c</xref>
; <xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 3b</xref>
). Additionally, performance improved within daily experimental sessions (<xref rid="F2" ref-type="fig">Fig. 2d</xref>
). Psychometric analysis of RAT stimulation amplitudes indicated that at least 8 nC per ICMS waveform phase (100 μs wide current pulses of 80 μA) was needed for the AT discrimination (P < 0.001, one-sided binomial test). Performance was at chance level for catch trials (in Task II), where ICMS was not delivered (P = 0.90, one-sided binomial test).</p>
<p id="P7">The statistics of object exploration intervals (total time spent over a particular object on a given trial) indicated that the monkeys uniquely discriminated each AT type (<xref rid="F2" ref-type="fig">Fig. 2c</xref>
; <xref rid="F3" ref-type="fig">3a,c</xref>
) and interpreted ICMS within hundreds of milliseconds—a timescale comparable to the discrimination of peripheral tactile stimuli <sup><xref rid="R24" ref-type="bibr">24</xref>
,<xref rid="R25" ref-type="bibr">25</xref>
</sup>
. Early in Task I, exploration intervals were equal for RAT and NAT (P > 0.5, Wilcoxon signed-rank test) and, with training, became longer for RAT and shorter for NAT (Tasks I–II) and UAT (Tasks III–V). During HC, the mean interval was longest for RAT (monkey M: 1,396 ± 21 ms; monkey N: 1,165 ± 15 ms; mean ± s.e.m.), shortest for NAT (304 ± 8 ms; 300 ± 10 ms), and intermediate for UAT (452 ± 13 ms; 402 ± 14 ms) (P < 0.01, ANOVA). During BC, intervals spent exploring NAT (498 ± 15 ms; 587 ± 25 ms) and UAT (685 ± 20 ms; 764 ± 32 ms) were longer as compared to HC, but still shorter as compared to RAT (1,420 ± 28 ms; 1,398 ± 55 ms) (P<0.01, ANOVA).</p>
<p id="P8">Additional hallmarks of active exploration were seen in the conditional probabilities of selecting different ATs (<xref rid="F3" ref-type="fig">Figure 3b,d</xref>
). During HC trials, the monkeys stayed over the first encountered AT (arrows that loop back to the same AT in <xref rid="F3" ref-type="fig">Fig. 3b,d</xref>
) with high probability if it was RAT (P=0.70 for monkey M and 0.76 for monkey N), but with low probability if it was UAT (0.05 and 0.01) or NAT (0.0 and 0.0) (<xref rid="F3" ref-type="fig">Fig. 3b,d</xref>
, left). After examining the second AT, the monkeys could identify the correct AT either by apprehending it directly or through a process of elimination. This follows from the increase in the probability of moving to RAT from NAT or UAT from chance to approximately 0.7 and the decrease in the probability of revisiting UAT or NAT to approximately 0.2 (<xref rid="F3" ref-type="fig">Fig. 3b,d</xref>
right). Similar effects were observed for BC (<xref rid="F3" ref-type="fig">Fig. 3e</xref>
, red text).</p>
<p id="P9">BC started in Task IV. During BC with hand movements (BCWH), the monkeys continued to hold the joystick although it was disconnected <sup><xref rid="R16" ref-type="bibr">16</xref>
,<xref rid="R22" ref-type="bibr">22</xref>
</sup>
. During brain control without hand (BCWOH) <sup><xref rid="R9" ref-type="bibr">9</xref>
,<xref rid="R22" ref-type="bibr">22</xref>
</sup>
, the joystick was removed. In monkey M, with more than 200-recorded neurons, performance was less accurate during BCWH (73.75 ± 3.00%, mean ± s.e.m.) than during HC (91.48 ± 1.20%). In Monkey N with 50-recorded neurons, performance dropped further (50.37 ± 3.74 % versus 91.45 ± 1.91%), but still significantly exceeded the 33% chance level. M1 neurons exhibited directionally tuned modulations (<xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 5; 6</xref>
) that were retained across different interfering ICMS patterns both during HC (<xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 4a,b</xref>
) and BC (<xref rid="F4" ref-type="fig">Fig. 4a,b</xref>
).</p>
<p id="P10">In BCWOH, task requirements were eased: the object selection period was reduced to 300–500 ms and monkeys were allowed to overstay at an incorrect object. Performance for monkey M, measured as the number of rewards per minute, steadily improved from 1.021 ± 0.007 to 2.962 ± 0.005 (mean ± s.e.m.) (<xref rid="F2" ref-type="fig">Fig. 2d</xref>
). Similar improvements were observed for HC and BCWH (inset in <xref rid="F2" ref-type="fig">Fig. 2d</xref>
). The average frequency of actuator displacements, calculated from power spectra, was correlated with the improvement in performance during BCWOH (R<sup>2</sup>
=0.16 for the X-coordinate and R<sup>2</sup>
=0.26 for the Y-coordinate, P<0.001, F-test), which indicated that the monkey modulated its brain activity to scan the targets faster. This behaviour was not random, as the exploration interval for NAT (3,620 ± 350 ms, mean ± s.e.m.) was significantly shorter (P<0.02, Wilcoxon rank sum test) than for UAT (4,270 ± 310 ms). The exploration of RAT (2,255 ± 94 ms) was the shortest due to the reduced selection period. For monkey N, BCWOH performance (2.084 ± 0.085 rewards per minute) did not change within sessions, and the differences in exploration intervals were not significant.</p>
<p id="P11">In agreement with others <sup><xref rid="R26" ref-type="bibr">26</xref>
–<xref rid="R30" ref-type="bibr">30</xref>
</sup>
, we observed that M1 neurons represented the movements of the actuator even when it was passively observed by the monkey (<xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 7</xref>
). Actuator movements (task V) replayed for the monkeys could be reconstructed from M1 activity, using a separately trained decoder (<xref rid="F4" ref-type="fig">Fig. 4d</xref>
), with similar accuracy to reconstructions made for HC (<xref rid="F4" ref-type="fig">Fig. 4c</xref>
). M1 representation of the passively viewed actuator is consistent with our suggestion that a neuroprosthetic limb might become incorporated in brain circuitry <sup><xref rid="R1" ref-type="bibr">1</xref>
</sup>
.</p>
<p id="P12">Our BMBI demonstrated direct bidirectional communication between a primate brain and an external actuator. As both the afferent and efferent channels bypassed the subject’s body, we propose that BMBIs can effectively liberate a brain from the physical constraints of the body. Accordingly, future BMBIs may not be limited to limb prostheses, but may include devices designed for reciprocal communication between and among neural structures and with a variety of external actuators.</p>
<sec id="S1"><title>METHODS SUMMARY</title>
<p id="P13">All animal procedures were performed in accordance with the National Research Council’s Guide for the Care and Use of Laboratory Animals and were approved by the Duke University Institutional Animal Care and Use Committee. Two rhesus monkeys were implanted with micro-wire arrays in both hemispheres. These implants were used for both recordings and ICMS (symmetric, biphasic, charge-balanced pulse trains; 100–200 μs, 120–200 μA). Monkeys manipulated a joystick to produce reaches with an actuator (computer cursor or a virtual reality arm) towards up to three objects displayed on a computer monitor. The task required searching for the object with particular artificial tactile properties. Objects consisted of a central response zone and a peripheral feedback zone. Artificial tactile feedback was delivered when the actuator entered the feedback zone and continued in the response zone. Monkeys held the actuator over the correct object for 0.8–1.3 s to receive a fruit juice reward. Holding over an incorrect object cancelled the trial. In brain control trials, the actuator was controlled by cortical ensemble activity decoded using an Unscented Kalman Filter <sup><xref rid="R23" ref-type="bibr">23</xref>
</sup>
. An interleaved scheme of alternating recording and stimulation subintervals (50 ms each, 50% duty cycle) was implemented to achieve concurrent afferent and efferent operations. In all offline analyses, ICMS periods were excluded from calculations of neuronal firing rates. The virtual reality arm was animated using Motion Builder (Autodesk, Inc., San Rafael, CA).</p>
</sec>
<sec sec-type="methods" id="S2"><title>METHODS</title>
<sec id="S3" sec-type="subjects"><title>Subjects and implants</title>
<p id="P14">Two adult rhesus macaque monkeys (<italic>Macaca mulatta</italic>
) participated in this study. Each monkey was implanted with four 96-micro-wire arrays constructed of stainless steel 304. Each hemisphere received two arrays: one in the upper and one in the lower limb representation areas. These array sampled neurons in both primary motor (M1) and primary sensory (S1) cortex. We used recordings from the right hemisphere arm arrays in each monkey, since both manipulated the joystick with their left hands. Within each array, micro-wires were grouped in two 4-by-4 uniformly-spaced grids of 16-triplets of electrodes. The separation between triplets of electrodes was 1 mm. The electrodes of each triplet had three different lengths, staggered at 300 μm intervals. The penetration depth of each triplet was adjusted with a miniature screw. After adjustments during the month following the implantation surgery, the depth of the triplets was fixed. The longest electrodes in all triplets protruded to 2 mm in length measured from the cortical surface.</p>
</sec>
<sec id="S4"><title>Tasks</title>
<p id="P15">The monkeys were trained to manipulate a computer cursor or a virtual reality arm and to make reaches towards objects displayed on a computer monitor. The objects were visually identical, but exhibited different tactile properties as conveyed by ICMS of S1. In manual control, each trial commenced when the monkey held the joystick with their working hand. Then, a target appeared in the centre of the screen. The monkey had to hold the actuator (cursor or virtual reality monkey arm) within that centre target for a random hold time uniformly drawn from the interval 0 to 2 s. After this, the central target disappeared and was replaced by a set of virtual objects radially arranged about the centre of the screen. Each of these consisted of a central response zone and a peripheral feedback zone, distinguished by their shading (<xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 1c</xref>
). Tactile feedback was delivered in the feedback zone or corresponding response zone. For monkey M, the radius of the response zone varied from 1.5 to 4.0 cm and the radius of the feedback zone varied from 4.5 to 7.25 cm, across all tasks and sessions. For monkey N, the radius of the response zone varied from 1.5 to 4.5 cm and the radius of the feedback zone varied from 4.75 to 9.5 cm, across all tasks and sessions. A trial was concluded when the monkey placed the actuator within the response zone for a hold interval (800 to 1300 ms for HC, depending on the session; 300 to 500 ms for BC) or the monkey released the joystick handle (in manual control trials). The next trial could commence after an inter-trial interval (500 ms). The sequence of events was the same during brain control trials. In some brain control sessions, the joystick was removed from the behavioural setup. For these, each new trial commenced following the previous inter-trial interval without the requirement for the monkey to hold the joystick. For Tasks I through III, monkeys chose from a set of two objects. For Task I, the monkeys had to choose between RAT and NAT for fixed object locations. For Task II, RAT and NAT were presented on the screen at different angular locations on each trial. For Task III, object number and spatial arrangement were the same as in Task II, but RAT and UAT were used. For Task IV, three objects were used (RAT, UAT and NAT), whose arrangement on the screen varied from trial to trial. Finally, for Task V, the virtual reality monkey arm replaced the computer cursor.</p>
</sec>
<sec id="S5"><title>Psychometric measurements</title>
<p id="P16">Psychometric measurements determined the minimum ICMS amplitude that the monkeys could discriminate. In these measurements, the ICMS amplitude was different on every trial. In each psychometric session a range of amplitudes was selected so that about half were in a range clearly above the monkeys’ threshold for discrimination and half were in a range of unknown discriminability.</p>
</sec>
<sec id="S6"><title>Catch trials</title>
<p id="P17">In some sessions, a small percentage of trials (typically 1%) were designated for catch trials. For these trials, the microstimulator delivered pulse trains with zero amplitude, however all other aspects of the behavioural task remained the same. This allowed us to confirm that there were no unintentional sources of information that the monkeys could use to perform the tasks.</p>
</sec>
<sec id="S7"><title>Algorithms</title>
<p id="P18">An Nth-order Unscented Kalman filter (UKF) <sup><xref rid="R23" ref-type="bibr">23</xref>
</sup>
used for BC predictions. Up to a 10th-order UKF was used in some sessions, but in most sessions we found that the 3rd-order UKF was sufficient. The filter parameters were fit based on the hand movements of the monkeys while they performed the task using a joystick or based on passive observation of actuator movements while the monkeys’ arms were restrained.</p>
</sec>
<sec id="S8"><title>ICMS</title>
<p id="P19">Symmetric, biphasic, charge-balanced pulse trains were delivered in a bipolar fashion across pairs of microwires. The channels selected had clear sensory receptive fields in the upper limb (monkey M, two pairs of microwires with synchronous pulse trains) or lower limb (monkey N, one pair of microwires). For monkey M, the anodic and cathodic phases of stimulation had a pulse width of 105 μs; for monkey N the pulse width was 200 μs. The anodic and cathodic phases of the stimulation waveforms were separated by 25 μs.</p>
</sec>
<sec id="S9"><title>Interleaved ICMS and recordings</title>
<p id="P20">We implemented an interleaved scheme of alternating recording and stimulation intervals (<xref rid="SD1" ref-type="supplementary-material">Supplementary Fig. 2a</xref>
). Our BMI had a 10 Hz update rate. That is, 100 ms of past neural data are used to make predictions about the desired state of the actuator. We broke up each 100 ms interval into two 50 ms sub-intervals. In the first sub-interval (Rec), neural activity was recorded as usual and the measured spike count was used to estimate the firing rate for the whole 100 ms interval. The second sub-interval (Stim) was reserved exclusively for delivering ICMS; all spiking activity occurring in this subinterval was discarded. Whenever the actuator was in contact with a virtual object at the start of a Stim interval, an ICMS pulse train was delivered. For RAT, nine pulses of ICMS were delivered; For UAT, 18 pulses of ICMS were delivered; for NAT, no pulses of ICMS were delivered. The neural activity in the Stim interval was discarded even in the case of NAT, so that there would be no bias induced by ICMS-occluded neural data.</p>
</sec>
<sec id="S10"><title>Virtual reality monkey arm</title>
<p id="P21">In Task V, we introduced a novel brain-controlled virtual reality arm with realistic kinematic movements and spatial interactions. The control loop rate was 50 Hz, with visual refreshing at 30 Hz. The arm model was designed to depict a rhesus conspecific. We presented a first person perspective of the virtual reality arm to the monkey, who controlled the position of the hand. Arm posture was controlled using a mixture of direct control of end effectors and inverse kinematics, constrained by the physical interdependencies of the joints.</p>
</sec>
</sec>
<sec sec-type="supplementary-material" id="S11"><title>Supplementary Material</title>
<supplementary-material content-type="local-data" id="SD1"><label>1</label>
<media xlink:href="NIHMS319148-supplement-1.doc" mimetype="application" mime-subtype="msword" orientation="portrait" xlink:type="simple" id="d37e488" position="anchor"></media>
</supplementary-material>
</sec>
</body>
<back><ack id="S12"><p>We thank D. Dimitrov for conducting the animal neurosurgeries, G. Lehew and J. Meloy for building brain implants, J. Fruh for rendering the monkey arm, T. Phillips, L. Oliveira, and S. Halkiotis for technical support, and E. Thomson and Z. Li for comments. This research was supported by DARPA N66001-06-C-2019, TATRC W81XWH-08-2-0119, NIH NS073125, NICHD/OD RC1HD063390 and NIH Director’s Pioneer Award DP1OD006798 to MALN. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Office of the NIH Director or the NIH.</p>
</ack>
<fn-group><fn id="FN1" fn-type="con"><p><bold>Author Contributions</bold>
</p>
<p>JEO, MAL and MALN designed experiments, analyzed data and wrote the paper, JEO, MAL, PJI and KZZ conducted experiments, SS and HB developed the virtual reality monkey arm.</p>
</fn>
</fn-group>
<ref-list><ref id="R1"><label>1</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lebedev</surname>
<given-names>MA</given-names>
</name>
<name><surname>Nicolelis</surname>
<given-names>MA</given-names>
</name>
</person-group>
<article-title>Brain-machine interfaces: past, present and future</article-title>
<source>Trends Neurosci</source>
<volume>29</volume>
<fpage>536</fpage>
<lpage>546</lpage>
<comment>S0166-2236(06)00147-0 [pii]</comment>
<pub-id pub-id-type="doi">10.1016/j.tins.2006.07.004</pub-id>
<year>2006</year>
<pub-id pub-id-type="pmid">16859758</pub-id>
</element-citation>
</ref>
<ref id="R2"><label>2</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nicolelis</surname>
<given-names>MA</given-names>
</name>
<name><surname>Lebedev</surname>
<given-names>MA</given-names>
</name>
</person-group>
<article-title>Principles of neural ensemble physiology underlying the operation of brain-machine interfaces</article-title>
<source>Nat Rev Neurosci</source>
<volume>10</volume>
<fpage>530</fpage>
<lpage>540</lpage>
<comment>nrn2653 [pii]</comment>
<pub-id pub-id-type="doi">10.1038/nrn2653</pub-id>
<year>2009</year>
<pub-id pub-id-type="pmid">19543222</pub-id>
</element-citation>
</ref>
<ref id="R3"><label>3</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chapin</surname>
<given-names>JK</given-names>
</name>
<name><surname>Moxon</surname>
<given-names>KA</given-names>
</name>
<name><surname>Markowitz</surname>
<given-names>RS</given-names>
</name>
<name><surname>Nicolelis</surname>
<given-names>MAL</given-names>
</name>
</person-group>
<article-title>Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex</article-title>
<source>Nat Neurosci</source>
<volume>2</volume>
<fpage>664</fpage>
<lpage>670</lpage>
<pub-id pub-id-type="doi">10.1038/10223</pub-id>
<year>1999</year>
<pub-id pub-id-type="pmid">10404201</pub-id>
</element-citation>
</ref>
<ref id="R4"><label>4</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Velliste</surname>
<given-names>M</given-names>
</name>
<name><surname>Perel</surname>
<given-names>S</given-names>
</name>
<name><surname>Spalding</surname>
<given-names>MC</given-names>
</name>
<name><surname>Whitford</surname>
<given-names>AS</given-names>
</name>
<name><surname>Schwartz</surname>
<given-names>AB</given-names>
</name>
</person-group>
<article-title>Cortical control of a prosthetic arm for self-feeding</article-title>
<source>Nature</source>
<volume>453</volume>
<fpage>1098</fpage>
<lpage>1101</lpage>
<comment>nature06996 [pii]</comment>
<pub-id pub-id-type="doi">10.1038/nature06996</pub-id>
<year>2008</year>
<pub-id pub-id-type="pmid">18509337</pub-id>
</element-citation>
</ref>
<ref id="R5"><label>5</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moritz</surname>
<given-names>CT</given-names>
</name>
<name><surname>Perlmutter</surname>
<given-names>SI</given-names>
</name>
<name><surname>Fetz</surname>
<given-names>EE</given-names>
</name>
</person-group>
<article-title>Direct control of paralysed muscles by cortical neurons</article-title>
<source>Nature</source>
<volume>456</volume>
<fpage>639</fpage>
<lpage>642</lpage>
<comment>nature07418 [pii]</comment>
<pub-id pub-id-type="doi">10.1038/nature07418</pub-id>
<year>2008</year>
<pub-id pub-id-type="pmid">18923392</pub-id>
</element-citation>
</ref>
<ref id="R6"><label>6</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wessberg</surname>
<given-names>J</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Real-time prediction of hand trajectory by ensembles of cortical neurons in primates</article-title>
<source>Nature</source>
<volume>408</volume>
<fpage>361</fpage>
<lpage>365</lpage>
<pub-id pub-id-type="doi">10.1038/35042582</pub-id>
<year>2000</year>
<pub-id pub-id-type="pmid">11099043</pub-id>
</element-citation>
</ref>
<ref id="R7"><label>7</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Taylor</surname>
<given-names>DM</given-names>
</name>
<name><surname>Helms-Tillery</surname>
<given-names>SI</given-names>
</name>
<name><surname>Schwartz</surname>
<given-names>AB</given-names>
</name>
</person-group>
<article-title>Direct cortical control of 3D neuroprosthetic devices</article-title>
<source>Science</source>
<volume>296</volume>
<fpage>1829</fpage>
<lpage>1832</lpage>
<pub-id pub-id-type="doi">10.1126/science.1070291</pub-id>
<year>2002</year>
<pub-id pub-id-type="pmid">12052948</pub-id>
</element-citation>
</ref>
<ref id="R8"><label>8</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Serruya</surname>
<given-names>MD</given-names>
</name>
<name><surname>Hatsopoulos</surname>
<given-names>NG</given-names>
</name>
<name><surname>Paninski</surname>
<given-names>L</given-names>
</name>
<name><surname>Fellows</surname>
<given-names>MR</given-names>
</name>
<name><surname>Donoghue</surname>
<given-names>JP</given-names>
</name>
</person-group>
<article-title>Instant neural control of a movement signal</article-title>
<source>Nature</source>
<volume>416</volume>
<fpage>141</fpage>
<lpage>142</lpage>
<pub-id pub-id-type="doi">10.1038/416141a</pub-id>
<comment>416141a [pii]</comment>
<year>2002</year>
<pub-id pub-id-type="pmid">11894084</pub-id>
</element-citation>
</ref>
<ref id="R9"><label>9</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Carmena</surname>
<given-names>JM</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Learning to control a brain-machine interface for reaching and grasping by primates</article-title>
<source>PLoS Biol</source>
<volume>1</volume>
<fpage>E42</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pbio.0000042</pub-id>
<year>2003</year>
<pub-id pub-id-type="pmid">14624244</pub-id>
</element-citation>
</ref>
<ref id="R10"><label>10</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Johansson</surname>
<given-names>RS</given-names>
</name>
<name><surname>Westling</surname>
<given-names>G</given-names>
</name>
</person-group>
<article-title>Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects</article-title>
<source>Experimental brain research. Experimentelle Hirnforschung. Expérimentation cérébrale</source>
<volume>56</volume>
<fpage>550</fpage>
<lpage>564</lpage>
<year>1984</year>
<pub-id pub-id-type="pmid">6499981</pub-id>
</element-citation>
</ref>
<ref id="R11"><label>11</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Flanagan</surname>
<given-names>JR</given-names>
</name>
<name><surname>Wing</surname>
<given-names>AM</given-names>
</name>
</person-group>
<article-title>Modulation of grip force with load force during point-to-point arm movements</article-title>
<source>Experimental brain research. Experimentelle Hirnforschung. Expérimentation cérébrale</source>
<volume>95</volume>
<fpage>131</fpage>
<lpage>143</lpage>
<year>1993</year>
<pub-id pub-id-type="pmid">8405245</pub-id>
</element-citation>
</ref>
<ref id="R12"><label>12</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>James</surname>
<given-names>TW</given-names>
</name>
<name><surname>Kim</surname>
<given-names>S</given-names>
</name>
<name><surname>Fisher</surname>
<given-names>JS</given-names>
</name>
</person-group>
<article-title>The neural basis of haptic object processing</article-title>
<source>Can J Exp Psychol</source>
<volume>61</volume>
<fpage>219</fpage>
<lpage>229</lpage>
<year>2007</year>
<pub-id pub-id-type="pmid">17974316</pub-id>
</element-citation>
</ref>
<ref id="R13"><label>13</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chatterjee</surname>
</name>
<name><surname>Aggarwal</surname>
<given-names>V</given-names>
</name>
<name><surname>Ramos</surname>
</name>
<name><surname>Acharya</surname>
<given-names>S</given-names>
</name>
<name><surname>Thakor</surname>
<given-names>NV</given-names>
</name>
</person-group>
<article-title>A brain-computer interface with vibrotactile biofeedback for haptic information</article-title>
<source>J Neuroengineering Rehabil</source>
<volume>4</volume>
<fpage>40</fpage>
<pub-id pub-id-type="doi">10.1186/1743-0003-4-40</pub-id>
<year>2007</year>
</element-citation>
</ref>
<ref id="R14"><label>14</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kaczmarek</surname>
<given-names>K</given-names>
</name>
<name><surname>Webster</surname>
<given-names>J</given-names>
</name>
<name><surname>Bach-y-Rita</surname>
<given-names>P</given-names>
</name>
<name><surname>Tompkins</surname>
<given-names>W</given-names>
</name>
</person-group>
<article-title>Electrotactile and vibrotactile displays for sensory substitution systems</article-title>
<source>IEEE Transactions on Biomedical Engineering</source>
<volume>38</volume>
<fpage>1 </fpage>
<lpage>16</lpage>
<pub-id pub-id-type="doi">10.1109/10.68204</pub-id>
<year>1991</year>
<pub-id pub-id-type="pmid">2026426</pub-id>
</element-citation>
</ref>
<ref id="R15"><label>15</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Marasco</surname>
<given-names>PD</given-names>
</name>
<name><surname>Schultz</surname>
<given-names>AE</given-names>
</name>
<name><surname>Kuiken</surname>
<given-names>TA</given-names>
</name>
</person-group>
<article-title>Sensory capacity of reinnervated skin after redirection of amputated upper limb nerves to the chest</article-title>
<source>Brain</source>
<volume>132</volume>
<fpage>1441</fpage>
<lpage>1448</lpage>
<pub-id pub-id-type="doi">10.1093/brain/awp082</pub-id>
<year>2009</year>
<pub-id pub-id-type="pmid">19369486</pub-id>
</element-citation>
</ref>
<ref id="R16"><label>16</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>O’Doherty</surname>
<given-names>JE</given-names>
</name>
<name><surname>Lebedev</surname>
<given-names>MA</given-names>
</name>
<name><surname>Hanson</surname>
<given-names>TL</given-names>
</name>
<name><surname>Fitzsimmons</surname>
<given-names>NA</given-names>
</name>
<name><surname>Nicolelis</surname>
<given-names>MA</given-names>
</name>
</person-group>
<article-title>A brain-machine interface instructed by direct intracortical microstimulation</article-title>
<source>Front Integr Neurosci</source>
<volume>3</volume>
<fpage>20</fpage>
<pub-id pub-id-type="doi">10.3389/neuro.07.020.2009</pub-id>
<year>2009</year>
<pub-id pub-id-type="pmid">19750199</pub-id>
</element-citation>
</ref>
<ref id="R17"><label>17</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Richer</surname>
<given-names>F</given-names>
</name>
<name><surname>Martinez</surname>
<given-names>M</given-names>
</name>
<name><surname>Robert</surname>
<given-names>M</given-names>
</name>
<name><surname>Bouvier</surname>
<given-names>G</given-names>
</name>
<name><surname>Saint-Hilaire</surname>
<given-names>JM</given-names>
</name>
</person-group>
<article-title>Stimulation of human somatosensory cortex: tactile and body displacement perceptions in medial regions</article-title>
<source>Experimental brain research. Experimentelle Hirnforschung. Expérimentation cérébrale</source>
<volume>93</volume>
<fpage>173</fpage>
<lpage>176</lpage>
<year>1993</year>
<pub-id pub-id-type="pmid">8467887</pub-id>
</element-citation>
</ref>
<ref id="R18"><label>18</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>London</surname>
<given-names>BM</given-names>
</name>
<name><surname>Jordan</surname>
<given-names>LR</given-names>
</name>
<name><surname>Jackson</surname>
<given-names>CR</given-names>
</name>
<name><surname>Miller</surname>
<given-names>LE</given-names>
</name>
</person-group>
<article-title>Electrical stimulation of the proprioceptive cortex (area 3a) used to instruct a behaving monkey</article-title>
<source>IEEE Trans Neural Syst Rehabil Eng</source>
<volume>16</volume>
<fpage>32</fpage>
<lpage>36</lpage>
<year>2008</year>
<pub-id pub-id-type="pmid">18303803</pub-id>
</element-citation>
</ref>
<ref id="R19"><label>19</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Romo</surname>
<given-names>R</given-names>
</name>
<name><surname>Hernandez</surname>
<given-names>A</given-names>
</name>
<name><surname>Zainos</surname>
<given-names>A</given-names>
</name>
<name><surname>Salinas</surname>
<given-names>E</given-names>
</name>
</person-group>
<article-title>Somatosensory discrimination based on cortical microstimulation</article-title>
<source>Nature</source>
<volume>392</volume>
<fpage>387</fpage>
<lpage>390</lpage>
<pub-id pub-id-type="doi">10.1038/32891</pub-id>
<year>1998</year>
<pub-id pub-id-type="pmid">9537321</pub-id>
</element-citation>
</ref>
<ref id="R20"><label>20</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fitzsimmons</surname>
<given-names>NA</given-names>
</name>
<name><surname>Drake</surname>
<given-names>W</given-names>
</name>
<name><surname>Hanson</surname>
<given-names>TL</given-names>
</name>
<name><surname>Lebedev</surname>
<given-names>MA</given-names>
</name>
<name><surname>Nicolelis</surname>
<given-names>MA</given-names>
</name>
</person-group>
<article-title>Primate reaching cued by multichannel spatiotemporal cortical microstimulation</article-title>
<source>J Neurosci</source>
<volume>27</volume>
<fpage>5593</fpage>
<lpage>5602</lpage>
<comment>27/21/5593 [pii]</comment>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5297-06.2007</pub-id>
<year>2007</year>
<pub-id pub-id-type="pmid">17522304</pub-id>
</element-citation>
</ref>
<ref id="R21"><label>21</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lederman</surname>
<given-names>SJ</given-names>
</name>
<name><surname>Klatzky</surname>
<given-names>RL</given-names>
</name>
</person-group>
<article-title>Hand movements: a window into haptic object recognition</article-title>
<source>Cogn Psychol</source>
<volume>19</volume>
<fpage>342</fpage>
<lpage>368</lpage>
<year>1987</year>
<pub-id pub-id-type="pmid">3608405</pub-id>
</element-citation>
</ref>
<ref id="R22"><label>22</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lebedev</surname>
<given-names>MA</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface</article-title>
<source>J Neurosci</source>
<volume>25</volume>
<fpage>4681</fpage>
<lpage>4693</lpage>
<comment>25/19/4681 [pii]</comment>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4088-04.2005</pub-id>
<year>2005</year>
<pub-id pub-id-type="pmid">15888644</pub-id>
</element-citation>
</ref>
<ref id="R23"><label>23</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Li</surname>
<given-names>Z</given-names>
</name>
<etal></etal>
</person-group>
<article-title>Unscented Kalman filter for brain-machine interfaces</article-title>
<source>PLoS ONE</source>
<volume>4</volume>
<fpage>e6243</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pone.0006243</pub-id>
<year>2009</year>
<pub-id pub-id-type="pmid">19603074</pub-id>
</element-citation>
</ref>
<ref id="R24"><label>24</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lebedev</surname>
<given-names>MA</given-names>
</name>
<name><surname>Denton</surname>
<given-names>JM</given-names>
</name>
<name><surname>Nelson</surname>
<given-names>RJ</given-names>
</name>
</person-group>
<article-title>Vibration-entrained and premovement activity in monkey primary somatosensory cortex</article-title>
<source>J Neurophysiol</source>
<volume>72</volume>
<fpage>1654</fpage>
<lpage>1673</lpage>
<year>1994</year>
<pub-id pub-id-type="pmid">7823093</pub-id>
</element-citation>
</ref>
<ref id="R25"><label>25</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname>
<given-names>Y</given-names>
</name>
<name><surname>Denton</surname>
<given-names>JM</given-names>
</name>
<name><surname>Nelson</surname>
<given-names>RJ</given-names>
</name>
</person-group>
<article-title>Neuronal activity in primary motor cortex differs when monkeys perform somatosensory and visually guided wrist movements</article-title>
<source>Exp Brain Res</source>
<volume>167</volume>
<fpage>571</fpage>
<lpage>586</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-005-0052-8</pub-id>
<year>2005</year>
<pub-id pub-id-type="pmid">16078029</pub-id>
</element-citation>
</ref>
<ref id="R26"><label>26</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cisek</surname>
<given-names>P</given-names>
</name>
<name><surname>Kalaska</surname>
<given-names>JF</given-names>
</name>
</person-group>
<article-title>Neural correlates of mental rehearsal in dorsal premotor cortex</article-title>
<source>Nature</source>
<volume>431</volume>
<fpage>993</fpage>
<lpage>996</lpage>
<comment>nature03005 [pii]</comment>
<pub-id pub-id-type="doi">10.1038/nature03005</pub-id>
<year>2004</year>
<pub-id pub-id-type="pmid">15496925</pub-id>
</element-citation>
</ref>
<ref id="R27"><label>27</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Graziano</surname>
<given-names>MS</given-names>
</name>
<name><surname>Cooke</surname>
<given-names>DF</given-names>
</name>
<name><surname>Taylor</surname>
<given-names>CS</given-names>
</name>
</person-group>
<article-title>Coding the location of the arm by sight</article-title>
<source>Science</source>
<volume>290</volume>
<fpage>1782</fpage>
<lpage>1786</lpage>
<comment>9014 [pii]</comment>
<year>2000</year>
<pub-id pub-id-type="pmid">11099420</pub-id>
</element-citation>
</ref>
<ref id="R28"><label>28</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Maravita</surname>
<given-names>A</given-names>
</name>
<name><surname>Iriki</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Tools for the body (schema)</article-title>
<source>Trends Cogn Sci</source>
<volume>8</volume>
<fpage>79</fpage>
<lpage>86</lpage>
<comment>S1364661303003450 [pii]</comment>
<pub-id pub-id-type="doi">10.1016/j.tics.2003.12.008</pub-id>
<year>2004</year>
<pub-id pub-id-type="pmid">15588812</pub-id>
</element-citation>
</ref>
<ref id="R29"><label>29</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tkach</surname>
<given-names>D</given-names>
</name>
<name><surname>Reimer</surname>
<given-names>J</given-names>
</name>
<name><surname>Hatsopoulos</surname>
<given-names>NG</given-names>
</name>
</person-group>
<article-title>Observation-based learning for brain-machine interfaces</article-title>
<source>Curr Opin Neurobiol</source>
<volume>18</volume>
<fpage>589</fpage>
<lpage>594</lpage>
<year>2008</year>
<pub-id pub-id-type="pmid">18838120</pub-id>
</element-citation>
</ref>
<ref id="R30"><label>30</label>
<element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dushanova</surname>
<given-names>J</given-names>
</name>
<name><surname>Donoghue</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Neurons in primary motor cortex engaged during action observation</article-title>
<source>Eur J Neurosci</source>
<volume>31</volume>
<fpage>386</fpage>
<lpage>398</lpage>
<comment>EJN7067 [pii]</comment>
<pub-id pub-id-type="doi">10.1111/j.1460-9568.2009.07067.x</pub-id>
<year>2010</year>
<pub-id pub-id-type="pmid">20074212</pub-id>
</element-citation>
</ref>
</ref-list>
</back>
<floats-group><fig id="F1" orientation="portrait" position="float"><label>Figure 1</label>
<caption><title>The brain-machine-brain interface</title>
<p><bold>a,</bold>
Movement intentions are decoded from M1; artificial tactile feedback is delivered to S1. <bold>b,</bold>
Microwires were implanted in M1 and S1. <bold>c,</bold>
Microwires used for ICMS in monkey M are accented in red. <bold>d,</bold>
Actuator movements for a trial where monkey M explores the UAT object but ultimately selects the RAT object. Gray bars indicate stimulation patterns; insets indicate the ICMS frequency. <bold>e,</bold>
Rastergram of M1 neurons recorded during the trial shown in panel d.</p>
</caption>
<graphic xlink:href="nihms319148f1"></graphic>
</fig>
<fig id="F2" orientation="portrait" position="float"><label>Figure 2</label>
<caption><title>Learning to use ICMS feedback</title>
<p><bold>a,</bold>
Behavioural tasks. <bold>b, c,</bold>
Performance of monkey M (72 sessions). Circles (<bold>b</bold>
) depict fraction of correctly performed trials. Open circles indicate chance performance. Curves are lines of best fit. Asterisk indicates session used for psychometric measurements. Squares, triangles and crosses (<bold>c</bold>
) represent mean times spent in RAT, UAT, and NAT, respectively. Black symbols indicate HC; red, BC. <bold>d,</bold>
Intrasession performance for monkey M. Curves represent averages for BCWOH (main panel, 3 sessions), HC (inset, 12 sessions) and BCWH (inset, 12 sessions). Lines are best linear fits.</p>
</caption>
<graphic xlink:href="nihms319148f2"></graphic>
</fig>
<fig id="F3" orientation="portrait" position="float"><label>Figure 3</label>
<caption><title>Statistics of object exploration</title>
<p><bold>a,</bold>
Object exploration intervals during HC and BC (inset) for monkey M (HC: n=1809 trials, BC: n=1355 trials). <bold>b,</bold>
State transition diagrams for monkey M indicating the probability of reaches between RAT, UAT, and NAT after the first (left sub-panel) or second (right sub-panel) reach. Black labels indicate HC; red, BC. Line thickness is proportional to transition probability. <bold>c,</bold>
Same as panel a, but for monkey N (HC: n=808 trials, BC: n=729 trials). <bold>d,</bold>
Same as panel b, but for monkey N.</p>
</caption>
<graphic xlink:href="nihms319148f3"></graphic>
</fig>
<fig id="F4" orientation="portrait" position="float"><label>Figure 4</label>
<caption><title>M1 modulations during active control versus passive observation</title>
<p><bold>a, b,</bold>
Average BC movements for monkey M (n=294 trials) towards the RAT, UAT and NAT objects appearing on the left side off the screen (<bold>a</bold>
) and corresponding neuronal modulations (<bold>b</bold>
). Red trace is actuator; dashed black, joystick. Only trials with subsequent counter-clockwise reaches are included in the middle and right sub-panels. Red vertical lines indicate object onset. Firing rate normalized by s.d. <bold>c, d,</bold>
Position of the actuator actively controlled (<bold>c</bold>
) and passive observed (<bold>d</bold>
) by monkey M. Black trace is joystick; red, offline predictions.</p>
</caption>
<graphic xlink:href="nihms319148f4"></graphic>
</fig>
</floats-group>
</pmc>
<affiliations><list><country><li>Brésil</li>
<li>Suisse</li>
<li>États-Unis</li>
</country>
<region><li>Canton de Vaud</li>
<li>Caroline du Nord</li>
</region>
<settlement><li>Lausanne</li>
</settlement>
</list>
<tree><country name="États-Unis"><region name="Caroline du Nord"><name sortKey="O Oherty, Joseph E" sort="O Oherty, Joseph E" uniqKey="O Oherty J" first="Joseph E." last="O Oherty">Joseph E. O Oherty</name>
</region>
<name sortKey="Ifft, Peter J" sort="Ifft, Peter J" uniqKey="Ifft P" first="Peter J." last="Ifft">Peter J. Ifft</name>
<name sortKey="Ifft, Peter J" sort="Ifft, Peter J" uniqKey="Ifft P" first="Peter J." last="Ifft">Peter J. Ifft</name>
<name sortKey="Lebedev, Mikhail A" sort="Lebedev, Mikhail A" uniqKey="Lebedev M" first="Mikhail A." last="Lebedev">Mikhail A. Lebedev</name>
<name sortKey="Lebedev, Mikhail A" sort="Lebedev, Mikhail A" uniqKey="Lebedev M" first="Mikhail A." last="Lebedev">Mikhail A. Lebedev</name>
<name sortKey="Nicolelis, Miguel A L" sort="Nicolelis, Miguel A L" uniqKey="Nicolelis M" first="Miguel A. L." last="Nicolelis">Miguel A. L. Nicolelis</name>
<name sortKey="Nicolelis, Miguel A L" sort="Nicolelis, Miguel A L" uniqKey="Nicolelis M" first="Miguel A. L." last="Nicolelis">Miguel A. L. Nicolelis</name>
<name sortKey="Nicolelis, Miguel A L" sort="Nicolelis, Miguel A L" uniqKey="Nicolelis M" first="Miguel A. L." last="Nicolelis">Miguel A. L. Nicolelis</name>
<name sortKey="Nicolelis, Miguel A L" sort="Nicolelis, Miguel A L" uniqKey="Nicolelis M" first="Miguel A. L." last="Nicolelis">Miguel A. L. Nicolelis</name>
<name sortKey="O Oherty, Joseph E" sort="O Oherty, Joseph E" uniqKey="O Oherty J" first="Joseph E." last="O Oherty">Joseph E. O Oherty</name>
<name sortKey="Zhuang, Katie Z" sort="Zhuang, Katie Z" uniqKey="Zhuang K" first="Katie Z." last="Zhuang">Katie Z. Zhuang</name>
<name sortKey="Zhuang, Katie Z" sort="Zhuang, Katie Z" uniqKey="Zhuang K" first="Katie Z." last="Zhuang">Katie Z. Zhuang</name>
</country>
<country name="Suisse"><region name="Canton de Vaud"><name sortKey="Shokur, Solaiman" sort="Shokur, Solaiman" uniqKey="Shokur S" first="Solaiman" last="Shokur">Solaiman Shokur</name>
</region>
<name sortKey="Bleuler, Hannes" sort="Bleuler, Hannes" uniqKey="Bleuler H" first="Hannes" last="Bleuler">Hannes Bleuler</name>
</country>
<country name="Brésil"><noRegion><name sortKey="Nicolelis, Miguel A L" sort="Nicolelis, Miguel A L" uniqKey="Nicolelis M" first="Miguel A. L." last="Nicolelis">Miguel A. L. Nicolelis</name>
</noRegion>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001C55 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd -nk 001C55 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Checkpoint |type= RBID |clé= PMC:3236080 |texte= Active tactile exploration enabled by a brain-machine-brain interface }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/RBID.i -Sk "pubmed:21976021" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |