Virtual Grasping: Closed-Loop Force Control Using Electrotactile Feedback
Identifieur interne : 000831 ( Pmc/Checkpoint ); précédent : 000830; suivant : 000832Virtual Grasping: Closed-Loop Force Control Using Electrotactile Feedback
Auteurs : Nikola Jorgovanovic [Serbie] ; Strahinja Dosen [Allemagne] ; Damir J. Djozic [Serbie] ; Goran Krajoski [Serbie] ; Dario Farina [Allemagne]Source :
- Computational and Mathematical Methods in Medicine [ 1748-670X ] ; 2014.
Abstract
Closing the control loop by providing somatosensory feedback to the user of a prosthesis is a well-known, long standing challenge in the field of prosthetics. Various approaches have been investigated for feedback restoration, ranging from direct neural stimulation to noninvasive sensory substitution methods. Although there are many studies presenting closed-loop systems, only a few of them objectively evaluated the closed-loop performance, mostly using vibrotactile stimulation. Importantly, the conclusions about the utility of the feedback were partly contradictory. The goal of the current study was to systematically investigate the capability of human subjects to control grasping force in closed loop using electrotactile feedback. We have developed a realistic experimental setup for virtual grasping, which operated in real time, included a set of real life objects, as well as a graphical and dynamical model of the prosthesis. We have used the setup to test 10 healthy, able bodied subjects to investigate the role of training, feedback and feedforward control, robustness of the closed loop, and the ability of the human subjects to generalize the control to previously “unseen” objects. Overall, the outcomes of this study are very optimistic with regard to the benefits of feedback and reveal various, practically relevant, aspects of closed-loop control.
Url:
DOI: 10.1155/2014/120357
PubMed: 24516504
PubMed Central: 3909980
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
PMC:3909980Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Virtual Grasping: Closed-Loop Force Control Using Electrotactile Feedback</title><author><name sortKey="Jorgovanovic, Nikola" sort="Jorgovanovic, Nikola" uniqKey="Jorgovanovic N" first="Nikola" last="Jorgovanovic">Nikola Jorgovanovic</name><affiliation wicri:level="1"><nlm:aff id="I1">Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia</nlm:aff><country xml:lang="fr">Serbie</country><wicri:regionArea>Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad</wicri:regionArea><wicri:noRegion>Novi Sad</wicri:noRegion></affiliation></author><author><name sortKey="Dosen, Strahinja" sort="Dosen, Strahinja" uniqKey="Dosen S" first="Strahinja" last="Dosen">Strahinja Dosen</name><affiliation wicri:level="3"><nlm:aff id="I2">Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen</wicri:regionArea><placeName><region type="land" nuts="2">Basse-Saxe</region><settlement type="city">Göttingen</settlement></placeName></affiliation></author><author><name sortKey="Djozic, Damir J" sort="Djozic, Damir J" uniqKey="Djozic D" first="Damir J." last="Djozic">Damir J. Djozic</name><affiliation wicri:level="1"><nlm:aff id="I1">Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia</nlm:aff><country xml:lang="fr">Serbie</country><wicri:regionArea>Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad</wicri:regionArea><wicri:noRegion>Novi Sad</wicri:noRegion></affiliation></author><author><name sortKey="Krajoski, Goran" sort="Krajoski, Goran" uniqKey="Krajoski G" first="Goran" last="Krajoski">Goran Krajoski</name><affiliation wicri:level="1"><nlm:aff id="I1">Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia</nlm:aff><country xml:lang="fr">Serbie</country><wicri:regionArea>Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad</wicri:regionArea><wicri:noRegion>Novi Sad</wicri:noRegion></affiliation></author><author><name sortKey="Farina, Dario" sort="Farina, Dario" uniqKey="Farina D" first="Dario" last="Farina">Dario Farina</name><affiliation wicri:level="3"><nlm:aff id="I2">Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen</wicri:regionArea><placeName><region type="land" nuts="2">Basse-Saxe</region><settlement type="city">Göttingen</settlement></placeName></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">24516504</idno><idno type="pmc">3909980</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3909980</idno><idno type="RBID">PMC:3909980</idno><idno type="doi">10.1155/2014/120357</idno><date when="2014">2014</date><idno type="wicri:Area/Pmc/Corpus">001C67</idno><idno type="wicri:Area/Pmc/Curation">001C67</idno><idno type="wicri:Area/Pmc/Checkpoint">000831</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Virtual Grasping: Closed-Loop Force Control Using Electrotactile Feedback</title><author><name sortKey="Jorgovanovic, Nikola" sort="Jorgovanovic, Nikola" uniqKey="Jorgovanovic N" first="Nikola" last="Jorgovanovic">Nikola Jorgovanovic</name><affiliation wicri:level="1"><nlm:aff id="I1">Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia</nlm:aff><country xml:lang="fr">Serbie</country><wicri:regionArea>Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad</wicri:regionArea><wicri:noRegion>Novi Sad</wicri:noRegion></affiliation></author><author><name sortKey="Dosen, Strahinja" sort="Dosen, Strahinja" uniqKey="Dosen S" first="Strahinja" last="Dosen">Strahinja Dosen</name><affiliation wicri:level="3"><nlm:aff id="I2">Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen</wicri:regionArea><placeName><region type="land" nuts="2">Basse-Saxe</region><settlement type="city">Göttingen</settlement></placeName></affiliation></author><author><name sortKey="Djozic, Damir J" sort="Djozic, Damir J" uniqKey="Djozic D" first="Damir J." last="Djozic">Damir J. Djozic</name><affiliation wicri:level="1"><nlm:aff id="I1">Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia</nlm:aff><country xml:lang="fr">Serbie</country><wicri:regionArea>Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad</wicri:regionArea><wicri:noRegion>Novi Sad</wicri:noRegion></affiliation></author><author><name sortKey="Krajoski, Goran" sort="Krajoski, Goran" uniqKey="Krajoski G" first="Goran" last="Krajoski">Goran Krajoski</name><affiliation wicri:level="1"><nlm:aff id="I1">Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia</nlm:aff><country xml:lang="fr">Serbie</country><wicri:regionArea>Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad</wicri:regionArea><wicri:noRegion>Novi Sad</wicri:noRegion></affiliation></author><author><name sortKey="Farina, Dario" sort="Farina, Dario" uniqKey="Farina D" first="Dario" last="Farina">Dario Farina</name><affiliation wicri:level="3"><nlm:aff id="I2">Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen</wicri:regionArea><placeName><region type="land" nuts="2">Basse-Saxe</region><settlement type="city">Göttingen</settlement></placeName></affiliation></author></analytic><series><title level="j">Computational and Mathematical Methods in Medicine</title><idno type="ISSN">1748-670X</idno><idno type="eISSN">1748-6718</idno><imprint><date when="2014">2014</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Closing the control loop by providing somatosensory feedback to the user of a prosthesis is a well-known, long standing challenge in the field of prosthetics. Various approaches have been investigated for feedback restoration, ranging from direct neural stimulation to noninvasive sensory substitution methods. Although there are many studies presenting closed-loop systems, only a few of them objectively evaluated the closed-loop performance, mostly using vibrotactile stimulation. Importantly, the conclusions about the utility of the feedback were partly contradictory. The goal of the current study was to systematically investigate the capability of human subjects to control grasping force in closed loop using electrotactile feedback. We have developed a realistic experimental setup for virtual grasping, which operated in real time, included a set of real life objects, as well as a graphical and dynamical model of the prosthesis. We have used the setup to test 10 healthy, able bodied subjects to investigate the role of training, feedback and feedforward control, robustness of the closed loop, and the ability of the human subjects to generalize the control to previously “unseen” objects. Overall, the outcomes of this study are very optimistic with regard to the benefits of feedback and reveal various, practically relevant, aspects of closed-loop control.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Johansson, Rs" uniqKey="Johansson R">RS Johansson</name></author><author><name sortKey="Cole, Kj" uniqKey="Cole K">KJ Cole</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Iyengar, V" uniqKey="Iyengar V">V Iyengar</name></author><author><name sortKey="Santos, Mj" uniqKey="Santos M">MJ Santos</name></author><author><name sortKey="Ko, M" uniqKey="Ko M">M Ko</name></author><author><name sortKey="Aruin, As" uniqKey="Aruin A">AS Aruin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rothwell, Jc" uniqKey="Rothwell J">JC Rothwell</name></author><author><name sortKey="Traub, Mm" uniqKey="Traub M">MM Traub</name></author><author><name sortKey="Day, Bl" uniqKey="Day B">BL Day</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Dhillon, Gs" uniqKey="Dhillon G">GS Dhillon</name></author><author><name sortKey="Horch, Kw" uniqKey="Horch K">KW Horch</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Szeto, A" uniqKey="Szeto A">A Szeto</name></author><author><name sortKey="Saunders, Fa" uniqKey="Saunders F">FA Saunders</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kaczmarek, Ka" uniqKey="Kaczmarek K">KA Kaczmarek</name></author><author><name sortKey="Webster, Jg" uniqKey="Webster J">JG Webster</name></author><author><name sortKey="Bach Y Rita, P" uniqKey="Bach Y Rita P">P Bach-y-Rita</name></author><author><name sortKey="Tompkins, Wj" uniqKey="Tompkins W">WJ Tompkins</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pylatiuk, C" uniqKey="Pylatiuk C">C Pylatiuk</name></author><author><name sortKey="Kargov, A" uniqKey="Kargov A">A Kargov</name></author><author><name sortKey="Schulz, S" uniqKey="Schulz S">S Schulz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chatterjee, A" uniqKey="Chatterjee A">A Chatterjee</name></author><author><name sortKey="Chaubey, P" uniqKey="Chaubey P">P Chaubey</name></author><author><name sortKey="Martin, J" uniqKey="Martin J">J Martin</name></author><author><name sortKey="Thakor, N" uniqKey="Thakor N">N Thakor</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cipriani, C" uniqKey="Cipriani C">C Cipriani</name></author><author><name sortKey="Zaccone, F" uniqKey="Zaccone F">F Zaccone</name></author><author><name sortKey="Micera, S" uniqKey="Micera S">S Micera</name></author><author><name sortKey="Carrozza, Mc" uniqKey="Carrozza M">MC Carrozza</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Patterson, Pe" uniqKey="Patterson P">PE Patterson</name></author><author><name sortKey="Katz, Ja" uniqKey="Katz J">JA Katz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meek, Sg" uniqKey="Meek S">SG Meek</name></author><author><name sortKey="Jacobsen, Sc" uniqKey="Jacobsen S">SC Jacobsen</name></author><author><name sortKey="Goulding, Pp" uniqKey="Goulding P">PP Goulding</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Shannon, Gf" uniqKey="Shannon G">GF Shannon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Witteveen, Hjb" uniqKey="Witteveen H">HJB Witteveen</name></author><author><name sortKey="Rietman, Js" uniqKey="Rietman J">JS Rietman</name></author><author><name sortKey="Veltink, Ph" uniqKey="Veltink P">PH Veltink</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Saunders, I" uniqKey="Saunders I">I Saunders</name></author><author><name sortKey="Vijayakumar, S" uniqKey="Vijayakumar S">S Vijayakumar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chatterjee, A" uniqKey="Chatterjee A">A Chatterjee</name></author><author><name sortKey="Chaubey, P" uniqKey="Chaubey P">P Chaubey</name></author><author><name sortKey="Martin, J" uniqKey="Martin J">J Martin</name></author><author><name sortKey="Thakor, Nv" uniqKey="Thakor N">NV Thakor</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Scott, Rn" uniqKey="Scott R">RN Scott</name></author><author><name sortKey="Caldwell, Rr" uniqKey="Caldwell R">RR Caldwell</name></author><author><name sortKey="Brittain, Rh" uniqKey="Brittain R">RH Brittain</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wang, G" uniqKey="Wang G">G Wang</name></author><author><name sortKey="Zhang, X" uniqKey="Zhang X">X Zhang</name></author><author><name sortKey="Zhang, J" uniqKey="Zhang J">J Zhang</name></author><author><name sortKey="Gruver, Wa" uniqKey="Gruver W">WA Gruver</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lundborg, G" uniqKey="Lundborg G">G Lundborg</name></author><author><name sortKey="Ro N, B" uniqKey="Ro N B">B Rośn</name></author><author><name sortKey="Lindstrom, K" uniqKey="Lindstrom K">K Lindström</name></author><author><name sortKey="Lindberg, S" uniqKey="Lindberg S">S Lindberg</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zafar, M" uniqKey="Zafar M">M Zafar</name></author><author><name sortKey="Van Doren, Cl" uniqKey="Van Doren C">CL Van Doren</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Humbert, Sd" uniqKey="Humbert S">SD Humbert</name></author><author><name sortKey="Snyder, Sa" uniqKey="Snyder S">SA Snyder</name></author><author><name sortKey="Grill, Wm" uniqKey="Grill W">WM Grill</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kingdom, Faa" uniqKey="Kingdom F">FAA Kingdom</name></author><author><name sortKey="Prins, N" uniqKey="Prins N">N Prins</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stepp, Ce" uniqKey="Stepp C">CE Stepp</name></author><author><name sortKey="An, Q" uniqKey="An Q">Q An</name></author><author><name sortKey="Matsuoka, Y" uniqKey="Matsuoka Y">Y Matsuoka</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stepp, Ce" uniqKey="Stepp C">CE Stepp</name></author><author><name sortKey="Matsuoka, Y" uniqKey="Matsuoka Y">Y Matsuoka</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Szeto, Ayj" uniqKey="Szeto A">AYJ Szeto</name></author><author><name sortKey="Lyman, J" uniqKey="Lyman J">J Lyman</name></author><author><name sortKey="Prior, Re" uniqKey="Prior R">RE Prior</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mccallum, P" uniqKey="Mccallum P">P McCallum</name></author><author><name sortKey="Goldberg, H" uniqKey="Goldberg H">H Goldberg</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Marcus, Pl" uniqKey="Marcus P">PL Marcus</name></author><author><name sortKey="Fuglevand, Aj" uniqKey="Fuglevand A">AJ Fuglevand</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Buma, Dg" uniqKey="Buma D">DG Buma</name></author><author><name sortKey="Buitenweg, Jr" uniqKey="Buitenweg J">JR Buitenweg</name></author><author><name sortKey="Veltink, Ph" uniqKey="Veltink P">PH Veltink</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Szeto, Ayj" uniqKey="Szeto A">AYJ Szeto</name></author><author><name sortKey="Farrenkopf, Gr" uniqKey="Farrenkopf G">GR Farrenkopf</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Censor, N" uniqKey="Censor N">N Censor</name></author><author><name sortKey="Sagi, D" uniqKey="Sagi D">D Sagi</name></author><author><name sortKey="Cohen, Lg" uniqKey="Cohen L">LG Cohen</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Comput Math Methods Med</journal-id><journal-id journal-id-type="iso-abbrev">Comput Math Methods Med</journal-id><journal-id journal-id-type="publisher-id">CMMM</journal-id><journal-title-group><journal-title>Computational and Mathematical Methods in Medicine</journal-title></journal-title-group><issn pub-type="ppub">1748-670X</issn><issn pub-type="epub">1748-6718</issn><publisher><publisher-name>Hindawi Publishing Corporation</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">24516504</article-id><article-id pub-id-type="pmc">3909980</article-id><article-id pub-id-type="doi">10.1155/2014/120357</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>Virtual Grasping: Closed-Loop Force Control Using Electrotactile Feedback</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Jorgovanovic</surname><given-names>Nikola</given-names></name><xref ref-type="aff" rid="I1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1">*</xref></contrib><contrib contrib-type="author"><name><surname>Dosen</surname><given-names>Strahinja</given-names></name><xref ref-type="aff" rid="I2"><sup>2</sup></xref></contrib><contrib contrib-type="author"><name><surname>Djozic</surname><given-names>Damir J.</given-names></name><xref ref-type="aff" rid="I1"><sup>1</sup></xref></contrib><contrib contrib-type="author"><name><surname>Krajoski</surname><given-names>Goran</given-names></name><xref ref-type="aff" rid="I1"><sup>1</sup></xref></contrib><contrib contrib-type="author"><name><surname>Farina</surname><given-names>Dario</given-names></name><xref ref-type="aff" rid="I2"><sup>2</sup></xref></contrib></contrib-group><aff id="I1"><sup>1</sup>Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia</aff><aff id="I2"><sup>2</sup>Department of Neurorehabilitation Engineering, University Medical Center Göttingen, Georg-August University, Göttingen, Germany</aff><author-notes><corresp id="cor1">*Nikola Jorgovanovic: <email>nikolaj@uns.ac.rs</email></corresp><fn fn-type="other"><p>Academic Editor: Imre Cikajlo</p></fn></author-notes><pub-date pub-type="ppub"><year>2014</year></pub-date><pub-date pub-type="epub"><day>2</day><month>1</month><year>2014</year></pub-date><volume>2014</volume><elocation-id>120357</elocation-id><history><date date-type="received"><day>27</day><month>9</month><year>2013</year></date><date date-type="accepted"><day>20</day><month>11</month><year>2013</year></date></history><permissions><copyright-statement>Copyright © 2014 Nikola Jorgovanovic et al.</copyright-statement><copyright-year>2014</copyright-year><license license-type="open-access"><license-p>This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p></license></permissions><abstract><p>Closing the control loop by providing somatosensory feedback to the user of a prosthesis is a well-known, long standing challenge in the field of prosthetics. Various approaches have been investigated for feedback restoration, ranging from direct neural stimulation to noninvasive sensory substitution methods. Although there are many studies presenting closed-loop systems, only a few of them objectively evaluated the closed-loop performance, mostly using vibrotactile stimulation. Importantly, the conclusions about the utility of the feedback were partly contradictory. The goal of the current study was to systematically investigate the capability of human subjects to control grasping force in closed loop using electrotactile feedback. We have developed a realistic experimental setup for virtual grasping, which operated in real time, included a set of real life objects, as well as a graphical and dynamical model of the prosthesis. We have used the setup to test 10 healthy, able bodied subjects to investigate the role of training, feedback and feedforward control, robustness of the closed loop, and the ability of the human subjects to generalize the control to previously “unseen” objects. Overall, the outcomes of this study are very optimistic with regard to the benefits of feedback and reveal various, practically relevant, aspects of closed-loop control.</p></abstract><funding-group><award-group><funding-source>http://dx.doi.org/10.13039/501100000780 European Commission</funding-source><award-id>FP7-PEOPLE-2011-IAPP-286208</award-id></award-group></funding-group></article-meta></front><body><sec id="sec1"><title>1. Introduction</title><p>Human grasping is characterized by a remarkable flexibility. Humans can easily grasp, lift, and manipulate objects of very different properties (e.g., texture, weight, and stiffness). Obviously, this process requires an advanced control of grasping forces, which is in human motor control implemented through a blend of feedforward and feedback mechanisms [<xref rid="B1" ref-type="bibr">1</xref>]. The former is well reflected in the paradigm of economical grasping: humans use previous sensory-motor experience to scale appropriately the grasping forces according to the expected (estimated) weight of the target object. The goal is to minimize the forces and thereby energy expenditure, and yet avoid slipping. However, this specific mechanism and also grasping as a whole can be significantly impaired when somatosensory feedback pathways are not fully functional due to a disease of the nervous system (e.g., multiple sclerosis [<xref rid="B2" ref-type="bibr">2</xref>], deafferented patients [<xref rid="B3" ref-type="bibr">3</xref>]).</p><p>After an amputation of the hand, a prosthetic device can be used as a functional and morphological replacement of the lost limb. To control the artificial limb, the intention of the user can be inferred from the recorded activity of the user's muscles (myoelectric control). This method, which essentially implements the feedforward pathway between the brain and artificial limb, has been in routine use in commercially available prostheses for decades [<xref rid="B4" ref-type="bibr">4</xref>, <xref rid="B5" ref-type="bibr">5</xref>]. However, none of the commercial systems provides any deliberate somatosensory feedback to the user to close the control loop.</p><p>Providing somatosensory feedback is a well-known, long standing challenge in the field of prosthetics. The researchers have been investigating various approaches to provide feedback artificially, ranging from direct neural stimulation [<xref rid="B6" ref-type="bibr">6</xref>] to noninvasive sensory substitution methods [<xref rid="B7" ref-type="bibr">7</xref>, <xref rid="B8" ref-type="bibr">8</xref>]. In the latter, the state of the prosthesis (e.g., joint angles or grasping forces) is communicated to the user by stimulating the skin of the residual limb using mechanical (e.g., vibration motors [<xref rid="B9" ref-type="bibr">9</xref>–<xref rid="B11" ref-type="bibr">11</xref>], pressure cuffs [<xref rid="B12" ref-type="bibr">12</xref>], and motor driven pushers [<xref rid="B13" ref-type="bibr">13</xref>]) or electrical stimulation [<xref rid="B14" ref-type="bibr">14</xref>]. Closed-loop control of grasping force was most commonly tested. This is not surprising since an appropriate grasping force is necessary for safe lifting and object handling and since this variable cannot be assessed directly using vision (contrary to, for example, hand joint angles).</p><p>Although there are many studies presenting closed-loop systems, only a few of them objectively evaluated the closed-loop performance, mostly using vibrotactile stimulation. The conclusions of earlier studies are however partly contradictory. Some found that the feedback improved the performance [<xref rid="B12" ref-type="bibr">12</xref>, <xref rid="B13" ref-type="bibr">13</xref>, <xref rid="B15" ref-type="bibr">15</xref>], while others did not find a clear advantage of the closed-loop control [<xref rid="B11" ref-type="bibr">11</xref>]. In some studies, the feedback was beneficial only under certain conditions (e.g., feedforward uncertainty [<xref rid="B16" ref-type="bibr">16</xref>] and experienced subjects [<xref rid="B17" ref-type="bibr">17</xref>]).</p><p>In the case of electrical stimulation, systematic evaluation is very scarce. Scott et al. [<xref rid="B18" ref-type="bibr">18</xref>] reported subject satisfaction with the provided electrotactile feedback while Wang et al. [<xref rid="B19" ref-type="bibr">19</xref>] stated that the users could differentiate appropriate gripping force for a wide variety of different activities, but in both cases the claims were not backed up with the actual results. Lundborg et al. [<xref rid="B20" ref-type="bibr">20</xref>] evaluated two-channel electrical stimulation feedback in four patients with sensory impairments (recent median nerve repair) and a single user of a myoelectric prosthesis. In all subjects, the performance in force control during a force matching task was better when using electrical stimulation with respect to the condition with no tactile feedback. Only one level of force, selected as comfortable by the subject before the test, was used during the task. Zafar and Van Doren [<xref rid="B21" ref-type="bibr">21</xref>] tested a single channel electrical stimulation feedback using a specialized setup simulating grasping of a compliant object, thereby allowing the subject to exploit visual cues for the force control in parallel to the tactile feedback. It was found that the supplemental feedback slightly improved the force control even when additional visual cues were provided.</p><p>The goal of the current study was to systematically and objectively investigate the capability of human subjects to control grasping force in closed loop using electrotactile feedback. We have developed a virtual setup that allowed us to investigate different aspects of the closed-loop control. The setup is also realistic in the sense that it operates in real time and includes a set of real life objects, as well as a graphical and dynamical model of the prosthesis. We have used the setup to investigate the role of training, feedback and feedforward control, robustness of the closed loop, and the ability of the human subjects to generalize the control to previously “unseen” objects.</p></sec><sec id="sec2"><title>2. Methods</title><sec id="sec2.1"><title>2.1. Subjects</title><p>The experiment was carried out in the Biomedical Engineering Lab at the Department for Systems, Signals and Control, Faculty of Technical Sciences, University of Novi Sad, Serbia. Ten healthy, able bodied volunteer subjects (5 males and 5 females, 28 ± 3 years old) participated in the experiment after signing the consent form which was approved by the local ethical committee.</p></sec><sec id="sec2.2"><title>2.2. Experimental Setup</title><p>The experimental setup (see <xref ref-type="fig" rid="fig1">Figure 1</xref>) comprised the following components: (1) single-axis contactless joystick (CH Products, USA), (2) mechanical pushbutton, (3) current-controlled multichannel stimulator TremUNA (UNA systems, SRB), and (4) a standard desktop computer (host PC) equipped with a data acquisition card (PCI 6024, National Instruments, USA). The control program for virtual grasping experiments was implemented using Matlab 2012b and Simulink, Simulink 3D Animation, and Real Time Windows Target toolboxes. The signals from the joystick and the mechanical pushbutton were acquired by the DAQ card and supplied as the control inputs to the model of the prosthesis. The control loop operated in real time at the sampling frequency of 100 Hz. Based on the grasping force generated by the prosthesis, the stimulation unit provided the electrotactile feedback to the user. The unit included eight stimulation channels in total but only two were actually used in the current experiment. The stimulation parameters were controlled in real time from the host PC via a USB port, and the current pulses were delivered by using self-adhesive concentric electrodes (CoDe 501500, 4 cm diameter, SpesMedica, IT).</p><p>The graphical user interface depicted a model of a simple, single degree of freedom prosthetic hand (gripper) and the object that was the target for grasping. The object was positioned between the fingers of the prosthesis so that when the hand closed, it grasped the object. In some experimental conditions, visual force feedback was also provided to the subject in the form of a bar graph (see <xref ref-type="fig" rid="fig1">Figure 1</xref> and <xref ref-type="sec" rid="sec2.5">Section 2.5</xref>). The virtual hand was controlled by the joystick and it operated as a first order, velocity-controlled system (i.e., transfer function <italic>G</italic>(<italic>s</italic>) = 0.5/<italic>s</italic>). Before the hand contacted the object, the joystick inclination was proportional to the speed of hand closing, whereas after the contact has been made, the joystick inclination was proportional to the buildup rate of the grasping force. This was similar to the “gated ramp controller” that was also used in [<xref rid="B16" ref-type="bibr">16</xref>, <xref rid="B22" ref-type="bibr">22</xref>]. The pushbutton indicated the end of force control phase and the start of the object lift-off phase (see <xref ref-type="sec" rid="sec2.4">Section 2.4</xref>).</p><p>Joystick was selected since it provided a stable feedforward interface. Using myoelectric control would have been possible as well; however, in the current study the focus was on the feedback interface and therefore the influence of the other system components was minimized by assuming ideal behaviors. The gated ramp controller was adopted since it is similar to the control method actually used in one of the commercially available hands (i-Limb from Touch Bionics [<xref rid="B4" ref-type="bibr">4</xref>]) and also since this approach effectively “decoupled” the position of the joystick from the amplitude of the grasping force; if the force would be controlled proportionally as in some other prosthesis (Sensor Hand Speed and Michelangelo Hand from Otto Bock [<xref rid="B5" ref-type="bibr">5</xref>]), the subjects could easily estimate the current force level directly from the joystick inclination and without using electrotactile feedback information. In addition to the possibility to “safely” conduct tests which could be difficult to realize in real life (i.e., breaking objects), an advantage of the virtual setup was that it provided very controlled feedback and prevented incidental sources of information which would be available if the users controlled a real prosthesis (e.g., motor sound and vibrations).</p></sec><sec id="sec2.3"><title>2.3. Electrotactile Feedback</title><p>Electrotactile feedback was provided using two bipolar concentric electrodes placed on the dorsal side of the subject forearm, approximately midway between the elbow and wrist. The stimulation was delivered in monopolar configuration: the inner fields were used as the cathodes and the outer rings were connected together as a common anode. The stimulation was monophasic compensated; rectangular depolarizing pulse injecting charge to activate cutaneous afferents and elicit tactile sensation was followed by an exponential discharge waveform of opposite polarity to remove the charge out of the tissue. The rate of pulse delivery was constant and set to 100 Hz. This frequency was selected since pilot tests demonstrated that it elicited a well-localized, continuous sensation (i.e., responses to individual pulses fused together) resembling constant pressure on the surface of the skin. The current amplitude was also constant and set to 3 mA, and the pulse width was modulated within the dynamic range of the stimulation. The latter was determined for each subject individually as the interval between 1.2∗ST and 0.8∗PT, where ST and PT are sensation and pain thresholds tested before the start of the experiment. The thresholds were detected using the method of limits [<xref rid="B23" ref-type="bibr">23</xref>]; that is, the pulse width was set to minimal value (50 <italic>μ</italic>s) and then successively increased in steps of 50 <italic>μ</italic>s until the subject indicated that he/she felt the stimulation (SP) or that the stimulation became painful (PT). This procedure was repeated three times in succession, and the average was used as the final value. The scaling factors for ST and PT defining the dynamic range [1.2∗ST, 0.8∗PT] were adopted heuristically to assure that the minimal stimulation within the dynamic range can be perceived by the subject (pulse width > ST) while maximal stimulation is still nonpainful (pulse width < PT). The stimulation was proportional to the force; that is, normalized force (0-1) was linearly mapped to the dynamic range. Stimulation intensity was modulated by adjusting the pulse width since this allowed a finer control of elicited sensations compared to changing the current intensity (pilot tests). The two electrodes delivered the same information, that is, the same force scaled between the respective electrode thresholds as explained above. This configuration was selected since the pilot tests demonstrated that two electrodes provided better quality and discriminability of sensation compared to the use of a single electrode.</p></sec><sec id="sec2.4"><title>2.4. Virtual Grasping Task</title><p>At the beginning of the trial, a graphical model of the object that was the target for grasping was shown, positioned directly in front of the gripper and in-between the fingers, as explained before. Each object was characterized by two parameters: minimal grasping force needed to successfully lift the object and maximal allowed grasping force (“breaking” threshold). In total, 19 different objects were used for the experiment (see <xref ref-type="table" rid="tab1">Table 1</xref>). The limits for each object (min/max force in <xref ref-type="table" rid="tab1">Table 1</xref>) are expressed as normalized force, where 1 corresponds to the maximal force that the virtual prosthesis could produce. The force limits were selected heuristically but the goal was to reflect the reality as much as possible. The minimal force was proportional to the weight of the object, and the maximal force was set to about 130% of the minimal force. The role of the maximal force was to prohibit the subjects from using excessively high forces to lift the objects, enforcing the paradigm of economical grasping (i.e., minimizing grasp forces while avoiding object slip [<xref rid="B16" ref-type="bibr">16</xref>]). Without this constraint, each object could have been securely grasped simply by generating the maximum force. However, generating too high grasping forces during the real life not only would mean excessive energy expenditure and lower battery life (i.e., noneconomical prosthesis use) but could also damage or even break the objects (e.g., a light bulb or an egg). Note that it was not important for the force limits to strictly reflect the reality, since the subjects anyway got the opportunity to “learn” the objects before the performance was evaluated (see <xref ref-type="sec" rid="sec2.5">Section 2.5</xref>). The goal was to give more general, absolute (e.g., heavy or light) or relative (i.e., heavier/lighter than the previous object), visual cues about the object weight.</p><p>The task for the subject was to grasp and lift the object by generating force that was within the predefined limits (target window), that is, enough to lift the object and yet lower than the “breaking” force. The hand was initially fully opened. The subject started hand closing by pushing on the joystick. After the contact was detected, the joystick controlled the grasping force, as explained before. At the same time, the electrotactile feedback was activated. All the objects were absolutely stiff (no deformation, i.e., static grasp) and therefore the visual cues about the developed force were not available. When the subject judged that the grip strength was appropriate, he/she pressed the button to signal that the hand should lift the object. If the force was above the lower limit, the hand would successfully lift the object (task successfully accomplished). Otherwise, if the force became less than the lower limit anytime during the object lift-off, the object would slip from the hand (task failed). Similarly, if the grasping force went above the higher limit for the given object anytime during the trial, the gripper would immediately “fall through,” signaling that the object has been broken (task failed). The steps within the trial are shown in <xref ref-type="fig" rid="fig2">Figure 2</xref>, while <xref ref-type="fig" rid="fig3">Figure 3</xref> depicts the relevant signals and prosthesis behavior.</p></sec><sec id="sec2.5"><title>2.5. Experimental Protocol</title><p>The subjects were comfortably seated in a chair in front of the table so that he/she was able to operate the joystick and a pushbutton. The experimental session comprised training and evaluation, and each phase included several conditions which are described in sequel. In total, the experiment lasted approximately 2.5 h. Before starting, the experiment was explained to the subject, the stimulation thresholds were determined, and the subject was allowed to practice virtual grasping with one object for approximately 5 min (simultaneous electrotactile and visual feedback). The goal was for the subject to familiarize with the setup and the task, to accommodate to the sensation of continuous stimulation, and also to learn the force coding through electrotactile stimulation.</p><p>The training phase comprised the following conditions.</p><p><italic>(i) TR-VIS-ELE: Training with Visual and Electrotactile Feedback.</italic> The subject performed virtual grasping trials with five different target objects, while visual (force bar) and electrotactile force feedback were simultaneously provided. Due to visual feedback (see <xref ref-type="fig" rid="fig1">Figure 1</xref>), this was an easy task and each object was grasped two times. The objects were selected to span the full range of normalized weights (0-1), and they were ordered and presented to the subjects according to their weight, from light to heavy (i.e., see <xref ref-type="table" rid="tab1">Table 1</xref>, objects 1, 2, 3, 4, and 11). The goal of this step was for the subjects to become familiar with a set of objects by learning their weights and corresponding electrotactile sensations assisted by the full visual feedback about force (force bar). </p><p><italic>(ii) TR-ELE-1: Training with Electrotactile Feedback and Known Objects.</italic> The same five objects as in TR-VIS-ELE were presented again and in the same order, but this time only the electrotactile force feedback was given. Each object was presented repeatedly, until the subject accomplished the grasping task successfully two times in a row or until the maximum number of trials was exceeded (15 trials). After grasping and lifting the object two times in succession, we assumed that the subject learned to adjust the correct force for that particular object by relying on the electrotactile feedback.</p><p><italic>(iii) TR-ELE-2: Training with Electrotactile Feedback and “Unseen” Objects.</italic> The procedure was the same as in TR-ELE-1 but this time a new set of five objects was used. Again, the objects were selected to sample the full range of weights, and they were presented to the subjects ordered according to their weights (i.e., see <xref ref-type="table" rid="tab1">Table 1</xref>, objects 7, 8, 10, 5, and 6). This condition was compared to the previous one. The goal was to evaluate if the subjects could generalize the principles learned in TR-VIS-ELE and TR-ELE-1 to grasp a set of novel objects in this condition using only electrotactile feedback (i.e., without previously revealing the object weight through simultaneous electrotactile and visual feedback).</p><p>The evaluation phase comprised the following conditions.</p><p><italic>(i) TE-FDB: Closed-Loop Performance Test.</italic> Ten objects used in TR-ELE-1 and TR-ELE-2 were presented to the subject, each object twice in succession (20 trials in total). The goal of this test was to determine the baseline closed-loop control performance, that is, the performance of grasping ten objects which were used during the training. This was the control condition for all the other tests to follow. </p><p><italic>(ii) TE-FWD: Feedforward Test (No Feedback).</italic> The procedure was the same as in the previous test, but this time no force feedback was provided. This condition was compared to TE-FDB to test to what extent the subjects relied on the feedback for the task accomplishment. Since the prosthesis was modeled as an ideal integrator, the grasping task could be accomplished without using the feedback. Instead, the subjects could set the joystick in a certain position and count the time needed for the force to increase to a desired value (pure feedforward control). To further simplify the task for the subjects, the hand was already in contact with the object at the beginning of the trials in this condition (i.e., no need to close the hand and visually confirm that the contact has been made). </p><p><italic>(iii) TE-FWD-ALT: Feedforward Test (No Feedback) with Altered System Parameters.</italic> The procedure was as in the previous condition, but the prosthesis model <italic>G</italic>(<italic>s</italic>) was changed (i.e., integrator gain doubled, <italic>G</italic>(<italic>s</italic>) = 1/<italic>s</italic>), making the force responding two times faster to the joystick command. The goal was to test how robust was the feedforward control to the change of the model parameters. Since there were two trials per object and the set of objects was known, the assumption was that the subjects could implicitly discover that the system behavior has been changed, for example, by using the task accomplishment or failure as the feedback to update the control in the subsequent trials.</p><p><italic>(iv) TE-FDB-ALT: Closed-Loop Performance Test with Altered System Parameters.</italic> The procedure was the same as in the previous condition, but with the electrotactile feedback provided. If the subject used the feedback with the original system, this test would show how robust closed-loop control was with respect to a significant change in the system behavior. If the subjects used feedforward control with the original system, this test would show if closing the loop was useful at least when there was a change in the system behavior (uncertainty).</p><p><italic>(v) TE-FDB-GEN: Closed-Loop Performance Test for Generalization.</italic> In this test, objects were presented in pairs (see <xref ref-type="table" rid="tab2">Table 2</xref>). First, one object used in the previous conditions was presented as a reference, and the grasping trials were repeated with the same object until the task was accomplished successfully. Then, a novel, test object was presented, where this object was “derived” from the reference in several ways: (1) similar weight as the reference, (2) a composite comprising a stack of the reference objects (e.g., two reference objects packed together), and (3) scaled version of the reference (i.e., scaled up or down in volume with respect to the reference). The first case was essentially a classical force matching task [<xref rid="B17" ref-type="bibr">17</xref>] while in the two other cases the subjects had to accomplish a “multiplication”/“division” in the space of force/electrotactile sensations. The goal of this step was to test the ability of the subject to solve the type of tasks that we envision the users of the prosthesis could face during the real life application of the device (i.e., grasping a novel object that can be related through the user's experience to a similar object that was handled in the past).</p><p>Contrary to training conditions in which the objects were presented ordered according to their weight (from lighter to heavier), during all the evaluations the objects were presented in the random order.</p></sec><sec id="sec2.6"><title>2.6. Data Analysis</title><p>The performance was measured using the following outcome measures.<list list-type="roman-lower"><list-item><p><italic>Average number of attempts (ANA):</italic> This performance index was used to evaluate the training and it was defined as the average number of grasping trials per object before the subject “learned” to grasp the object, that is, before the object was grasped successfully two times in succession.</p></list-item><list-item><p><italic>Success rate in task accomplishment (SR):</italic> As explained before, if the subject successfully lifted the object without object slipping or breaking, the trial was deemed successful. Success rate was expressed in percent.</p></list-item><list-item><p><italic>Force error (FE):</italic> FE was calculated as the difference between the minimal force to lift the given object and the applied grasping force, but only considering those trials in which the grasping force was not high enough and the object thereby slipped from the grasp. FE evaluated the average level of undershooting and it was adopted as a more sensitive, continuous measure of performance compared to SR, which had only a binary outcome (success or failure).</p></list-item><list-item><p><italic>Time to accomplish the task (TAT):</italic> This was the time from the beginning and until the end of the trial (success, slip, and break).</p></list-item></list>Data analysis was performed using custom functions written in MATLAB 2012b (MathWorks, US). Statistical tests were performed using STATISTICA 10 (StatSoft, US). Repeated measures ANOVA with the experimental condition as the within-subject factor was used for the group comparison and Tukey's honestly significant difference criterion for the post hoc pairwise tests. The data were tested for sphericity (Mauchly's sphericity test). The threshold for the statistical significance was set to <italic>P</italic> < 0.05.</p></sec></sec><sec id="sec3"><title>3. Results</title><p>The average sensation and pain thresholds were 120 ± 50 <italic>μ</italic>s and 500 ± 50 <italic>μ</italic>s, respectively. <xref ref-type="fig" rid="fig4"> Figure 4</xref> shows a representative result from the second and third training condition (TR-ELE-1 and TR-ELE-2). It can be seen (<xref ref-type="fig" rid="fig4">Figure 4(a)</xref>, third object) that the subject was adjusting the force in the next trial based on the outcome of the previous one, reaching the target window in a few steps. In the case of light and medium objects (e.g., object 3 in TR-ELE-1), these steps were rather small, suggesting fine control, whereas for the heavy object (e.g., object 5 in TR-ELE-1), the adjustments were more crude, producing trial by trial oscillations above and below the target window. Fewer trials were needed to complete the training in TR-ELE-2. The summary results of the training are given in <xref ref-type="fig" rid="fig5">Figure 5</xref>. The average number of attempts (ANA) per object was similar in TR-ELE-2 and TR-ELE-1 condition (<xref ref-type="fig" rid="fig5">Figure 5(a)</xref>), despite the fact that in TR-ELE-2 the subjects faced a set of objects that were not handled before using visual force feedback (as in TR-VIS-ELE and TR-ELE-1). In addition, it seems that heavier objects posed a challenge for the subjects in TR-ELE-1, while in TR-ELE-2 the performance was similar across all objects (i.e., no statistically significant differences between light and heavy objects). The data for individual objects (<xref ref-type="fig" rid="fig5">Figure 5(b)</xref>) did not pass the sphericity test, and therefore ANOVA with Greenhouse-Geisser correction was used in this case, and it showed that there was a significant difference between the objects (adjusted <italic>P</italic> < 0.05).</p><p><xref ref-type="fig" rid="fig6">Figure 6</xref> illustrates the results from the four testing conditions. For this particular subject, the success rate during the closed-loop control was 70% (TE-FDB) and the performance was similar even after the system behavior was significantly changed (SR of 60% in TE-FDB-ALT). Without feedback, the performance was low (20% in TE-FWD and 15% in TE-FWD-ALT). In the conditions with feedback, the subject was more successful in hitting the target force window already in the first trial (i.e., 7 out of 10 in TE-FDB versus 1 out of 10 in TE-FWD). Furthermore, if the first trial was unsuccessful, the subject was better in correcting the mistake in the second trial. Without feedback, the subject tried to correct as well, but he/she was not very precise, often first overshooting (break) and then in the very next trial undershooting (slip) or vice versa (e.g., see trials 13-14 and 15-16 in TE-FWD; <xref ref-type="fig" rid="fig6">Figure 6</xref>).</p><p>The characteristics of the human control in different conditions can be seen from the force traces depicted in <xref ref-type="fig" rid="fig7">Figure 7</xref>. Different subjects exhibited similar control strategies in the same condition. When the subjects were provided with electrotactile feedback, they would steadily increase the force, but they would also modulate the rate of force increase many times during the trial (several joystick adjustments). Without feedback, the subjects would simply increase the force at a constant rate by always keeping the joystick at one selected inclination.</p><p>The overall results from the testing phase are given in <xref ref-type="fig" rid="fig8">Figure 8</xref>. The average performance during closed-loop control (Figures <xref ref-type="fig" rid="fig8">8(a)</xref> and <xref ref-type="fig" rid="fig8">8(b)</xref>) was 64 ± 18% for first trials only and 72 ± 10% for first and second (correction) trials together. During feedforward control, the success rate dropped significantly: 30 ± 15% and 41 ± 13% in TE-FWD and 36 ± 21% and 36 ± 18% in TE-FWD-ALT, for the first trials only and first and second trials together, respectively. When the feedback was reactivated, the performance recovered to a similar level as before, that is, 57 ± 13% (first trials) and 63 ± 11% (first and second trials) in TE-FDB-ALT, despite the fact that the system behavior was in this case significantly changed (Figures <xref ref-type="fig" rid="fig8">8(a)</xref> and <xref ref-type="fig" rid="fig8">8(b)</xref>). There is an indication that during the closed-loop control the subjects tended to make smaller force errors in the unsuccessful trials (<xref ref-type="fig" rid="fig8">Figure 8(c)</xref>); that is, in the failed trials in which object slipped from the grasp, the generated forces were closer to the target window if the subjects were provided with the electrotactile force feedback. However, the differences were statistically significant only between TE-FWD and TE-FDB-ALT. Finally, when the feedback was delivered, the subjects were more successful in using the outcome of the previous trial (slip or break) to modify the force and correctly grasp the same object from the second chance (83% and 64% versus 43% and 27% for the SR in corrections in <xref ref-type="fig" rid="fig8">Figure 8(d)</xref>). It can be noted from the standard deviations that the results were variable between the subjects. For example, the subject success rates (<xref ref-type="fig" rid="fig8">Figure 8(b)</xref>) in the two conditions with feedback (TE-FDB and TE-FDB-ALT) were in the ranges 55–90% and 55–85%, respectively. Without feedback, the performance could be as low as 20% in TE-FWD and 10% in TE-FWD-ALT, but it could also reach up to 60 and 65% (best results), respectively.</p><p>The average time to accomplish the task (<xref ref-type="fig" rid="fig9">Figure 9</xref>) was significantly longer during closed-loop control conditions, that is, 16 ± 8 s and 14 ± 9 s for TE-FDB and TE-FDB-ALT versus 12 ± 7 s and 7 ± 7 s for TE-FWD and TE-FWD-ALT. There was a statistically significant difference also between the two conditions in which the feedback was provided (TE-FDB versus TE-FBD-ALT). This can be due to the fact that the altered system responded faster, resulting in shorter trials. Also with this system, the subjects were almost two times faster without feedback than with feedback, suggesting the lack of meaningful control in TE-FWD-ALT. Similar to the success rates, note that there was a large variability between the subjects also in the time that they used to accomplish the task.</p><p>The results of TE-FDB-GEN test are given in <xref ref-type="fig" rid="fig10">Figure 10</xref>. The test evaluated the ability of the human subjects to generalize the closed-loop control to an object that was similar to a reference one (force matching task) or represented a stacked/scaled version of the reference (see <xref ref-type="table" rid="tab2">Table 2</xref>). In the case of lighter objects, the subjects were very good in generating grasping forces for the similar test and reference objects and also in up-/downscaling of the force to reflect the up-/downscaling of the reference object (success rate > 80%, except for one outlier). However, when the force that the subjects had to generate increased (heavier objects), the success rate decreased to around 50% for the normalized forces of approximately 0.5 and to only 9% for the normalized forces of 0.8.</p></sec><sec id="sec4"><title>4. Discussion and Conclusions</title><p>In this study, we have developed a test system for the closed-loop control of force based on electrotactile feedback. The system operates in real time and integrates a setup for virtual grasping using a dynamic model of a single degree of freedom prosthetic hand. We have used this tool to investigate different properties of closed-loop force control during grasping of a set of daily life objects spanning a full range of normalized weights (0-1).</p><p>There are only a limited number of studies evaluating objectively the role and utility of closed-loop control in prosthetics, especially regarding the electrotactile feedback. Contrary to some other studies which showed no or limited improvement during closed-loop force control [<xref rid="B11" ref-type="bibr">11</xref>, <xref rid="B16" ref-type="bibr">16</xref>, <xref rid="B17" ref-type="bibr">17</xref>], the results in the current study are very optimistic with respect to the benefits of feedback.</p><p>After training shortly with only 5 objects (TR-ELE-VIS and TR-ELE-1) sampling the range of weights (from light to heavy), the subjects understood the “meaning” of electrotactile feedback and learned how to scale the force (tactile sensation) with the expected weight of the object. This first step (i.e., a basic introduction) facilitated the future training so that the subjects “learned” novel objects (TR-ELE-2, <xref ref-type="fig" rid="fig5">Figure 5</xref>) using only electrotactile feedback at the same pace as when they were learning objects assisted by both visual and electrotactile force feedback (TR-VIS-ELE and TR-ELE-1). Finally, after a short training which lasted less than 30 min in total, the subjects were able to grasp 10 objects of very different weights (from an egg to a hammer) with a success rate of 72% in total. As one of the future steps, it would be interesting to evaluate the effect of a more extensive training (longer time and/or more objects to grasp). As demonstrated in different context (i.e., object manipulation rather than grasping) and for vibrotactile feedback [<xref rid="B24" ref-type="bibr">24</xref>], the training is very important for performance, even more than the actual stimulation setup [<xref rid="B25" ref-type="bibr">25</xref>].</p><p>We have also shown that in this particular task the feedback was truly instrumental for good performance. The success rates dropped significantly with purely feedforward control (<xref ref-type="fig" rid="fig8">Figure 8</xref>), and also as demonstrated by the force profiles (<xref ref-type="fig" rid="fig7">Figure 7</xref>), the subjects used very different control strategies with and without the feedback. The subjects relied on the feedback both to adjust the force while grasping an object and also to correct the control based on the outcome of the previous trial. Both of these mechanisms were significantly less effective in the feedforward control. Finally, the closed-loop control showed to be very robust with respect to the change of system parameters. When the rate of change of force was doubled, the performance did not significantly change. There were no statistically significant differences in any of the outcome measures between TE-FDB and TE-FDB-ALT (<xref ref-type="fig" rid="fig8">Figure 8</xref>), except for the time to accomplish the task (<xref ref-type="fig" rid="fig9">Figure 9</xref>). The feedback improved the performance but at the expense of the longer time to accomplish the task due to a more complex processing that had to be accomplished by the subject. We have also demonstrated (<xref ref-type="fig" rid="fig10">Figure 10</xref>) that closed-loop control could be successfully used to grasp not only objects that were trained, but also novel objects that were “derived” from the latter ones in nontrivial ways (stacking up and scaling).</p><p>In some of the previous studies investigating the closed-loop control using vibrotactile stimulation, the ineffectiveness of the closed-loop control might be due to the actual experimental task. In some studies, only two [<xref rid="B16" ref-type="bibr">16</xref>] or three [<xref rid="B10" ref-type="bibr">10</xref>, <xref rid="B17" ref-type="bibr">17</xref>] target force levels have been used. In Cipriani et al. [<xref rid="B11" ref-type="bibr">11</xref>], many objects were tested but the subjects were not instructed explicitly to follow the economical grasping paradigm. Saunders and Vijayakumar [<xref rid="B16" ref-type="bibr">16</xref>] used a binary switch as the controller and a single, constant rate of force increase/decrease. It might be that in these cases it was easier for the subjects to learn the task and system dynamics, after which they could “switch” to mostly feedforward control. In the current study, we have used more force levels and also an analog control interface (joystick) with continuous system dynamics (integrator). A greater variety and a relatively brief training could have made the feedback information essential for accomplishing the task. Note that this context is similar to the one that a user of a prosthesis will face in the real life (e.g., many different objects to handle). However, the reliance on feedback likely depends strongly on the provided training; it might be that, with a longer training, the subjects would eventually switch to feedforward control. An interesting outcome was that also in this study the subjects could reach a success rate of around 40% by relying purely on the feedforward control.</p><p>In the study by Meek et al. [<xref rid="B13" ref-type="bibr">13</xref>], the object to be grasped had a constant weight and the breaking force has been modified in different conditions. Similarly, Zafar and Van Doren [<xref rid="B21" ref-type="bibr">21</xref>] used a single target force level and several values for the width of the target force window. These studies have therefore shown that feedback improves the precision when reaching a single level of target force. In the current study, however, we have demonstrated that the feedback improved the performance when reaching a broad range of target force levels. In a recent conference paper by Witteveen et al. [<xref rid="B15" ref-type="bibr">15</xref>] a somewhat similar setup was used. However, vibrotactile stimulation was investigated and dynamic behavior of the prosthesis was not considered.</p><p>In general, the subjects were more successful when controlling lower forces, that is, when handling lighter objects. There might be two reasons for this. The first one is the linear scaling of the pulse width that we have used for information coding. It is well known that in general the intensity of the sensory stimulus does not map linearly to the intensity of perceived sensation [<xref rid="B23" ref-type="bibr">23</xref>]. For the higher pulses widths, larger absolute steps have to be made in the pulse width to produce a just noticeable difference in the elicited sensation [<xref rid="B26" ref-type="bibr">26</xref>]. We could have used a different scaling (e.g., power law or exponential function [<xref rid="B27" ref-type="bibr">27</xref>]). However, there is no agreement in the literature about the exact parameters of this mapping [<xref rid="B8" ref-type="bibr">8</xref>, <xref rid="B28" ref-type="bibr">28</xref>], and the goal in this initial study was to test what can be done using the simplest approach. The second reason for the difficulties in handling heavy objects could be the habituation, which is more pronounced at higher intensities [<xref rid="B7" ref-type="bibr">7</xref>, <xref rid="B8" ref-type="bibr">8</xref>]. While adjusting the force around the target window, the subjects might have lost the basic sensitivity in discriminating the changes in the intensity of the electrotactile stimulation. Importantly, most of the grasps in daily life are performed with light to medium objects, and also fine force control is mostly needed in the low to medium ranges, since the heavier objects are usually more robust. Nevertheless, the possibility of losing the basic sensitivity in the perception of electrotactile stimulation due to nonlinear psychometric function and/or habituation is an important problem. It affected the results in this study as described above and it therefore needs to be resolved for the future experiments, especially when considering the intended practical application. One possible approach could be to use the intermittent stimulation to decrease the habituation as successfully demonstrated in [<xref rid="B29" ref-type="bibr">29</xref>]. Moreover, in addition to the aforementioned scaling laws, different modulation schemes (e.g., simultaneous intensity and frequency modulation) could be tested to increase the discriminability of the stimulation [<xref rid="B30" ref-type="bibr">30</xref>].</p><p>Finally, in the next paragraphs, we point out certain limitations of the current study. It was not our goal to capture the full intricate complexity of the real life grasping task in which there are numerous factors affecting the selected grasping strategy, control, and progression. For example, grasping strongly depends on the object properties (e.g., texture and stiffness) and geometry, hand-object interaction (contact points), prosthesis features (e.g., nonideal dynamic response), and the functional goals (e.g., strong, stable grip versus fine manipulation). We implemented a virtual setup including certain realistic features (e.g., real time operation and set of real life objects) but we also assumed an ideal feedforward interface (joystick), prosthesis dynamic response (pure integrator), and contact dynamics (contact stability depended only on the grasping force). These simplifications were however intentional since the goal was to isolate a specific aspect that was of most interest in the current study: the general utility and characteristics of the electrotactile feedback during closed-loop control of grasping force. Importantly, some of the aforementioned, presently disregarded factors can be accommodated by our virtual grasping setup and investigated in the future experiments, as explained later.</p><p>The experimental protocol and the results of the current study can be discussed from the viewpoint of the common mechanisms of human perceptual and motor learning [<xref rid="B31" ref-type="bibr">31</xref>]. Namely, the research in this field has demonstrated that a rapid improvement in performance when an individual is first exposed to a novel task is a general characteristic of human learning both in motor and sensory domains. In the context of the current study, the success that the subjects have demonstrated during the tests evaluating the closed-loop control (TE-FDB, TE-FDB-ALT, and TE-FDB-GEN) could reflect this fast learning paradigm. Importantly, since the task at hand was closed-loop control, the learning took place in both domains simultaneously, integrating tactile feedback with motor commands (sensory-motor integration learning). However, it is still unclear if the achieved performance is just due to a normal, short term adaptation to the given sequence of motor tasks, or it reflects a more robust sensory-motor representation which could be stable over time (consolidated memory) or in different scenarios (randomized tests). This is an important question that needs to be addressed in the future studies by, for example, repeating the tests in several sessions over different days to assess the relevant mechanisms (e.g., stabilization, between-session and generalization of learning).</p><p>It is well known from the general psychometry [<xref rid="B23" ref-type="bibr">23</xref>] that sensory perception is affected by many internal and external factors (e.g., subject concentration) and that it can be therefore very variable both within session and between subjects. Since the performance in sensory processing is instrumental for the execution of the closed-loop control task, this could be a possible explanation for the variability of the results (i.e., large standard deviations in Figures <xref ref-type="fig" rid="fig8">8</xref> and <xref ref-type="fig" rid="fig9">9</xref>). Also related to this, the number of subjects in this study was limited but sufficient to reach general conclusions (e.g., feedback versus feedforward) with statistical significance. However, a larger pool of subjects needs to be tested in order to assess with more confidence the actual baseline performance values in each of the tested conditions.</p><p>The setup developed in this study is very general and can be used to implement many different experimental scenarios for testing of the closed-loop control. It relies on modelling and virtual objects, which make it flexible, while at the same time it provides a realistic behaviour through real time performance. A more sophisticated and realistic model of a prosthesis can be easily implemented by changing few parameters of a Matlab Simulink block (e.g., using an integrator with a lag element and a pure time delay). Also, this is an ideal environment for testing how different feedback variables (position, velocity, force, and jerk) or modes of control (position or force control) affect the closed-loop performance. The developed test bench therefore provides a high flexibility in implementing real time closed-loop control scenarios that could generate important insights about the various aspects of artificial sensory feedback in prosthetics. Importantly, one should keep in mind that these experiments are still conducted in well-controlled conditions and by using an abstraction (model) of reality and that therefore the ultimate test of these results is an actual real life assessment. We intend to use the insights from this and similar virtual reality experiments as general guidelines for designing prototype systems, which will then be evaluated in subjects (healthy and amputees) operating real prosthesis to accomplish practical tasks (e.g., grasping real life objects).</p></sec></body><back><ack><title>Acknowledgments</title><p>This research was supported by the Ministry of Education and Science of the Republic of Serbia (Project no. III-41007), by the European Commission under the MYOSENS (FP7-PEOPLE-2011-IAPP-286208) projects, and by the German Ministry for Education and Research (BMBF) via the Bernstein Focus Neurotechnology (BFNT), Göttingen, under Grant no. 01GQ0810.</p></ack><sec sec-type="conflict"><title>Conflict of Interests</title><p>The authors declare that there is no conflict of interests regarding the publication of this paper.</p></sec><ref-list><ref id="B1"><label>1</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Johansson</surname><given-names>RS</given-names></name><name><surname>Cole</surname><given-names>KJ</given-names></name></person-group><article-title>Sensory-motor coordination during grasping and manipulative actions</article-title><source><italic>Current Opinion in Neurobiology</italic></source><year>1992</year><volume>2</volume><issue>6</issue><fpage>815</fpage><lpage>823</lpage><pub-id pub-id-type="other">2-s2.0-0027025157</pub-id><pub-id pub-id-type="pmid">1477545</pub-id></element-citation></ref><ref id="B2"><label>2</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Iyengar</surname><given-names>V</given-names></name><name><surname>Santos</surname><given-names>MJ</given-names></name><name><surname>Ko</surname><given-names>M</given-names></name><name><surname>Aruin</surname><given-names>AS</given-names></name></person-group><article-title>Grip force control in individuals with multiple sclerosis</article-title><source><italic>Neurorehabilitation and Neural Repair</italic></source><year>2009</year><volume>23</volume><issue>8</issue><fpage>855</fpage><lpage>861</lpage><pub-id pub-id-type="other">2-s2.0-70349301537</pub-id><pub-id pub-id-type="pmid">19531607</pub-id></element-citation></ref><ref id="B3"><label>3</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rothwell</surname><given-names>JC</given-names></name><name><surname>Traub</surname><given-names>MM</given-names></name><name><surname>Day</surname><given-names>BL</given-names></name></person-group><article-title>Manual motor performance in a deafferented man</article-title><source><italic>Brain</italic></source><year>1982</year><volume>105</volume><issue>3</issue><fpage>515</fpage><lpage>542</lpage><pub-id pub-id-type="other">2-s2.0-0019920672</pub-id><pub-id pub-id-type="pmid">6286035</pub-id></element-citation></ref><ref id="B4"><label>4</label><element-citation publication-type="other"><article-title>Touch Bionics iLimb</article-title><comment>2013, <ext-link ext-link-type="uri" xlink:href="http://www.touchbionics.com/">http://www.touchbionics.com/</ext-link></comment></element-citation></ref><ref id="B5"><label>5</label><element-citation publication-type="other"><article-title>Otto Bock Sensor Hand Speed</article-title><comment>2013, <ext-link ext-link-type="uri" xlink:href="http://www.ottobock.de/cps/rde/xchg/ob_com_en/hs.xsl/3652.html">http://www.ottobock.de/cps/rde/xchg/ob_com_en/hs.xsl/3652.html</ext-link></comment></element-citation></ref><ref id="B6"><label>6</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dhillon</surname><given-names>GS</given-names></name><name><surname>Horch</surname><given-names>KW</given-names></name></person-group><article-title>Direct neural sensory feedback and control of a prosthetic arm</article-title><source><italic>IEEE Transactions on Neural Systems and Rehabilitation Engineering</italic></source><year>2005</year><volume>13</volume><issue>4</issue><fpage>468</fpage><lpage>472</lpage><pub-id pub-id-type="other">2-s2.0-29644439037</pub-id><pub-id pub-id-type="pmid">16425828</pub-id></element-citation></ref><ref id="B7"><label>7</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Szeto</surname><given-names>A</given-names></name><name><surname>Saunders</surname><given-names>FA</given-names></name></person-group><article-title>Electrocutaneous stimulation for sensory communication in rehabilitation engineering</article-title><source><italic>IEEE Transactions on Biomedical Engineering</italic></source><year>1982</year><volume>29</volume><issue>4</issue><fpage>300</fpage><lpage>308</lpage><pub-id pub-id-type="other">2-s2.0-0020116505</pub-id><pub-id pub-id-type="pmid">7068167</pub-id></element-citation></ref><ref id="B8"><label>8</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kaczmarek</surname><given-names>KA</given-names></name><name><surname>Webster</surname><given-names>JG</given-names></name><name><surname>Bach-y-Rita</surname><given-names>P</given-names></name><name><surname>Tompkins</surname><given-names>WJ</given-names></name></person-group><article-title>Electrotactile and vibrotactile displays for sensory substitution systems</article-title><source><italic>IEEE Transactions on Biomedical Engineering</italic></source><year>1991</year><volume>38</volume><issue>1</issue><fpage>1</fpage><lpage>16</lpage><pub-id pub-id-type="other">2-s2.0-0026096943</pub-id><pub-id pub-id-type="pmid">2026426</pub-id></element-citation></ref><ref id="B9"><label>9</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pylatiuk</surname><given-names>C</given-names></name><name><surname>Kargov</surname><given-names>A</given-names></name><name><surname>Schulz</surname><given-names>S</given-names></name></person-group><article-title>Design and evaluation of a low-cost force feedback system for myoelectric prosthetic hands</article-title><source><italic>Journal of Prosthetics and Orthotics</italic></source><year>2006</year><volume>18</volume><issue>2</issue><fpage>57</fpage><lpage>61</lpage><pub-id pub-id-type="other">2-s2.0-33749435189</pub-id></element-citation></ref><ref id="B10"><label>10</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chatterjee</surname><given-names>A</given-names></name><name><surname>Chaubey</surname><given-names>P</given-names></name><name><surname>Martin</surname><given-names>J</given-names></name><name><surname>Thakor</surname><given-names>N</given-names></name></person-group><article-title>Testing a prosthetic haptic feedback simulator with an interactive force matching task</article-title><source><italic>Journal of Prosthetics and Orthotics</italic></source><year>2008</year><volume>20</volume><issue>2</issue><fpage>27</fpage><lpage>34</lpage><pub-id pub-id-type="other">2-s2.0-41849087742</pub-id></element-citation></ref><ref id="B11"><label>11</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cipriani</surname><given-names>C</given-names></name><name><surname>Zaccone</surname><given-names>F</given-names></name><name><surname>Micera</surname><given-names>S</given-names></name><name><surname>Carrozza</surname><given-names>MC</given-names></name></person-group><article-title>On the shared control of an EMG-controlled prosthetic hand: analysis of user-prosthesis interaction</article-title><source><italic>IEEE Transactions on Robotics</italic></source><year>2008</year><volume>24</volume><issue>1</issue><fpage>170</fpage><lpage>184</lpage><pub-id pub-id-type="other">2-s2.0-40949129655</pub-id></element-citation></ref><ref id="B12"><label>12</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Patterson</surname><given-names>PE</given-names></name><name><surname>Katz</surname><given-names>JA</given-names></name></person-group><article-title>Design and evaluation of a sensory feedback system that provides grasping pressure in a myoelectric hand</article-title><source><italic>Journal of Rehabilitation Research and Development</italic></source><year>1992</year><volume>29</volume><issue>1</issue><fpage>1</fpage><lpage>8</lpage><pub-id pub-id-type="other">2-s2.0-0027006830</pub-id><pub-id pub-id-type="pmid">1740774</pub-id></element-citation></ref><ref id="B13"><label>13</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meek</surname><given-names>SG</given-names></name><name><surname>Jacobsen</surname><given-names>SC</given-names></name><name><surname>Goulding</surname><given-names>PP</given-names></name></person-group><article-title>Extended physiologic taction: design and evaluation of a proportional force feedback system</article-title><source><italic>Journal of Rehabilitation Research and Development</italic></source><year>1989</year><volume>26</volume><issue>3</issue><fpage>53</fpage><lpage>62</lpage><pub-id pub-id-type="other">2-s2.0-0024676405</pub-id><pub-id pub-id-type="pmid">2666644</pub-id></element-citation></ref><ref id="B14"><label>14</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shannon</surname><given-names>GF</given-names></name></person-group><article-title>Sensory feedback for artificial limbs</article-title><source><italic>Medical Progress through Technology</italic></source><year>1979</year><volume>6</volume><issue>2</issue><fpage>73</fpage><lpage>79</lpage><pub-id pub-id-type="other">2-s2.0-0018412407</pub-id><pub-id pub-id-type="pmid">431509</pub-id></element-citation></ref><ref id="B15"><label>15</label><element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Witteveen</surname><given-names>HJB</given-names></name><name><surname>Rietman</surname><given-names>JS</given-names></name><name><surname>Veltink</surname><given-names>PH</given-names></name></person-group><article-title>Grasping force and slip feedback through vibrotactile stimulation to be used in myoelectric forearm prostheses</article-title><volume>2012</volume><conf-name>Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society</conf-name><conf-date>January 2012</conf-date><fpage>2969</fpage><lpage>2972</lpage></element-citation></ref><ref id="B16"><label>16</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Saunders</surname><given-names>I</given-names></name><name><surname>Vijayakumar</surname><given-names>S</given-names></name></person-group><article-title>The role of feed-forward and feedback processes for closed-loop prosthesis control</article-title><source><italic>Journal of NeuroEngineering and Rehabilitation</italic></source><year>2011</year><volume>8, article 60</volume><pub-id pub-id-type="other">2-s2.0-80054943371</pub-id></element-citation></ref><ref id="B17"><label>17</label><element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Chatterjee</surname><given-names>A</given-names></name><name><surname>Chaubey</surname><given-names>P</given-names></name><name><surname>Martin</surname><given-names>J</given-names></name><name><surname>Thakor</surname><given-names>NV</given-names></name></person-group><article-title>Quantifying prosthesis control improvements using a vibrotactile representation of grip force</article-title><conf-name>Proceedings of the IEEE Region 5 Conference</conf-name><conf-date>April 2008</conf-date><conf-loc>Kansas City, Mo, USA</conf-loc><fpage>1</fpage><lpage>5</lpage><pub-id pub-id-type="other">2-s2.0-51849139929</pub-id></element-citation></ref><ref id="B18"><label>18</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Scott</surname><given-names>RN</given-names></name><name><surname>Caldwell</surname><given-names>RR</given-names></name><name><surname>Brittain</surname><given-names>RH</given-names></name></person-group><article-title>Sensory-feedback system compatible with myoelectric control</article-title><source><italic>Medical and Biological Engineering and Computing</italic></source><year>1980</year><volume>18</volume><issue>1</issue><fpage>65</fpage><lpage>69</lpage><pub-id pub-id-type="other">2-s2.0-0018913645</pub-id><pub-id pub-id-type="pmid">7382591</pub-id></element-citation></ref><ref id="B19"><label>19</label><element-citation publication-type="confproc"><person-group person-group-type="author"><name><surname>Wang</surname><given-names>G</given-names></name><name><surname>Zhang</surname><given-names>X</given-names></name><name><surname>Zhang</surname><given-names>J</given-names></name><name><surname>Gruver</surname><given-names>WA</given-names></name></person-group><article-title>Gripping force sensory feedback for a myoelectrically controlled forearm prosthesis</article-title><conf-name>Proceedings of the IEEE International Conference on Systems, Man and Cybernetics</conf-name><conf-date>October 1995</conf-date><fpage>501</fpage><lpage>504</lpage><pub-id pub-id-type="other">2-s2.0-0029487943</pub-id></element-citation></ref><ref id="B20"><label>20</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lundborg</surname><given-names>G</given-names></name><name><surname>Rośn</surname><given-names>B</given-names></name><name><surname>Lindström</surname><given-names>K</given-names></name><name><surname>Lindberg</surname><given-names>S</given-names></name></person-group><article-title>Artificial sensibility based on the use of piezoresistive sensors: preliminary observations</article-title><source><italic>Journal of Hand Surgery</italic></source><year>1998</year><volume>23</volume><issue>5</issue><fpage>620</fpage><lpage>626</lpage><pub-id pub-id-type="other">2-s2.0-0031762621</pub-id></element-citation></ref><ref id="B21"><label>21</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zafar</surname><given-names>M</given-names></name><name><surname>Van Doren</surname><given-names>CL</given-names></name></person-group><article-title>Effectiveness of supplemental grasp-force feedback in the presence of vision</article-title><source><italic>Medical and Biological Engineering and Computing</italic></source><year>2000</year><volume>38</volume><issue>3</issue><fpage>267</fpage><lpage>274</lpage><pub-id pub-id-type="other">2-s2.0-0034081324</pub-id><pub-id pub-id-type="pmid">10912342</pub-id></element-citation></ref><ref id="B22"><label>22</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Humbert</surname><given-names>SD</given-names></name><name><surname>Snyder</surname><given-names>SA</given-names></name><name><surname>Grill</surname><given-names>WM</given-names><suffix>Jr.</suffix></name></person-group><article-title>Evaluation of command algorithms for control of upper-extremity neural prostheses</article-title><source><italic>IEEE Transactions on Neural Systems and Rehabilitation Engineering</italic></source><year>2002</year><volume>10</volume><issue>2</issue><fpage>94</fpage><lpage>101</lpage><pub-id pub-id-type="other">2-s2.0-0036592583</pub-id><pub-id pub-id-type="pmid">12236452</pub-id></element-citation></ref><ref id="B23"><label>23</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Kingdom</surname><given-names>FAA</given-names></name><name><surname>Prins</surname><given-names>N</given-names></name></person-group><source><italic>Psychophysics: A Practical Introduction</italic></source><year>2009</year><publisher-name>Academic Press</publisher-name></element-citation></ref><ref id="B24"><label>24</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stepp</surname><given-names>CE</given-names></name><name><surname>An</surname><given-names>Q</given-names></name><name><surname>Matsuoka</surname><given-names>Y</given-names></name></person-group><article-title>Repeated training with augmentative vibrotactile feedback increases object manipulation performance</article-title><source><italic>PLoS ONE</italic></source><year>2012</year><volume>7</volume><issue>2</issue><pub-id pub-id-type="other">2-s2.0-84857590738</pub-id><pub-id pub-id-type="publisher-id">e32743</pub-id></element-citation></ref><ref id="B25"><label>25</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stepp</surname><given-names>CE</given-names></name><name><surname>Matsuoka</surname><given-names>Y</given-names></name></person-group><article-title>Object manipulation improvements due to single session training outweigh the differences among stimulation sites during vibrotactile feedback</article-title><source><italic>IEEE Transactions on Neural Systems and Rehabilitation Engineering</italic></source><year>2011</year><volume>19</volume><issue>6</issue><fpage>677</fpage><lpage>685</lpage><pub-id pub-id-type="other">2-s2.0-83455220037</pub-id><pub-id pub-id-type="pmid">21984521</pub-id></element-citation></ref><ref id="B26"><label>26</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Szeto</surname><given-names>AYJ</given-names></name><name><surname>Lyman</surname><given-names>J</given-names></name><name><surname>Prior</surname><given-names>RE</given-names></name></person-group><article-title>Electrocutaneous pulse rate and pulse width psychometric functions for sensory communications</article-title><source><italic>Human Factors</italic></source><year>1979</year><volume>21</volume><issue>2</issue><fpage>241</fpage><lpage>249</lpage><pub-id pub-id-type="other">2-s2.0-0018463773</pub-id><pub-id pub-id-type="pmid">489023</pub-id></element-citation></ref><ref id="B27"><label>27</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McCallum</surname><given-names>P</given-names></name><name><surname>Goldberg</surname><given-names>H</given-names></name></person-group><article-title>Magnitude scales for electrocutaneous stimulation</article-title><source><italic>Perception and Psychophysics</italic></source><year>1975</year><volume>17</volume><issue>1</issue><fpage>75</fpage><lpage>78</lpage><pub-id pub-id-type="other">2-s2.0-0016427652</pub-id></element-citation></ref><ref id="B28"><label>28</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Marcus</surname><given-names>PL</given-names></name><name><surname>Fuglevand</surname><given-names>AJ</given-names></name></person-group><article-title>Perception of electrical and mechanical stimulation of the skin: implications for electrotactile feedback</article-title><source><italic>Journal of Neural Engineering</italic></source><year>2009</year><volume>6</volume><issue>6</issue><pub-id pub-id-type="publisher-id">66008</pub-id><pub-id pub-id-type="other">2-s2.0-75549089971</pub-id></element-citation></ref><ref id="B29"><label>29</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Buma</surname><given-names>DG</given-names></name><name><surname>Buitenweg</surname><given-names>JR</given-names></name><name><surname>Veltink</surname><given-names>PH</given-names></name></person-group><article-title>Intermittent stimulation delays adaptation to electrocutaneous sensory feedback</article-title><source><italic>IEEE Transactions on Neural Systems and Rehabilitation Engineering</italic></source><year>2007</year><volume>15</volume><issue>3</issue><fpage>435</fpage><lpage>441</lpage><pub-id pub-id-type="other">2-s2.0-34648857532</pub-id><pub-id pub-id-type="pmid">17894276</pub-id></element-citation></ref><ref id="B30"><label>30</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Szeto</surname><given-names>AYJ</given-names></name><name><surname>Farrenkopf</surname><given-names>GR</given-names></name></person-group><article-title>Optimization of single electrode tactile codes</article-title><source><italic>Annals of Biomedical Engineering</italic></source><year>1992</year><volume>20</volume><issue>6</issue><fpage>647</fpage><lpage>665</lpage><pub-id pub-id-type="other">2-s2.0-0026471896</pub-id><pub-id pub-id-type="pmid">1449232</pub-id></element-citation></ref><ref id="B31"><label>31</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Censor</surname><given-names>N</given-names></name><name><surname>Sagi</surname><given-names>D</given-names></name><name><surname>Cohen</surname><given-names>LG</given-names></name></person-group><article-title>Common mechanisms of human perceptual and motor learning</article-title><source><italic>Nature Reviews Neuroscience</italic></source><year>2012</year><volume>13</volume><issue>9</issue><fpage>658</fpage><lpage>664</lpage></element-citation></ref></ref-list></back><floats-group><fig id="fig1" orientation="portrait" position="float"><label>Figure 1</label><caption><p>Experimental setup for closed-loop force control using electrotactile stimulation. The task for the subject was to generate an appropriate force to lift the target object without breaking it. The command interface was joystick and a push button. The electrotactile feedback was provided using a stimulation unit and concentric electrodes placed on the forearm of the subject. The control loop operated in real time at the sampling frequency of 100 Hz. The graphical interface for the subject included a model of the prosthesis, target object, and a force bar showing the minimal, current, maximal and breaking force. The bar plot was used at the beginning of the training to teach the subjects the task they should perform as well as the meaning of the electrotactile feedback. Otherwise, the visual force feedback was not shown on the screen. For detailed explanation see <xref ref-type="sec" rid="sec2.4">Section 2.4</xref>.</p></caption><graphic xlink:href="CMMM2014-120357.001"></graphic></fig><fig id="fig2" orientation="portrait" position="float"><label>Figure 2</label><caption><p>The steps comprising a single trial of a virtual grasping. There were three phases: (1) hand closing, (2) force control, and (3) object lift-off. The trial was deemed successful if the object was successfully lifted, while keeping the grasping force within the predefined limits (target window) for the given object.</p></caption><graphic xlink:href="CMMM2014-120357.002"></graphic></fig><fig id="fig3" orientation="portrait" position="float"><label>Figure 3</label><caption><p>Control signals and prosthesis state variables recorded during a representative trial. In the hand closing phase, the joystick controls the hand aperture and after contacting the object, it controls the grasping force. Initially the subject increased the force faster to bring the signal in the vicinity of the target window. Afterwards, the subject becomes more careful, slowing down the force increase and performing fine corrections. To achieve stable control, a dead zone for the joystick signal was adopted.</p></caption><graphic xlink:href="CMMM2014-120357.003"></graphic></fig><fig id="fig4" orientation="portrait" position="float"><label>Figure 4</label><caption><p>Representative results of the training: (a) TR-ELE-1 and (b) TR-ELE-2. The horizontal lines are force limits, green circle is a successful grasp and lift, blue circle denotes the trial in which the object slipped from the grasp (i.e., grasping force lower than the minimal necessary force), and the red circle represents the trials in which the object was broken (i.e., grasping force crossed the upper limit). The trials with the same object are grouped by a dashed line. From trial to trial, the subject adjusted the grasping force, eventually reaching the target force window. The training was faster in TR-ELE-2.</p></caption><graphic xlink:href="CMMM2014-120357.004"></graphic></fig><fig id="fig5" orientation="portrait" position="float"><label>Figure 5</label><caption><p>Overall training results (i.e., average number of attempts per object ± standard deviation): (a) across conditions and (b) across objects. The training took similar number of trials in TR-ELE-2 (“unseen” objects) and TR-ELE-1 (previously “seen” objects). In addition, in TR-ELE-2 the subjects learned how to handle heavy objects, which were particularly challenging in TR-ELE-1. Within each condition, the objects in (b) are arranged by their weight (*<italic>P</italic> < 0.05; **<italic>P</italic> < 0.01; ***<italic>P</italic> < 0.001).</p></caption><graphic xlink:href="CMMM2014-120357.005"></graphic></fig><fig id="fig6" orientation="portrait" position="float"><label>Figure 6</label><caption><p>Representative results for the testing conditions: (a) TE-FDB, (b) TE-FWD, (c) TE-FWD-ALT, and (d) TE-FDB-ALT. The horizontal lines are force limits, green circle is a successful grasp and lift, blue circle denotes the trial in which the object has slipped from the grasp (i.e., grasping force lower than the minimal necessary force), and the red circle represents the trials in which the object was broken (i.e., grasping force crossed the upper limit). For each of the ten objects, there were two grasping trials in succession. The performance was much better when the feedback was provided.</p></caption><graphic xlink:href="CMMM2014-120357.006"></graphic></fig><fig id="fig7" orientation="portrait" position="float"><label>Figure 7</label><caption><p>Representative examples of forces generated by different subjects (color profiles) grasping the same object in different testing conditions: (a) and (b) for successful grasping and breaking during TE-FDB, respectively, and (c) and (d) for successful grasping and breaking during TE-FWD, respectively. In both conditions, the subjects would steadily increase the force, but when the feedback was provided, they would also adjust the rate of force increase many times during the trial (e.g., see corrections in (a)). The time is normalized to the duration of the trial in order to emphasize the similarity in the shape of the force profiles for different subjects in the same condition.</p></caption><graphic xlink:href="CMMM2014-120357.007"></graphic></fig><fig id="fig8" orientation="portrait" position="float"><label>Figure 8</label><caption><p>Overall results (mean ± standard deviation) in different testing conditions: (a) success rates (SR) from the first trials only, (b) SR from the first and second (correction) trials together, (c) force errors (FE) in the trials in which the object slipped from the grasp, and (d) SR in corrections (second trial was successful after the first had failed). In (d), only a grand average is reported, since the number of failed first trials was very different between subjects and conditions (30/36, 29/67, 12/44, and 28/44 for overall corrected/failed, left to right). The subjects were more successful in grasping the objects, made smaller errors in the failed trials, and better corrected the unsuccessful trials when the feedback was provided (*<italic>P</italic> < 0.05; **<italic>P</italic> < 0.01; ***<italic>P</italic> < 0.001).</p></caption><graphic xlink:href="CMMM2014-120357.008"></graphic></fig><fig id="fig9" orientation="portrait" position="float"><label>Figure 9</label><caption><p>Average time to accomplish the task (ATA) (mean ± standard deviation) in different testing conditions. Providing feedback increased the time to accomplish the task.</p></caption><graphic xlink:href="CMMM2014-120357.009"></graphic></fig><fig id="fig10" orientation="portrait" position="float"><label>Figure 10</label><caption><p>Success rates in generalizing closed-loop control from a reference object to a test object (see <xref ref-type="table" rid="tab2">Table 2</xref>). The task was to grasp an object that was similar to the reference (white bars) or represented a stacked/scaled version of the reference (gray bars). The objects are ordered according to the weight (from lighter to heavier). For the small forces (lighter objects), the subjects were very successful in both tasks.</p></caption><graphic xlink:href="CMMM2014-120357.010"></graphic></fig><table-wrap id="tab1" orientation="portrait" position="float"><label>Table 1</label><caption><p>Objects used in the tests.</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="1" colspan="1">Object number</th><th align="center" rowspan="1" colspan="1">Object</th><th align="center" rowspan="1" colspan="1">Normalized min/max force</th><th align="center" rowspan="1" colspan="1">Object number</th><th align="center" rowspan="1" colspan="1">Object</th><th align="center" rowspan="1" colspan="1">Normalized min/max force</th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">1</td><td align="center" rowspan="1" colspan="1">Egg</td><td align="center" rowspan="1" colspan="1">0.05/0.2</td><td align="center" rowspan="1" colspan="1">12</td><td align="center" rowspan="1" colspan="1">Wine glass empty</td><td align="center" rowspan="1" colspan="1">0.15/0.3</td></tr><tr><td align="left" rowspan="1" colspan="1">2</td><td align="center" rowspan="1" colspan="1">CD</td><td align="center" rowspan="1" colspan="1">0.05/0.2</td><td align="center" rowspan="1" colspan="1">13</td><td align="center" rowspan="1" colspan="1">Wine glass half full</td><td align="center" rowspan="1" colspan="1">0.28/0.4</td></tr><tr><td align="left" rowspan="1" colspan="1">3</td><td align="center" rowspan="1" colspan="1">Orange</td><td align="center" rowspan="1" colspan="1">0.2/0.4</td><td align="center" rowspan="1" colspan="1">14</td><td align="center" rowspan="1" colspan="1">Light bulb</td><td align="center" rowspan="1" colspan="1">0.05/0.2</td></tr><tr><td align="left" rowspan="1" colspan="1">4</td><td align="center" rowspan="1" colspan="1">Wine glass full</td><td align="center" rowspan="1" colspan="1">0.35/0.5</td><td align="center" rowspan="1" colspan="1">15</td><td align="center" rowspan="1" colspan="1">Brick small</td><td align="center" rowspan="1" colspan="1">0.45/0.6</td></tr><tr><td align="left" rowspan="1" colspan="1">5</td><td align="center" rowspan="1" colspan="1">Bottle half full</td><td align="center" rowspan="1" colspan="1">0.5/0.7</td><td align="center" rowspan="1" colspan="1">16</td><td align="center" rowspan="1" colspan="1">Hammer small</td><td align="center" rowspan="1" colspan="1">0.6/0.8</td></tr><tr><td align="left" rowspan="1" colspan="1">6</td><td align="center" rowspan="1" colspan="1">Hammer </td><td align="center" rowspan="1" colspan="1">0.75/0.97</td><td align="center" rowspan="1" colspan="1">17</td><td align="center" rowspan="1" colspan="1">Lighter</td><td align="center" rowspan="1" colspan="1">0.05/0.2</td></tr><tr><td align="left" rowspan="1" colspan="1">7</td><td align="center" rowspan="1" colspan="1">Stack of cards</td><td align="center" rowspan="1" colspan="1">0.08/0.25</td><td align="center" rowspan="1" colspan="1">18</td><td align="center" rowspan="1" colspan="1">Lemon</td><td align="center" rowspan="1" colspan="1">0.2/0.4</td></tr><tr><td align="left" rowspan="1" colspan="1">8</td><td align="center" rowspan="1" colspan="1">Cereal box small</td><td align="center" rowspan="1" colspan="1">0.15/0.3</td><td align="center" rowspan="1" colspan="1">19</td><td align="center" rowspan="1" colspan="1">Apple</td><td align="center" rowspan="1" colspan="1">0.2/0.4</td></tr><tr><td align="left" rowspan="1" colspan="1">9</td><td align="center" rowspan="1" colspan="1">Cereal box</td><td align="center" rowspan="1" colspan="1">0.3/0.5</td><td align="center" rowspan="1" colspan="1"> </td><td align="center" rowspan="1" colspan="1"> </td><td align="center" rowspan="1" colspan="1"> </td></tr><tr><td align="left" rowspan="1" colspan="1">10</td><td align="center" rowspan="1" colspan="1">Book thin</td><td align="center" rowspan="1" colspan="1">0.3/0.5</td><td align="center" rowspan="1" colspan="1"> </td><td align="center" rowspan="1" colspan="1"> </td><td align="center" rowspan="1" colspan="1"> </td></tr><tr><td align="left" rowspan="1" colspan="1">11</td><td align="center" rowspan="1" colspan="1">Brick</td><td align="center" rowspan="1" colspan="1">0.75/0.9</td><td align="center" rowspan="1" colspan="1"> </td><td align="center" rowspan="1" colspan="1"> </td><td align="center" rowspan="1" colspan="1"> </td></tr></tbody></table></table-wrap><table-wrap id="tab2" orientation="portrait" position="float"><label>Table 2</label><caption><p>Objects used in TE-FDB-GEN.</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="1" colspan="1">Reference object</th><th align="center" rowspan="1" colspan="1">Test object</th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">Egg</td><td align="center" rowspan="1" colspan="1">Light bulb</td></tr><tr><td align="left" rowspan="1" colspan="1">Egg</td><td align="center" rowspan="1" colspan="1">Lighter</td></tr><tr><td align="left" rowspan="1" colspan="1">Orange</td><td align="center" rowspan="1" colspan="1">Apple</td></tr><tr><td align="left" rowspan="1" colspan="1">Orange</td><td align="center" rowspan="1" colspan="1">Lemon</td></tr><tr><td align="left" rowspan="1" colspan="1">Stack of cards</td><td align="center" rowspan="1" colspan="1">Stack of cards × 2</td></tr><tr><td align="left" rowspan="1" colspan="1">Cereal box</td><td align="center" rowspan="1" colspan="1">Cereal box small</td></tr><tr><td align="left" rowspan="1" colspan="1">Cereal box small</td><td align="center" rowspan="1" colspan="1">Cereal box small × 2</td></tr><tr><td align="left" rowspan="1" colspan="1">CD</td><td align="center" rowspan="1" colspan="1">CD × 5</td></tr><tr><td align="left" rowspan="1" colspan="1">CD</td><td align="center" rowspan="1" colspan="1">CD × 4</td></tr><tr><td align="left" rowspan="1" colspan="1">Thin book</td><td align="center" rowspan="1" colspan="1">Thin book × 3</td></tr><tr><td align="left" rowspan="1" colspan="1">Thin book</td><td align="center" rowspan="1" colspan="1">Thin book × 2</td></tr><tr><td align="left" rowspan="1" colspan="1">Small hammer</td><td align="center" rowspan="1" colspan="1">Small brick </td></tr></tbody></table></table-wrap></floats-group></pmc><affiliations><list><country><li>Allemagne</li><li>Serbie</li></country><region><li>Basse-Saxe</li></region><settlement><li>Göttingen</li></settlement></list><tree><country name="Serbie"><noRegion><name sortKey="Jorgovanovic, Nikola" sort="Jorgovanovic, Nikola" uniqKey="Jorgovanovic N" first="Nikola" last="Jorgovanovic">Nikola Jorgovanovic</name></noRegion><name sortKey="Djozic, Damir J" sort="Djozic, Damir J" uniqKey="Djozic D" first="Damir J." last="Djozic">Damir J. Djozic</name><name sortKey="Krajoski, Goran" sort="Krajoski, Goran" uniqKey="Krajoski G" first="Goran" last="Krajoski">Goran Krajoski</name></country><country name="Allemagne"><region name="Basse-Saxe"><name sortKey="Dosen, Strahinja" sort="Dosen, Strahinja" uniqKey="Dosen S" first="Strahinja" last="Dosen">Strahinja Dosen</name></region><name sortKey="Farina, Dario" sort="Farina, Dario" uniqKey="Farina D" first="Dario" last="Farina">Dario Farina</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000831 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd -nk 000831 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Pmc
|étape= Checkpoint
|type= RBID
|clé= PMC:3909980
|texte= Virtual Grasping: Closed-Loop Force Control Using Electrotactile Feedback
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/RBID.i -Sk "pubmed:24516504" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |