Assessment of Robotic Patient Simulators for Training in Manual Physical Therapy Examination Techniques
Identifieur interne : 003885 ( Ncbi/Merge ); précédent : 003884; suivant : 003886Assessment of Robotic Patient Simulators for Training in Manual Physical Therapy Examination Techniques
Auteurs : Shun Ishikawa [Japon] ; Shogo Okamoto [Japon] ; Kaoru Isogai [Japon] ; Yasuhiro Akiyama [Japon] ; Naomi Yanagihara [Japon] ; Yoji Yamada [Japon]Source :
- PLoS ONE [ 1932-6203 ] ; 2015.
Abstract
Robots that simulate patients suffering from joint resistance caused by biomechanical and neural impairments are used to aid the training of physical therapists in manual examination techniques. However, there are few methods for assessing such robots. This article proposes two types of assessment measures based on typical judgments of clinicians. One of the measures involves the evaluation of how well the simulator presents different severities of a specified disease. Experienced clinicians were requested to rate the simulated symptoms in terms of severity, and the consistency of their ratings was used as a performance measure. The other measure involves the evaluation of how well the simulator presents different types of symptoms. In this case, the clinicians were requested to classify the simulated resistances in terms of symptom type, and the average ratios of their answers were used as performance measures. For both types of assessment measures, a higher index implied higher agreement among the experienced clinicians that subjectively assessed the symptoms based on typical symptom features. We applied these two assessment methods to a patient knee robot and achieved positive appraisals. The assessment measures have potential for use in comparing several patient simulators for training physical therapists, rather than as absolute indices for developing a standard.
Url:
DOI: 10.1371/journal.pone.0126392
PubMed: 25923719
PubMed Central: 4414623
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000288
- to stream Pmc, to step Curation: 000288
- to stream Pmc, to step Checkpoint: 000740
Links to Exploration step
PMC:4414623Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Assessment of Robotic Patient Simulators for Training in Manual Physical Therapy Examination Techniques</title><author><name sortKey="Ishikawa, Shun" sort="Ishikawa, Shun" uniqKey="Ishikawa S" first="Shun" last="Ishikawa">Shun Ishikawa</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Okamoto, Shogo" sort="Okamoto, Shogo" uniqKey="Okamoto S" first="Shogo" last="Okamoto">Shogo Okamoto</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Isogai, Kaoru" sort="Isogai, Kaoru" uniqKey="Isogai K" first="Kaoru" last="Isogai">Kaoru Isogai</name><affiliation wicri:level="1"><nlm:aff id="aff002"><addr-line>Department of Physical Therapy, Faculty of Health and Medical Science, Tokoha University, Hamamatsu, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Physical Therapy, Faculty of Health and Medical Science, Tokoha University, Hamamatsu</wicri:regionArea><wicri:noRegion>Hamamatsu</wicri:noRegion></affiliation></author><author><name sortKey="Akiyama, Yasuhiro" sort="Akiyama, Yasuhiro" uniqKey="Akiyama Y" first="Yasuhiro" last="Akiyama">Yasuhiro Akiyama</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Yanagihara, Naomi" sort="Yanagihara, Naomi" uniqKey="Yanagihara N" first="Naomi" last="Yanagihara">Naomi Yanagihara</name><affiliation wicri:level="1"><nlm:aff id="aff003"><addr-line>Department of Physical and Occupational Therapy, Graduate School of Medicine, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Physical and Occupational Therapy, Graduate School of Medicine, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Yamada, Yoji" sort="Yamada, Yoji" uniqKey="Yamada Y" first="Yoji" last="Yamada">Yoji Yamada</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">25923719</idno><idno type="pmc">4414623</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4414623</idno><idno type="RBID">PMC:4414623</idno><idno type="doi">10.1371/journal.pone.0126392</idno><date when="2015">2015</date><idno type="wicri:Area/Pmc/Corpus">000288</idno><idno type="wicri:Area/Pmc/Curation">000288</idno><idno type="wicri:Area/Pmc/Checkpoint">000740</idno><idno type="wicri:Area/Ncbi/Merge">003885</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Assessment of Robotic Patient Simulators for Training in Manual Physical Therapy Examination Techniques</title><author><name sortKey="Ishikawa, Shun" sort="Ishikawa, Shun" uniqKey="Ishikawa S" first="Shun" last="Ishikawa">Shun Ishikawa</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Okamoto, Shogo" sort="Okamoto, Shogo" uniqKey="Okamoto S" first="Shogo" last="Okamoto">Shogo Okamoto</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Isogai, Kaoru" sort="Isogai, Kaoru" uniqKey="Isogai K" first="Kaoru" last="Isogai">Kaoru Isogai</name><affiliation wicri:level="1"><nlm:aff id="aff002"><addr-line>Department of Physical Therapy, Faculty of Health and Medical Science, Tokoha University, Hamamatsu, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Physical Therapy, Faculty of Health and Medical Science, Tokoha University, Hamamatsu</wicri:regionArea><wicri:noRegion>Hamamatsu</wicri:noRegion></affiliation></author><author><name sortKey="Akiyama, Yasuhiro" sort="Akiyama, Yasuhiro" uniqKey="Akiyama Y" first="Yasuhiro" last="Akiyama">Yasuhiro Akiyama</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Yanagihara, Naomi" sort="Yanagihara, Naomi" uniqKey="Yanagihara N" first="Naomi" last="Yanagihara">Naomi Yanagihara</name><affiliation wicri:level="1"><nlm:aff id="aff003"><addr-line>Department of Physical and Occupational Therapy, Graduate School of Medicine, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Physical and Occupational Therapy, Graduate School of Medicine, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author><author><name sortKey="Yamada, Yoji" sort="Yamada, Yoji" uniqKey="Yamada Y" first="Yoji" last="Yamada">Yoji Yamada</name><affiliation wicri:level="1"><nlm:aff id="aff001"><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></nlm:aff><country xml:lang="fr">Japon</country><wicri:regionArea>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya</wicri:regionArea><wicri:noRegion>Nagoya</wicri:noRegion></affiliation></author></analytic><series><title level="j">PLoS ONE</title><idno type="eISSN">1932-6203</idno><imprint><date when="2015">2015</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Robots that simulate patients suffering from joint resistance caused by biomechanical and neural impairments are used to aid the training of physical therapists in manual examination techniques. However, there are few methods for assessing such robots. This article proposes two types of assessment measures based on typical judgments of clinicians. One of the measures involves the evaluation of how well the simulator presents different severities of a specified disease. Experienced clinicians were requested to rate the simulated symptoms in terms of severity, and the consistency of their ratings was used as a performance measure. The other measure involves the evaluation of how well the simulator presents different types of symptoms. In this case, the clinicians were requested to classify the simulated resistances in terms of symptom type, and the average ratios of their answers were used as performance measures. For both types of assessment measures, a higher index implied higher agreement among the experienced clinicians that subjectively assessed the symptoms based on typical symptom features. We applied these two assessment methods to a patient knee robot and achieved positive appraisals. The assessment measures have potential for use in comparing several patient simulators for training physical therapists, rather than as absolute indices for developing a standard.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Kikuchi, T" uniqKey="Kikuchi T">T Kikuchi</name></author><author><name sortKey="Oda, K" uniqKey="Oda K">K Oda</name></author><author><name sortKey="Yamaguchi, S" uniqKey="Yamaguchi S">S Yamaguchi</name></author><author><name sortKey="Furusho, J" uniqKey="Furusho J">J Furusho</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kikuchi, T" uniqKey="Kikuchi T">T Kikuchi</name></author><author><name sortKey="Oda, K" uniqKey="Oda K">K Oda</name></author><author><name sortKey="Furusho, J" uniqKey="Furusho J">J Furusho</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Mouri, T" uniqKey="Mouri T">T Mouri</name></author><author><name sortKey="Kawasaki, H" uniqKey="Kawasaki H">H Kawasaki</name></author><author><name sortKey="Nishimoto, Y" uniqKey="Nishimoto Y">Y Nishimoto</name></author><author><name sortKey="Aoki, T" uniqKey="Aoki T">T Aoki</name></author><author><name sortKey="Ishiguro, Y" uniqKey="Ishiguro Y">Y Ishiguro</name></author><author><name sortKey="Tanahashi, M" uniqKey="Tanahashi M">M Tanahashi</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Park, Hs" uniqKey="Park H">HS Park</name></author><author><name sortKey="Kim, J" uniqKey="Kim J">J Kim</name></author><author><name sortKey="Damiano, Dl" uniqKey="Damiano D">DL Damiano</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Dietz, V" uniqKey="Dietz V">V Dietz</name></author><author><name sortKey="Sinkjaer, T" uniqKey="Sinkjaer T">T Sinkjaer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jobin, A" uniqKey="Jobin A">A Jobin</name></author><author><name sortKey="Levin, Mf" uniqKey="Levin M">MF Levin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Powers, Rk" uniqKey="Powers R">RK Powers</name></author><author><name sortKey="Marder Meyer, J" uniqKey="Marder Meyer J">J Marder-Meyer</name></author><author><name sortKey="Rymer, Wz" uniqKey="Rymer W">WZ Rymer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Urban, Pp" uniqKey="Urban P">PP Urban</name></author><author><name sortKey="Wolf, T" uniqKey="Wolf T">T Wolf</name></author><author><name sortKey="Uebele, M" uniqKey="Uebele M">M Uebele</name></author><author><name sortKey="Marx, Jj" uniqKey="Marx J">JJ Marx</name></author><author><name sortKey="Vogt, T" uniqKey="Vogt T">T Vogt</name></author><author><name sortKey="Stoeter, P" uniqKey="Stoeter P">P Stoeter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wissel, J" uniqKey="Wissel J">J Wissel</name></author><author><name sortKey="Manack, A" uniqKey="Manack A">A Manack</name></author><author><name sortKey="Brainin, M" uniqKey="Brainin M">M Brainin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bohannon, Rw" uniqKey="Bohannon R">RW Bohannon</name></author><author><name sortKey="Smith, Mb" uniqKey="Smith M">MB Smith</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mccrea, Ph" uniqKey="Mccrea P">PH McCrea</name></author><author><name sortKey="Eng, Jj" uniqKey="Eng J">JJ Eng</name></author><author><name sortKey="Hodgson, Aj" uniqKey="Hodgson A">AJ Hodgson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Calota, A" uniqKey="Calota A">A Calota</name></author><author><name sortKey="Feldman, Ag" uniqKey="Feldman A">AG Feldman</name></author><author><name sortKey="Levin, Mf" uniqKey="Levin M">MF Levin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fleuren, Jf" uniqKey="Fleuren J">JF Fleuren</name></author><author><name sortKey="Voerman, Ge" uniqKey="Voerman G">GE Voerman</name></author><author><name sortKey="Erren Wolters, Cv" uniqKey="Erren Wolters C">CV Erren-Wolters</name></author><author><name sortKey="Snoek, Gj" uniqKey="Snoek G">GJ Snoek</name></author><author><name sortKey="Rietman, Js" uniqKey="Rietman J">JS Rietman</name></author><author><name sortKey="Hermens, Hj" uniqKey="Hermens H">HJ Hermens</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pandyan, Ad" uniqKey="Pandyan A">AD Pandyan</name></author><author><name sortKey="Johnson, Gr" uniqKey="Johnson G">GR Johnson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mutlu, A" uniqKey="Mutlu A">A Mutlu</name></author><author><name sortKey="Livanelioglu, A" uniqKey="Livanelioglu A">A Livanelioglu</name></author><author><name sortKey="Gunel, Mk" uniqKey="Gunel M">MK Gunel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kaya, T" uniqKey="Kaya T">T Kaya</name></author><author><name sortKey="Goksel Karatepe, A" uniqKey="Goksel Karatepe A">A Goksel Karatepe</name></author><author><name sortKey="Gunaydin, R" uniqKey="Gunaydin R">R Gunaydin</name></author><author><name sortKey="Koc, A" uniqKey="Koc A">A Koc</name></author><author><name sortKey="Altundal Ercan, U" uniqKey="Altundal Ercan U">U Altundal Ercan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mehrholz, J" uniqKey="Mehrholz J">J Mehrholz</name></author><author><name sortKey="Major, Y" uniqKey="Major Y">Y Major</name></author><author><name sortKey="Mei Ner, D" uniqKey="Mei Ner D">D Meißner</name></author><author><name sortKey="Sandi Gahun, S" uniqKey="Sandi Gahun S">S Sandi-Gahun</name></author><author><name sortKey="Koch, R" uniqKey="Koch R">R Koch</name></author><author><name sortKey="Pohl, M" uniqKey="Pohl M">M Pohl</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mehrholz, J" uniqKey="Mehrholz J">J Mehrholz</name></author><author><name sortKey="Wagner, K" uniqKey="Wagner K">K Wagner</name></author><author><name sortKey="Mei Ner, D" uniqKey="Mei Ner D">D Meißner</name></author><author><name sortKey="Grundmann, K" uniqKey="Grundmann K">K Grundmann</name></author><author><name sortKey="Zange, C" uniqKey="Zange C">C Zange</name></author><author><name sortKey="Koch, R" uniqKey="Koch R">R Koch</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Stebbins, Gt" uniqKey="Stebbins G">GT Stebbins</name></author><author><name sortKey="Goetz, Cg" uniqKey="Goetz C">CG Goetz</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">PLoS One</journal-id><journal-id journal-id-type="iso-abbrev">PLoS ONE</journal-id><journal-id journal-id-type="publisher-id">plos</journal-id><journal-id journal-id-type="pmc">plosone</journal-id><journal-title-group><journal-title>PLoS ONE</journal-title></journal-title-group><issn pub-type="epub">1932-6203</issn><publisher><publisher-name>Public Library of Science</publisher-name><publisher-loc>San Francisco, CA USA</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">25923719</article-id><article-id pub-id-type="pmc">4414623</article-id><article-id pub-id-type="publisher-id">PONE-D-14-24284</article-id><article-id pub-id-type="doi">10.1371/journal.pone.0126392</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>Assessment of Robotic Patient Simulators for Training in Manual Physical Therapy Examination Techniques</article-title><alt-title alt-title-type="running-head">Assessment of Robotic Patient Simulators</alt-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Ishikawa</surname><given-names>Shun</given-names></name><xref ref-type="aff" rid="aff001"><sup>1</sup></xref></contrib><contrib contrib-type="author"><name><surname>Okamoto</surname><given-names>Shogo</given-names></name><xref ref-type="aff" rid="aff001"><sup>1</sup></xref><xref ref-type="corresp" rid="cor001">*</xref></contrib><contrib contrib-type="author"><name><surname>Isogai</surname><given-names>Kaoru</given-names></name><xref ref-type="aff" rid="aff002"><sup>2</sup></xref></contrib><contrib contrib-type="author"><name><surname>Akiyama</surname><given-names>Yasuhiro</given-names></name><xref ref-type="aff" rid="aff001"><sup>1</sup></xref></contrib><contrib contrib-type="author"><name><surname>Yanagihara</surname><given-names>Naomi</given-names></name><xref ref-type="aff" rid="aff003"><sup>3</sup></xref></contrib><contrib contrib-type="author"><name><surname>Yamada</surname><given-names>Yoji</given-names></name><xref ref-type="aff" rid="aff001"><sup>1</sup></xref></contrib></contrib-group><aff id="aff001"><label>1</label><addr-line>Department of Mechanical Science and Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan</addr-line></aff><aff id="aff002"><label>2</label><addr-line>Department of Physical Therapy, Faculty of Health and Medical Science, Tokoha University, Hamamatsu, Japan</addr-line></aff><aff id="aff003"><label>3</label><addr-line>Department of Physical and Occupational Therapy, Graduate School of Medicine, Nagoya University, Nagoya, Japan</addr-line></aff><contrib-group><contrib contrib-type="editor"><name><surname>Wang</surname><given-names>Long</given-names></name><role>Academic Editor</role><xref ref-type="aff" rid="edit1"></xref></contrib></contrib-group><aff id="edit1"><addr-line>Peking University, CHINA</addr-line></aff><author-notes><fn fn-type="conflict" id="coi001"><p><bold>Competing Interests: </bold>The authors have declared that no competing interests exist.</p></fn><fn fn-type="con" id="contrib001"><p>Conceived and designed the experiments: SI SO KI. Performed the experiments: SI SO KI. Analyzed the data: SI SO. Contributed reagents/materials/analysis tools: SI SO KI YA NY YY. Wrote the paper: SI SO KI.</p></fn><corresp id="cor001">* E-mail: <email>okamoto-shogo@nagoya-u.jp</email></corresp></author-notes><pub-date pub-type="collection"><year>2015</year></pub-date><pub-date pub-type="epub"><day>29</day><month>4</month><year>2015</year></pub-date><volume>10</volume><issue>4</issue><elocation-id>e0126392</elocation-id><history><date date-type="received"><day>1</day><month>7</month><year>2014</year></date><date date-type="accepted"><day>1</day><month>4</month><year>2015</year></date></history><permissions><copyright-year>2015</copyright-year><copyright-holder>Ishikawa et al</copyright-holder><license xlink:href="http://creativecommons.org/licenses/by/4.0/"><license-p>This is an open access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited</license-p></license></permissions><self-uri content-type="pdf" xlink:type="simple" xlink:href="pone.0126392.pdf"></self-uri><abstract><p>Robots that simulate patients suffering from joint resistance caused by biomechanical and neural impairments are used to aid the training of physical therapists in manual examination techniques. However, there are few methods for assessing such robots. This article proposes two types of assessment measures based on typical judgments of clinicians. One of the measures involves the evaluation of how well the simulator presents different severities of a specified disease. Experienced clinicians were requested to rate the simulated symptoms in terms of severity, and the consistency of their ratings was used as a performance measure. The other measure involves the evaluation of how well the simulator presents different types of symptoms. In this case, the clinicians were requested to classify the simulated resistances in terms of symptom type, and the average ratios of their answers were used as performance measures. For both types of assessment measures, a higher index implied higher agreement among the experienced clinicians that subjectively assessed the symptoms based on typical symptom features. We applied these two assessment methods to a patient knee robot and achieved positive appraisals. The assessment measures have potential for use in comparing several patient simulators for training physical therapists, rather than as absolute indices for developing a standard.</p></abstract><funding-group><funding-statement>This work was supported by Naito Science & Engineering Foundation (no grant number), <ext-link ext-link-type="uri" xlink:href="http://www.naitozaidan.or.jp/">http://www.naitozaidan.or.jp/</ext-link>. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</funding-statement></funding-group><counts><fig-count count="4"></fig-count><table-count count="4"></table-count><page-count count="16"></page-count></counts><custom-meta-group><custom-meta id="data-availability"><meta-name>Data Availability</meta-name><meta-value>All relevant data are within the paper.</meta-value></custom-meta></custom-meta-group></article-meta><notes><title>Data Availability</title><p>All relevant data are within the paper.</p></notes></front><body><sec sec-type="intro" id="sec001"><title>Introduction</title><p>Manual examination is one of the essential techniques employed in physical therapy. A physical therapist manually tests the biomechanical and neural responses of the limbs of a patient to understand their pathology and the status of the disorder. In the application of this technique, the therapist examines the dynamic joint-resistances, ranges of joint motions, and complaints of pain by the patient when the impaired limb is passively moved. The therapist requires clinical experience to master the manual examination procedures because the joint resistance is highly dependent on the individual patient and specific disease. However, in educational facilities, trainee therapists hardly get the opportunity to deal with real patients. Even during internship, engaging trainees in the treatment of patients is considered ethically unacceptable.</p><p>To solve such problems in educational facilities, some research groups have recently conducted studies on patient robots that can be used to aid the training of physical therapists in manual examination techniques. For example, Masutani et al. [<xref rid="pone.0126392.ref001" ref-type="bibr">1</xref>] developed a leg robot that simulates the symptoms of joint contracture and limited joint motion. Kikuchi et al. [<xref rid="pone.0126392.ref002" ref-type="bibr">2</xref>, <xref rid="pone.0126392.ref003" ref-type="bibr">3</xref>] arranged two types of actuators on a leg robot to simulate both large and quick force outputs. Morita et al. [<xref rid="pone.0126392.ref004" ref-type="bibr">4</xref>] also developed a leg robot with a two-degree-of-freedom knee joint that rotates when it flexes or extends in imitation of the behavior of a human knee. Grow et al. [<xref rid="pone.0126392.ref005" ref-type="bibr">5</xref>] and Tkahashi et al. [<xref rid="pone.0126392.ref006" ref-type="bibr">6</xref>] developed elbow robots for similar educational purposes. Mouri et al. [<xref rid="pone.0126392.ref007" ref-type="bibr">7</xref>] imitated finger contracture using a robotic hand with 22 actuated joints. Human peculiarities were taken into consideration in the development of some of these robots, including complex human joint motions, which are intrinsically different from those of mechanical hinges and universal joints, and the skin and bone features of human limbs. This was because such realism is instrumental to the proper learning of manual examination techniques by trainees. However, the developers also considered striking an appropriate balance between the realism and economy of the patient robots. In the quest for a well-balanced patient simulator, Ishikawa et al. [<xref rid="pone.0126392.ref008" ref-type="bibr">8</xref>, <xref rid="pone.0126392.ref009" ref-type="bibr">9</xref>] and Okumura et al. [<xref rid="pone.0126392.ref010" ref-type="bibr">10</xref>] introduced the concept of wearable patient robots. In this case, healthy students wear exoskeleton robots on their legs or feet, and actuators installed on the robots produce resistance forces to mimic impaired joints. The trainees can thus have firsthand experience of the disorders while learning the manual examination techniques.</p><p>However, these previous works did not systematically validate the simulated symptoms, although there were assertions of corroboration by clinicians. For example, in [<xref rid="pone.0126392.ref003" ref-type="bibr">3</xref>], there was the question of whether the specific parameters used to characterize the simulated symptoms, such as the maximum joint torque, were within the range of those of actual patients. As a sanity check, some works either commented on the apparent behaviors of the simulated outputs [<xref rid="pone.0126392.ref004" ref-type="bibr">4</xref>] or rated the subjective realism [<xref rid="pone.0126392.ref007" ref-type="bibr">7</xref>]. In addition, these earlier studies did not employ the perception of clinicians in the statistical examination of how well the symptoms were simulated. However, Park et al. [<xref rid="pone.0126392.ref011" ref-type="bibr">11</xref>] and Kim et al. [<xref rid="pone.0126392.ref012" ref-type="bibr">12</xref>], in their thorough examination of the validity of their developed robotic elbow spasticity simulators, requested clinicians to rate both a real patient and the simulated elbow spasticity using a well-known clinical spasticity criterion. They then discussed how well the clinicians’ assessments of the real and simulated disorders matched.</p><p>Because effective evaluation methods are yet to be established at this early stage of the development of patient simulators used for physical therapy training, they have not been thoroughly validated. One possible evaluation method involves comparison of simulated joint resistances with those measured from real patients [<xref rid="pone.0126392.ref011" ref-type="bibr">11</xref>]. However, the data obtained from patients contain significant individuality, which makes the approach more suitable for the further training of experienced clinicians. Considering the nature of a typical lecture scene at an educational facility, a patient robot is required to reproduce or simulate typical symptoms rather than those unique to individual patients. Hence, Fujisawa et al. [<xref rid="pone.0126392.ref013" ref-type="bibr">13</xref>] considered the typical resistance of a spastic elbow in their study, wherein an experienced physical therapist mimicked the typical behaviors of a disabled elbow by using his own elbow, and the robotic patient simulator was then designed to reproduce those behaviors. Based on the notion that patient robots used for educational purposes simulate generalized symptoms that majority of clinicians consent to, we designed methods for evaluating patient robots used for physical therapy training. We statistically assessed the extent to which a robot demonstrated symptoms that were considered invariant and typical by clinicians, whereas most previous studies were concerned with the error of the torque outputs in the simulation of specific actual patients. Moreover these previous assessments were not based on the perceptions of practicing clinicians, and most of them also employed non-statistical analyses. To the best of our knowledge, only few studies have statistically assessed such patient robots from the perspective of generalized symptoms.</p><p>Our is thus the first article that would propose general measures for assessing patient robots used to train physical therapists in manual examination techniques. Two types of assessments that we propose are based on the judgment of clinicians, and were experimentally applied to our patient robot. The two assessment types complement each other by addressing distinct aspects of patient simulators, and their measures can be used as practical indices for comparing different patient simulators when they become commercially available in the near future. There are currently no such performance indices. All the experimental procedures of the present study were approved by the Ethics Committee, School of Engineering, Nagoya University, and each participant signed an informed consent document.</p><p><bold>Severity assessment of specific disease</bold> The first measure is the evaluation of how well the patient robot presents the severity of a specific disease, and is based on [<xref rid="pone.0126392.ref009" ref-type="bibr">9</xref>]. Experienced therapists were requested to judge the severity of the simulated symptoms using a clinical rating method, and we then examined the goodness of the simulated symptoms based on the variance or consistency of the judgments of the therapists. If the symptoms were well simulated, there would be fair agreement among the judgments. This approach is basically similar to that adopted by Park et al. [<xref rid="pone.0126392.ref011" ref-type="bibr">11</xref>], although they used an elbow robot that mimicked the joint resistances of three real patients, and not generalized symptoms.</p><p><bold>Disease classification ability</bold> The second measure is the evaluation of how well the patient robot presents the symptoms of different diseases. The therapists were requested to classify several simulated symptoms, and we examined the rates of successful classifications. The higher the average classification rates, the more accurately the simulator presented the typical features of different symptoms.</p></sec><sec id="sec002"><title>Wearable robotic knee joint as impairment simulator</title><p>As shown in <xref ref-type="fig" rid="pone.0126392.g001">Fig 1</xref>, we used a wearable robot [<xref rid="pone.0126392.ref008" ref-type="bibr">8</xref>, <xref rid="pone.0126392.ref009" ref-type="bibr">9</xref>] to simulate the resistance forces of the knee of a patient. In physical therapy educational facilities, trainees commonly study manual examination techniques in pairs. One trainee acts as a patient and the other practices the techniques. The wearable patient robot is particularly designed for such training situations. The trainee that plays the part of a patient wears the robot and relaxes to avoid generating voluntary forces. The other trainee manually tests the dummy patient leg for which the robot produces a resistance force to simulate joint impairments such as abnormal muscular tensions or neural disorders.</p><fig id="pone.0126392.g001" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.g001</object-id><label>Fig 1</label><caption><title>Training in manual examination techniques using a wearable knee joint.</title><p>Left: Healthy person wearing the robotic knee joint. Right: Trainee therapist</p></caption><graphic xlink:href="pone.0126392.g001"></graphic></fig><p>As shown in <xref ref-type="fig" rid="pone.0126392.g002">Fig 2</xref>, the wearable robot has a geared (1/86) DC motor (RE35, Maxon, stalling torque = 949 mN⋅m), encoder, two links, and four cuffs for attachment to the femoral and lower thighs of the wearer. The DC motor was activated by a current-control motor driver (4-Q-DC ADS 50/5, Maxon). The gear friction was fairly constant and compensated for during the motion. The total weight of the device was 1.16 kg. Although natural human knee motion involves minor stretch and rotation, which contrasts with that of the uniaxial robot, the compliance of the skin or clothes beneath the cuffs obscures the mechanical differences between the two.</p><fig id="pone.0126392.g002" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.g002</object-id><label>Fig 2</label><caption><title>Structure of wearable knee joint.</title></caption><graphic xlink:href="pone.0126392.g002"></graphic></fig><p>The advantages of a wearable patient simulator include the enablement of trainees to touch and feel an actual human limb, thereby affording the perception of the complex motion of the human joint and the features of the human skin and bone. This concept provides high realism at relatively low costs. However, it also has some limitations, which include the fact that the symptoms that can be simulated by the wearable simulator are physically limited by the body characteristics of the wearer. For example, a knee joint significantly deformed by osteoarthritis cannot be simulated by a healthy wearer. Furthermore, the mass and inertia moment of the wearable device cannot, in principle, be completely compensated for. In the case of the knee joint, if the hip joint of the wearer is fixed, his femoral thigh would receive the torques used to compensate for the mass and inertia of the robot. However, this is not always the case during a manual examination. In the present study, the mass and inertia moment were not canceled.</p></sec><sec id="sec003"><title>Severity assessment of simulated spasticity</title><p>In this assessment type, we evaluated how well the patient robot presented differing severities of a particular type of disease. We developed a resistance model of a spastic joint and simulated several degrees of severity using the patient simulator. Practicing physical therapists were requested to rate the severities based on the common symptoms of spasticity. We then examined the consistency of the ratings of the therapists and how well the spasticity was simulated.</p><sec id="sec004"><title>Spasticity and modified Ashworth scale</title><p>Spasticity is typically triggered by stroke or injury to the spinal cord, brain, or other central nervous system lesions [<xref rid="pone.0126392.ref014" ref-type="bibr">14</xref>]. It is a motor disorder with a velocity-dependent joint resistance that increases in the tonic stretch reflex, with exaggerated tendon jerks resulting from hyperexcitability of the stretch reflex [<xref rid="pone.0126392.ref015" ref-type="bibr">15</xref>, <xref rid="pone.0126392.ref016" ref-type="bibr">16</xref>]. Approximately 40% of stroke survivors develop symptomatic spasticity in their chronic phases [<xref rid="pone.0126392.ref017" ref-type="bibr">17</xref>, <xref rid="pone.0126392.ref018" ref-type="bibr">18</xref>].</p><p>The modified Ashworth scale (MAS) [<xref rid="pone.0126392.ref019" ref-type="bibr">19</xref>] is a well-known clinical criterion of spasticity. As presented in <xref ref-type="table" rid="pone.0126392.t001">Table 1</xref>, it can be used to classify the severity of spasticity into six levels based on the resistances that a physical therapist experiences when moving the joints of the patient. For example, at level 1, mild muscle tone is palpable with a sense of slight sticking during passive joint movement. Additionally, weak resistance manifests at the end of the range of motion. When the severity increases to level 2 or 3, increased muscle tones are observable through most of the range of motion. Finally, at level 4, the joint is completely rigid and cannot be moved.</p><table-wrap id="pone.0126392.t001" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.t001</object-id><label>Table 1</label><caption><title>Modified Ashworth scale as described in the source article [<xref rid="pone.0126392.ref019" ref-type="bibr">19</xref>].</title></caption><alternatives><graphic id="pone.0126392.t001g" xlink:href="pone.0126392.t001"></graphic><table frame="box" rules="all" border="0"><colgroup span="1"><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col></colgroup><thead><tr><th align="left" rowspan="1" colspan="1">Score</th><th align="left" rowspan="1" colspan="1">Modified Ashworth Scale</th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">No increase in muscle tone</td></tr><tr><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">Slight increase in muscle tone, manifested by a catch and release or by minimal resistance at the end of the range of motion when the affected part(s) is moved in flexion or extension</td></tr><tr><td align="left" rowspan="1" colspan="1">1+</td><td align="left" rowspan="1" colspan="1">Slight increase in muscle tone, manifested by a catch, followed by minimal resistance throughout the remainder (less than half) of the range of movement (ROM)</td></tr><tr><td align="left" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1">More marked increase in muscle tone through most of the ROM, but affected part(s) easily moved</td></tr><tr><td align="left" rowspan="1" colspan="1">3</td><td align="left" rowspan="1" colspan="1">Considerable increase in muscle tone, passive movement difficult</td></tr><tr><td align="left" rowspan="1" colspan="1">4</td><td align="left" rowspan="1" colspan="1">Affected part(s) rigid in flexion or extension</td></tr></tbody></table></alternatives></table-wrap></sec><sec id="sec005"><title>Simulated spasticity</title><p>Velocity-dependent tonic resistance is often considered as a characteristic feature of spastic joints. However, as indicated in <xref ref-type="table" rid="pone.0126392.t001">Table 1</xref>, muscle and tendon rigidity [<xref rid="pone.0126392.ref020" ref-type="bibr">20</xref>] and limitation of the range of motion are also practical criteria for evaluating the extent of the symptoms. Our dummy joint collectively simulated these criteria symptoms.</p><p>The phasic stretch reflex torque [<xref rid="pone.0126392.ref015" ref-type="bibr">15</xref>, <xref rid="pone.0126392.ref016" ref-type="bibr">16</xref>] is commonly expressed in terms of the viscosity resistances with respect to the joint angular velocity [<xref rid="pone.0126392.ref002" ref-type="bibr">2</xref>, <xref rid="pone.0126392.ref005" ref-type="bibr">5</xref>, <xref rid="pone.0126392.ref011" ref-type="bibr">11</xref>, <xref rid="pone.0126392.ref020" ref-type="bibr">20</xref>]. The resistance torque is considered to be negligible up to a particular angular velocity, <italic>ω</italic><sub>0</sub>, which corresponds to the dynamic stretch reflex threshold, namely the velocity-dependent joint angle at which stretch reflex manifests (e.g., [<xref rid="pone.0126392.ref021" ref-type="bibr">21</xref>]). The threshold was originally defined as a line on a phase-plane of the joint angle and angular velocity. The reflective resistance thereafter increases proportionally to the angular velocity. If the joint angle is denoted by <italic>θ</italic>(<italic>t</italic>) and the coefficient of viscosity by <italic>c</italic>, the velocity-dependent resistance torque <italic>τ</italic><sub><italic>c</italic></sub>(<italic>t</italic>) can be expressed as
<disp-formula id="pone.0126392.e001"><alternatives><graphic xlink:href="pone.0126392.e001.jpg" id="pone.0126392.e001g" mimetype="image" position="anchor" orientation="portrait"></graphic><mml:math id="M1"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd columnalign="right"><mml:mrow><mml:msub><mml:mi>τ</mml:mi><mml:mi>c</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo>{</mml:mo><mml:mtable><mml:mtr><mml:mtd columnalign="left"><mml:mrow><mml:mi>c</mml:mi><mml:mo>(</mml:mo><mml:mover accent="true"><mml:mi>θ</mml:mi><mml:mo>˙</mml:mo></mml:mover><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>-</mml:mo><mml:msub><mml:mi>ω</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mover accent="true"><mml:mi>θ</mml:mi><mml:mo>˙</mml:mo></mml:mover><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>></mml:mo><mml:msub><mml:mi>ω</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd columnalign="left"><mml:mn>0</mml:mn></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mover accent="true"><mml:mi>θ</mml:mi><mml:mo>˙</mml:mo></mml:mover><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>≤</mml:mo><mml:msub><mml:mi>ω</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo>)</mml:mo><mml:mo>.</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable><mml:mo></mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></alternatives><label>(1)</label></disp-formula>The resistance acts in only one direction because, typically, either the flexors or the extensors are affected by such diseases. The equation gives the resistance in only the flexion phase when <italic>θ</italic> = 0 at full extension.</p><p>According to the MAS, a limit in the range of motion manifests from level 1. At level 1+, there is resistance to over nearly half of the range of motion. When the range of motion of the knee joint is 0 < <italic>θ</italic>(<italic>t</italic>) < <italic>θ</italic><sub>max</sub>, the resistance torque at the end of the motion, <italic>τ</italic><sub><italic>e</italic></sub>(<italic>t</italic>), is given by
<disp-formula id="pone.0126392.e002"><alternatives><graphic xlink:href="pone.0126392.e002.jpg" id="pone.0126392.e002g" mimetype="image" position="anchor" orientation="portrait"></graphic><mml:math id="M2"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd columnalign="right"><mml:mrow><mml:msub><mml:mi>τ</mml:mi><mml:mi>e</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo>{</mml:mo><mml:mtable><mml:mtr><mml:mtd columnalign="left"><mml:mn>0</mml:mn></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mn>0</mml:mn><mml:mo>≤</mml:mo><mml:mi>θ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo><</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi>max</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi mathvariant="normal">e</mml:mi></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd columnalign="left"><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mi mathvariant="normal">e</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>θ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>-</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi>max</mml:mi></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi mathvariant="normal">e</mml:mi></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi>max</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi mathvariant="normal">e</mml:mi></mml:msub><mml:mo>≤</mml:mo><mml:mi>θ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>≤</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi>max</mml:mi></mml:msub><mml:mo>)</mml:mo><mml:mo>,</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable><mml:mo></mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></alternatives><label>(2)</label></disp-formula>where <italic>k</italic><sub><italic>e</italic></sub> and <italic>θ</italic><sub>e</sub> denote the modulus of elasticity and the angle at which limitation of the joint motion begins, respectively. These parameters increase with the severity of the spasticity. We also introduced the constant resistance <italic>τ</italic><sub>r</sub>, which acts throughout the entire motion range. Consequently, the total resistance is
<disp-formula id="pone.0126392.e003"><alternatives><graphic xlink:href="pone.0126392.e003.jpg" id="pone.0126392.e003g" mimetype="image" position="anchor" orientation="portrait"></graphic><mml:math id="M3"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd columnalign="right"><mml:mrow><mml:mi>τ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mi>τ</mml:mi><mml:mi mathvariant="normal">r</mml:mi></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi>τ</mml:mi><mml:mi mathvariant="normal">c</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:msub><mml:mi>τ</mml:mi><mml:mi mathvariant="normal">e</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></alternatives><label>(3)</label></disp-formula>The five parameters <italic>τ</italic><sub>r</sub>, <italic>ω</italic><sub>0</sub>, <italic>c</italic>, <italic>θ</italic><sub>e</sub>, and <italic>k</italic><sub>e</sub> were varied to reflect the severity of the spasticity.</p></sec><sec id="sec006"><title>Severity rating of simulated spasticity</title><sec id="sec007"><title>Tasks and participants</title><p>A healthy person wore the wearable robot on his right leg and lay down on a clinical bed. The assessor freely tested the supposed knee impairment by moving the leg of the wearer and rated the severity of the simulated spasticity based on the six MAS levels. Each trial was limited to within 1 min. After all the tasks, we asked the assessor about the subjective criteria that they particularly considered in rating the simulated symptoms.</p><p>Eight practicing physical therapists, each with more than three years of clinical experience, participated in the experiment after a few minutes of practice without the simulated symptoms. None of them had previously experienced simulated spasticity.</p></sec><sec id="sec008"><title>Parameter sets of simulated spasticity</title><p>We varied five parameters in presenting different spastic resistances as enumerated in <xref ref-type="table" rid="pone.0126392.t002">Table 2</xref>. Ten spasticity grades were prepared, namely, <italic>S</italic><sub>0</sub>–<italic>S</italic><sub>9</sub>, with <italic>S</italic><sub>0</sub> being the least severe (healthy state). For <italic>S</italic><sub>9</sub>, <italic>τ</italic><sub>r</sub>, <italic>ω</italic><sub>0</sub>, <italic>c</italic>, <italic>θ</italic><sub>e</sub>, and <italic>k</italic><sub>e</sub> were set to 3.0 N ⋅ m, 0 rad/s, 9/<italic>π</italic> Nm ⋅ s/rad, 16<italic>π</italic>/45 rad, and 54/5<italic>π</italic> N ⋅ m/rad, respectively. These parameters were specified with the assistance of two physical therapists, K. I. and N. Y., who are coauthors of this article, such that the majority of physical therapists would likely regard <italic>S</italic><sub>9</sub> as 3 on the MAS. We excluded the severest MAS level at which the joint is almost unmovable because the DC motor on the wearable robot could not generate sufficient torques to fully resist the manual forces applied by the assessors. The parameters for <italic>S</italic><sub>0</sub> were set such that no resistance was generated. Regarding the other eight simulated spasticity conditions, each of the parameters was linearly varied between the maximum and minimum values in <xref ref-type="table" rid="pone.0126392.t002">Table 2</xref>. The simulated spasticity conditions were presented in random order, and two different orders were used for each participant.</p><table-wrap id="pone.0126392.t002" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.t002</object-id><label>Table 2</label><caption><title>Parameter sets of simulated spasticity.</title></caption><alternatives><graphic id="pone.0126392.t002g" xlink:href="pone.0126392.t002"></graphic><table frame="box" rules="all" border="0"><colgroup span="1"><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col></colgroup><thead><tr><th align="left" rowspan="1" colspan="1"></th><th colspan="10" align="center" rowspan="1">Simulated spasticity</th></tr><tr><th align="left" rowspan="1" colspan="1"></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>0</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>1</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>2</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>3</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>4</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>5</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>6</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>7</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>8</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>9</sub></th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1"><italic>τ</italic><sub>r</sub> [N⋅m]</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.3</td><td align="left" rowspan="1" colspan="1">0.7</td><td align="left" rowspan="1" colspan="1">1.0</td><td align="left" rowspan="1" colspan="1">1.3</td><td align="left" rowspan="1" colspan="1">1.7</td><td align="left" rowspan="1" colspan="1">2.0</td><td align="left" rowspan="1" colspan="1">2.3</td><td align="left" rowspan="1" colspan="1">2.7</td><td align="left" rowspan="1" colspan="1">3.0</td></tr><tr><td align="left" rowspan="1" colspan="1"><italic>ω</italic><sub>0</sub> [rad/s]</td><td align="left" rowspan="1" colspan="1"><italic>π</italic>/2</td><td align="left" rowspan="1" colspan="1">4<italic>π</italic>/9</td><td align="left" rowspan="1" colspan="1">7<italic>π</italic>/18</td><td align="left" rowspan="1" colspan="1"><italic>π</italic>/3</td><td align="left" rowspan="1" colspan="1">5<italic>π</italic>/18</td><td align="left" rowspan="1" colspan="1">2<italic>π</italic>/9</td><td align="left" rowspan="1" colspan="1"><italic>π</italic>/6</td><td align="left" rowspan="1" colspan="1"><italic>π</italic>/9</td><td align="left" rowspan="1" colspan="1"><italic>π</italic>/18</td><td align="left" rowspan="1" colspan="1">0</td></tr><tr><td align="left" rowspan="1" colspan="1"><italic>c</italic> [Nm⋅s/rad]</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">1/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">2/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">3/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">4/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">5/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">6/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">7/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">8/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">9/<italic>π</italic></td></tr><tr><td align="left" rowspan="1" colspan="1"><italic>θ</italic><sub><italic>e</italic></sub> [rad]</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">16<italic>π</italic>/405</td><td align="left" rowspan="1" colspan="1">32<italic>π</italic>/405</td><td align="left" rowspan="1" colspan="1">16<italic>π</italic>/135</td><td align="left" rowspan="1" colspan="1">64<italic>π</italic>/405</td><td align="left" rowspan="1" colspan="1">16<italic>π</italic>/81</td><td align="left" rowspan="1" colspan="1">32<italic>π</italic>/135</td><td align="left" rowspan="1" colspan="1">112<italic>π</italic>/405</td><td align="left" rowspan="1" colspan="1">128<italic>π</italic>/405</td><td align="left" rowspan="1" colspan="1">16<italic>π</italic>/45</td></tr><tr><td align="left" rowspan="1" colspan="1"><italic>k</italic><sub>e</sub> [N⋅m/rad]</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">6/5<italic>π</italic></td><td align="left" rowspan="1" colspan="1">12/5<italic>π</italic></td><td align="left" rowspan="1" colspan="1">18/5<italic>π</italic></td><td align="left" rowspan="1" colspan="1">24/5<italic>π</italic></td><td align="left" rowspan="1" colspan="1">6/<italic>π</italic></td><td align="left" rowspan="1" colspan="1">36/5<italic>π</italic></td><td align="left" rowspan="1" colspan="1">42/5<italic>π</italic></td><td align="left" rowspan="1" colspan="1">48/5<italic>π</italic></td><td align="left" rowspan="1" colspan="1">54/5<italic>π</italic></td></tr></tbody></table></alternatives></table-wrap><p><xref ref-type="fig" rid="pone.0126392.g003">Fig 3</xref> shows examples of the behaviors of the simulated spasticity conditions. The figures show the angular velocities and resistance torques that were converted from the outputs of a force sensor that was fixed to the lower thigh link of the robot. The sample values were recorded without a wearer. As the spasticity level rose from <italic>S</italic><sub>0</sub> to <italic>S</italic><sub>8</sub>, the resistance torque clearly increased. For <italic>S</italic><sub>0</sub>, there was hardly any resistance torque apart from the static friction of the gear. For <italic>S</italic><sub>2</sub> and <italic>S</italic><sub>4</sub>, the velocity-dependent resistances were noticeable, and their profiles were similar to those of the angular velocities. The values of the constant resistance <italic>τ</italic><sub>r</sub> for <italic>S</italic><sub>6</sub> and <italic>S</italic><sub>8</sub> were significant. The measured torques fairly matched the set torques, with the maximum error being less than 1 N⋅m.</p><fig id="pone.0126392.g003" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.g003</object-id><label>Fig 3</label><caption><title>Sample resistance torques and knee angular velocities of simulated spasticity.</title><p><italic>S</italic><sub>0</sub>: Simulated healthy knee without apparent resistance. <italic>S</italic><sub>2</sub> and <italic>S</italic><sub>4</sub>: Knees with resistances for which the velocity-dependent components were obvious. <italic>S</italic><sub>6</sub> and <italic>S</italic><sub>8</sub>: Knees with resistances sufficiently large to impede angular velocity. The black and gray curves respectively represent the observed and set torques, and <italic>e</italic><sub>r</sub> is the maximum and mean errors between the two.</p></caption><graphic xlink:href="pone.0126392.g003"></graphic></fig></sec></sec><sec id="sec009"><title>Results of severity rating</title><p>The ratios of the answers given by the therapists for each simulated spasticity condition are given in <xref ref-type="table" rid="pone.0126392.t003">Table 3</xref>. No therapist indicated MAS level 4, which we intentionally excluded from the simulation as described earlier. There was a tendency to regard <italic>S</italic><sub>0</sub> and <italic>S</italic><sub>1</sub> as level 0, and approximately 30% of the answers indicated that the simulated spasticity conditions were of level 1. Contrary to our expectation, level 1 was several times assigned to <italic>S</italic><sub>0</sub>, which was supposed to represent the case of no resistance. Based on the introspective reports obtained after the experiment, the participants considered the mass of the wearable robot to be non-negligible, and this additional mass constituted a kind of disturbance to the participants when judging the severity of the simulated symptoms. There was clear consensus on <italic>S</italic><sub>7</sub>, <italic>S</italic><sub>8</sub>, and <italic>S</italic><sub>9</sub> being level 2 conditions. In addition, the majority of the answers suggested that <italic>S</italic><sub>3</sub> and <italic>S</italic><sub>5</sub> corresponded to level 1+, whereas the answers for <italic>S</italic><sub>2</sub>, <italic>S</italic><sub>4</sub>, and <italic>S</italic><sub>6</sub> were distributed over a few levels. Overall, the results exhibited a clear trend of the MAS level increasing with increasing simulated resistance (Spearman’s rank correlation <italic>ρ</italic> = 0.71, and <italic>p</italic> = 2.2E-16).</p><table-wrap id="pone.0126392.t003" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.t003</object-id><label>Table 3</label><caption><title>Response ratios for each simulated spasticity.</title></caption><alternatives><graphic id="pone.0126392.t003g" xlink:href="pone.0126392.t003"></graphic><table frame="box" rules="all" border="0"><colgroup span="1"><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col></colgroup><thead><tr><th align="left" rowspan="1" colspan="1"></th><th colspan="10" align="center" rowspan="1">Simulated spasticity</th></tr><tr><th align="left" rowspan="1" colspan="1">MAS</th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>0</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>1</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>2</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>3</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>4</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>5</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>6</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>7</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>8</sub></th><th align="left" rowspan="1" colspan="1"><italic>S</italic><sub>9</sub></th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">4</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td></tr><tr><td align="left" rowspan="1" colspan="1">3</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">12.5</td><td align="left" rowspan="1" colspan="1">25.0</td></tr><tr><td align="left" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">18.8</td><td align="left" rowspan="1" colspan="1">37.5</td><td align="left" rowspan="1" colspan="1">12.5</td><td align="left" rowspan="1" colspan="1">31.3</td><td align="left" rowspan="1" colspan="1">62.5</td><td align="left" rowspan="1" colspan="1">81.3</td><td align="left" rowspan="1" colspan="1">75.0</td></tr><tr><td align="left" rowspan="1" colspan="1">1+</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">31.3</td><td align="left" rowspan="1" colspan="1">50.0</td><td align="left" rowspan="1" colspan="1">31.3</td><td align="left" rowspan="1" colspan="1">56.3</td><td align="left" rowspan="1" colspan="1">37.5</td><td align="left" rowspan="1" colspan="1">18.8</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">0</td></tr><tr><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">31.3</td><td align="left" rowspan="1" colspan="1">31.3</td><td align="left" rowspan="1" colspan="1">25.0</td><td align="left" rowspan="1" colspan="1">25.0</td><td align="left" rowspan="1" colspan="1">18.8</td><td align="left" rowspan="1" colspan="1">25.0</td><td align="left" rowspan="1" colspan="1">25.0</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td></tr><tr><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">56.3</td><td align="left" rowspan="1" colspan="1">56.3</td><td align="left" rowspan="1" colspan="1">37.5</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">12.4</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">6.2</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td></tr></tbody></table></alternatives></table-wrap><p>The criterion that was most frequently cited in the introspective reports by the participants as being most significant was the velocity-dependent resistance (seven out of the eight participants), followed by the limited range of motion (five participants), and then the static resistance or perceived heaviness over the entire movement range (four participants). Three participants noted the importance of the overall resistance that they felt. None of them mentioned the threshold angular velocity at which the velocity-dependent resistance began.</p></sec><sec id="sec010"><title>Discussion: Consistency of answers of therapists</title><p>Here, we discuss the quality of the simulated spasticity based on the observed consistency in the answers of the participants. It should be noted that the goodness of a simulated symptom cannot be solely judged based on answer consistency because, under clinical settings, the MAS scores of assessors are not always in good agreement [<xref rid="pone.0126392.ref022" ref-type="bibr">22</xref>, <xref rid="pone.0126392.ref023" ref-type="bibr">23</xref>]. Nonetheless, if the consistency for the simulator is as high as that expected under clinical conditions, the simulator would be validated. A significantly low consistency in the answers given by the participants regarding the simulated symptoms would indicate that the simulator is flawed.</p><p>Fleuren et al. [<xref rid="pone.0126392.ref022" ref-type="bibr">22</xref>] reported an interclass correlation coefficient of 0.63 for the MAS scores of three assessors regarding knee patients, whereas the value for our experiment was 0.70. Mutlu et al. [<xref rid="pone.0126392.ref024" ref-type="bibr">24</xref>] also reported values of 0.61–0.87 for several muscles of diplegic children, within which range our value falls.</p><p>Park et al. [<xref rid="pone.0126392.ref011" ref-type="bibr">11</xref>] reported that the MAS scores of their simulated elbow spasticity obtained from eight clinicians had a Fleiss’ kappa of 0.626. The values under clinical settings vary substantially between 0.16 and 0.87 [<xref rid="pone.0126392.ref025" ref-type="bibr">25</xref>–<xref rid="pone.0126392.ref027" ref-type="bibr">27</xref>] depending on the experience of the assessors, the training sessions before the experiment, and the types of patients. The Fleiss’ kappa of our results was 0.42, which is comparable to those reported in literature.</p><p>Bohannon et al. [<xref rid="pone.0126392.ref019" ref-type="bibr">19</xref>] also reported consistency in the MAS scores given by two physicians, represented by a Kendall’s rank correlation coefficient of 0.85. Unfortunately, this coefficient only defined the consistency in the scores given by only two assessors, and can thus not be directly compared with our results. To enable comparison, we computed the Kendall’s rank correlation coefficient for twenty-eight pairs of assessors obtained from the eight assessors that participated in our study. The mean coefficient and standard deviation were respectively 0.66 and ±0.17, which are smaller than the values reported by Bohannon et al.</p><p>As noted above, the consistency indices of the MAS ratings of the multiple assessors of our simulated spasticity are fairly within, or not significantly below, the range of those observed from previous studies, and this validates the effectiveness of our patient simulator. However, the limitations of such consistency comparisons are as described above.</p></sec></sec><sec id="sec011"><title>Classification of several simulated symptoms</title><p>The second type of assessment concerns the ability of a patient simulator to present the characteristic resistances of various symptoms. To investigate this ability, we conducted a classification task in which nine physical therapists were requested to categorize five different symptoms presented by our patient simulator. We then examined the goodness of the simulator in terms of the presentation of different types of symptoms.</p><sec id="sec012"><title>Five types of simulated symptoms</title><p>The five types of simulated symptoms are presented below. The symptoms are some of those that physical therapists frequently encounter clinically. The parameters for defining the symptoms were selected based on the consensus of two experienced physical therapists (coauthors of this article), such that each symptom was slightly more obvious than the one that had just been identified.</p><p><bold>Lead-pipe rigidity</bold> Lead-pipe rigidity is characterized by constant stiffness of the joint during passive motion, and is often due to disorders of the basal ganglia such as Parkinson’s disease [<xref rid="pone.0126392.ref028" ref-type="bibr">28</xref>, <xref rid="pone.0126392.ref029" ref-type="bibr">29</xref>]. By definition, we presented its resistance as a constant torque irrespective to the direction of motion. The resistance was set to 0.5 N ⋅ m. <xref ref-type="fig" rid="pone.0126392.g004">Fig 4</xref> shows a sample of the simulated lead-pipe rigidity. As in the previous section, the data were obtained using only the wearable robot without a wearer. The dynamism of the resistance torque was minuscule, and a nearly constant torque was observed during the passive joint motion.</p><fig id="pone.0126392.g004" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.g004</object-id><label>Fig 4</label><caption><title>Sample resistance torques and knee angular velocities of the five types of simulated symptoms.</title><p>The black and gray curves respectively represent the measured and set torques. <italic>e</italic><sub>r</sub> indicates the maximum and mean errors between the two values. Overall, the measured torques are in adequate agreement with the set values.</p></caption><graphic xlink:href="pone.0126392.g004"></graphic></fig><p><bold>Cogwheel rigidity</bold> Cogwheel rigidity resembles lead-pipe rigidity but is distinguished by its intermittent resistance. It is also one of the typical symptoms of Parkinson’s disease [<xref rid="pone.0126392.ref028" ref-type="bibr">28</xref>, <xref rid="pone.0126392.ref029" ref-type="bibr">29</xref>]. Because there are few available guides or literature on the simulation of this symptom, we modeled it by repetitive on-and-off resistances based on perceived realism. The torque was controlled as
<disp-formula id="pone.0126392.e004"><alternatives><graphic xlink:href="pone.0126392.e004.jpg" id="pone.0126392.e004g" mimetype="image" position="anchor" orientation="portrait"></graphic><mml:math id="M4"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd columnalign="right"><mml:mrow><mml:msub><mml:mi>τ</mml:mi><mml:mi>cog</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo>{</mml:mo><mml:mtable><mml:mtr><mml:mtd columnalign="left"><mml:msub><mml:mi>c</mml:mi><mml:mi>on</mml:mi></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd columnalign="left"><mml:msub><mml:mi>c</mml:mi><mml:mi>off</mml:mi></mml:msub></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mfrac><mml:mi>π</mml:mi><mml:mn>9</mml:mn></mml:mfrac><mml:mo><</mml:mo><mml:mi>θ</mml:mi><mml:mo><</mml:mo><mml:mfrac><mml:mrow><mml:mn>5</mml:mn><mml:mi>π</mml:mi></mml:mrow><mml:mn>36</mml:mn></mml:mfrac><mml:mo>,</mml:mo><mml:mfrac><mml:mi>π</mml:mi><mml:mn>6</mml:mn></mml:mfrac><mml:mo><</mml:mo><mml:mi>θ</mml:mi><mml:mo><</mml:mo><mml:mfrac><mml:mrow><mml:mn>7</mml:mn><mml:mi>π</mml:mi></mml:mrow><mml:mn>36</mml:mn></mml:mfrac><mml:mo>,</mml:mo><mml:mfrac><mml:mrow><mml:mn>2</mml:mn><mml:mi>π</mml:mi></mml:mrow><mml:mn>9</mml:mn></mml:mfrac><mml:mo><</mml:mo><mml:mi>θ</mml:mi><mml:mo><</mml:mo><mml:mfrac><mml:mi>π</mml:mi><mml:mn>4</mml:mn></mml:mfrac><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable><mml:mo></mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></alternatives><label>(4)</label></disp-formula>where <italic>c</italic><sub>on</sub> and <italic>c</italic><sub>off</sub> are constant torques of 1.0 and 0.5 N ⋅ m, respectively. <xref ref-type="fig" rid="pone.0126392.g004">Fig 4</xref> shows a sample of the simulated cogwheel rigidity. Because of the limited dynamics of the DC motor, the torque of the jerk output did not precisely follow the instruction; intermittent resistances were apparent in the three jerks of the recorded torques and angular velocity.</p><p><bold>Spasticity (velocity-dependent resistance)</bold> Velocity-dependent resistance or tonic stretch reflex is a feature of a spastic joint. This transient resistance can be represented by viscous resistance, as described in the previous section. Here, the resistance torque was more simply defined by
<disp-formula id="pone.0126392.e005"><alternatives><graphic xlink:href="pone.0126392.e005.jpg" id="pone.0126392.e005g" mimetype="image" position="anchor" orientation="portrait"></graphic><mml:math id="M5"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd columnalign="right"><mml:mrow><mml:msub><mml:mi>τ</mml:mi><mml:mi mathvariant="normal">s</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo>{</mml:mo><mml:mtable><mml:mtr><mml:mtd columnalign="left"><mml:mrow><mml:msub><mml:mi>c</mml:mi><mml:mi mathvariant="normal">s</mml:mi></mml:msub><mml:mover accent="true"><mml:mi>θ</mml:mi><mml:mo>˙</mml:mo></mml:mover><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mover accent="true"><mml:mi>θ</mml:mi><mml:mo>˙</mml:mo></mml:mover><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>≥</mml:mo><mml:mn>0</mml:mn><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd columnalign="left"><mml:mn>0</mml:mn></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mi>otherwise</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable><mml:mo></mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></alternatives><label>(5)</label></disp-formula>where <italic>c</italic><sub>s</sub> is the determinant of the gain relative to the angular velocity, and has a value of 1.5 Nm ⋅ s/rad. <xref ref-type="fig" rid="pone.0126392.g004">Fig 4</xref> shows a sample simulated velocity-dependent resistance. Although the profile of the torque did not completely match that of the angular velocity, primarily because of the inertia of the lower thigh of the wearable robot, its proportionality to the angular velocity was apparent.</p><p><bold>Limitation of motion range (contracture)</bold> Contracture is a limitation of joint motion range caused by a chronic shortening of soft tissues such as muscles and tendons. Abnormal elastic resistances occur at the end of the movable range. This so-called end-feel has been the focus of clinicians and is an important criterion for manual therapy and examination. We simulated the phenomenon by applying a spring resistance to the joint angle. The resistance torque was described by
<disp-formula id="pone.0126392.e006"><alternatives><graphic xlink:href="pone.0126392.e006.jpg" id="pone.0126392.e006g" mimetype="image" position="anchor" orientation="portrait"></graphic><mml:math id="M6"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd columnalign="right"><mml:mrow><mml:msub><mml:mi>τ</mml:mi><mml:mi>con</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo>{</mml:mo><mml:mtable><mml:mtr><mml:mtd columnalign="left"><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mi>con</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>θ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>-</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi>con</mml:mi></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mi>θ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>></mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi>con</mml:mi></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd columnalign="left"><mml:mn>0</mml:mn></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mi>otherwise</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable><mml:mo></mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></alternatives><label>(6)</label></disp-formula>where <italic>k</italic><sub>con</sub> and <italic>θ</italic><sub>con</sub> are respectively the elastic coefficient and joint angle at which the limitation of motion manifests; <italic>k</italic><sub>con</sub> = 5.7 N ⋅ m/rad and <italic>θ</italic><sub>con</sub> = <italic>π</italic>/18 rad. <xref ref-type="fig" rid="pone.0126392.g004">Fig 4</xref> shows a sample of simulated contracture. The robotic limb simply acted as a spring resistance.</p><p><bold>Limitation of motion range (bony ankylosis)</bold> Another type of limitation of joint motion is caused by the deformation of joint bones or cartilages. The end-feel resistance caused by this symptom feels like a contact with nonsoft tissue or a bony contact, which is distinct from that of the previous disorder. A resistance of this nature can be simply presented by a hard virtual stick using
<disp-formula id="pone.0126392.e007"><alternatives><graphic xlink:href="pone.0126392.e007.jpg" id="pone.0126392.e007g" mimetype="image" position="anchor" orientation="portrait"></graphic><mml:math id="M7"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd columnalign="right"><mml:mrow><mml:msub><mml:mi>τ</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo>{</mml:mo><mml:mtable><mml:mtr><mml:mtd columnalign="left"><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>θ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>-</mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mi>θ</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>></mml:mo><mml:msub><mml:mi>θ</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd columnalign="left"><mml:mn>0</mml:mn></mml:mtd><mml:mtd columnalign="left"><mml:mrow><mml:mo>(</mml:mo><mml:mi>otherwise</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable><mml:mo></mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></alternatives><label>(7)</label></disp-formula>where <italic>k</italic><sub>a</sub> is the high spring coefficient for presenting the sense of hard contact and <italic>θ</italic><sub>a</sub> is the joint angle at which the sticking resistance manifests; <italic>k</italic><sub>a</sub> = 28.5 N ⋅ m/rad and <italic>θ</italic><sub>a</sub> = 2<italic>π</italic>/3 rad. <xref ref-type="fig" rid="pone.0126392.g004">Fig 4</xref> shows a sample limited motion range caused by bony ankylosis. The resistance torque of the simulated bony contact was impulsive and exhibited vibratory behavior after the impact. The maximum error between the set and observed torques was large, and this was clearly because of the phase difference between the torques, although their profiles were similar.</p></sec><sec id="sec013"><title>Experiment: Tasks and participants</title><p>As in the previous experiment, a healthy person wore the wearable robot on his leg and lay on a bed in a relaxed state. The assessors were given the names of the symptoms that they would experience, and were then allowed to freely experience the five simulated symptoms for a few minutes but, without knowledge of the correspondences between the names of the symptoms and the simulated resistances. They were then presented with the five simulated symptoms sequentially, and were required to classify them in a forced-choice manner. A total of twenty-five presentations were made to each assessor in random order, with each symptom appearing five times. Nine assessors who were physical therapists, each with at least five years of clinical experience, participated in the experiment. The assessors were different from those that participated in the previous experiment and had no previous experience with similar patient simulators.</p></sec><sec id="sec014"><title>Results of classification</title><p>The answer ratios of the experiment are given in <xref ref-type="table" rid="pone.0126392.t004">Table 4</xref>. Each cell indicates the ratio for each combination of presented and answered symptoms.</p><table-wrap id="pone.0126392.t004" orientation="portrait" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0126392.t004</object-id><label>Table 4</label><caption><title>Results of the classification of the five types of simulated symptoms (mean ± standard deviation of the answer ratios of the nine assessors).</title></caption><alternatives><graphic id="pone.0126392.t004g" xlink:href="pone.0126392.t004"></graphic><table frame="box" rules="all" border="0"><colgroup span="1"><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col><col align="left" valign="top" span="1"></col></colgroup><thead><tr><th colspan="2" align="center" rowspan="1"></th><th colspan="5" align="center" rowspan="1">Presented symptom</th></tr><tr><th colspan="2" align="center" rowspan="1"></th><th align="left" rowspan="1" colspan="1">Lead-pipe rigidity</th><th align="left" rowspan="1" colspan="1">Spasticity</th><th align="left" rowspan="1" colspan="1">Contracture</th><th align="left" rowspan="1" colspan="1">Ankylosis</th><th align="left" rowspan="1" colspan="1">Cogwheel rigidity</th></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1"></td><td align="left" rowspan="1" colspan="1">Lead-pipe rigidity</td><td align="left" rowspan="1" colspan="1">0.73 ± 0.33</td><td align="left" rowspan="1" colspan="1">0.31 ± 0.23</td><td align="left" rowspan="1" colspan="1">0.04 ± 0.09</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.36 ± 0.28</td></tr><tr><td align="left" rowspan="1" colspan="1"></td><td align="left" rowspan="1" colspan="1">Spasticity</td><td align="left" rowspan="1" colspan="1">0.11 ± 0.18</td><td align="left" rowspan="1" colspan="1">0.24 ± 0.24</td><td align="left" rowspan="1" colspan="1">0.40 ± 0.36</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.04 ± 0.09</td></tr><tr><td align="left" rowspan="1" colspan="1">Answered</td><td align="left" rowspan="1" colspan="1">Contracture</td><td align="left" rowspan="1" colspan="1">0.13 ± 0.20</td><td align="left" rowspan="1" colspan="1">0.33 ± 0.30</td><td align="left" rowspan="1" colspan="1">0.24 ± 0.19</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.04 ± 0.09</td></tr><tr><td align="left" rowspan="1" colspan="1">symptom</td><td align="left" rowspan="1" colspan="1">Ankylosis</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.07 ± 0.14</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">0</td></tr><tr><td align="left" rowspan="1" colspan="1"></td><td align="left" rowspan="1" colspan="1">Cog-wheel rigidity</td><td align="left" rowspan="1" colspan="1">0.02 ± 0.07</td><td align="left" rowspan="1" colspan="1">0.11 ± 0.27</td><td align="left" rowspan="1" colspan="1">0.24 ± 0.26</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.56 ± 0.30</td></tr></tbody></table></alternatives></table-wrap><p>The overall positive (correct) answer ratio was expected to be higher than could have been obtained by chance (0.2). The mean ratio (± standard deviation) for the nine assessors was 0.56 ± 0.097, which was higher than chance (<italic>t</italic>(8) = 11.0, <italic>p</italic> = 4.2E − 6, unpaired <italic>t</italic>-test). However, a consideration of the individual symptoms reveals that a few of them were not clearly classified. The answer ratios for spasticity (<italic>t</italic>(8) = 0.55, <italic>p</italic> = 0.59, unpaired <italic>t</italic>-test) and contracture (<italic>t</italic>(8) = 0.69, <italic>p</italic> = 0.51, unpaired <italic>t</italic>-test) were not significantly higher than chance, whereas those for lead-pipe rigidity (<italic>t</italic>(8) = 4.82, <italic>p</italic> = 1.3E − 3, unpaired <italic>t</italic>-test), cogwheel rigidity (<italic>t</italic>(8) = 3.60, <italic>p</italic> = 7.0E − 3, unpaired <italic>t</italic>-test), and ankylosis were above chance.</p><p>Spasticity and contracture were often confused with each other, which may be partly because spasticity or velocity-dependent resistance of actual patients is often developed together with other types of joint resistances. Although some assessors explicitly cited constant resistance and hyperexcited jerk reflective resistance (the jack-knife phenomenon) as references for lead-pipe rigidity and spasticity, respectively, the parameters that determined the perceptibility of these symptoms were set to moderate values. Classification of these symptoms was thus hindered. In addition, the sticking sensations in cogwheel rigidity were small, which impeded distinction between the two types of rigidities.</p><p>In summary, there was consensus among the experienced therapists regarding typical lead-pipe rigidity, bony ankylosis, and cogwheel rigidity. In contrast, the simulations of spasticity and contracture require improvement to enable distinction between the two. Although the parameters of the symptoms were maintained at moderate values in the experiment, increasing them would facilitate classification by assessors.</p></sec><sec id="sec015"><title>Discussion: Limitation of classification task</title><p>Spasticity and contracture were frequently confused in the experiment. Clinicians generally should be able to distinguish symptoms to ensure that the patient receives the appropriate therapy. However, confusing symptoms are not necessarily judged solely on the basis of manual examination. Hence, classification performance cannot be regarded as the only index for evaluating a patient simulator, but it should be used in conjunction with other measures as described in the discussion section. However, it is our consideration that it would still be beneficial for a patient robot to be capable of simulating some confusing symptoms even when they do not need to be completely classified by manual examination. This is because simulators are also used to afford trainees some kind of practical experience with symptoms to complement the lessons of theoretical lectures. Such educational applications have not been thoroughly investigated, but are expected to be intensively pursued in the future.</p></sec></sec><sec id="sec016"><title>General Discussion</title><p>Here, we discuss a few general issues regarding the assessment of robotic patient simulators for training physical therapists. We note how the assessment methods proposed in this article should be utilized, and also discuss the use of assessments based on subjective judgment as well as other types of performance measures for patient simulators.</p><sec id="sec017"><title>Assessment measure as relative performance comparator</title><p>In industry, absolute performance indices that can be used as standards for testing products are often preferred. However, the indices used in the present study (at least the consistency of the assessor ratings) are likely to be subjected to significant variance in test institutes. As stated earlier, previous studies observed very different interclass correlations among the MAS scores of assessors. Hence, the consistency indices or average correct answer ratios of classification tasks cannot be appropriately used as absolute test standards. The assessment measures proposed in this article are more effective for comparing different patient simulators tested under the same or similar conditions, rather than for absolute judgment. They may also be used for relative testing to determine whether or not a certain product has been successfully upgraded. In this sense, the assessment measures of the present article would be the first practical performance measures for developing patient simulators.</p></sec><sec id="sec018"><title>Subjective or objective assessment?</title><p>Measures based on physical quantities may sometimes be considered preferable to those based on subjective evaluation by therapists. Given that the purpose of a simulator is the mimicking of an actual patient, the similarity between the dynamic joint resistance patterns of simulated and actual symptoms should be used as a measure [<xref rid="pone.0126392.ref011" ref-type="bibr">11</xref>]. However, in physical therapy educational facilities, trainees learn characteristic symptoms using subjective criteria. From this view point, the training simulators should be evaluated based on how well they present the characteristics of impaired joints that are shared by the majority of experienced therapists.</p></sec><sec id="sec019"><title>Other necessary assessments</title><p>Multiple criteria are usually used to assess complex systems like patient simulators. Here, we discuss required assessments other than those used in this study.</p><p>The most important feature of patient simulators is the realism of the simulated symptoms, and this was partly assessed in this study. To evaluate the realism, the qualities of the symptom models and the capabilities of the actuators also require consideration. There have been previous studies that emphasized these aspects. For example, Park et al. [<xref rid="pone.0126392.ref011" ref-type="bibr">11</xref>] evaluated their model in terms of its ability to mimic the joint resistances of actual patients, and Kikuchi et al. [<xref rid="pone.0126392.ref002" ref-type="bibr">2</xref>] used two types of actuators to compensate for the individual limitations.</p><p>The realism of other features is also important. Several previous works have advocated the implementation of the complex motions of human joint [<xref rid="pone.0126392.ref004" ref-type="bibr">4</xref>, <xref rid="pone.0126392.ref006" ref-type="bibr">6</xref>–<xref rid="pone.0126392.ref008" ref-type="bibr">8</xref>]. In addition, Masutani et al. [<xref rid="pone.0126392.ref001" ref-type="bibr">1</xref>] highlighted the importance of the skin and bone features in their simulator.</p><p>The number of symptoms that a patient simulator can present determines its educational value, and such becomes an inevitable performance measure.</p><p>When a patient simulator is designed for training physical therapists, a rating system for the therapeutic techniques that it is used to practice is required. Hence, the goodness of the rating system would also be a factor for assessing the simulator. Further studies are required to developing such a rating system.</p><p>Finally, assistive functions for instructors should be incorporated into patient simulators used for training purposes. For example, a programmable function for tuning the simulated symptoms would be useful in educational settings.</p></sec></sec><sec sec-type="conclusions" id="sec020"><title>Conclusion</title><p>Robotic patient simulators are used to aid the training of physical therapists in manual examination techniques. Such simulators are expected to enhance the quality of training because trainees rarely have the opportunity to deal with actual patients in educational facilities. Many research groups have thus developed diverse patient simulators in recent years. However, there is no general method for evaluating the simulators. The assessment methods proposed in this article enable evaluation of the ability of simulators to present the typical and intrinsic joint resistances that characterize symptoms that are generally accepted among experienced clinicians. The more accurately the simulator presented the common features of symptoms, the higher the two types of assessment measures.</p><p>The first assessment measure was used to evaluate the ability of the simulator to present different severities of a specific disease. The assessors rated the simulated symptoms using well-known criteria, and the consistency of the ratings of the assessors was examined. The quality of the simulated symptoms was discussed based on the consistency index. If the simulator accurately presented the typical features of joint resistances, the consistency of the ratings would be high. We used the method to evaluate the spasticity simulation of a wearable patient knee simulator. Eight experienced physical therapists subjectively rated the simulated spasticity based on the MAS. The observed consistency indices were comparable to those obtained from previous clinical studies (ICC = 0.70, Fleiss’ kappa = 0.42, and Kendall’s rank correlation = 0.66).</p><p>The second assessment measure was used to evaluate the ability of the simulator to present different types of symptoms. The assessors classified the simulated symptoms based on the observed joint resistances. High correct or positive answer ratios indicated agreement among the assessors regarding the features of the simulated symptoms. We used this method to evaluate the simulations of five different symptoms by the wearable patient robot. Nine physical therapists classified the simulated symptoms into five categories. The overall positive answer ratio was 56%, which was significantly greater than chance. However, the simulated spasticity and contracture were often confused with each other, and their simulations require improvement.</p><p>The two assessment measures address different aspects of patient simulators and are to be used in a complementary manner. They are relative indices that can be used to compare different simulators, rather than absolute standards. We expect that these measures would contribute to the development of commercial patient simulators for training physical therapists in the near future.</p></sec></body><back><ack><p>This study was in part supported by Naito Science and Engineering Foundation.</p></ack><ref-list><title>References</title><ref id="pone.0126392.ref001"><label>1</label><mixed-citation publication-type="other">Wakura S, Masutani Y, Nishimura A (2006). Patient simulating robot for rehabilitation education and rehabilitation education method. JP2006204832 (A).</mixed-citation></ref><ref id="pone.0126392.ref002"><label>2</label><mixed-citation publication-type="journal"><name><surname>Kikuchi</surname><given-names>T</given-names></name>, <name><surname>Oda</surname><given-names>K</given-names></name>, <name><surname>Yamaguchi</surname><given-names>S</given-names></name>, <name><surname>Furusho</surname><given-names>J</given-names></name> (<year>2010</year>) <article-title>Leg-robot with MR clutch to realize virtual spastic movements</article-title>. <source>Journal of intelligent material systems and structures</source><volume>21</volume>: <fpage>1523</fpage>–<lpage>1529</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1177/1045389X10367838">10.1177/1045389X10367838</ext-link></comment></mixed-citation></ref><ref id="pone.0126392.ref003"><label>3</label><mixed-citation publication-type="journal"><name><surname>Kikuchi</surname><given-names>T</given-names></name>, <name><surname>Oda</surname><given-names>K</given-names></name>, <name><surname>Furusho</surname><given-names>J</given-names></name> (<year>2010</year>) <article-title>Leg-robot for demonstration of spastic movements of brain-injured patients with compact magnetorheological fluid clutch</article-title>. <source>Advanced Robotics</source><volume>24</volume>: <fpage>671</fpage>–<lpage>686</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1163/016918610X493534">10.1163/016918610X493534</ext-link></comment></mixed-citation></ref><ref id="pone.0126392.ref004"><label>4</label><mixed-citation publication-type="other">Morita Y, Hayashi Y, Hirano T, Ukai H, Sanaka K, Takao K (2011) Development of knee joint robot with flexion, extension and rotation movements –experiments on imitation of knee joint movement of healthy and disable persons. Proceeding of International workshop on Robot and Motion control: 393–402.</mixed-citation></ref><ref id="pone.0126392.ref005"><label>5</label><mixed-citation publication-type="other">Grow DI, Wu M, Locastro MJ, Arora SK, Bastian AJ, Okamura AM (2008) Haptic simulation of elbow joint spasticity. Proceedings of the IEEE symposium on haptic interfaces for virtual environments and teleoperator systems: 475–476.</mixed-citation></ref><ref id="pone.0126392.ref006"><label>6</label><mixed-citation publication-type="other">Takahashi Y, Komeda T, Koyama H, Yamamoto S, Arimatsu T, Kawakami Y, et al. (2011) Development of an upper limb patient simulator for physical therapy exercise. Proceedings of the 2011 IEEE international conference on rehabilitation robotics: 1–4.</mixed-citation></ref><ref id="pone.0126392.ref007"><label>7</label><mixed-citation publication-type="journal"><name><surname>Mouri</surname><given-names>T</given-names></name>, <name><surname>Kawasaki</surname><given-names>H</given-names></name>, <name><surname>Nishimoto</surname><given-names>Y</given-names></name>, <name><surname>Aoki</surname><given-names>T</given-names></name>, <name><surname>Ishiguro</surname><given-names>Y</given-names></name>, <name><surname>Tanahashi</surname><given-names>M</given-names></name> (<year>2008</year>) <article-title>Robot hand imitating ddisable person for education/training of rehabilitation</article-title>. <source>Journal of Robotics and Mechatronics</source><volume>20</volume>: <fpage>280</fpage>–<lpage>288</lpage>.</mixed-citation></ref><ref id="pone.0126392.ref008"><label>8</label><mixed-citation publication-type="other">Ishikawa S, Okamoto S, Akiyama Y, Isogai K, Yamada Y, Hara S (2012) Wearable dummy to simulate joint impairment: Model for the discontinuous friction resistance due to arthritis. Proceedings of the IEEE International Conference on Robotics and Biomimetics: 1409–1414.</mixed-citation></ref><ref id="pone.0126392.ref009"><label>9</label><mixed-citation publication-type="other">Ishikawa S, Okamoto S, Isogai K, Akiyama Y, Yanagihara N, Yamada Y (2013) Wearable dummy to simulate joint impairment: Severity-based assessment of simulated spasticity of knee joint. Proceedings of the 2013 IEEE/SICE International Symposium on System Integration: 300–305.</mixed-citation></ref><ref id="pone.0126392.ref010"><label>10</label><mixed-citation publication-type="other">Okumura H, Okamoto S, Ishikawa S, Akiyama Y, Isogai K, Hirano Y, et al. (2013) Wearable dummy to simulate equinovarus for training of physical therapists. Proceedings of the 2013 international conference on instrumentation, control, information technology and system: 2272–2277.</mixed-citation></ref><ref id="pone.0126392.ref011"><label>11</label><mixed-citation publication-type="journal"><name><surname>Park</surname><given-names>HS</given-names></name>, <name><surname>Kim</surname><given-names>J</given-names></name>, <name><surname>Damiano</surname><given-names>DL</given-names></name> (<year>2012</year>) <article-title>Development of a haptic elbow spasticity simulator (HESS) for improving accuracy and reliability of clinical assessment of spasticity</article-title>. <source>IEEE Transactions on Neural Systems and Rehabilitation Engineering</source><volume>20</volume>: <fpage>361</fpage>–<lpage>370</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1109/TNSRE.2012.2195330">10.1109/TNSRE.2012.2195330</ext-link></comment><pub-id pub-id-type="pmid">22562769</pub-id></mixed-citation></ref><ref id="pone.0126392.ref012"><label>12</label><mixed-citation publication-type="other">Kim J, Park HS, Damiano DL (2011) Accuracy and reliability of haptic spasticity assessment using HESS (haptic elbow spasticity simulator). Proceedings of International Conference of IEEE Engineering in Medicine and Biology Society: 8527–8530.</mixed-citation></ref><ref id="pone.0126392.ref013"><label>13</label><mixed-citation publication-type="other">Fujisawa T, Takagi M, Takahashi Y, Inoue K (2007) Basic research on the upper limb patient simulator. Proceedings of IEEE International Conference on Rehabilitation Robotics: 48–51.</mixed-citation></ref><ref id="pone.0126392.ref014"><label>14</label><mixed-citation publication-type="journal"><name><surname>Dietz</surname><given-names>V</given-names></name>, <name><surname>Sinkjaer</surname><given-names>T</given-names></name> (<year>2007</year>) <article-title>Spastic movement disorder: impaired reflex function and altered muscle mechanics</article-title>. <source>Lancet Neurology</source><volume>6</volume>: <fpage>725</fpage>–<lpage>733</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/S1474-4422(07)70193-X">10.1016/S1474-4422(07)70193-X</ext-link></comment><pub-id pub-id-type="pmid">17638613</pub-id></mixed-citation></ref><ref id="pone.0126392.ref015"><label>15</label><mixed-citation publication-type="journal"><name><surname>Jobin</surname><given-names>A</given-names></name>, <name><surname>Levin</surname><given-names>MF</given-names></name> (<year>2000</year>) <article-title>Regulation of stretch reflex threshold in elbow flexors in children with cerebral palsy: a new measure of spasticity</article-title>. <source>Developmental medicine and child neurology</source><volume>42</volume>: <fpage>531</fpage>–<lpage>540</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1017/S0012162200001018">10.1017/S0012162200001018</ext-link></comment><pub-id pub-id-type="pmid">10981931</pub-id></mixed-citation></ref><ref id="pone.0126392.ref016"><label>16</label><mixed-citation publication-type="journal"><name><surname>Powers</surname><given-names>RK</given-names></name>, <name><surname>Marder-Meyer</surname><given-names>J</given-names></name>, <name><surname>Rymer</surname><given-names>WZ</given-names></name> (<year>1988</year>) <article-title>Quantitative relations between hypertonia and stretch reflex threshold in spastic hemiparesis</article-title>. <source>Annals of Neurology</source><volume>23</volume>: <fpage>115</fpage>–<lpage>124</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1002/ana.410230203">10.1002/ana.410230203</ext-link></comment><pub-id pub-id-type="pmid">3377434</pub-id></mixed-citation></ref><ref id="pone.0126392.ref017"><label>17</label><mixed-citation publication-type="journal"><name><surname>Urban</surname><given-names>PP</given-names></name>, <name><surname>Wolf</surname><given-names>T</given-names></name>, <name><surname>Uebele</surname><given-names>M</given-names></name>, <name><surname>Marx</surname><given-names>JJ</given-names></name>, <name><surname>Vogt</surname><given-names>T</given-names></name>, <name><surname>Stoeter</surname><given-names>P</given-names></name>, <etal>et al</etal> (<year>2010</year>) <article-title>Occurrence and clinical predictors of spasticity after ischemic stroke</article-title>. <source>Stroke</source><volume>41</volume>: <fpage>2016</fpage>–<lpage>2020</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1161/STROKEAHA.110.581991">10.1161/STROKEAHA.110.581991</ext-link></comment><pub-id pub-id-type="pmid">20705930</pub-id></mixed-citation></ref><ref id="pone.0126392.ref018"><label>18</label><mixed-citation publication-type="journal"><name><surname>Wissel</surname><given-names>J</given-names></name>, <name><surname>Manack</surname><given-names>A</given-names></name>, <name><surname>Brainin</surname><given-names>M</given-names></name> (<year>2013</year>) <article-title>Toward an epidemiology of poststroke spasticity</article-title>. <source>Neurology</source><volume>80</volume>: <fpage>S13</fpage>–<lpage>S19</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1212/WNL.0b013e3182762448">10.1212/WNL.0b013e3182762448</ext-link></comment><pub-id pub-id-type="pmid">23319481</pub-id></mixed-citation></ref><ref id="pone.0126392.ref019"><label>19</label><mixed-citation publication-type="journal"><name><surname>Bohannon</surname><given-names>RW</given-names></name>, <name><surname>Smith</surname><given-names>MB</given-names></name> (<year>1987</year>) <article-title>Interrater reliability of a modified ashworth scale of muscle spasticity</article-title>. <source>Physical therapy</source><volume>67</volume>: <fpage>206</fpage>–<lpage>207</lpage>. <pub-id pub-id-type="pmid">3809245</pub-id></mixed-citation></ref><ref id="pone.0126392.ref020"><label>20</label><mixed-citation publication-type="journal"><name><surname>McCrea</surname><given-names>PH</given-names></name>, <name><surname>Eng</surname><given-names>JJ</given-names></name>, <name><surname>Hodgson</surname><given-names>AJ</given-names></name> (<year>2003</year>) <article-title>Linear spring-damper model of the hypertonic elbow: reliability and validity</article-title>. <source>Journal of Neuroscience Methods</source><volume>128</volume>: <fpage>121</fpage>–<lpage>128</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/S0165-0270(03)00169-9">10.1016/S0165-0270(03)00169-9</ext-link></comment><pub-id pub-id-type="pmid">12948555</pub-id></mixed-citation></ref><ref id="pone.0126392.ref021"><label>21</label><mixed-citation publication-type="journal"><name><surname>Calota</surname><given-names>A</given-names></name>, <name><surname>Feldman</surname><given-names>AG</given-names></name>, <name><surname>Levin</surname><given-names>MF</given-names></name> (<year>2008</year>) <article-title>Spasticity measurement based on tonic stretch reflex threshold in stroke using a portable device</article-title>. <source>Clinical Neurology</source><volume>119</volume>: <fpage>2329</fpage>–<lpage>2337</lpage>.</mixed-citation></ref><ref id="pone.0126392.ref022"><label>22</label><mixed-citation publication-type="journal"><name><surname>Fleuren</surname><given-names>JF</given-names></name>, <name><surname>Voerman</surname><given-names>GE</given-names></name>, <name><surname>Erren-Wolters</surname><given-names>CV</given-names></name>, <name><surname>Snoek</surname><given-names>GJ</given-names></name>, <name><surname>Rietman</surname><given-names>JS</given-names></name>, <name><surname>Hermens</surname><given-names>HJ</given-names></name>, <etal>et al</etal> (<year>2009</year>) <article-title>Stop using the ashworth scale for the assessment of spasticity</article-title>. <source>Journal of neurology, neurosurgery and psychiatry</source><volume>81</volume>: <fpage>1</fpage>–<lpage>29</lpage>.</mixed-citation></ref><ref id="pone.0126392.ref023"><label>23</label><mixed-citation publication-type="journal"><name><surname>Pandyan</surname><given-names>AD</given-names></name>, <name><surname>Johnson</surname><given-names>GR</given-names></name> (<year>1999</year>) <article-title>A review of the properties and limitations of the ashworth and modified ashworth scales as measures of spasticity</article-title>. <source>Clinical rehabilitation</source><volume>13</volume>: <fpage>373</fpage>–<lpage>383</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1191/026921599677595404">10.1191/026921599677595404</ext-link></comment><pub-id pub-id-type="pmid">10498344</pub-id></mixed-citation></ref><ref id="pone.0126392.ref024"><label>24</label><mixed-citation publication-type="journal"><name><surname>Mutlu</surname><given-names>A</given-names></name>, <name><surname>Livanelioglu</surname><given-names>A</given-names></name>, <name><surname>Gunel</surname><given-names>MK</given-names></name> (<year>2008</year>) <article-title>Reliability of ashworth and modified ashworth scales in children with spastic cerebral palsy</article-title>. <source>BMC Musculoskeletal Disorders</source><volume>9</volume>: <fpage>44</fpage><comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1186/1471-2474-9-44">10.1186/1471-2474-9-44</ext-link></comment><pub-id pub-id-type="pmid">18402701</pub-id></mixed-citation></ref><ref id="pone.0126392.ref025"><label>25</label><mixed-citation publication-type="journal"><name><surname>Kaya</surname><given-names>T</given-names></name>, <name><surname>Goksel Karatepe</surname><given-names>A</given-names></name>, <name><surname>Gunaydin</surname><given-names>R</given-names></name>, <name><surname>Koc</surname><given-names>A</given-names></name>, <name><surname>Altundal Ercan</surname><given-names>U</given-names></name> (<year>2011</year>) <article-title>Inter-rater reliability of the modified ashworth scale and modified modified ashworth scale in assessing poststroke elbow flexor spasticity</article-title>. <source>International Journal of Rehabilitation Research</source><volume>34</volume>: <fpage>59</fpage>–<lpage>64</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1097/MRR.0b013e32833d6cdf">10.1097/MRR.0b013e32833d6cdf</ext-link></comment><pub-id pub-id-type="pmid">20671560</pub-id></mixed-citation></ref><ref id="pone.0126392.ref026"><label>26</label><mixed-citation publication-type="journal"><name><surname>Mehrholz</surname><given-names>J</given-names></name>, <name><surname>Major</surname><given-names>Y</given-names></name>, <name><surname>Meißner</surname><given-names>D</given-names></name>, <name><surname>Sandi-Gahun</surname><given-names>S</given-names></name>, <name><surname>Koch</surname><given-names>R</given-names></name>, <name><surname>Pohl</surname><given-names>M</given-names></name> (<year>2005</year>) <article-title>The influence of contractures and variation in measurement stretching velocity on the reliability of the modified ashworth scale in patients with severe brain injury</article-title>. <source>Clinical Rehabilitation</source><volume>19</volume>: <fpage>63</fpage>–<lpage>72</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1191/0269215505cr889oa">10.1191/0269215505cr889oa</ext-link></comment><pub-id pub-id-type="pmid">15704510</pub-id></mixed-citation></ref><ref id="pone.0126392.ref027"><label>27</label><mixed-citation publication-type="journal"><name><surname>Mehrholz</surname><given-names>J</given-names></name>, <name><surname>Wagner</surname><given-names>K</given-names></name>, <name><surname>Meißner</surname><given-names>D</given-names></name>, <name><surname>Grundmann</surname><given-names>K</given-names></name>, <name><surname>Zange</surname><given-names>C</given-names></name>, <name><surname>Koch</surname><given-names>R</given-names></name>, <etal>et al</etal> (<year>2005</year>) <article-title>Reliability of the modified tardieu scale and the modified ashworth scale in adult patients with severe brain injury: a comparison study</article-title>. <source>Clinical Rehabilitation</source><volume>19</volume>: <fpage>751</fpage>–<lpage>759</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1191/0269215505cr889oa">10.1191/0269215505cr889oa</ext-link></comment><pub-id pub-id-type="pmid">16250194</pub-id></mixed-citation></ref><ref id="pone.0126392.ref028"><label>28</label><mixed-citation publication-type="other">Merck Sharp & Dohme Corp. Merck manual—Parkinson disease. URL <ext-link ext-link-type="uri" xlink:href="http://www.merckmanuals.com/professional/neurologic_disorders/movement_and_cerebellar_disorders/parkinson_disease.html">http://www.merckmanuals.com/professional/neurologic_disorders/movement_and_cerebellar_disorders/parkinson_disease.html</ext-link>. Apr. 24, 2014.</mixed-citation></ref><ref id="pone.0126392.ref029"><label>29</label><mixed-citation publication-type="journal"><name><surname>Stebbins</surname><given-names>GT</given-names></name>, <name><surname>Goetz</surname><given-names>CG</given-names></name> (<year>1998</year>) <article-title>Factor structure of the unified Parkinson’s disease rating scale: Motor examination section</article-title>. <source>Movement Disorders</source><volume>13</volume>: <fpage>633</fpage>–<lpage>636</lpage>. <comment>doi: <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1002/mds.870130404">10.1002/mds.870130404</ext-link></comment><pub-id pub-id-type="pmid">9686766</pub-id></mixed-citation></ref></ref-list></back></pmc><affiliations><list><country><li>Japon</li></country></list><tree><country name="Japon"><noRegion><name sortKey="Ishikawa, Shun" sort="Ishikawa, Shun" uniqKey="Ishikawa S" first="Shun" last="Ishikawa">Shun Ishikawa</name></noRegion><name sortKey="Akiyama, Yasuhiro" sort="Akiyama, Yasuhiro" uniqKey="Akiyama Y" first="Yasuhiro" last="Akiyama">Yasuhiro Akiyama</name><name sortKey="Isogai, Kaoru" sort="Isogai, Kaoru" uniqKey="Isogai K" first="Kaoru" last="Isogai">Kaoru Isogai</name><name sortKey="Okamoto, Shogo" sort="Okamoto, Shogo" uniqKey="Okamoto S" first="Shogo" last="Okamoto">Shogo Okamoto</name><name sortKey="Yamada, Yoji" sort="Yamada, Yoji" uniqKey="Yamada Y" first="Yoji" last="Yamada">Yoji Yamada</name><name sortKey="Yanagihara, Naomi" sort="Yanagihara, Naomi" uniqKey="Yanagihara N" first="Naomi" last="Yanagihara">Naomi Yanagihara</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Ncbi/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 003885 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd -nk 003885 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Ncbi
|étape= Merge
|type= RBID
|clé= PMC:4414623
|texte= Assessment of Robotic Patient Simulators for Training in Manual Physical Therapy Examination Techniques
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/RBID.i -Sk "pubmed:25923719" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |