Concurrent validity and test-retest reliability of the Virtual Peg Insertion Test to quantify upper limb function in patients with chronic stroke
Identifieur interne : 000851 ( Pmc/Curation ); précédent : 000850; suivant : 000852Concurrent validity and test-retest reliability of the Virtual Peg Insertion Test to quantify upper limb function in patients with chronic stroke
Auteurs : Bernadette C. Tobler-Ammann [Suisse, Pays-Bas] ; Eling D. De Bruin [Pays-Bas, Suisse] ; Marie-Christine Fluet [Suisse] ; Olivier Lambercy [Suisse] ; Rob A. De Bie [Pays-Bas] ; Ruud H. Knols [Suisse]Source :
- Journal of NeuroEngineering and Rehabilitation [ 1743-0003 ] ; 2016.
Abstract
Measuring arm and hand function of the affected side is vital in stroke rehabilitation. Therefore, the Virtual Peg Insertion Test (VPIT), an assessment combining virtual reality and haptic feedback during a goal-oriented task derived from the Nine Hole Peg Test (NHPT), was developed. This study aimed to evaluate (1) the concurrent validity of key outcome measures of the VPIT, namely the execution time and the number of dropped pegs, with the NHPT and Box and Block Test (BBT), and (2) the test-retest-reliability of these parameters together with the VPIT’s additional kinetic and kinematic parameters in patients with chronic stroke.
The three tests were administered on 31 chronic patients with stroke in one session (concurrent validity), and the VPIT was retested in a second session 3–7 days later (test-retest reliability). Spearman rank correlation coefficients (ρ) were calculated for assessing concurrent validity, and intraclass correlation coefficients (ICCs) were used to determine relative reliability. Bland-Altman plots were drawn and the smallest detectable difference (SDD) was calculated to examine absolute reliability.
For the 31 included patients, 11 were able to perform the VPIT solely via use of their affected arm, whereas 20 patients also had to utilize support from their unaffected arm. For
The VPIT is a promising upper limb function assessment for patients with stroke requiring other components of upper limb motor performance than the NHPT and BBT. The high intra-subject variation indicated that it is a demanding test for this stroke sample, which necessitates a thorough introduction to this assessment. Once familiar, the VPIT provides more objective and comprehensive measurements of upper limb function than conventional, non-computerized hand assessments.
Url:
DOI: 10.1186/s12984-016-0116-y
PubMed: 26801395
PubMed Central: 4724098
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :000851
Links to Exploration step
PMC:4724098Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Concurrent validity and test-retest reliability of the Virtual Peg Insertion Test to quantify upper limb function in patients with chronic stroke</title><author><name sortKey="Tobler Ammann, Bernadette C" sort="Tobler Ammann, Bernadette C" uniqKey="Tobler Ammann B" first="Bernadette C." last="Tobler-Ammann">Bernadette C. Tobler-Ammann</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="De Bruin, Eling D" sort="De Bruin, Eling D" uniqKey="De Bruin E" first="Eling D." last="De Bruin">Eling D. De Bruin</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff3">Institute of Human Movement Sciences and Sport, Department of Health Sciences and Technology, ETH Zurich, Wolfgang-Pauli-Str. 27, 8093 Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Institute of Human Movement Sciences and Sport, Department of Health Sciences and Technology, ETH Zurich, Wolfgang-Pauli-Str. 27, 8093 Zurich</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff4">Centre for Evidence Based Physiotherapy, Maastricht University, PO Box 616, 6200 MD Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Centre for Evidence Based Physiotherapy, Maastricht University, PO Box 616, 6200 MD Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Fluet, Marie Christine" sort="Fluet, Marie Christine" uniqKey="Fluet M" first="Marie-Christine" last="Fluet">Marie-Christine Fluet</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff6">ReHaptix GmbH, ETH Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>ReHaptix GmbH, ETH Zurich, Zurich</wicri:regionArea></affiliation></author><author><name sortKey="Lambercy, Olivier" sort="Lambercy, Olivier" uniqKey="Lambercy O" first="Olivier" last="Lambercy">Olivier Lambercy</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich</wicri:regionArea></affiliation></author><author><name sortKey="De Bie, Rob A" sort="De Bie, Rob A" uniqKey="De Bie R" first="Rob A." last="De Bie">Rob A. De Bie</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Knols, Ruud H" sort="Knols, Ruud H" uniqKey="Knols R" first="Ruud H." last="Knols">Ruud H. Knols</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich</wicri:regionArea></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">26801395</idno><idno type="pmc">4724098</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4724098</idno><idno type="RBID">PMC:4724098</idno><idno type="doi">10.1186/s12984-016-0116-y</idno><date when="2016">2016</date><idno type="wicri:Area/Pmc/Corpus">000851</idno><idno type="wicri:Area/Pmc/Curation">000851</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Concurrent validity and test-retest reliability of the Virtual Peg Insertion Test to quantify upper limb function in patients with chronic stroke</title><author><name sortKey="Tobler Ammann, Bernadette C" sort="Tobler Ammann, Bernadette C" uniqKey="Tobler Ammann B" first="Bernadette C." last="Tobler-Ammann">Bernadette C. Tobler-Ammann</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="De Bruin, Eling D" sort="De Bruin, Eling D" uniqKey="De Bruin E" first="Eling D." last="De Bruin">Eling D. De Bruin</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff3">Institute of Human Movement Sciences and Sport, Department of Health Sciences and Technology, ETH Zurich, Wolfgang-Pauli-Str. 27, 8093 Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Institute of Human Movement Sciences and Sport, Department of Health Sciences and Technology, ETH Zurich, Wolfgang-Pauli-Str. 27, 8093 Zurich</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff4">Centre for Evidence Based Physiotherapy, Maastricht University, PO Box 616, 6200 MD Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Centre for Evidence Based Physiotherapy, Maastricht University, PO Box 616, 6200 MD Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Fluet, Marie Christine" sort="Fluet, Marie Christine" uniqKey="Fluet M" first="Marie-Christine" last="Fluet">Marie-Christine Fluet</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff6">ReHaptix GmbH, ETH Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>ReHaptix GmbH, ETH Zurich, Zurich</wicri:regionArea></affiliation></author><author><name sortKey="Lambercy, Olivier" sort="Lambercy, Olivier" uniqKey="Lambercy O" first="Olivier" last="Lambercy">Olivier Lambercy</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich</wicri:regionArea></affiliation></author><author><name sortKey="De Bie, Rob A" sort="De Bie, Rob A" uniqKey="De Bie R" first="Rob A." last="De Bie">Rob A. De Bie</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Knols, Ruud H" sort="Knols, Ruud H" uniqKey="Knols R" first="Ruud H." last="Knols">Ruud H. Knols</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich</wicri:regionArea></affiliation></author></analytic><series><title level="j">Journal of NeuroEngineering and Rehabilitation</title><idno type="eISSN">1743-0003</idno><imprint><date when="2016">2016</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec><title>Background</title><p>Measuring arm and hand function of the affected side is vital in stroke rehabilitation. Therefore, the Virtual Peg Insertion Test (VPIT), an assessment combining virtual reality and haptic feedback during a goal-oriented task derived from the Nine Hole Peg Test (NHPT), was developed. This study aimed to evaluate (1) the concurrent validity of key outcome measures of the VPIT, namely the execution time and the number of dropped pegs, with the NHPT and Box and Block Test (BBT), and (2) the test-retest-reliability of these parameters together with the VPIT’s additional kinetic and kinematic parameters in patients with chronic stroke.</p><p>The three tests were administered on 31 chronic patients with stroke in one session (concurrent validity), and the VPIT was retested in a second session 3–7 days later (test-retest reliability). Spearman rank correlation coefficients (ρ) were calculated for assessing concurrent validity, and intraclass correlation coefficients (ICCs) were used to determine relative reliability. Bland-Altman plots were drawn and the smallest detectable difference (SDD) was calculated to examine absolute reliability.</p></sec><sec><title>Results</title><p>For the 31 included patients, 11 were able to perform the VPIT solely via use of their affected arm, whereas 20 patients also had to utilize support from their unaffected arm. For <italic>n</italic> = 31, the VPIT showed low correlations with the NHPT (<italic>ρ</italic> = 0.31 for <italic>time</italic> (T<sub>ex</sub>[s]); <italic>ρ</italic> = 0.21 for <italic>number of dropped pegs</italic> (N<sub>dp</sub>)) and BBT (<italic>ρ</italic> = −0.23 for <italic>number of transported cubes</italic> (N<sub>tc</sub>); <italic>ρ</italic> = −0.12 for <italic>number of dropped cubes</italic> (N<sub>dc</sub>)). The test-retest reliability for the parameters T<sub>ex</sub>[s], <italic>mean grasping force</italic> (F<sub>g</sub>go[N]), <italic>number of zero-crossings</italic> (N<sub>zc[1/s</sub>go/return) and <italic>mean collision force</italic> (F<sub>cmean</sub>[N]) were good to high, with ICCs ranging from 0.83 to 0.94. Fair reliability could be found for F<sub>g</sub>return (ICC = 0.75) and <italic>trajectory error</italic> (E<sub>traj</sub>go[cm]) (0.70). Poor reliability was measured for E<sub>traj</sub>return[cm] (0.67) and N<sub>dp</sub> (0.58). The SDDs were: T<sub>ex</sub> = 70.2 s, N<sub>dp</sub> = 0.4 pegs; F<sub>g</sub>go/return = 3.5/1.2 Newton; N<sub>zc[1/s]</sub>go/return = 0.2/1.8 zero-crossings; E<sub>traj</sub>go/return = 0.5/0.8 cm; F<sub>cmean</sub> = 0.7 Newton.</p></sec><sec><title>Conclusions</title><p>The VPIT is a promising upper limb function assessment for patients with stroke requiring other components of upper limb motor performance than the NHPT and BBT. The high intra-subject variation indicated that it is a demanding test for this stroke sample, which necessitates a thorough introduction to this assessment. Once familiar, the VPIT provides more objective and comprehensive measurements of upper limb function than conventional, non-computerized hand assessments.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Lundborg, G" uniqKey="Lundborg G">G Lundborg</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Johansson, Bb" uniqKey="Johansson B">BB Johansson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fluet, Gg" uniqKey="Fluet G">GG Fluet</name></author><author><name sortKey="Deutsch, Je" uniqKey="Deutsch J">JE Deutsch</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lin, Kc" uniqKey="Lin K">KC Lin</name></author><author><name sortKey="Chuang, Ll" uniqKey="Chuang L">LL Chuang</name></author><author><name sortKey="Wu, Cy" uniqKey="Wu C">CY Wu</name></author><author><name sortKey="Hsieh, Yw" uniqKey="Hsieh Y">YW Hsieh</name></author><author><name sortKey="Chang, Wy" uniqKey="Chang W">WY Chang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mathiowetz, V" uniqKey="Mathiowetz V">V Mathiowetz</name></author><author><name sortKey="Volland, G" uniqKey="Volland G">G Volland</name></author><author><name sortKey="Kashman, N" uniqKey="Kashman N">N Kashman</name></author><author><name sortKey="Weber, K" uniqKey="Weber K">K Weber</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mathiowetz, V" uniqKey="Mathiowetz V">V Mathiowetz</name></author><author><name sortKey="Weber, K" uniqKey="Weber K">K Weber</name></author><author><name sortKey="Kashman, N" uniqKey="Kashman N">N Kashman</name></author><author><name sortKey="Volland, G" uniqKey="Volland G">G Volland</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Oxford Grice, K" uniqKey="Oxford Grice K">K Oxford Grice</name></author><author><name sortKey="Vogel, Ka" uniqKey="Vogel K">KA Vogel</name></author><author><name sortKey="Le, V" uniqKey="Le V">V Le</name></author><author><name sortKey="Mitchell, A" uniqKey="Mitchell A">A Mitchell</name></author><author><name sortKey="Muniz, S" uniqKey="Muniz S">S Muniz</name></author><author><name sortKey="Vollmer, Ma" uniqKey="Vollmer M">MA Vollmer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Laver, Ke" uniqKey="Laver K">KE Laver</name></author><author><name sortKey="George, S" uniqKey="George S">S George</name></author><author><name sortKey="Thomas, S" uniqKey="Thomas S">S Thomas</name></author><author><name sortKey="Deutsch, Je" uniqKey="Deutsch J">JE Deutsch</name></author><author><name sortKey="Crotty, M" uniqKey="Crotty M">M Crotty</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brewer, L" uniqKey="Brewer L">L Brewer</name></author><author><name sortKey="Horgan, F" uniqKey="Horgan F">F Horgan</name></author><author><name sortKey="Hickey, A" uniqKey="Hickey A">A Hickey</name></author><author><name sortKey="Williams, D" uniqKey="Williams D">D Williams</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Yeh, Sc" uniqKey="Yeh S">SC Yeh</name></author><author><name sortKey="Lee, Sh" uniqKey="Lee S">SH Lee</name></author><author><name sortKey="Chan, Rc" uniqKey="Chan R">RC Chan</name></author><author><name sortKey="Chen, S" uniqKey="Chen S">S Chen</name></author><author><name sortKey="Rizzo, A" uniqKey="Rizzo A">A Rizzo</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fordell, H" uniqKey="Fordell H">H Fordell</name></author><author><name sortKey="Bodin, K" uniqKey="Bodin K">K Bodin</name></author><author><name sortKey="Bucht, G" uniqKey="Bucht G">G Bucht</name></author><author><name sortKey="Malm, J" uniqKey="Malm J">J Malm</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lee, Jh" uniqKey="Lee J">JH Lee</name></author><author><name sortKey="Ku, J" uniqKey="Ku J">J Ku</name></author><author><name sortKey="Cho, W" uniqKey="Cho W">W Cho</name></author><author><name sortKey="Hahn, Wy" uniqKey="Hahn W">WY Hahn</name></author><author><name sortKey="Kim, Iy" uniqKey="Kim I">IY Kim</name></author><author><name sortKey="Lee, Sm" uniqKey="Lee S">SM Lee</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Amirabdollahian, F" uniqKey="Amirabdollahian F">F Amirabdollahian</name></author><author><name sortKey="Johnson, G" uniqKey="Johnson G">G Johnson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bardorfer, A" uniqKey="Bardorfer A">A Bardorfer</name></author><author><name sortKey="Munih, M" uniqKey="Munih M">M Munih</name></author><author><name sortKey="Zupan, A" uniqKey="Zupan A">A Zupan</name></author><author><name sortKey="Primozic, A" uniqKey="Primozic A">A Primozic</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Feys, P" uniqKey="Feys P">P Feys</name></author><author><name sortKey="Alders, G" uniqKey="Alders G">G Alders</name></author><author><name sortKey="Gijbels, D" uniqKey="Gijbels D">D Gijbels</name></author><author><name sortKey="De Boeck, J" uniqKey="De Boeck J">J De Boeck</name></author><author><name sortKey="De Weyer, T" uniqKey="De Weyer T">T De Weyer</name></author><author><name sortKey="Coninx, K" uniqKey="Coninx K">K Coninx</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Xydas, E" uniqKey="Xydas E">E Xydas</name></author><author><name sortKey="Louca, L" uniqKey="Louca L">L Louca</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fluet, M C" uniqKey="Fluet M">M-C Fluet</name></author><author><name sortKey="Lambercy, O" uniqKey="Lambercy O">O Lambercy</name></author><author><name sortKey="Gassert, R" uniqKey="Gassert R">R Gassert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lambercy, O" uniqKey="Lambercy O">O Lambercy</name></author><author><name sortKey="Fluet, Mc" uniqKey="Fluet M">MC Fluet</name></author><author><name sortKey="Lamers, I" uniqKey="Lamers I">I Lamers</name></author><author><name sortKey="Kerkhofs, L" uniqKey="Kerkhofs L">L Kerkhofs</name></author><author><name sortKey="Feys, P" uniqKey="Feys P">P Feys</name></author><author><name sortKey="Gassert, R" uniqKey="Gassert R">R Gassert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gagnon, C" uniqKey="Gagnon C">C Gagnon</name></author><author><name sortKey="Lavoie, C" uniqKey="Lavoie C">C Lavoie</name></author><author><name sortKey="Lessard, I" uniqKey="Lessard I">I Lessard</name></author><author><name sortKey="Mathieu, J" uniqKey="Mathieu J">J Mathieu</name></author><author><name sortKey="Brais, B" uniqKey="Brais B">B Brais</name></author><author><name sortKey="Bouchard, Jp" uniqKey="Bouchard J">JP Bouchard</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nordin, N" uniqKey="Nordin N">N Nordin</name></author><author><name sortKey="Xie, Sq" uniqKey="Xie S">SQ Xie</name></author><author><name sortKey="Wunsche, B" uniqKey="Wunsche B">B Wunsche</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kim, H" uniqKey="Kim H">H Kim</name></author><author><name sortKey="Miller, Lm" uniqKey="Miller L">LM Miller</name></author><author><name sortKey="Fedulow, I" uniqKey="Fedulow I">I Fedulow</name></author><author><name sortKey="Simkins, M" uniqKey="Simkins M">M Simkins</name></author><author><name sortKey="Abrams, Gm" uniqKey="Abrams G">GM Abrams</name></author><author><name sortKey="Byl, N" uniqKey="Byl N">N Byl</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Panarese, A" uniqKey="Panarese A">A Panarese</name></author><author><name sortKey="Colombo, R" uniqKey="Colombo R">R Colombo</name></author><author><name sortKey="Sterpi, I" uniqKey="Sterpi I">I Sterpi</name></author><author><name sortKey="Pisano, F" uniqKey="Pisano F">F Pisano</name></author><author><name sortKey="Micera, S" uniqKey="Micera S">S Micera</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rohrer, B" uniqKey="Rohrer B">B Rohrer</name></author><author><name sortKey="Fasoli, S" uniqKey="Fasoli S">S Fasoli</name></author><author><name sortKey="Krebs, Hi" uniqKey="Krebs H">HI Krebs</name></author><author><name sortKey="Hughes, R" uniqKey="Hughes R">R Hughes</name></author><author><name sortKey="Volpe, B" uniqKey="Volpe B">B Volpe</name></author><author><name sortKey="Frontera, Wr" uniqKey="Frontera W">WR Frontera</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Milner, Te" uniqKey="Milner T">TE Milner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chen, Hm" uniqKey="Chen H">HM Chen</name></author><author><name sortKey="Chen, Cc" uniqKey="Chen C">CC Chen</name></author><author><name sortKey="Hsueh, Ip" uniqKey="Hsueh I">IP Hsueh</name></author><author><name sortKey="Huang, Sl" uniqKey="Huang S">SL Huang</name></author><author><name sortKey="Hsieh, Cl" uniqKey="Hsieh C">CL Hsieh</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Folstein, Mf" uniqKey="Folstein M">MF Folstein</name></author><author><name sortKey="Folstein, Se" uniqKey="Folstein S">SE Folstein</name></author><author><name sortKey="Mchugh, Pr" uniqKey="Mchugh P">PR McHugh</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lang, Ji" uniqKey="Lang J">JI Lang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brown, S" uniqKey="Brown S">S Brown</name></author><author><name sortKey="Weih, L" uniqKey="Weih L">L Weih</name></author><author><name sortKey="Mukesh, N" uniqKey="Mukesh N">N Mukesh</name></author><author><name sortKey="Mccarty, C" uniqKey="Mccarty C">C McCarty</name></author><author><name sortKey="Taylor, H" uniqKey="Taylor H">H Taylor</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sch Dler, S" uniqKey="Sch Dler S">S Schädler</name></author><author><name sortKey="Kool, J" uniqKey="Kool J">J Kool</name></author><author><name sortKey="Luthi, H" uniqKey="Luthi H">H Lüthi</name></author><author><name sortKey="Marks, D" uniqKey="Marks D">D Marks</name></author><author><name sortKey="Oesch, P" uniqKey="Oesch P">P Oesch</name></author><author><name sortKey="Pfeffer, A" uniqKey="Pfeffer A">A Pfeffer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mathiowetz, V" uniqKey="Mathiowetz V">V Mathiowetz</name></author><author><name sortKey="Weber, K" uniqKey="Weber K">K Weber</name></author><author><name sortKey="Volland, G" uniqKey="Volland G">G Volland</name></author><author><name sortKey="Kashman, N" uniqKey="Kashman N">N Kashman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Norman, Gr" uniqKey="Norman G">GR Norman</name></author><author><name sortKey="Streiner, Dl" uniqKey="Streiner D">DL Streiner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Munro, Bh" uniqKey="Munro B">BH Munro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Landis, Jr" uniqKey="Landis J">JR Landis</name></author><author><name sortKey="Koch, Gg" uniqKey="Koch G">GG Koch</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Weir, Jp" uniqKey="Weir J">JP Weir</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Shrout, Pe" uniqKey="Shrout P">PE Shrout</name></author><author><name sortKey="Fleiss, Jl" uniqKey="Fleiss J">JL Fleiss</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="De Vet, Hc" uniqKey="De Vet H">HC de Vet</name></author><author><name sortKey="Terwee, Cb" uniqKey="Terwee C">CB Terwee</name></author><author><name sortKey="Knol, Dl" uniqKey="Knol D">DL Knol</name></author><author><name sortKey="Bouter, Lm" uniqKey="Bouter L">LM Bouter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Arnall, Fa" uniqKey="Arnall F">FA Arnall</name></author><author><name sortKey="Koumantakis, Ga" uniqKey="Koumantakis G">GA Koumantakis</name></author><author><name sortKey="Oldham, Ja" uniqKey="Oldham J">JA Oldham</name></author><author><name sortKey="Cooper, Rg" uniqKey="Cooper R">RG Cooper</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Denegar, Cr" uniqKey="Denegar C">CR Denegar</name></author><author><name sortKey="Ball, Dw" uniqKey="Ball D">DW Ball</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rankin, G" uniqKey="Rankin G">G Rankin</name></author><author><name sortKey="Stokes, M" uniqKey="Stokes M">M Stokes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bland, Jm" uniqKey="Bland J">JM Bland</name></author><author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bland, Jm" uniqKey="Bland J">JM Bland</name></author><author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Liaw, Lj" uniqKey="Liaw L">LJ Liaw</name></author><author><name sortKey="Hsieh, Cl" uniqKey="Hsieh C">CL Hsieh</name></author><author><name sortKey="Lo, Sk" uniqKey="Lo S">SK Lo</name></author><author><name sortKey="Chen, Hm" uniqKey="Chen H">HM Chen</name></author><author><name sortKey="Lee, S" uniqKey="Lee S">S Lee</name></author><author><name sortKey="Lin, Jh" uniqKey="Lin J">JH Lin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brehm, Ma" uniqKey="Brehm M">MA Brehm</name></author><author><name sortKey="Scholtes, Va" uniqKey="Scholtes V">VA Scholtes</name></author><author><name sortKey="Dallmeijer, Aj" uniqKey="Dallmeijer A">AJ Dallmeijer</name></author><author><name sortKey="Twisk, Jw" uniqKey="Twisk J">JW Twisk</name></author><author><name sortKey="Harlaar, J" uniqKey="Harlaar J">J Harlaar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bland, Jm" uniqKey="Bland J">JM Bland</name></author><author><name sortKey="Altman, Dg" uniqKey="Altman D">DG Altman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Euser, Am" uniqKey="Euser A">AM Euser</name></author><author><name sortKey="Dekker, Fw" uniqKey="Dekker F">FW Dekker</name></author><author><name sortKey="Le Cessie, S" uniqKey="Le Cessie S">S le Cessie</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Aaronson, N" uniqKey="Aaronson N">N Aaronson</name></author><author><name sortKey="Alonso, J" uniqKey="Alonso J">J Alonso</name></author><author><name sortKey="Burnam, A" uniqKey="Burnam A">A Burnam</name></author><author><name sortKey="Lohr, Kn" uniqKey="Lohr K">KN Lohr</name></author><author><name sortKey="Patrick, Dl" uniqKey="Patrick D">DL Patrick</name></author><author><name sortKey="Perrin, E" uniqKey="Perrin E">E Perrin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bowler, M" uniqKey="Bowler M">M Bowler</name></author><author><name sortKey="Amirabdollahian, F" uniqKey="Amirabdollahian F">F Amirabdollahian</name></author><author><name sortKey="Dautenhahn, K" uniqKey="Dautenhahn K">K Dautenhahn</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Terwee, Cb" uniqKey="Terwee C">CB Terwee</name></author><author><name sortKey="Bot, Sd" uniqKey="Bot S">SD Bot</name></author><author><name sortKey="De Boer, Mr" uniqKey="De Boer M">MR de Boer</name></author><author><name sortKey="Van Der Windt, Da" uniqKey="Van Der Windt D">DA van der Windt</name></author><author><name sortKey="Knol, Dl" uniqKey="Knol D">DL Knol</name></author><author><name sortKey="Dekker, J" uniqKey="Dekker J">J Dekker</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zou, Gy" uniqKey="Zou G">GY Zou</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jette, Am" uniqKey="Jette A">AM Jette</name></author><author><name sortKey="Tao, W" uniqKey="Tao W">W Tao</name></author><author><name sortKey="Norweg, A" uniqKey="Norweg A">A Norweg</name></author><author><name sortKey="Haley, S" uniqKey="Haley S">S Haley</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schmidheiny, A" uniqKey="Schmidheiny A">A Schmidheiny</name></author><author><name sortKey="Swanenburg, J" uniqKey="Swanenburg J">J Swanenburg</name></author><author><name sortKey="Straumann, D" uniqKey="Straumann D">D Straumann</name></author><author><name sortKey="De Bruin, Ed" uniqKey="De Bruin E">ED de Bruin</name></author><author><name sortKey="Knols, Rh" uniqKey="Knols R">RH Knols</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Pollock, A" uniqKey="Pollock A">A Pollock</name></author><author><name sortKey="Farmer, Se" uniqKey="Farmer S">SE Farmer</name></author><author><name sortKey="Brady, Mc" uniqKey="Brady M">MC Brady</name></author><author><name sortKey="Langhorne, P" uniqKey="Langhorne P">P Langhorne</name></author><author><name sortKey="Mead, Ge" uniqKey="Mead G">GE Mead</name></author><author><name sortKey="Mehrholz, J" uniqKey="Mehrholz J">J Mehrholz</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">J Neuroeng Rehabil</journal-id><journal-id journal-id-type="iso-abbrev">J Neuroeng Rehabil</journal-id><journal-title-group><journal-title>Journal of NeuroEngineering and Rehabilitation</journal-title></journal-title-group><issn pub-type="epub">1743-0003</issn><publisher><publisher-name>BioMed Central</publisher-name><publisher-loc>London</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">26801395</article-id><article-id pub-id-type="pmc">4724098</article-id><article-id pub-id-type="publisher-id">116</article-id><article-id pub-id-type="doi">10.1186/s12984-016-0116-y</article-id><article-categories><subj-group subj-group-type="heading"><subject>Methodology</subject></subj-group></article-categories><title-group><article-title>Concurrent validity and test-retest reliability of the Virtual Peg Insertion Test to quantify upper limb function in patients with chronic stroke</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Tobler-Ammann</surname><given-names>Bernadette C.</given-names></name><address><email>bernadette.tobler@usz.ch</email></address><xref ref-type="aff" rid="Aff1"></xref><xref ref-type="aff" rid="Aff2"></xref></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-6542-7385</contrib-id><name><surname>de Bruin</surname><given-names>Eling D.</given-names></name><address><phone>+41 44 632 40 18</phone><email>eling.debruin@hest.ethz.ch</email></address><xref ref-type="aff" rid="Aff2"></xref><xref ref-type="aff" rid="Aff3"></xref><xref ref-type="aff" rid="Aff4"></xref></contrib><contrib contrib-type="author"><name><surname>Fluet</surname><given-names>Marie-Christine</given-names></name><address><email>marie-christine.fluet@alumni.ethz.ch</email></address><xref ref-type="aff" rid="Aff5"></xref><xref ref-type="aff" rid="Aff6"></xref></contrib><contrib contrib-type="author"><name><surname>Lambercy</surname><given-names>Olivier</given-names></name><address><email>olambercy@ethz.ch</email></address><xref ref-type="aff" rid="Aff5"></xref></contrib><contrib contrib-type="author"><name><surname>de Bie</surname><given-names>Rob A.</given-names></name><address><email>ra.debie@maastrichtuniversity.nl</email></address><xref ref-type="aff" rid="Aff2"></xref></contrib><contrib contrib-type="author"><name><surname>Knols</surname><given-names>Ruud H.</given-names></name><address><email>ruud.knols@usz.ch</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><aff id="Aff1"><label></label>Directorate of Research and Education, Physiotherapy & Occupational Therapy Research, University Hospital Zurich, Zurich, Switzerland</aff><aff id="Aff2"><label></label>Department of Epidemiology, CAPHRI School for Primary Health and Primary Education, Maastricht University, Maastricht, The Netherlands</aff><aff id="Aff3"><label></label>Institute of Human Movement Sciences and Sport, Department of Health Sciences and Technology, ETH Zurich, Wolfgang-Pauli-Str. 27, 8093 Zurich, Switzerland</aff><aff id="Aff4"><label></label>Centre for Evidence Based Physiotherapy, Maastricht University, PO Box 616, 6200 MD Maastricht, The Netherlands</aff><aff id="Aff5"><label></label>Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland</aff><aff id="Aff6"><label></label>ReHaptix GmbH, ETH Zurich, Zurich, Switzerland</aff></contrib-group><pub-date pub-type="epub"><day>22</day><month>1</month><year>2016</year></pub-date><pub-date pub-type="pmc-release"><day>22</day><month>1</month><year>2016</year></pub-date><pub-date pub-type="collection"><year>2016</year></pub-date><volume>13</volume><elocation-id>8</elocation-id><history><date date-type="received"><day>7</day><month>8</month><year>2015</year></date><date date-type="accepted"><day>17</day><month>1</month><year>2016</year></date></history><permissions><copyright-statement>© Tobler-Ammann et al. 2016</copyright-statement><license license-type="OpenAccess"><license-p><bold>Open Access</bold>This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">http://creativecommons.org/publicdomain/zero/1.0/</ext-link>) applies to the data made available in this article, unless otherwise stated.</license-p></license></permissions><abstract id="Abs1"><sec><title>Background</title><p>Measuring arm and hand function of the affected side is vital in stroke rehabilitation. Therefore, the Virtual Peg Insertion Test (VPIT), an assessment combining virtual reality and haptic feedback during a goal-oriented task derived from the Nine Hole Peg Test (NHPT), was developed. This study aimed to evaluate (1) the concurrent validity of key outcome measures of the VPIT, namely the execution time and the number of dropped pegs, with the NHPT and Box and Block Test (BBT), and (2) the test-retest-reliability of these parameters together with the VPIT’s additional kinetic and kinematic parameters in patients with chronic stroke.</p><p>The three tests were administered on 31 chronic patients with stroke in one session (concurrent validity), and the VPIT was retested in a second session 3–7 days later (test-retest reliability). Spearman rank correlation coefficients (ρ) were calculated for assessing concurrent validity, and intraclass correlation coefficients (ICCs) were used to determine relative reliability. Bland-Altman plots were drawn and the smallest detectable difference (SDD) was calculated to examine absolute reliability.</p></sec><sec><title>Results</title><p>For the 31 included patients, 11 were able to perform the VPIT solely via use of their affected arm, whereas 20 patients also had to utilize support from their unaffected arm. For <italic>n</italic> = 31, the VPIT showed low correlations with the NHPT (<italic>ρ</italic> = 0.31 for <italic>time</italic> (T<sub>ex</sub>[s]); <italic>ρ</italic> = 0.21 for <italic>number of dropped pegs</italic> (N<sub>dp</sub>)) and BBT (<italic>ρ</italic> = −0.23 for <italic>number of transported cubes</italic> (N<sub>tc</sub>); <italic>ρ</italic> = −0.12 for <italic>number of dropped cubes</italic> (N<sub>dc</sub>)). The test-retest reliability for the parameters T<sub>ex</sub>[s], <italic>mean grasping force</italic> (F<sub>g</sub>go[N]), <italic>number of zero-crossings</italic> (N<sub>zc[1/s</sub>go/return) and <italic>mean collision force</italic> (F<sub>cmean</sub>[N]) were good to high, with ICCs ranging from 0.83 to 0.94. Fair reliability could be found for F<sub>g</sub>return (ICC = 0.75) and <italic>trajectory error</italic> (E<sub>traj</sub>go[cm]) (0.70). Poor reliability was measured for E<sub>traj</sub>return[cm] (0.67) and N<sub>dp</sub> (0.58). The SDDs were: T<sub>ex</sub> = 70.2 s, N<sub>dp</sub> = 0.4 pegs; F<sub>g</sub>go/return = 3.5/1.2 Newton; N<sub>zc[1/s]</sub>go/return = 0.2/1.8 zero-crossings; E<sub>traj</sub>go/return = 0.5/0.8 cm; F<sub>cmean</sub> = 0.7 Newton.</p></sec><sec><title>Conclusions</title><p>The VPIT is a promising upper limb function assessment for patients with stroke requiring other components of upper limb motor performance than the NHPT and BBT. The high intra-subject variation indicated that it is a demanding test for this stroke sample, which necessitates a thorough introduction to this assessment. Once familiar, the VPIT provides more objective and comprehensive measurements of upper limb function than conventional, non-computerized hand assessments.</p></sec></abstract><kwd-group xml:lang="en"><title>Keywords</title><kwd>Virtual Peg Insertion Test, Upper limb function, Stroke, Concurrent validity</kwd><kwd>Test-retest reliability</kwd></kwd-group><custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name><meta-value>© The Author(s) 2016</meta-value></custom-meta></custom-meta-group></article-meta></front><body><sec id="Sec1" sec-type="introduction"><title>Background</title><p>Upper limb function relies on the delicate interaction between hand and brain, defining our ability to perform activities of daily living (ADL) [<xref ref-type="bibr" rid="CR1">1</xref>]. Brain injury caused by cerebrovascular accident may result in reduced cerebral hand representation over time [<xref ref-type="bibr" rid="CR1">1</xref>]. The consequences for patients after a stroke are tremendous and ADL become challenging. However, building on brain plasticity and intensive training, hand representation in the brain can be increased again [<xref ref-type="bibr" rid="CR2">2</xref>]. Novel upper limb training modalities include the use of virtual reality (VR), robotics and computer gaming, all of which can provide ecologically valid, intensive and task specific training [<xref ref-type="bibr" rid="CR3">3</xref>]. It is essential to regularly measure motor function in order to document changes in upper limb performance during the course of rehabilitation. Such regular evaluation also informs adaptation of therapy settings, as needs arise. To date, there are several assessments measuring upper limb motor function, such as the Box and Block Test (BBT) [<xref ref-type="bibr" rid="CR4">4</xref>, <xref ref-type="bibr" rid="CR5">5</xref>] and the Nine Hole Peg Test (NHPT) [<xref ref-type="bibr" rid="CR6">6</xref>, <xref ref-type="bibr" rid="CR7">7</xref>] which measure gross and fine manual dexterity respectively. Additionally, the use of VR and robotic devices are not only an effective alternative to conventional therapy [<xref ref-type="bibr" rid="CR8">8</xref>, <xref ref-type="bibr" rid="CR9">9</xref>], but can also be used for precise and objective concurrent assessment of attributes such as motor function, cognition and ADL [<xref ref-type="bibr" rid="CR10">10</xref>–<xref ref-type="bibr" rid="CR16">16</xref>].</p><p>A promising assessment tool for measuring upper limb function is the Virtual Peg Insertion Test (VPIT), a computer-assisted assessment. The task is that of the NHPT, but since there is no precision grip required, the movement has more similarities to the BBT [<xref ref-type="bibr" rid="CR17">17</xref>]. The VPIT allows measurement of three-dimensional hand position and orientation as well as grasp force during the accomplishment of a goal-oriented task consisting of grasping, transporting and inserting nine virtual pegs into the nine holes of a virtual pegboard. This is achieved by positioning and controlling a grasping force applied to grasping a handle instrumented with force sensors mounted on a PHANTOM Omni haptic device (Geomagic, USA). The clinical practicability and measurement properties of the VPIT were tested in patients with Multiple Sclerosis (MS) [<xref ref-type="bibr" rid="CR18">18</xref>] and pilot-tested in patients with Autosomal Recessive Spastic Ataxia of Charlevoix-Saguenay (ARSACS) [<xref ref-type="bibr" rid="CR19">19</xref>]. Both patient groups were significantly less coordinated and slower than age-matched healthy subjects when evaluated using the VPIT. The preliminary results of both studies illustrate the feasibility of using the VPIT in both MS and ARSACS patients, and underline the potential of this test to evaluate upper limb motor function. To date, there is only one pilot study reporting initial evaluation of the VPIT outcome measures in a group of four chronic patients with stroke, showing significant differences in grasping force control and upper limb movement patterns compared to healthy subjects [<xref ref-type="bibr" rid="CR17">17</xref>]. However, the relation between the analyzed performance parameters during the VPIT and impaired function needs to be further established. A way to achieve this would be to evaluate the validity and reliability of the VPIT parameters for this population. As the VPIT combines the characteristics of the conventional NHPT and the BBT, one option could be to validate their mutual parameters, namely the execution time (T<sub>ex</sub>[s]) and the number of dropped pegs (N<sub>dp</sub>). As the VPIT provides in total nine different outcome measures including kinematic and kinetic parameters quantifying movement coordination, smoothness, upper limb synergies and force control, we decided to evaluate all of these for their reliability when administered twice in a test and retest procedure. Therefore, this study aimed to evaluate (1) the concurrent validity of key outcome measures of the VPIT, namely the execution time and the number of dropped pegs, with the NHPT and BBT, and (2) the test-retest reliability of these parameters together with the VPIT’s additional kinetic and kinematic parameters, in patients with chronic stroke.</p></sec><sec id="Sec2" sec-type="materials|methods"><title>Methods</title><sec id="Sec3"><title>Apparatus</title><p>In the VPIT, pegs and holes are displayed in a virtual environment and can be felt through a haptic interface. Subjects are asked to move the handle of the haptic device to grasp, displace and release the pegs (Fig. <xref rid="Fig1" ref-type="fig">1</xref>). The aim is to grasp, transport and place all pegs in the holes as fast as possible. To evaluate upper limb function during the execution of the task, the VPIT software records and computes nine specific parameters. These are (Fig. <xref rid="Fig1" ref-type="fig">1</xref>):<fig id="Fig1"><label>Fig. 1</label><caption><p>VPIT setup and upper limb function parameters. T<sub>ex</sub>[s]: execution time in seconds; N<sub>dp</sub>: number of dropped pegs during transport. Kinematic parameters: E<sub>traj</sub>[cm]go/return: trajectory error: Nzc[1/s]go/return: number of zero-crossings of the acceleration. Kinetic parameters: F<sub>g</sub>[N]go/return: mean grasping force; F<sub>cmean</sub>[N]: mean collision force</p></caption><graphic xlink:href="12984_2016_116_Fig1_HTML" id="MO1"></graphic></fig></p><p>The two primary outcome parameters evaluating the overall arm and hand functional ability of the patient are: (1) Tex[s]: time to execute the task from the approach to the first peg to the insertion of the last peg. (2) Ndp: number of times a peg is dropped during the transport. Secondary outcome parameters pertain to four kinematic and three kinetic parameters.</p><p>The four kinematic parameters are: (3–4) Etraj[cm]go/return: trajectory error measured as the distance between the actual trajectory and the ideal straightest trajectory projected on the horizontal plane. This parameter is used to evaluate movement accuracy and upper limb motor synergies during a movement requiring the simultaneous control of shoulder, elbow and hand [<xref ref-type="bibr" rid="CR20">20</xref>–<xref ref-type="bibr" rid="CR22">22</xref>]. (5–6) Nzc[1/s]go/return: the time-normalized number of zero-crossings (i.e., change of sign) of the acceleration during the gross movement from a peg to a hole, or from a hole to a peg. This parameter provides an estimate of the number of sub-movements a point-to-point movement is composed of, which is a commonly accepted measure of movement smoothness and upper limb coordination [<xref ref-type="bibr" rid="CR19">19</xref>, <xref ref-type="bibr" rid="CR23">23</xref>, <xref ref-type="bibr" rid="CR24">24</xref>].</p><p>The three kinetic parameters are: (7–8) F<sub>g</sub>[N]go/return: average grasping force calculated during the transport of one peg and for the return trajectory. This parameter evaluates factors such as force control. (9) F<sub>cmean</sub>[N]: mean collision force exerted against the virtual pegboard.</p><p>The “go” refers to the trajectory during the outbound trip when a peg is transported to the hole, and the “return” stands for the way back from the hole to approach a new peg. While performing the VPIT, the patient additionally receives visual feedback regarding the force applied on the peg being held: the cursor is yellow when no peg is held, turns orange to indicate that it is properly aligned with a peg, green when a peg is currently held and red when excessive grasping force is applied to the handle but no peg is held. Parameters are computed offline and no feedback related to the user’s performance is displayed during or after the test. For a more detailed description of the apparatus, we refer to Fluet et al. (2011) [<xref ref-type="bibr" rid="CR17">17</xref>].</p></sec><sec id="Sec4"><title>Conventional tests</title><p>The NHPT version produced by Smith & Nephew Rehabilitation, Inc.<xref ref-type="fn" rid="Fn1">1</xref> was used. It consists of a plastic board with a shallow round dish to contain the pegs on one end of the board and the nine holes in a 3x3 grid on the opposite end. Initially, the participant had to use their affected hand to grasp, one by one, the nine pegs from the dish, inserting each one into a hole until all pegs are placed. After this the participant then has to replace each of the pegs back into the dish. All of this is carried out as fast as possible [<xref ref-type="bibr" rid="CR7">7</xref>]. The test was timed, with a stopwatch, from the moment the participant touched the first peg until the moment when all pegs were removed from the holes. As the VPIT stops when all pegs are placed into the holes, we measured an intermediate time when all pegs were placed into the holes of the NHPT board. We labelled this parameter “time point 1” (TP1). All dropped pegs were counted and noted on the case report form (CRF).</p><p>The BBT consists of 50 wooden blocks (cubes of 2.54 cm on each side) placed in a wooden box that has 2 equal-sized compartments that are separated by a central wooden partition of 15.2 cm height [<xref ref-type="bibr" rid="CR5">5</xref>]. The participant was instructed to use their affected hand to move blocks, one by one, from one compartment to the other, evaluating the maximum number which could be transferred within 1 min. The transported blocks were counted during the test duration with the help of a counter clicker. All dropped blocks were noted on the CRF.</p></sec><sec id="Sec5"><title>Participants</title><p>In total, 31 patients with stroke were consecutively recruited in this study. The occupational therapy (OT) outpatient practices that are registered as specialized in neurorehabilitation in the canton of Bern, Switzerland, were contacted to recruit patients with chronic stroke. The inclusion criteria were (1) a stroke diagnosis at least 6 months before study inclusion confirmed by a physician, (2) ≥ 18 years of age, (3) ability to communicate in German language, (4) capable of sitting in a (wheel-)chair with a backrest for up to 90 min, (5) able to lift and hold the arm in 90° of elbow flexion and 45° of shoulder abduction and (6) able to grasp a wooden block of 2.54 cm on each side as used in the BBT [<xref ref-type="bibr" rid="CR25">25</xref>]. Exclusion criteria were (1) a diagnosis of a brain injury other than stroke, (2) a diagnosed neglect, aphasia or hemianopsia and, (3) non-controlled medical conditions (chronic pain, drug abuse). All included patients were screened for dementia and stereopsis and their handedness was assessed. A Mini Mental State Examination (MMSE) of at least 20 points (light dementia or better) was required to participate in the study [<xref ref-type="bibr" rid="CR26">26</xref>]. The stereopsis of each patient was evaluated with the Lang Stereotest 1 (LST), which shows three objects differing in disparity and perceived distance: a cat, a star and a car [<xref ref-type="bibr" rid="CR27">27</xref>, <xref ref-type="bibr" rid="CR28">28</xref>]. It has a high predictive value for stereo-positivity in adults [<xref ref-type="bibr" rid="CR28">28</xref>], which we assumed would be of importance in conducting the VPIT, which is represented in a 3D virtual environment on a computer screen. The study was approved by the Ethics Committee (KEK-Nr. 119/13) of the canton of Bern (Switzerland). All subjects gave their informed consent prior to study entry.</p></sec><sec id="Sec6"><title>Procedures</title><p>The measurements for the patients with stroke took place at the patients’ outpatient OT practice or in their home environment. The setting and test instructions for the BBT and NHPT corresponded to the standards set by Mathiowetz et al. (1985) [<xref ref-type="bibr" rid="CR5">5</xref>, <xref ref-type="bibr" rid="CR6">6</xref>], translated into German by Schädler et al. (2011) [<xref ref-type="bibr" rid="CR29">29</xref>]. The procedures followed for the VPIT were as described by Fluet et al. (2011) [<xref ref-type="bibr" rid="CR17">17</xref>], with the following adaptations: 1) only 3 repetitions of the test were carried out as opposed to the 5 suggested by Fluet et al. (2011); 2) The force threshold to grasp and release pegs was set to 2 Newtons. This force threshold was empirically tested in our previous work with neurological patients, where it was shown to be adequate for most participants with mild to moderate hand impairment to perform the task [<xref ref-type="bibr" rid="CR18">18</xref>, <xref ref-type="bibr" rid="CR19">19</xref>]; and 3) participants who needed assistance for the affected arm to perform the test were allowed to do so. The third adaptation was not initially planned, but proved necessary to implement after we observed major difficulties in performing the VPIT during the test trial in some participants (e.g., cursor alignment or regulation of the grasping force while holding the handle not precise enough). The participants were requested to first perform the BBT and the NHPT as per protocol. In some we noticed that participants needed support for the VPIT while the 2 clinical tests were already completed. It was too much due to fatigue to repeat them. The validity of this adaptation was addressed by a later subgroup analysis (see results section).</p><p>To minimize the effect of the required adaptation to a novel tool (VPIT), we gave patients a test trial prior to the measurements (on both days), where they were given all the time they needed to explore the virtual environment and get familiar to the functioning of the test. According to our previous work, this proved to be sufficient for patients to understand the task and the use of the VPIT.</p><p>All participants were tested twice with a 3–7 day interval between assessments. This time interval (mean 6.4 ± 0.5 days) was defined to minimize any learning effect that may occur from repeating the tests within a short time frame. During the first assessment session, demographic data were collected and the MMSE, FLANDERS and LST were carried out. Then, motor tests were performed in the following order of (1) BBT, (2) NHPT and (3) VPIT. For each test, one test trial (not timed) was allowed, which was then followed by three repetitions of the test. If needed, participants could have a rest between the motor test performances. All tests were done with the affected arm only where possible, with participants being allowed to use both hands for the VPIT as necessary. Therefore, depending on the result of the VPIT test trial (support of the affected arm needed/not needed), the following three repetitions of the VPIT were all performed accordingly. The second assessment session was composed of the test trial followed by three repetitions of the VPIT.</p></sec><sec id="Sec7"><title>Data analysis</title><p>SPSS version 22.0 (SPSS Inc, Chicago, Illinois) was used for data analysis. The study population and clinical characteristics were defined adopting descriptive statistics. The average of the 3 trials of each test was calculated and used for data analysis, as test-retest reliability is highest in all tests when the mean of three trials is used; lower correlations are known to occur when one trial or the highest score of three trials are utilized [<xref ref-type="bibr" rid="CR30">30</xref>]. Normality of data was evaluated using the Shapiro Wilk test [<xref ref-type="bibr" rid="CR31">31</xref>]. The level of statistical significance was set to <italic>p</italic> ≤ 0.05.</p><sec id="Sec8"><title>Validity</title><p>Concurrent validity was assessed by determining Spearman’s rank correlation coefficient (ρ) for the relationship between the VPIT/BBT and the VPIT/NHPT, respectively [<xref ref-type="bibr" rid="CR31">31</xref>], namely for the parameters measuring a similar construct in both tests: (1) mean time in seconds (T<sub>ex</sub>[s]VPIT / T<sub>ex</sub>[s]NHPT), (2) mean number of dropped pegs (N<sub>dp</sub>VPIT / N<sub>dp</sub>NHPT), (3) mean number of dropped pegs/cubes (N<sub>dp</sub>VPIT / N<sub>dc</sub>BBT) and (4) mean number of transported cubes (T<sub>ex</sub>[s]VPIT / N<sub>tc</sub>BBT). The following correlation classification was used: no or very low: <italic>ρ</italic> = 0–0.25; low: <italic>ρ</italic> = 0.26–0.40; moderate: <italic>ρ</italic> = 0.41–0.69; high: <italic>ρ</italic> = 0.70–0.89; very high: <italic>ρ</italic> = 0.90–1.0 [<xref ref-type="bibr" rid="CR32">32</xref>]. To measure the correlation between the mean number of dropped pegs/cubes during the VPIT/NHPT and VPIT/BBT, Cohen’s kappa was computed using GraphPad software (<ext-link ext-link-type="uri" xlink:href="http://www.graphpad.com/quickcalcs">www.graphpad.com/quickcalcs</ext-link>) [<xref ref-type="bibr" rid="CR33">33</xref>]. We hypothesized that (1) the correlations between T<sub>ex</sub>[s]VPIT / T<sub>ex</sub>[s]NHPT and T<sub>ex</sub>[s]VPIT / N<sub>tc</sub>BBT would be high for chronic patients with stroke (0.70–0.89). We further hypothesized that (2) the correlations between the number of pegs dropped during the VPIT and the number of pegs/cubes dropped during the conventional NHPT and BBT for chronic patients with stroke would be moderate (0.41–0.69).</p></sec><sec id="Sec9"><title>Reliability</title><p><italic>Relative reliability</italic> was determined by calculating intraclass correlation coefficients (ICCs) separately for average measures. In particular, we used the ICC 2 (A,k) formula (two-way mixed effects model where people effects are random and measures effects are fixed; k because the average of the three tests was used) [<xref ref-type="bibr" rid="CR34">34</xref>, <xref ref-type="bibr" rid="CR35">35</xref>]. We selected the option “absolute agreement” in order to take into account the systematic error between raters, as there were two raters (BCT and JH) involved in data collection [<xref ref-type="bibr" rid="CR36">36</xref>]. In this study, the same rater performed the test and the re-test procedure with a single participant. Furthermore, intensive pilot-testing was performed prior to data collection by both raters. The following classification was used: 0.90–0.99, high reliability; 0.80–0.89, good reliability; 0.70–0.79, fair reliability; 0.69 or below, poor reliability [<xref ref-type="bibr" rid="CR37">37</xref>, <xref ref-type="bibr" rid="CR38">38</xref>]. We anticipated that the relative reliability of the 9 parameters measured with the VPIT would be good (ICC ≥ 0.80) [<xref ref-type="bibr" rid="CR37">37</xref>].</p><p>To calculate <italic>absolute reliability</italic>, the ICCs were complemented by the Bland-Altman analysis, which can be used to show variation (or the magnitude of difference) of repeated measurements [<xref ref-type="bibr" rid="CR39">39</xref>, <xref ref-type="bibr" rid="CR40">40</xref>]. The plots show the difference between test sessions 2 and 1 against the mean of the two test sessions for each subject [<xref ref-type="bibr" rid="CR41">41</xref>, <xref ref-type="bibr" rid="CR42">42</xref>]. A free sample of the MedCalc statistical software version 14.8.1 (<ext-link ext-link-type="uri" xlink:href="http://www.medcalc.org/">www.medcalc.org</ext-link>) was used to draw the Bland-Altman plots. The degree of heteroscedasticity was measured by calculating Kendall’s tau correlation (Τ) between the absolute differences and the corresponding means of each VPIT parameter. When a positive Τ > 0.1 was found, the data were considered heteroscedastic. When Τ < 0.1 or negative, the data were considered homoscedastic [<xref ref-type="bibr" rid="CR43">43</xref>]. The data were logarithmically or square root transformed when heteroscedasticity was found [<xref ref-type="bibr" rid="CR44">44</xref>, <xref ref-type="bibr" rid="CR45">45</xref>]. Thereafter, we calculated Kendall’s tau again; if Τ<sub>trans</sub> decreased - indicating a more homoscedastic distribution of the data - reliability was analyzed using the transformed parameters [<xref ref-type="bibr" rid="CR43">43</xref>].</p><p>To quantify the precision of individual scores on a test, we calculated the Standard Error of Measurement (SEM), using the formula <inline-formula id="IEq1"><alternatives><tex-math id="M1">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$ \mathrm{S}\mathrm{E}\mathrm{M}=\upsigma \sqrt{\left(1-\mathrm{I}\mathrm{C}\mathrm{C}\right)} $$\end{document}</tex-math><mml:math id="M2"><mml:mi mathvariant="normal">S</mml:mi><mml:mi mathvariant="normal">E</mml:mi><mml:mi mathvariant="normal">M</mml:mi><mml:mo>=</mml:mo><mml:mi mathvariant="normal">σ</mml:mi><mml:msqrt><mml:mfenced close=")" open="("><mml:mrow><mml:mn>1</mml:mn><mml:mo>−</mml:mo><mml:mi mathvariant="normal">I</mml:mi><mml:mi mathvariant="normal">C</mml:mi><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:mfenced></mml:msqrt></mml:math><inline-graphic xlink:href="12984_2016_116_Article_IEq1.gif"></inline-graphic></alternatives></inline-formula>, with σ being the total variance of the scores from all subjects [<xref ref-type="bibr" rid="CR34">34</xref>, <xref ref-type="bibr" rid="CR36">36</xref>]. We then calculated the Smallest Detectable Difference (SDD) based on the SEM, as follows: <inline-formula id="IEq2"><alternatives><tex-math id="M3">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$ \mathrm{S}\mathrm{D}\mathrm{D}=\mathrm{S}\mathrm{E}\mathrm{M}*1.96*\sqrt{2} $$\end{document}</tex-math><mml:math id="M4"><mml:mi mathvariant="normal">S</mml:mi><mml:mi mathvariant="normal">D</mml:mi><mml:mi mathvariant="normal">D</mml:mi><mml:mo>=</mml:mo><mml:mi mathvariant="normal">S</mml:mi><mml:mi mathvariant="normal">E</mml:mi><mml:mi mathvariant="normal">M</mml:mi><mml:mo>*</mml:mo><mml:mn>1.96</mml:mn><mml:mo>*</mml:mo><mml:msqrt><mml:mn>2</mml:mn></mml:msqrt></mml:math><inline-graphic xlink:href="12984_2016_116_Article_IEq2.gif"></inline-graphic></alternatives></inline-formula>. As a last step we calculated: <inline-formula id="IEq3"><alternatives><tex-math id="M5">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$ \mathrm{S}\mathrm{D}\mathrm{D}\%=\frac{\mathrm{SDD}}{\mathrm{grand}\ \mathrm{mean}}*100 $$\end{document}</tex-math><mml:math id="M6"><mml:mi mathvariant="normal">S</mml:mi><mml:mi mathvariant="normal">D</mml:mi><mml:mi mathvariant="normal">D</mml:mi><mml:mo>%</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi mathvariant="normal">S</mml:mi><mml:mi mathvariant="normal">D</mml:mi><mml:mi mathvariant="normal">D</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="normal">grand</mml:mi><mml:mspace width="0.25em"></mml:mspace><mml:mi mathvariant="normal">mean</mml:mi></mml:mrow></mml:mfrac><mml:mo>*</mml:mo><mml:mn>100</mml:mn></mml:math><inline-graphic xlink:href="12984_2016_116_Article_IEq3.gif"></inline-graphic></alternatives></inline-formula>. The grand mean is the mean of the means of each VPIT parameter. As agreement parameters (SDDs) are expressed on the actual scale of the assessments, they allow clinical interpretation of the results [<xref ref-type="bibr" rid="CR34">34</xref>, <xref ref-type="bibr" rid="CR36">36</xref>]. Furthermore, the SDD% can be used to compare test-retest reliability among tests [<xref ref-type="bibr" rid="CR25">25</xref>]. We hypothesized that the SDD% is ≤ 54 % of the mean average values of the VPIT, as Chen et al. (2009) found an SDD% of 54 % for the affected hand using the NHPT in patients with stroke [<xref ref-type="bibr" rid="CR25">25</xref>].</p></sec></sec></sec><sec id="Sec10" sec-type="results"><title>Results</title><p>The demographic and clinical characteristics of the participants are summarized in Table <xref rid="Tab1" ref-type="table">1</xref> and the results of the achieved scores (BBT, NHPT, VPIT) in Table <xref rid="Tab2" ref-type="table">2</xref>. From the 33 chronic patients with stroke initially recruited, two participants dropped out: one only completed 2 of the 3 required VPIT test trials due to poor physical health, whereas the second could not perform the VPIT task with the affected hand. In 26 participants (83.9 %), stroke had occurred for the first time, while 5 (16.1 %, 4 men and 1 woman) had suffered at least two stroke events. Although all participants fulfilled the inclusion criteria, 11 patients were able to perform all motor tests solely with the affected arm, whereas 20 patients also required support from the non-affected arm to perform the VPIT, as they possibly were fatigued by the duration of the tests. This support was needed to increase stability of the affected arm and therefore motor control of the affected hand. To account for these differences in test performance (with and without support), we decided to additionally conduct a subgroup analysis, subgroup 1 (<italic>n</italic> = 11) being without support of the non-affected arm and subgroup 2 (<italic>n</italic> = 20): being those who required support. Shapiro Wilk testing indicated too much difference within the validity and test-retest reliability data to be normally distributed.<table-wrap id="Tab1"><label>Table 1</label><caption><p>Demographics and clinical characteristics of participants (<italic>n</italic> = 31)</p></caption><table frame="hsides" rules="groups"><thead><tr><th>Characteristic</th><th>Value</th></tr></thead><tbody><tr><td colspan="2">Sex, <italic>n</italic> (%)</td></tr><tr><td> female</td><td>8 (25.8)</td></tr><tr><td> male</td><td>23 (74.2)</td></tr><tr><td colspan="2">Age, in years</td></tr><tr><td> mean ± SD</td><td>62.7 ± 15.1</td></tr><tr><td colspan="2">Time onset stroke, in months</td></tr><tr><td> mean ± SD</td><td>51.1 ± 82.0</td></tr><tr><td colspan="2">Affected hand, <italic>n</italic> (%)</td></tr><tr><td> right</td><td>17 (54.8)</td></tr><tr><td> left</td><td>14 (45.2)</td></tr><tr><td>Learned left-handedness due to stroke, <italic>n</italic> (%)</td><td>7 (22.6)</td></tr><tr><td>Affected hand = dominant hand, <italic>n</italic> (%)</td><td>18 (58.1)</td></tr><tr><td colspan="2">LST, recognized images, <italic>n</italic> (%)</td></tr><tr><td> 3 (out of 3)</td><td>5 (16.1)</td></tr><tr><td> 2 (out of 3)</td><td>12 (38.7)</td></tr><tr><td> 1 (out of 3)</td><td>11 (35.5)</td></tr><tr><td> 0 (out of 3)</td><td>3 (9.7)</td></tr><tr><td colspan="2">MMSE</td></tr><tr><td> mean ± SD</td><td>27.5 ± 2.4</td></tr></tbody></table><table-wrap-foot><p><italic>LST</italic> Lang Stereotest 1, <italic>MMSE</italic> Mini Mental Status Examination, <italic>n</italic> number, <italic>SD</italic> Standard Deviation</p></table-wrap-foot></table-wrap><table-wrap id="Tab2"><label>Table 2</label><caption><p>Achieved scores of the VPIT, NHPT and BBT</p></caption><table frame="hsides" rules="groups"><thead><tr><th>Parameters</th><th colspan="3">Mean ± SD of achieved scores</th></tr><tr><th>mean of 3 trials</th><th>All patients (<italic>n</italic> = 31)</th><th>Subgroup 1: without support (<italic>n</italic> = 11)</th><th>Subgroup 2: with support (<italic>n</italic> = 20)</th></tr></thead><tbody><tr><td>T<sub>ex</sub> [s] VPIT</td><td>119.7 ± 72.1</td><td>113.1 ± 64.5</td><td>123.3 ± 77.2</td></tr><tr><td>T<sub>ex</sub> [s] NHPT</td><td>54.4 ± 28.9</td><td>32.2 ± 15.3</td><td>66.7 ± 27.5</td></tr><tr><td>T<sub>ex</sub> [s] NHPT<sub>(TP1)</sub></td><td>39.4 ± 20.5</td><td>22.5 ± 10.5</td><td>48.6 ± 18.7</td></tr><tr><td>N<sub>tc</sub> BBT</td><td>35.8 ± 17.4</td><td>51.4 ± 13.8</td><td>27.2 ± 12.6</td></tr><tr><td>N<sub>dp</sub> VPIT</td><td>0.5 ± 1.1</td><td>0.1 ± 0.2</td><td>0.8 ± 1.3</td></tr><tr><td>N<sub>dp</sub> NHPT</td><td>0.8 ± 0.9</td><td>0.4 ± 0.4</td><td>1.0 ± 1.0</td></tr><tr><td>N<sub>dc</sub> BBT</td><td>0.7 ± 0.9</td><td>0.7 ± 0.8</td><td>0.7 ± 0.9</td></tr></tbody></table><table-wrap-foot><p><italic>T</italic><sub><italic>ex</italic></sub><italic>[s]</italic> execution time in seconds, <italic>VPIT</italic> Virtual Peg Insertion Test, <italic>NHPT</italic> Nine Hole Peg Test, <italic>TP1</italic> time point 1 (time stopped at the point when all 9 pegs were put in the 9 holes (without replacing them in the dish)), <italic>BBT</italic> Box and Block Test, <italic>N</italic><sub><italic>tc</italic></sub> number of transported cubes, <italic>N</italic><sub><italic>dp</italic></sub> number of dropped pegs, <italic>N</italic><sub><italic>dc</italic></sub> number of dropped cubes, <italic>SD</italic> Standard Deviation</p></table-wrap-foot></table-wrap></p><sec id="Sec11"><title>Concurrent validity</title><p>The results of the concurrent validity calculations (ranges) are presented in Table <xref rid="Tab3" ref-type="table">3</xref>. The correlations between the VPIT and BBT/NHPT were low (<italic>ρ</italic> = −0.23–0.31) and non-significant (<italic>p</italic> = 0.09–0.51) in all parameters. The correlations between the VPIT and BBT/NHPT for subgroup 1 were moderate (<italic>ρ</italic> = −0.41–0.61) and non-significant (<italic>p</italic> = 0.07–0.60). The correlations between the VPIT and BBT/NHPT for subgroup 2 were low (<italic>ρ</italic> = −0.21–0.35) and non-significant (<italic>p</italic> = 0.13–0.51). The strength of agreement for N<sub>dp</sub>VPIT / N<sub>dp</sub>NHPT and no (zero) dropped pegs in the VPIT and NHPT was considered to be poor (Kappa = 0.041; SE of kappa = 0.176; 95 % CI = −0.30–0.39) with 16 (51.6 %) observed agreements. Accordingly, the kappa agreement for the N<sub>dp</sub>VPIT / N<sub>dc</sub>BBT and no (zero) dropped pegs/cubes during those tests was poor (Kappa = 0.189; SE of kappa = 0.157; 95 % CI = −0.12–0.50) with 18 (58.1 %) observed agreements.<table-wrap id="Tab3"><label>Table 3</label><caption><p>Concurrent validity of the VPIT with the NHPT and the BBT</p></caption><table frame="hsides" rules="groups"><thead><tr><th>Concurrent validity parameters</th><th colspan="3">Spearman’s rank correlation coefficient</th></tr><tr><th>mean of 3 trials</th><th>All patients</th><th>Subgroup 1: without support</th><th>Subgroup 2: with support</th></tr><tr><th></th><th>(<italic>n</italic> = 31)</th><th>(<italic>n</italic> = 11)</th><th>(<italic>n</italic> = 20)</th></tr></thead><tbody><tr><td>T<sub>ex</sub> [s] VPIT /</td><td>0.31</td><td>0.57</td><td>0.35</td></tr><tr><td>T<sub>ex</sub> [s] NHPT</td><td>0.09*</td><td>0.07*</td><td>0.13*</td></tr><tr><td>T<sub>ex</sub> [s] VPIT /</td><td>0.30</td><td>0.61</td><td>0.32</td></tr><tr><td>T<sub>ex</sub> [s] NHPT<sub>(TP1)</sub></td><td>0.10*</td><td>0.47*</td><td>0.16*</td></tr><tr><td>T<sub>ex</sub> [s] VPIT /</td><td>−0.23</td><td>−0.41</td><td>−0.21</td></tr><tr><td>N<sub>tc</sub> BBT</td><td>0.22*</td><td>0.22*</td><td>0.37*</td></tr><tr><td>N<sub>dp</sub> VPIT /</td><td>0.21</td><td>−0.18</td><td>0.17</td></tr><tr><td>N<sub>dp</sub> NHPT</td><td>0.26*</td><td>0.60*</td><td>0.49*</td></tr><tr><td>N<sub>dp</sub> VPIT /</td><td>−0.12</td><td>−0.18</td><td>−0.16</td></tr><tr><td>N<sub>dc</sub> BBT</td><td>0.51*</td><td>0.60*</td><td>0.51*</td></tr></tbody></table><table-wrap-foot><p>*<italic>p</italic>-values: level of significance: <italic>p</italic> ≤ 0.05</p><p><italic>T</italic><sub><italic>ex</italic></sub><italic>[s]</italic> execution time in seconds, <italic>VPIT</italic> Virtual Peg Insertion Test, <italic>NHPT</italic> Nine Hole Peg Test, <italic>TP1</italic> time point 1 (time stopped at the point when all 9 pegs were put in the 9 holes (without replacing them in the dish)), <italic>BBT</italic> Box and Block Test, <italic>N</italic><sub><italic>tc</italic></sub> number of transported cubes, <italic>N</italic><sub><italic>dp</italic></sub> number of dropped pegs, <italic>N</italic><sub><italic>dc</italic></sub> number of dropped cubes, <italic>SD</italic> Standard Deviation</p></table-wrap-foot></table-wrap></p></sec><sec id="Sec12"><title>Test-retest reliability</title><p>The 9 test-retest reliability parameters of the VPIT are presented in Table <xref rid="Tab4" ref-type="table">4</xref> for the whole study population and in Table <xref rid="Tab5" ref-type="table">5</xref> (subgroup 1) and 6 (subgroup 2) for the subgroups. All VPIT parameters are illustrated in Fig. <xref rid="Fig2" ref-type="fig">2</xref> by Bland-Altman plots. For the whole stroke sample, the correlations for the 5 parameters T<sub>ex</sub>[s], F<sub>g</sub>go[N], Nzc[1/s]go/return and F<sub>cmean</sub>[N] were good to high (ICCs = 0.83–0.94, SEMs = 0.07–0.63, except for the T<sub>ex</sub>[s] with SEM = 25.34). Fair reliability was found for the parameters F<sub>g</sub>return (ICC = 0.75, SEM = 0.43) and E<sub>traj</sub>go[cm] (ICC = 0.70, SEM = 0.19). Poor reliability was measured for E<sub>traj</sub>return[cm] (ICC = 0.67, SEM = 0.29) and N<sub>dp</sub> (ICC = 0.58, SEM = 0.14). The SDD were ≤ 54 % in all VPIT parameters (SDD% = 1.37–21.42) except for T<sub>ex</sub>[s] with SDD% = 434.5 %.<table-wrap id="Tab4"><label>Table 4</label><caption><p>Test-retest reliability parameters of the whole stroke sample (<italic>n</italic> = 31)</p></caption><table frame="hsides" rules="groups"><thead><tr><th rowspan="2">VPIT parameters</th><th>Test</th><th>Retest</th><th>Test-Retest</th><th rowspan="2">Kendall’s tau correlation</th><th rowspan="2">Kendall’s tau correlation with transformed data</th><th rowspan="2">ICC (95 % CI)</th><th rowspan="2">SEM agreement</th><th rowspan="2">SDD</th><th rowspan="2">SDD%</th></tr><tr><th>Mean ± SD</th><th>Mean ± SD</th><th>Mean difference ± SD</th></tr></thead><tbody><tr><td>T<sub>ex</sub> [s]</td><td char="±" align="char">119.71 ± 72.05</td><td char="±" align="char">98.71 ± 50.77</td><td>21.01 ± 45.25</td><td>0.01</td><td>-</td><td>0.83 (0.61–0.92)</td><td char="." align="char">25.34</td><td char="." align="char">70.18</td><td char="." align="char">434.50</td></tr><tr><td rowspan="2">N<sub>dp</sub></td><td char="±" align="char">0.54 ± 1.06</td><td char="±" align="char">0.83 ± 1.59</td><td rowspan="2">−0.29 ± 1.55</td><td rowspan="2">0.16<sup>a</sup></td><td rowspan="2">0.12<sup>b,c</sup></td><td>0.51 (−0.01–0.76)</td><td char="." align="char">0.95</td><td char="." align="char">2.62</td><td char="." align="char">16.22</td></tr><tr><td char="±" align="char">0.13 ± 0.19<sup>c</sup></td><td char="±" align="char">0.18 ± 0.23<sup>c</sup></td><td>0.58 (0.13–0.79)<sup>c</sup></td><td char="." align="char">0.14<sup>c</sup></td><td char="." align="char">0.38<sup>c</sup></td><td char="." align="char">2.64<sup>c</sup></td></tr><tr><td>F<sub>g</sub> go [N]</td><td char="±" align="char">8.98 ± 5.15</td><td char="±" align="char">8.54 ± 4.96</td><td>0.44 ± 2.43</td><td>0.10</td><td>-</td><td>0.94 (0.87–0.97)</td><td char="." align="char">0.14</td><td char="." align="char">3.46</td><td char="." align="char">21.42</td></tr><tr><td>F<sub>g</sub> return [N]</td><td char="±" align="char">1.66 ± 0.83</td><td char="±" align="char">1.60 ± 0.91</td><td>0.06 ± 0.80</td><td>0.08</td><td>-</td><td>0.75 (0.47–0.88)</td><td char="." align="char">0.43</td><td char="." align="char">1.18</td><td char="." align="char">7.31</td></tr><tr><td rowspan="2">N<sub>zc [1/S]</sub> go</td><td char="±" align="char">11.09 ± 1.52</td><td char="±" align="char">10.80 ± 1.70</td><td rowspan="2">0.28 ± 0.89</td><td rowspan="2">0.21<sup>a</sup></td><td rowspan="2">0.20<sup>b,d</sup></td><td>0.91 (0.82–0.96)</td><td char="." align="char">0.48</td><td char="." align="char">1.33</td><td char="." align="char">8.23</td></tr><tr><td char="." align="char">3.32 ± 0.23<sup>d</sup></td><td char="." align="char">3.28 ± 0.26<sup>d</sup></td><td char="." align="char">0.92 (0.82–0.96)<sup>d</sup></td><td char="." align="char">0.07<sup>d</sup></td><td char="." align="char">0.20<sup>d</sup></td><td char="." align="char">1.37<sup>d</sup></td></tr><tr><td>N<sub>zc [1/s]</sub> return</td><td char="±" align="char">11.36 ± 1.69</td><td char="±" align="char">10.88 ± 1.76</td><td>0.48 ± 1.09</td><td>0.14<sup>a</sup></td><td>0.20<sup>c</sup></td><td>0.87 (0.71–0.94)</td><td char="." align="char">0.63</td><td char="." align="char">1.75</td><td char="." align="char">10.84</td></tr><tr><td>E<sub>traj</sub> go [cm]</td><td char="±" align="char">0.74 ± 0.38</td><td char="±" align="char">0.67 ± 0.29</td><td>0.07 ± 0.32</td><td>0.03</td><td>-</td><td>0.70 (0.39–0.85)</td><td char="." align="char">0.19</td><td char="." align="char">0.53</td><td char="." align="char">3.28</td></tr><tr><td>E<sub>traj</sub> return [cm]</td><td char="±" align="char">0.99 ± 0.40</td><td char="±" align="char">1.00 ± 0.56</td><td>0.01 ± 0.49</td><td>0.18<sup>a</sup></td><td>0.20<sup>c</sup></td><td>0.67 (0.30–0.84)</td><td char="." align="char">0.29</td><td char="." align="char">0.80</td><td char="." align="char">4.95</td></tr><tr><td>F<sub>cmean</sub> [N]</td><td char="±" align="char">1.32 ± 1.03</td><td char="±" align="char">1.29 ± 0.95</td><td>0.02 ± 0.51</td><td>0.06</td><td>-</td><td>0.93 (0.86–0.97)</td><td char="." align="char">0.26</td><td char="." align="char">0.73</td><td char="." align="char">4.52</td></tr></tbody></table><table-wrap-foot><p><sup>a</sup>Τ > 0.1, T<sub>trans</sub> decreased<sup>b</sup>, <sup>c</sup> = log10 transformed, <sup>d</sup> = square root transformed</p><p><italic>T</italic><sub><italic>ex</italic></sub><italic>[s]</italic> execution time in seconds, <italic>N</italic><sub><italic>dp</italic></sub> number of dropped pegs during transport, <italic>F</italic><sub><italic>g</italic></sub><italic>(go/return) [N]</italic> mean grasping force of the three force sensors integrated into the handle in Newton, <italic>Nzc[1/s](go/return)</italic> number of zero-crossings of the acceleration, <italic>E</italic><sub><italic>traj</italic></sub><italic>[cm]</italic> trajectory error, <italic>F</italic><sub><italic>cmean</italic></sub> mean collision force, <italic>SD</italic> Standard Deviation, <italic>ICC</italic> Intraclass Correlation Coefficient, <italic>CI</italic> Confidence Interval, <italic>SEM</italic> Standard Error of Measurement, <italic>SDD</italic> Smallest Detectable Difference</p></table-wrap-foot></table-wrap><table-wrap id="Tab5"><label>Table 5</label><caption><p>Test-retest reliability parameters for subgroup 1 (<italic>n</italic> = 11) without support of the non-affected arm</p></caption><table frame="hsides" rules="groups"><thead><tr><th></th><th colspan="9">Subgroup 1 (<italic>n</italic> = 11) VPIT test performance without support</th></tr><tr><th>VPIT parameters</th><th>Test Mean ± SD</th><th>Retest Mean ± SD</th><th>Test-Retest Mean difference ± SD</th><th>Kendall’s tau correlation</th><th>Kendall’s tau correlation with transformed data</th><th>ICC (95 % CI)</th><th>SEM agreement</th><th>SDD</th><th>SDD%</th></tr></thead><tbody><tr><td>T<sub>ex</sub> [s]</td><td>113.14 ± 64.54</td><td>83.56 ± 27.26</td><td>29.57 ± 61.17</td><td>.19<sup>a</sup></td><td>0.31<sup>c</sup></td><td>0.35 (−0.90–0.81)</td><td>37.01</td><td>102.50</td><td>682.87</td></tr><tr><td>N<sub>dp</sub></td><td>0.12 ± 0.23</td><td>0.12 ± 0.23</td><td>0.0 ± 0.34</td><td>0.0</td><td>-</td><td>0.25 (−6.04–0.69)</td><td>0.20</td><td>0.55</td><td>3.66</td></tr><tr><td>F<sub>g</sub> go [N]</td><td>10.49 ± 4.84</td><td>10.13 ± 4.09</td><td>0.36 ± 3.4</td><td>0.20<sup>a</sup></td><td>0.24<sup>c</sup></td><td>0.84 (0.40–0.96)</td><td>1.79</td><td>4.95</td><td>32.97</td></tr><tr><td>F<sub>g</sub> return [N]</td><td>1.74 ± 0.92</td><td>1.55 ± 1.22</td><td>0.19 ± 0.93</td><td>0.13<sup>a</sup></td><td>0.13<sup>d</sup></td><td>0.78 (0.18–0.94)</td><td>0.50</td><td>1.39</td><td>9.26</td></tr><tr><td>N<sub>zc [1/s]</sub> go</td><td>11.18 ± 1.79</td><td>10.79 ± 1.97</td><td>0.39 ± 1.21</td><td>0.06</td><td>-</td><td>0.89 (0.60–0.97)</td><td>0.62</td><td>1.73</td><td>11.53</td></tr><tr><td>N<sub>zc [1/s]</sub> return</td><td>11.72 ± 1.91</td><td>10.80 ± 1.83</td><td>0.92 ± 1.29</td><td>0.09</td><td>-</td><td>0.82 (0.28–0.95)</td><td>0.79</td><td>2.20</td><td>14.66</td></tr><tr><td rowspan="2">E<sub>traj</sub> go [cm]</td><td>0.56 ± 0.27</td><td>0.47 ± 0.15</td><td>0.09 ± 0.20</td><td rowspan="2">0.16<sup>a</sup></td><td rowspan="2">0.10<sup>b,c</sup></td><td>0.70 (0.00–0.92)</td><td>0.12</td><td>0.32</td><td>2.13</td></tr><tr><td>0.29 ± 0.18<sup>c</sup></td><td>0.35 ± 0.15<sup>c</sup></td><td>0.06 ± 0.11<sup>c</sup></td><td>0.83 (0.38–0.95)<sup>c</sup></td><td>0.07<sup>c</sup></td><td>0.19<sup>c</sup></td><td>1.27<sup>c</sup></td></tr><tr><td>E<sub>traj</sub> return [cm]</td><td>0.79 ± 0.28</td><td>0.75 ± 0.35</td><td>0.04 ± 0.42</td><td>0.06</td><td>-</td><td>0.18 (−2.80–0.80)</td><td>0.29</td><td>0.79</td><td>5.26</td></tr><tr><td>F<sub>cmean</sub> [N]</td><td>1.08 ± 0.72</td><td>1.18 ± 0.66</td><td>−0.10 ± 0.52</td><td>0.02</td><td>-</td><td>0.84 (0.41–0.96)</td><td>0.28</td><td>0.77</td><td>5.13</td></tr></tbody></table><table-wrap-foot><p><sup>a</sup>Τ > 0.1, T<sub>trans</sub> decreased<sup>b</sup>, <sup>c</sup> = log10 transformed, <sup>d</sup> = square root transformed</p><p><italic>T</italic><sub><italic>ex</italic></sub><italic>[s]</italic> execution time in seconds, <italic>N</italic><sub><italic>dp</italic></sub> number of dropped pegs during transport, <italic>F</italic><sub><italic>g</italic></sub><italic>(go/return) [N]</italic> mean grasping force of the three force sensors integrated into the handle in Newton, <italic>N</italic><sub><italic>zc [1/s]</italic></sub><italic>(go/return)</italic> number of zero-crossings of the acceleration, <italic>E</italic><sub><italic>traj</italic></sub><italic>[cm]</italic>: trajectory error, <italic>F</italic><sub><italic>cmean [N]</italic></sub> mean collision force, <italic>SD</italic> Standard Deviation, <italic>ICC</italic> Intraclass Correlation Coefficient, <italic>CI</italic> Confidence Interval, <italic>SEM</italic> Standard Error of Measurement, <italic>SDD</italic> Smallest Detectable Difference</p></table-wrap-foot></table-wrap><fig id="Fig2"><label>Fig. 2</label><caption><p>Bland-Altman plots of the 9 VPIT parameters. Plotted differences of (<bold>a</bold>) T<sub>ex</sub>[s]: execution time in seconds, (<bold>b</bold>) N<sub>dp</sub>: number of dropped pegs during transport, (<bold>c</bold>) F<sub>g</sub>go[N]: mean grasping force, (<bold>d</bold>) F<sub>g</sub>return[N]: mean grasping force, (<bold>e</bold>) Nzc[1/s]go/return: number of zero-crossings of the acceleration, (<bold>f</bold>) Nzc[1/s]go/return: number of zero-crossings of the acceleration, (<bold>g</bold>) E<sub>traj</sub>go[cm]: trajectory error, (<bold>h</bold>) E<sub>traj</sub>return[cm]: trajectory error, (<bold>i</bold>) F<sub>cmean</sub>[N]: mean collision force. ○ Represents subgroup 1 (<italic>n</italic> = 11); (orange square) Represents subgroup 2 (<italic>n</italic> = 20) (red broken line) Lines for 95 % CI of limits of agreement, (green broken line) Lines for 95 % CI of mean of differences</p></caption><graphic xlink:href="12984_2016_116_Fig2_HTML" id="MO2"></graphic></fig></p><p>The subgroup analysis of subgroup 1 (<italic>n</italic> = 11) showed good ICCs for the 5 VPIT parameters F<sub>g</sub>go[N], Nzc[1/s]go/return, E<sub>traj</sub>go and F<sub>cmean</sub> (ICCs = 0.82–0.89, SEMs = 0.07–1.79). Fair reliability was found in the parameter F<sub>g</sub>return[N] (ICC = 0.78, SEM = 0.50), while T<sub>ex</sub>[s], N<sub>dp</sub> and E<sub>traj</sub>return[cm] showed poor reliability (ICCs = 0.18–0.35 with SEMs = 0.20–37.01). All VPIT parameters showed SDD of ≤ 54 % (SDD% = 1.27–32.97) except for T<sub>ex</sub>[s] with SDD% = 682.87 %.</p><p>Subgroup 2 (<italic>n</italic> = 20) showed high ICCs in 5 out of 9 VPIT parameters (T<sub>ex</sub>[s], F<sub>g</sub>go[N], Nzc[1/s]go/return and F<sub>cmean</sub>[N] with ICCs = 0.92–0.97, SEMs = 0.02–19.25). Fair reliability was found in F<sub>g</sub>return[N] (ICC = 0.73, SEM = 0.40). The remaining 3 parameters (N<sub>dp</sub> and E<sub>traj</sub>go/return[cm]) showed poor reliability (ICCs = 0.49–0.69, SEMs = 0.10–0.22). Within subgroup 2, all VPIT parameters showed SDD% values of ≤ 54 % (SDD% = 0.26–15.08 %) except for T<sub>ex</sub>[s] with SDD% = 317.76 %.</p></sec></sec><sec id="Sec13" sec-type="discussion"><title>Discussion</title><p>This is the first study evaluating the test-retest reliability of the novel VPIT and its concurrent validity with conventional upper limb function tests in chronic patients with stroke. In this stroke sample (<italic>n</italic> = 31), the VPIT presented seven out of nine (78 %) reliable parameters that passed the accepted minimal standards for group comparisons (ICC ≥ 0.70) with ICCs = 0.70–0.94 [<xref ref-type="bibr" rid="CR46">46</xref>]. The SDD% values were small in all VPIT parameters (1.37–21.42 %) except for T<sub>ex</sub>[s] (SDD% = 434.5 %). The correlations of the execution time and the number of dropped pegs/cubes of the VPIT with the NHPT and the BBT, respectively, were (ρ = −0.23–0.31), although non-significant (<italic>p</italic> = 0.09–0.51).</p><sec id="Sec14"><title>Concurrent validity</title><p>For the concurrent validity part of this study, both hypotheses were rejected, as the correlations of the VPIT with the conventional tests NHPT and BBT were low. The rejection of <italic>hypothesis 1</italic> (correlations for the T<sub>ex</sub>[s]VPIT / T<sub>ex</sub>[s]NHPT and T<sub>ex</sub>[s]VPIT / N<sub>tc</sub>BBT) might be due to the following reasons: <bold>(1)</bold> the diverse and unstable upper limb skills of the study sample led to a large inter-subjects variation, which can be seen in the high Standard Deviation (SD) of T<sub>ex</sub>[s]VPIT with 72.1 s and SD = 28.9 s for the NHPT, respectively (Table <xref rid="Tab2" ref-type="table">2</xref>). Moreover, support of the affected-arm by the non-affected arm might have caused further variability in the data, <bold>(2)</bold> Although the test performance of the NHPT was stable within the 3 test trials (mean SD (average from each subject’s SD) = 5.2 s), there was variation within the 3 test trials of the VPIT (mean SD = 27.2 s). The higher intra-subject variation in the T<sub>ex</sub>[s]VPIT parameter could be attributed to the nature of the VPIT, which is not a real physical object manipulation test and involves tools that patients are not familiar with (e.g., the robotic handle and the computer for some patients). This is supported by Bowler et al. (2011), who achieved a more accurate and consistent data set for an embedded NHPT than for a purely hapto-VR-NHPT version [<xref ref-type="bibr" rid="CR47">47</xref>]. As the VPIT was the last assessment administered in session one, it might be that patients were already more tired and less able to concentrate than in the NHPT. This observation is supported by the smaller SD of the VPIT during the second assessment session (see Table <xref rid="Tab4" ref-type="table">4</xref>). Furthermore, compared to the BBT, the T<sub>ex</sub>[s]VPIT has no time limit, thus the participants with poorer upper limb function had to perform the assessment even longer than the more skilled ones, also resulting in increased fatigue of the affected arm from test trial to test trial (although they were allowed to have a rest between tests). Conversely, the correlations of the VPIT with the NHPT - the two tests with no time limit - were better than those with the BBT (time limit: 60 s). A reason for this could be the similar test procedures of the VPIT / NHPT, whereas the BBT has different test procedures [<xref ref-type="bibr" rid="CR5">5</xref>].</p><p>The rejection of <italic>hypothesis 2</italic> (correlations for N<sub>dp</sub>VPIT with the N<sub>dp</sub>NHPT / N<sub>dc</sub>BBT) occurred due to very low correlations between those validity parameters. The scatter plots of those parameters showed no linear correlation, as many participants did not drop any pegs or cubes during test trials (no drops <italic>n</italic> = 17 in VPIT (55 %); <italic>n</italic> = 10 in NHPT (32 %) and <italic>n</italic> = 14 in BBT (45 %)). This ceiling-effect - considered to be present if more than 15 % of all participants received the highest possible score (here: dropping no peg/cube) [<xref ref-type="bibr" rid="CR48">48</xref>] - did not allow a distinction from the participants with the highest achievable score, indicating limited validity. This finding is supported by the poor strength of agreement for the N<sub>dp</sub> and no dropped pegs in the VPIT and NHPT (Kappa = 0.04) or BBT (Kappa = 0.19), respectively. Furthermore, the high SDs of the N<sub>dp/c</sub> (VPIT/BBT/NHPT) parameters indicate the high variance of the study sample (Table <xref rid="Tab2" ref-type="table">2</xref>). The high variance in the VPIT could be due to the difficulty of the coordination of the PHANTOM Omni arm and the virtual pegboard in the virtual 3D space, especially for subgroup 2 (those with the higher N<sub>dp</sub> parameter than subgroup 1; see Table <xref rid="Tab2" ref-type="table">2</xref>). Most participants in this group had difficulty in aligning the handle of the haptic display to the dropped peg lying on the virtual board, which resulted in several grasp attempts and the associated higher drop rate of pegs.</p><p>Furthermore, the VPIT handle remains in the patients hand during the entire test, but inserting a peg in the hole requires control of grasping force and to decrease applied grasping force below the 2 N force threshold. Also, patients have to be below the 2 N threshold before being able to grasp a new peg (i.e., the patient cannot just tightly grasp the handle during the whole test and “only” align cursor to pegs/holes to achieve the task, see Fluet et al. (2011) [<xref ref-type="bibr" rid="CR17">17</xref>] and the force traces presented in that paper may illustrate how force control (grasping AND releasing) is required for achieving the task. Nevertheless, this may have influenced the performance time of the VIPT and also the low values for concurrent validity. The degree of stereopositivity (Table <xref rid="Tab1" ref-type="table">1</xref>), which we assumed to be important to perform the VPIT [<xref ref-type="bibr" rid="CR28">28</xref>], didn’t seem to be indicative of the participants being able to perform the VPIT or not, as all participants could perform it equally. However, further investigations into this observation would be necessary to allow us to draw a comprehensive conclusion.</p></sec><sec id="Sec15"><title>Test-retest reliability</title><p>In the hypothesis concerning the <italic>relative test-retest reliability</italic>, we expected the ICCs to be ≥ 0.80. This assumption was met by 5 out of 9 VPIT parameters in the whole stroke sample (Table <xref rid="Tab4" ref-type="table">4</xref>) and both subgroups (Tables <xref rid="Tab5" ref-type="table">5</xref> and <xref rid="Tab6" ref-type="table">6</xref>). Those 5 parameters were the same for the whole sample and for subgroup 2 (T<sub>ex</sub>[s], F<sub>g</sub>go[N], N<sub>zc[1/s]</sub>go/return and F<sub>cmean</sub>[N]), with slightly higher correlations in subgroup 2 than for the whole sample. This is not surprising, as subgroup 1 with the highest mean differences between test and retest (Table <xref rid="Tab5" ref-type="table">5</xref>) is not included, indicating that supporting the affected arm allowed a more stable test performance in subgroup 2. The lower ICCs in subgroup 1 might also be due to the lower number of participants (<italic>n</italic> = 11) [<xref ref-type="bibr" rid="CR49">49</xref>], as well as due to a learning effect in some parameters; e.g., the important decrease in T<sub>ex</sub>[s] of 29.6 s from test to retest (Table <xref rid="Tab5" ref-type="table">5</xref>). This finding is illustrated by the Bland-Altman plot (Fig. <xref rid="Fig2" ref-type="fig">2a</xref>)), where 4 subjects in subgroup 1 improved by > 50 s.<table-wrap id="Tab6"><label>Table 6</label><caption><p>Test-retest reliability parameters for subgroup 2 (<italic>n</italic> = 20) with support of the non-affected arm</p></caption><table frame="hsides" rules="groups"><thead><tr><th></th><th colspan="9">Subgroup 2 (<italic>n</italic> = 20) VPIT test performance with support</th></tr><tr><th>VPIT parameters</th><th>Test Mean ± SD</th><th>Retest Mean ± SD</th><th>Test-Retest Mean difference ± SD</th><th>Kendall’s tau correlation</th><th>Kendall’s tau correlation with transformed data</th><th>ICC (95 % CI)</th><th>SEM agreement</th><th>SDD</th><th>SDD%</th></tr></thead><tbody><tr><td>T<sub>ex</sub> [s]</td><td>123.33 ± 77.24</td><td>107.04 ± 58.93</td><td>16.30 ± 34.62</td><td>0.03</td><td>-</td><td>0.92 (0.79–0.97)</td><td>19.25</td><td>53.32</td><td>317.76</td></tr><tr><td rowspan="2">N<sub>dp</sub></td><td>0.77 ± 1.27</td><td>1.22 ± 1.87</td><td>−0.45 ± 1.91</td><td rowspan="2">0.18<sup>a</sup></td><td rowspan="2">0.11<sup>b,c</sup></td><td>0.45 (−0.37–0.78)</td><td>1.16</td><td>3.23</td><td>19.25</td></tr><tr><td>0.18 ± 0.22<sup>c</sup></td><td>0.26 ± 0.26<sup>c</sup></td><td>−0.07 ± 0.28<sup>c</sup></td><td>0.49 (−0.26–0.80)<sup>c</sup></td><td>0.17<sup>c</sup></td><td>0.48<sup>c</sup></td><td>3.11<sup>c</sup></td></tr><tr><td>F<sub>g</sub> go [N]</td><td>8.15 ± 5.25</td><td>7.67 ± 5.28</td><td>0.49 ± 1.79</td><td>0.11<sup>a</sup></td><td>0.12<sup>d</sup></td><td>0.97 (0.93–0.99)</td><td>0.91</td><td>2.53</td><td>15.08</td></tr><tr><td>F<sub>g</sub> return [N]</td><td>1.62 ± 0.80</td><td>1.63 ± 0.73</td><td>−0.02 ± 0.72</td><td>0.10<sup>a</sup></td><td>-</td><td>0.73 (0.29–0.89)</td><td>0.40</td><td>1.10</td><td>6.56</td></tr><tr><td rowspan="2">N<sub>zc [1/s]</sub>go</td><td>11.03 ± 1.39</td><td>10.81 ± 1.59</td><td>0.22 ± 0.68</td><td rowspan="2">0.34<sup>a</sup></td><td rowspan="2">0.32<sup>b,c</sup></td><td>0.94 (0.86–0.98)</td><td>0.37</td><td>1.01</td><td>6.02</td></tr><tr><td>1.04 ± 0.06<sup>c</sup></td><td>1.03 ± 0.07<sup>c</sup></td><td>0.01 ± 0.03<sup>c</sup></td><td>0.94 (0.85–0.98)<sup>c</sup></td><td>0.02<sup>c</sup></td><td>0.04<sup>c</sup></td><td>0.26<sup>c</sup></td></tr><tr><td>N<sub>zc[1/s]</sub> return</td><td>11.17 ± 1.57</td><td>10.93 ± 1.77</td><td>0.25 ± 0.91</td><td>0.18<sup>a</sup></td><td>0.18<sup>d</sup></td><td>0.92 (0.80–0.97)</td><td>0.47</td><td>1.31</td><td>7.81</td></tr><tr><td>E<sub>traj</sub> go [cm]</td><td>0.84 ± 0.39</td><td>0.78 ± 0.28</td><td>0.06 ± 0.37</td><td>0.01</td><td>-</td><td>0.58 (−0.06–0.84)</td><td>0.22</td><td>0.60</td><td>3.58</td></tr><tr><td rowspan="2">E<sub>traj</sub> return [cm]</td><td>1.10 ± 0.42</td><td>1.15 ± 0.61</td><td>−0.04 ± 0.53</td><td rowspan="2">0.16<sup>a</sup></td><td rowspan="2">0.15<sup>b,c</sup></td><td>0.66 (0.13–0.87)</td><td>0.30</td><td>0.83</td><td>4.95</td></tr><tr><td>0.02 ± 0.16<sup>c</sup></td><td>0.02 ± 0.19<sup>c</sup></td><td>0.00 ± 0.17<sup>c</sup></td><td>0.69 (0.21–0.88)<sup>c</sup></td><td>0.10<sup>c</sup></td><td>0.27<sup>c</sup></td><td>1.75<sup>c</sup></td></tr><tr><td rowspan="2">F<sub>cmean</sub> [N]</td><td>1.45 ± 1.16</td><td>1.36 ± 1.08</td><td>0.09 ± 0.50</td><td rowspan="2">0.10<sup>a</sup></td><td rowspan="2">0.01<sup>b,d</sup></td><td>0.95 (0.87–0.98)</td><td>0.25</td><td>0.69</td><td>4.11</td></tr><tr><td>1.11 ± 0.47<sup>d</sup></td><td>1.08 ± 0.47<sup>d</sup></td><td>0.04 ± 0.23<sup>d</sup></td><td>0.94 (0.84–0.98)<sup>d</sup></td><td>0.12<sup>d</sup></td><td>0.32<sup>d</sup></td><td>2.07<sup>d</sup></td></tr></tbody></table><table-wrap-foot><p><sup>a</sup>Τ > 0.1, T<sub>trans</sub> decreased<sup>b</sup>, <sup>c</sup> = log10 transformed, <sup>d</sup> = square root transformed</p><p><italic>T</italic><sub><italic>ex</italic></sub><italic>[s]</italic> execution time in seconds, <italic>N</italic><sub><italic>dp</italic></sub> number of dropped pegs during transport, <italic>F</italic><sub><italic>g</italic></sub><italic>(go/return) [N]</italic> mean grasping force of the three force sensors integrated into the handle in Newton, <italic>N</italic><sub><italic>zc[1/s]</italic></sub><italic>(go/return)</italic> number of zero-crossings of the acceleration, <italic>E</italic><sub><italic>traj</italic></sub><italic>[cm]</italic> trajectory error, <italic>F</italic><sub><italic>cmean [N]</italic></sub> mean collision force; <italic>SD</italic> Standard Deviation, <italic>ICC</italic> Intraclass Correlation Coefficient, <italic>CI</italic> Confidence Interval, <italic>SEM</italic> Standard Error of Measurement, <italic>SDD</italic> Smallest Detectable Difference</p></table-wrap-foot></table-wrap></p><p>The kinetic parameters F<sub>g</sub>go[N] and F<sub>cmean</sub>[N] and the kinematic parameters Nzc[1/s]go/return achieved high test-retest reliability in the whole sample and in both subgroups. This means that the stroke participants were able to transport the pegs with a constant grip strength and movement coordination while transporting the peg (go). However, there were fair correlations when approaching a new peg (return) (F<sub>g</sub>return) in the whole sample and both subgroups. This might be due to the fact that participants still had to hold an object (the handle) on the way back to approach a new peg without actually carrying a peg. Furthermore, if we look at the overall test-retest reliability of the whole study sample for N<sub>dp</sub>, it was poor (ICC = 0.58). This might be due to the artificial force threshold to grasp and release the pegs, which is quite unintuitive, as there is no feedback provided on the force applied by the subject and on the force threshold, although measured by the handle (F<sub>g</sub>go/return[N]). This might lead many subjects to drop the pegs. However, to achieve a conclusive statement regarding the clinical use of those unique kinetic and kinematic VPIT parameters, further research is needed. This could be done by comparing the reliability of stroke results with healthy controls, or by evaluating their validity with other outcome measurements quantifying force control and movement coordination.</p><p>From the 5 VPIT parameters meeting the hypothesis for <italic>relative test-retest reliability</italic>, all VPIT parameters fulfilled the hypothesis for the absolute test-retest reliability with SDD% of ≤ 54 % (Tables <xref rid="Tab4" ref-type="table">4</xref>, <xref rid="Tab5" ref-type="table">5</xref> and <xref rid="Tab6" ref-type="table">6</xref>) except for the parameter T<sub>ex</sub>[s]. This is quite surprising, as more complex and demanding upper limb function tests – such as the VPIT – have in general higher SDDs than simpler tests – such as the BBT or NHPT. Therefore, our results are in contrast with those of Chen et al. (2009) [<xref ref-type="bibr" rid="CR25">25</xref>], whose SDD% values were high for the affected hand, especially in the NHPT, with an SDD% of 52 % for the nonspastic and 88 % for the spastic group. In our sample however, the only VPIT parameter not being susceptible to change was T<sub>ex</sub>[s], as its SDD was high and varied greatly within the whole sample and both subgroups (SDDs = 53.3–102.5 s). In other words, only a change between two consecutive measurements exceeding at least 53 s for T<sub>ex</sub>[s] can be interpreted as a true clinical improvement when chronic patients with stroke perform the test with the affected hand. In addition, the SDD can be used as a threshold to identify statistically significant individual change [<xref ref-type="bibr" rid="CR50">50</xref>, <xref ref-type="bibr" rid="CR51">51</xref>]. Thus, if a change between 2 consecutive measurements for an individual patient exceeds the SDD (e.g., 53.3 s in subgroup 2) the individual patient may be exhibiting significant improvement. In our sample, this was the case for 4 participants for the T<sub>ex</sub>[s] parameter in subgroup 2, while one participant exceeded 102.5 s in subgroup 1. The data show that allowing support of the affected arm increased performance stability in the test and retest. This can be seen in the almost twice as high SDD of subgroup 1 (SDD = 102.5 s) compared to subgroup 2 with an SDD of 53.3 s.</p></sec><sec id="Sec16"><title>Limitations and future research</title><p>As the VPIT extracts much more (i.e., kinetic and kinematic) parameters than conventional, non-VR upper limb function assessments (i.e., time, number of dropped/transported objects), it was not possible to validate all of them. Therefore, future studies should focus on the validity of those parameters measurable by VR devices by comparing them with other VR-based upper limb function assessments. Furthermore, it would be of interest to evaluate the discriminant validity of the VPIT by comparing stroke participants’ performances with those of healthy controls.</p><p>Future versions of the VPIT should provide visual feedback on the force applied by the subject and on the force threshold. Another limitation might be the fact that two raters collected data, although the test-retest measurements of one participant were performed by the same rater. However, the major limitation of our study can be seen in the given permission to support the weight of the affected arm with the non-affected arm (and not use the other hand to steer), visually monitored by the supervising rater (occupational therapist). We are aware that this can be judged as a bias, because the test performance was not identical between the two subgroups, nor can we be sure how much the non-affected arm really supported (steered) the affected arm. Nevertheless, allowing support of the affected arm opens the use of the VPIT for a motorically weaker stroke population. If available, adjustable armrests (e.g., the Armon Elemento [<xref ref-type="bibr" rid="CR52">52</xref>]) could be used instead of the non-affected arm, which might improve body stability and therefore the test performance by providing repeatable conditions from trial to trial and patient to patient. Randomisation of the several tests (NHPT, BBT, VPIT) may also reduce tiredness of the patients and increase validity.</p><p>Last, the sample size was relatively small and may have affected the values of the reproducibility and measurement error. A sample size of at least 50 is generally seen as adequate for the assessment of the agreement parameter, based on a general guideline by Altman [<xref ref-type="bibr" rid="CR53">53</xref>]. The sample size we used of 33 patients with chronic stroke is, however, a realistic group size to find first estimates for the assumed relation between stroke and the hemi paretic arm / hand for the VPIT. Future studies may therefore strive for a bigger study sample and evaluate responsiveness to treatment of the VPIT.</p></sec><sec id="Sec17"><title>Implications for practice</title><p>The VPIT provides more objective and comprehensive measurements of upper limb function than conventional, non-computerized hand assessments. Receiving feedback concerning for example the patient’s ability to control force or movement coordination is essential for rehabilitation. Furthermore, getting information about movement smoothness, as provided by the VPIT, offers clinically relevant information, as smoothness has been shown to be a good indicator of upper limb coordination and stroke recovery [<xref ref-type="bibr" rid="CR23">23</xref>]. Therefore, clinicians can use these information to work on those motor skills crucial for the independent performance of daily activities [<xref ref-type="bibr" rid="CR54">54</xref>]. Thanks to its compact and transportable shape, the VPIT is easy to administer even in the patient’s home, thus allowing a broad use amongst clinicians working in different settings. As all test results are stored in the computer and could be graphically displayed immediately after completion of the test, performance can be discussed with the patient and adjustments made to the therapy program of a patient depending on the progress. To increase the ease of use of the VPIT, time limitations in the test duration for motorically weaker patients should be considered, together with the allowance to use adjustable armrests if needed.</p><p>An important aim of developing this new assessment is to improve the assessment of arm function in a clinical setting where the results of the assessment can be generalized to a population reflective of the “real world”. Seen from this perspective it is rather a strong point of our study that we had a rather heterogeneous sample because this can be considered more realistic for clinical settings.</p></sec></sec><sec id="Sec18" sec-type="conclusion"><title>Conclusions</title><p>The VPIT is a promising upper limb function assessment which has proved to be feasible for use with this diverse group of chronic patients with stroke. The low concurrent validity showed that the VPIT was inherently different from the conventional tasks, indicating that performing this hapto-virtual reality assessment requires other components of upper limb motor performance than the NHPT and BBT. The high test-retest reliability in 5 and the low SDD% in 8 out of 9 VPIT parameters showed that those parameters remain consistent when performed by patients with chronic stroke and are susceptible to change, allowing diagnostic and therapeutic use in clinical practice for this patient group. The other 4 parameters (N<sub>dp</sub>, F<sub>g</sub>return[N] and E<sub>traj</sub>go/return[cm]) showed poor to fair ICCs when performed with the affected hand and require further research for this population. The high intra-subject variation indicated that the VPIT is a demanding test for this stroke sample, which requires a thorough introduction to this assessment. Allowing testing trials before starting with the assessment is a prerequisite for a reliable test performance. When using the VPIT as outcome measurement, clinicians may want to use the SDDs reported in this article as reference points for clinically important changes, and the SDD% results to compare test-retest reliability among other tests.</p></sec></body><back><glossary><title>Abbreviations</title><def-list><def-item><term>BBT</term><def><p>Box and Block Test</p></def></def-item><def-item><term>CI</term><def><p>Confidence Interval</p></def></def-item><def-item><term>E<sub>traj</sub>[cm]</term><def><p>Trajectory error in centimeters</p></def></def-item><def-item><term>ICC</term><def><p>Intraclass Correlation Coefficient</p></def></def-item><def-item><term>F<sub>cmean</sub></term><def><p>Mean collsion force</p></def></def-item><def-item><term>F<sub>g</sub>[N]</term><def><p>Mean grasping force in Newton</p></def></def-item><def-item><term>N<sub>dc</sub></term><def><p>Number of dropped cubes</p></def></def-item><def-item><term>N<sub>dp</sub></term><def><p>Number of dropped pegs</p></def></def-item><def-item><term>NHPT</term><def><p>Nine Hole Peg Test</p></def></def-item><def-item><term>N<sub>tc</sub></term><def><p>Number of transported cubes</p></def></def-item><def-item><term>N<sub>zc</sub>Nzc[<sub>1/s</sub>]</term><def><p>Number of zero-crossings</p></def></def-item><def-item><term>SD</term><def><p>Standard Deviation</p></def></def-item><def-item><term>SDD</term><def><p>Smallest Detectable Difference</p></def></def-item><def-item><term>SEM</term><def><p>Standard Error of Measurement</p></def></def-item><def-item><term>T<sub>ex</sub>[s]</term><def><p>Execution time in seconds</p></def></def-item><def-item><term>VPIT</term><def><p>Virtual Peg Insertion Test</p></def></def-item></def-list></glossary><fn-group><fn id="Fn1"><label>1</label><p>104W13400 Donges Bay Road, PO Box 1005, Germantown, Wisconsin 53022-8205</p></fn><fn><p><bold>Competing interests</bold></p><p>MCF is shareholder of ReHaptix GmbH, Zurich, Switzerland, a startup company commercializing assessment technologies. All other authors declare that they have no competing interests.</p></fn><fn><p><bold>Authors’ contributions</bold></p><p>BCT conceived the methodology and carried out data collection, quality assessment, data analysis and manuscript writing. RK supervised progress, participating in methodology conception and manuscript writing & revision. MCF & OL had developed the VPIT and maintained technical support during data collection. MCF, OL & RDB contributed in manuscript revision. EDB supervised progress, helped with methodology conception, manuscript writing & revision. All authors read and approved the final manuscript.</p></fn></fn-group><ack><title>Acknowledgements</title><p>The authors warmly thank all OT outpatient clinics who were willing to help recruiting the participants for this study. Many thanks go to all participants who were willing to share their time for this project. Further thanks go to Judith Häberli (JH) who helped with data collection and to Dr Martin J Watson for proof reading the manuscript on English and structure. Final thanks go to the Rehabilitation Engineering Lab, Department of Health Sciences and Technology, ETH Zurich, Switzerland, who provided the VPIT for this research project.</p></ack><ref-list id="Bib1"><title>References</title><ref id="CR1"><label>1.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Lundborg</surname><given-names>G</given-names></name></person-group><source>The Hand and the Brain. From Lucy’s thumb to the tought-controlled robotic hand</source><year>2014</year><publisher-loc>London</publisher-loc><publisher-name>Springer</publisher-name></element-citation></ref><ref id="CR2"><label>2.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Johansson</surname><given-names>BB</given-names></name></person-group><article-title>Current trends in stroke rehabilitation. A review with focus on brain plasticity</article-title><source>Acta Neurol Scand</source><year>2011</year><volume>123</volume><issue>3</issue><fpage>147</fpage><lpage>59</lpage><pub-id pub-id-type="doi">10.1111/j.1600-0404.2010.01417.x</pub-id><pub-id pub-id-type="pmid">20726844</pub-id></element-citation></ref><ref id="CR3"><label>3.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fluet</surname><given-names>GG</given-names></name><name><surname>Deutsch</surname><given-names>JE</given-names></name></person-group><article-title>Virtual reality for sensorimotor rehabilitation post-stroke: the promise and current state of the field</article-title><source>Curr Phys Med Rehabil Rep</source><year>2013</year><volume>1</volume><issue>1</issue><fpage>9</fpage><lpage>20</lpage><pub-id pub-id-type="doi">10.1007/s40141-013-0005-2</pub-id><pub-id pub-id-type="pmid">24579058</pub-id></element-citation></ref><ref id="CR4"><label>4.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lin</surname><given-names>KC</given-names></name><name><surname>Chuang</surname><given-names>LL</given-names></name><name><surname>Wu</surname><given-names>CY</given-names></name><name><surname>Hsieh</surname><given-names>YW</given-names></name><name><surname>Chang</surname><given-names>WY</given-names></name></person-group><article-title>Responsiveness and validity of three dexterous function measures in stroke rehabilitation</article-title><source>J Rehabil Res Dev</source><year>2010</year><volume>47</volume><issue>6</issue><fpage>563</fpage><lpage>71</lpage><pub-id pub-id-type="doi">10.1682/JRRD.2009.09.0155</pub-id><pub-id pub-id-type="pmid">20848369</pub-id></element-citation></ref><ref id="CR5"><label>5.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mathiowetz</surname><given-names>V</given-names></name><name><surname>Volland</surname><given-names>G</given-names></name><name><surname>Kashman</surname><given-names>N</given-names></name><name><surname>Weber</surname><given-names>K</given-names></name></person-group><article-title>Adult norms for the Box and Block Test of manual dexterity</article-title><source>Am J Occup Ther</source><year>1985</year><volume>39</volume><issue>6</issue><fpage>386</fpage><lpage>91</lpage><pub-id pub-id-type="doi">10.5014/ajot.39.6.386</pub-id><pub-id pub-id-type="pmid">3160243</pub-id></element-citation></ref><ref id="CR6"><label>6.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mathiowetz</surname><given-names>V</given-names></name><name><surname>Weber</surname><given-names>K</given-names></name><name><surname>Kashman</surname><given-names>N</given-names></name><name><surname>Volland</surname><given-names>G</given-names></name></person-group><article-title>Adult norms for the Nine Hole Peg Test of finger dexterity</article-title><source>Occup Ther J Res</source><year>1985</year><volume>5</volume><fpage>24</fpage><lpage>38</lpage></element-citation></ref><ref id="CR7"><label>7.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oxford Grice</surname><given-names>K</given-names></name><name><surname>Vogel</surname><given-names>KA</given-names></name><name><surname>Le</surname><given-names>V</given-names></name><name><surname>Mitchell</surname><given-names>A</given-names></name><name><surname>Muniz</surname><given-names>S</given-names></name><name><surname>Vollmer</surname><given-names>MA</given-names></name></person-group><article-title>Adult norms for a commercially available Nine Hole Peg Test for finger dexterity</article-title><source>Am J Occup Ther</source><year>2003</year><volume>57</volume><issue>5</issue><fpage>570</fpage><lpage>3</lpage><pub-id pub-id-type="doi">10.5014/ajot.57.5.570</pub-id><pub-id pub-id-type="pmid">14527120</pub-id></element-citation></ref><ref id="CR8"><label>8.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Laver</surname><given-names>KE</given-names></name><name><surname>George</surname><given-names>S</given-names></name><name><surname>Thomas</surname><given-names>S</given-names></name><name><surname>Deutsch</surname><given-names>JE</given-names></name><name><surname>Crotty</surname><given-names>M</given-names></name></person-group><article-title>Virtual reality for stroke rehabilitation</article-title><source>Cochrane Database Syst Rev</source><year>2011</year><volume>9</volume><fpage>CD008349</fpage><pub-id pub-id-type="pmid">21901720</pub-id></element-citation></ref><ref id="CR9"><label>9.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brewer</surname><given-names>L</given-names></name><name><surname>Horgan</surname><given-names>F</given-names></name><name><surname>Hickey</surname><given-names>A</given-names></name><name><surname>Williams</surname><given-names>D</given-names></name></person-group><article-title>Stroke rehabilitation: recent advances and future therapies</article-title><source>QJM</source><year>2013</year><volume>106</volume><issue>1</issue><fpage>11</fpage><lpage>25</lpage><pub-id pub-id-type="doi">10.1093/qjmed/hcs174</pub-id><pub-id pub-id-type="pmid">23019591</pub-id></element-citation></ref><ref id="CR10"><label>10.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yeh</surname><given-names>SC</given-names></name><name><surname>Lee</surname><given-names>SH</given-names></name><name><surname>Chan</surname><given-names>RC</given-names></name><name><surname>Chen</surname><given-names>S</given-names></name><name><surname>Rizzo</surname><given-names>A</given-names></name></person-group><article-title>A virtual reality system integrated with robot-assisted haptics to simulate pinch-grip task: Motor ingredients for the assessment in chronic stroke</article-title><source>NeuroRehabilitation</source><year>2014</year><volume>35</volume><fpage>435</fpage><lpage>49</lpage><pub-id pub-id-type="pmid">25227546</pub-id></element-citation></ref><ref id="CR11"><label>11.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fordell</surname><given-names>H</given-names></name><name><surname>Bodin</surname><given-names>K</given-names></name><name><surname>Bucht</surname><given-names>G</given-names></name><name><surname>Malm</surname><given-names>J</given-names></name></person-group><article-title>A virtual reality test battery for assessment and screening of spatial neglect</article-title><source>Acta Neurol Scand</source><year>2011</year><volume>123</volume><issue>3</issue><fpage>167</fpage><lpage>74</lpage><pub-id pub-id-type="doi">10.1111/j.1600-0404.2010.01390.x</pub-id><pub-id pub-id-type="pmid">20569225</pub-id></element-citation></ref><ref id="CR12"><label>12.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname><given-names>JH</given-names></name><name><surname>Ku</surname><given-names>J</given-names></name><name><surname>Cho</surname><given-names>W</given-names></name><name><surname>Hahn</surname><given-names>WY</given-names></name><name><surname>Kim</surname><given-names>IY</given-names></name><name><surname>Lee</surname><given-names>SM</given-names></name><etal></etal></person-group><article-title>A virtual reality system for the assessment and rehabilitation of the activities of daily living</article-title><source>Cyberpsychol Behav</source><year>2003</year><volume>6</volume><issue>4</issue><fpage>383</fpage><lpage>8</lpage><pub-id pub-id-type="doi">10.1089/109493103322278763</pub-id><pub-id pub-id-type="pmid">14511450</pub-id></element-citation></ref><ref id="CR13"><label>13.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Amirabdollahian</surname><given-names>F</given-names></name><name><surname>Johnson</surname><given-names>G</given-names></name></person-group><article-title>Analysis of the results from use of haptic peg-in-hole task for assessment in neurorehabilitation</article-title><source>Appl Bionics Biomechanics</source><year>2011</year><volume>8</volume><issue>1</issue><fpage>1</fpage><lpage>11</lpage><pub-id pub-id-type="doi">10.1155/2011/250792</pub-id></element-citation></ref><ref id="CR14"><label>14.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bardorfer</surname><given-names>A</given-names></name><name><surname>Munih</surname><given-names>M</given-names></name><name><surname>Zupan</surname><given-names>A</given-names></name><name><surname>Primozic</surname><given-names>A</given-names></name></person-group><article-title>Upper limb motion analysis using haptic interface</article-title><source>IEEE ASME Trans Mechatron</source><year>2001</year><volume>6</volume><issue>3</issue><fpage>253</fpage><lpage>60</lpage><pub-id pub-id-type="doi">10.1109/3516.951363</pub-id></element-citation></ref><ref id="CR15"><label>15.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Feys</surname><given-names>P</given-names></name><name><surname>Alders</surname><given-names>G</given-names></name><name><surname>Gijbels</surname><given-names>D</given-names></name><name><surname>De Boeck</surname><given-names>J</given-names></name><name><surname>De Weyer</surname><given-names>T</given-names></name><name><surname>Coninx</surname><given-names>K</given-names></name><etal></etal></person-group><article-title>Arm training in multiple sclerosis using phantom: Clinical relevance of robotic outcome measures</article-title><source>IEEE International Conference on Rehabilitation Robotics</source><year>2009</year><fpage>576</fpage><lpage>81</lpage></element-citation></ref><ref id="CR16"><label>16.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Xydas</surname><given-names>E</given-names></name><name><surname>Louca</surname><given-names>L</given-names></name></person-group><article-title>Upper limb assessment of people with multiple sclerosis with the use of a haptic nine hole peg-board test</article-title><source>Proceedings of the 9th biennal Conference on Engineering Systems Design and Analysis</source><year>2009</year><fpage>159</fpage><lpage>66</lpage></element-citation></ref><ref id="CR17"><label>17.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Fluet</surname><given-names>M-C</given-names></name><name><surname>Lambercy</surname><given-names>O</given-names></name><name><surname>Gassert</surname><given-names>R</given-names></name></person-group><article-title>Upper limb assessment using a virtual peg insertion test</article-title><source>Proc IEEE International Conference on Rehabilitation Robotics (ICORR); Switzerland, Zurich</source><year>2011</year><fpage>1</fpage><lpage>6</lpage></element-citation></ref><ref id="CR18"><label>18.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lambercy</surname><given-names>O</given-names></name><name><surname>Fluet</surname><given-names>MC</given-names></name><name><surname>Lamers</surname><given-names>I</given-names></name><name><surname>Kerkhofs</surname><given-names>L</given-names></name><name><surname>Feys</surname><given-names>P</given-names></name><name><surname>Gassert</surname><given-names>R</given-names></name></person-group><article-title>Assessment of upper limb motor function in patients with multiple sclerosis using the Virtual Peg Insertion Test: a pilot study</article-title><source>IEEE Int Conf Rehabil Robot</source><year>2013</year><volume>2013</volume><fpage>6650494</fpage><pub-id pub-id-type="pmid">24187309</pub-id></element-citation></ref><ref id="CR19"><label>19.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gagnon</surname><given-names>C</given-names></name><name><surname>Lavoie</surname><given-names>C</given-names></name><name><surname>Lessard</surname><given-names>I</given-names></name><name><surname>Mathieu</surname><given-names>J</given-names></name><name><surname>Brais</surname><given-names>B</given-names></name><name><surname>Bouchard</surname><given-names>JP</given-names></name><etal></etal></person-group><article-title>The Virtual Peg Insertion Test as an assessment of upper limb coordination in ARSACS patients: a pilot study</article-title><source>J Neurol Sci</source><year>2014</year><volume>347</volume><issue>1–2</issue><fpage>341</fpage><lpage>4</lpage><pub-id pub-id-type="doi">10.1016/j.jns.2014.09.032</pub-id><pub-id pub-id-type="pmid">25439167</pub-id></element-citation></ref><ref id="CR20"><label>20.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nordin</surname><given-names>N</given-names></name><name><surname>Xie</surname><given-names>SQ</given-names></name><name><surname>Wunsche</surname><given-names>B</given-names></name></person-group><article-title>Assessment of movement quality in robot- assisted upper limb rehabilitation after stroke: a review</article-title><source>J Neuroeng Rehabil</source><year>2014</year><volume>11</volume><fpage>137</fpage><pub-id pub-id-type="doi">10.1186/1743-0003-11-137</pub-id><pub-id pub-id-type="pmid">25217124</pub-id></element-citation></ref><ref id="CR21"><label>21.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname><given-names>H</given-names></name><name><surname>Miller</surname><given-names>LM</given-names></name><name><surname>Fedulow</surname><given-names>I</given-names></name><name><surname>Simkins</surname><given-names>M</given-names></name><name><surname>Abrams</surname><given-names>GM</given-names></name><name><surname>Byl</surname><given-names>N</given-names></name><etal></etal></person-group><article-title>Kinematic data analysis for post-stroke patients following bilateral versus unilateral rehabilitation with an upper limb wearable robotic system</article-title><source>IEEE Trans Neural Syst Rehabil Eng</source><year>2013</year><volume>21</volume><issue>2</issue><fpage>153</fpage><lpage>64</lpage><pub-id pub-id-type="doi">10.1109/TNSRE.2012.2207462</pub-id><pub-id pub-id-type="pmid">22855233</pub-id></element-citation></ref><ref id="CR22"><label>22.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Panarese</surname><given-names>A</given-names></name><name><surname>Colombo</surname><given-names>R</given-names></name><name><surname>Sterpi</surname><given-names>I</given-names></name><name><surname>Pisano</surname><given-names>F</given-names></name><name><surname>Micera</surname><given-names>S</given-names></name></person-group><article-title>Tracking motor improvement at the subtask level during robot-aided neurorehabilitation of stroke patients</article-title><source>Neurorehabil Neural Repair</source><year>2012</year><volume>26</volume><issue>7</issue><fpage>822</fpage><lpage>33</lpage><pub-id pub-id-type="doi">10.1177/1545968311431966</pub-id><pub-id pub-id-type="pmid">22374174</pub-id></element-citation></ref><ref id="CR23"><label>23.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rohrer</surname><given-names>B</given-names></name><name><surname>Fasoli</surname><given-names>S</given-names></name><name><surname>Krebs</surname><given-names>HI</given-names></name><name><surname>Hughes</surname><given-names>R</given-names></name><name><surname>Volpe</surname><given-names>B</given-names></name><name><surname>Frontera</surname><given-names>WR</given-names></name><etal></etal></person-group><article-title>Movement smoothness changes during stroke recovery</article-title><source>J Neurosci</source><year>2002</year><volume>22</volume><issue>18</issue><fpage>8297</fpage><lpage>304</lpage><pub-id pub-id-type="pmid">12223584</pub-id></element-citation></ref><ref id="CR24"><label>24.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Milner</surname><given-names>TE</given-names></name></person-group><article-title>A model for the generation of movements requiring endpoint precision</article-title><source>Neuroscience</source><year>1992</year><volume>49</volume><issue>2</issue><fpage>487</fpage><lpage>96</lpage><pub-id pub-id-type="doi">10.1016/0306-4522(92)90113-G</pub-id><pub-id pub-id-type="pmid">1436478</pub-id></element-citation></ref><ref id="CR25"><label>25.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname><given-names>HM</given-names></name><name><surname>Chen</surname><given-names>CC</given-names></name><name><surname>Hsueh</surname><given-names>IP</given-names></name><name><surname>Huang</surname><given-names>SL</given-names></name><name><surname>Hsieh</surname><given-names>CL</given-names></name></person-group><article-title>Test-retest reproducibility and smallest real difference of 5 hand function tests in patients with stroke</article-title><source>Neurorehabil Neural Repair</source><year>2009</year><volume>23</volume><issue>5</issue><fpage>435</fpage><lpage>40</lpage><pub-id pub-id-type="doi">10.1177/1545968308331146</pub-id><pub-id pub-id-type="pmid">19261767</pub-id></element-citation></ref><ref id="CR26"><label>26.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Folstein</surname><given-names>MF</given-names></name><name><surname>Folstein</surname><given-names>SE</given-names></name><name><surname>McHugh</surname><given-names>PR</given-names></name></person-group><article-title>“Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician</article-title><source>J Psychiatr Res</source><year>1975</year><volume>12</volume><issue>3</issue><fpage>189</fpage><lpage>98</lpage><pub-id pub-id-type="doi">10.1016/0022-3956(75)90026-6</pub-id><pub-id pub-id-type="pmid">1202204</pub-id></element-citation></ref><ref id="CR27"><label>27.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lang</surname><given-names>JI</given-names></name></person-group><article-title>Ein neuer Stereotest</article-title><source>Klin Mbl Augenheilk</source><year>1983</year><volume>182</volume><fpage>373</fpage><lpage>5</lpage><pub-id pub-id-type="doi">10.1055/s-2008-1054792</pub-id></element-citation></ref><ref id="CR28"><label>28.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname><given-names>S</given-names></name><name><surname>Weih</surname><given-names>L</given-names></name><name><surname>Mukesh</surname><given-names>N</given-names></name><name><surname>McCarty</surname><given-names>C</given-names></name><name><surname>Taylor</surname><given-names>H</given-names></name></person-group><article-title>Assessment of adult stereopsis using the Lang 1 Stereotest: a pilot study</article-title><source>Binocul Vis Strabismus Q</source><year>2001</year><volume>16</volume><issue>2</issue><fpage>91</fpage><lpage>8</lpage><pub-id pub-id-type="pmid">11388881</pub-id></element-citation></ref><ref id="CR29"><label>29.</label><element-citation publication-type="book"><person-group person-group-type="editor"><name><surname>Schädler</surname><given-names>S</given-names></name><name><surname>Kool</surname><given-names>J</given-names></name><name><surname>Lüthi</surname><given-names>H</given-names></name><name><surname>Marks</surname><given-names>D</given-names></name><name><surname>Oesch</surname><given-names>P</given-names></name><name><surname>Pfeffer</surname><given-names>A</given-names></name><etal></etal></person-group><source>Assessments in der Rehabilitation</source><year>2011</year><edition>3</edition><publisher-loc>Bern</publisher-loc><publisher-name>Verlag Hans Huber</publisher-name></element-citation></ref><ref id="CR30"><label>30.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mathiowetz</surname><given-names>V</given-names></name><name><surname>Weber</surname><given-names>K</given-names></name><name><surname>Volland</surname><given-names>G</given-names></name><name><surname>Kashman</surname><given-names>N</given-names></name></person-group><article-title>Reliability and validity of grip and pinch strength evaluations</article-title><source>J Hand Surg Am</source><year>1984</year><volume>9</volume><issue>2</issue><fpage>222</fpage><lpage>6</lpage><pub-id pub-id-type="doi">10.1016/S0363-5023(84)80146-X</pub-id><pub-id pub-id-type="pmid">6715829</pub-id></element-citation></ref><ref id="CR31"><label>31.</label><element-citation publication-type="book"><person-group person-group-type="editor"><name><surname>Norman</surname><given-names>GR</given-names></name><name><surname>Streiner</surname><given-names>DL</given-names></name></person-group><source>Biostatistics: The bare essentials</source><year>2008</year><edition>3</edition><publisher-loc>USA</publisher-loc><publisher-name>People’s Medical Publishing House</publisher-name></element-citation></ref><ref id="CR32"><label>32.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Munro</surname><given-names>BH</given-names></name></person-group><source>Statistical methods for health care research</source><year>2005</year><edition>5</edition><publisher-loc>Philadelphia</publisher-loc><publisher-name>Lippincott Williams & Wilkins</publisher-name></element-citation></ref><ref id="CR33"><label>33.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Landis</surname><given-names>JR</given-names></name><name><surname>Koch</surname><given-names>GG</given-names></name></person-group><article-title>The measurement of observer agreement for categorical data</article-title><source>Biometrics</source><year>1977</year><volume>33</volume><issue>1</issue><fpage>159</fpage><lpage>74</lpage><pub-id pub-id-type="doi">10.2307/2529310</pub-id><pub-id pub-id-type="pmid">843571</pub-id></element-citation></ref><ref id="CR34"><label>34.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Weir</surname><given-names>JP</given-names></name></person-group><article-title>Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM</article-title><source>J Strength Cond Res</source><year>2005</year><volume>19</volume><issue>1</issue><fpage>231</fpage><lpage>40</lpage><pub-id pub-id-type="pmid">15705040</pub-id></element-citation></ref><ref id="CR35"><label>35.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shrout</surname><given-names>PE</given-names></name><name><surname>Fleiss</surname><given-names>JL</given-names></name></person-group><article-title>Intraclass correlations: Uses in assessing rater reliability</article-title><source>Psychological Bulletin</source><year>1979</year><volume>86</volume><fpage>420</fpage><lpage>8</lpage><pub-id pub-id-type="doi">10.1037/0033-2909.86.2.420</pub-id><pub-id pub-id-type="pmid">18839484</pub-id></element-citation></ref><ref id="CR36"><label>36.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>de Vet</surname><given-names>HC</given-names></name><name><surname>Terwee</surname><given-names>CB</given-names></name><name><surname>Knol</surname><given-names>DL</given-names></name><name><surname>Bouter</surname><given-names>LM</given-names></name></person-group><article-title>When to use agreement versus reliability measures</article-title><source>J Clin Epidemiol</source><year>2006</year><volume>59</volume><issue>10</issue><fpage>1033</fpage><lpage>9</lpage><pub-id pub-id-type="doi">10.1016/j.jclinepi.2005.10.015</pub-id><pub-id pub-id-type="pmid">16980142</pub-id></element-citation></ref><ref id="CR37"><label>37.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Arnall</surname><given-names>FA</given-names></name><name><surname>Koumantakis</surname><given-names>GA</given-names></name><name><surname>Oldham</surname><given-names>JA</given-names></name><name><surname>Cooper</surname><given-names>RG</given-names></name></person-group><article-title>Between-days reliability of electromyographic measures of paraspinal muscle fatigue at 40, 50 and 60 % levels of maximal voluntary contractile force</article-title><source>Clin Rehabil</source><year>2002</year><volume>16</volume><issue>7</issue><fpage>761</fpage><lpage>71</lpage><pub-id pub-id-type="doi">10.1191/0269215502cr551oa</pub-id><pub-id pub-id-type="pmid">12428825</pub-id></element-citation></ref><ref id="CR38"><label>38.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Denegar</surname><given-names>CR</given-names></name><name><surname>Ball</surname><given-names>DW</given-names></name></person-group><article-title>Assessing reliability and precision of measurement: an introduction to lntraclass correlation and standard error of measurement</article-title><source>J Sport Rehabil</source><year>1993</year><volume>2</volume><issue>1</issue><fpage>35</fpage><lpage>42</lpage></element-citation></ref><ref id="CR39"><label>39.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rankin</surname><given-names>G</given-names></name><name><surname>Stokes</surname><given-names>M</given-names></name></person-group><article-title>Reliability of assessment tools in rehabilitation: an illustration of appropriate statistical analyses</article-title><source>Clin Rehabil</source><year>1998</year><volume>12</volume><issue>3</issue><fpage>187</fpage><lpage>99</lpage><pub-id pub-id-type="doi">10.1191/026921598672178340</pub-id><pub-id pub-id-type="pmid">9688034</pub-id></element-citation></ref><ref id="CR40"><label>40.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bland</surname><given-names>JM</given-names></name><name><surname>Altman</surname><given-names>DG</given-names></name></person-group><article-title>Statistical methods for assessing agreement between two methods of clinical measurement</article-title><source>Lancet</source><year>1986</year><volume>1</volume><issue>8476</issue><fpage>307</fpage><lpage>10</lpage><pub-id pub-id-type="doi">10.1016/S0140-6736(86)90837-8</pub-id><pub-id pub-id-type="pmid">2868172</pub-id></element-citation></ref><ref id="CR41"><label>41.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bland</surname><given-names>JM</given-names></name><name><surname>Altman</surname><given-names>DG</given-names></name></person-group><article-title>Applying the right statistics: analyses of measurement studies</article-title><source>Ultrasound Obstet Gynecol</source><year>2003</year><volume>22</volume><issue>1</issue><fpage>85</fpage><lpage>93</lpage><pub-id pub-id-type="doi">10.1002/uog.122</pub-id><pub-id pub-id-type="pmid">12858311</pub-id></element-citation></ref><ref id="CR42"><label>42.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Liaw</surname><given-names>LJ</given-names></name><name><surname>Hsieh</surname><given-names>CL</given-names></name><name><surname>Lo</surname><given-names>SK</given-names></name><name><surname>Chen</surname><given-names>HM</given-names></name><name><surname>Lee</surname><given-names>S</given-names></name><name><surname>Lin</surname><given-names>JH</given-names></name></person-group><article-title>The relative and absolute reliability of two balance performance measures in chronic stroke patients</article-title><source>Disabil Rehabil</source><year>2008</year><volume>30</volume><issue>9</issue><fpage>656</fpage><lpage>61</lpage><pub-id pub-id-type="doi">10.1080/09638280701400698</pub-id><pub-id pub-id-type="pmid">17852318</pub-id></element-citation></ref><ref id="CR43"><label>43.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brehm</surname><given-names>MA</given-names></name><name><surname>Scholtes</surname><given-names>VA</given-names></name><name><surname>Dallmeijer</surname><given-names>AJ</given-names></name><name><surname>Twisk</surname><given-names>JW</given-names></name><name><surname>Harlaar</surname><given-names>J</given-names></name></person-group><article-title>The importance of addressing heteroscedasticity in the reliability analysis of ratio-scaled variables: an example based on walking energy-cost measurements</article-title><source>Dev Med Child Neurol</source><year>2012</year><volume>54</volume><issue>3</issue><fpage>267</fpage><lpage>73</lpage><pub-id pub-id-type="doi">10.1111/j.1469-8749.2011.04164.x</pub-id><pub-id pub-id-type="pmid">22150364</pub-id></element-citation></ref><ref id="CR44"><label>44.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bland</surname><given-names>JM</given-names></name><name><surname>Altman</surname><given-names>DG</given-names></name></person-group><article-title>Transforming data</article-title><source>BMJ</source><year>1996</year><volume>312</volume><issue>7033</issue><fpage>770</fpage><pub-id pub-id-type="doi">10.1136/bmj.312.7033.770</pub-id><pub-id pub-id-type="pmid">8605469</pub-id></element-citation></ref><ref id="CR45"><label>45.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Euser</surname><given-names>AM</given-names></name><name><surname>Dekker</surname><given-names>FW</given-names></name><name><surname>le Cessie</surname><given-names>S</given-names></name></person-group><article-title>A practical approach to Bland-Altman plots and variation coefficients for log transformed variables</article-title><source>J Clin Epidemiol</source><year>2008</year><volume>61</volume><issue>10</issue><fpage>978</fpage><lpage>82</lpage><pub-id pub-id-type="doi">10.1016/j.jclinepi.2007.11.003</pub-id><pub-id pub-id-type="pmid">18468854</pub-id></element-citation></ref><ref id="CR46"><label>46.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aaronson</surname><given-names>N</given-names></name><name><surname>Alonso</surname><given-names>J</given-names></name><name><surname>Burnam</surname><given-names>A</given-names></name><name><surname>Lohr</surname><given-names>KN</given-names></name><name><surname>Patrick</surname><given-names>DL</given-names></name><name><surname>Perrin</surname><given-names>E</given-names></name><etal></etal></person-group><article-title>Assessing health status and quality-of-life instruments: attributes and review criteria</article-title><source>Qual Life Res</source><year>2002</year><volume>11</volume><issue>3</issue><fpage>193</fpage><lpage>205</lpage><pub-id pub-id-type="doi">10.1023/A:1015291021312</pub-id><pub-id pub-id-type="pmid">12074258</pub-id></element-citation></ref><ref id="CR47"><label>47.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bowler</surname><given-names>M</given-names></name><name><surname>Amirabdollahian</surname><given-names>F</given-names></name><name><surname>Dautenhahn</surname><given-names>K</given-names></name></person-group><article-title>Using an embedded reality approach to improve test reliability for NHPT tasks</article-title><source>IEEE Int Conf Rehabil Robot</source><year>2011</year><volume>2011</volume><fpage>5975343</fpage><pub-id pub-id-type="pmid">22275548</pub-id></element-citation></ref><ref id="CR48"><label>48.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Terwee</surname><given-names>CB</given-names></name><name><surname>Bot</surname><given-names>SD</given-names></name><name><surname>de Boer</surname><given-names>MR</given-names></name><name><surname>van der Windt</surname><given-names>DA</given-names></name><name><surname>Knol</surname><given-names>DL</given-names></name><name><surname>Dekker</surname><given-names>J</given-names></name><etal></etal></person-group><article-title>Quality criteria were proposed for measurement properties of health status questionnaires</article-title><source>J Clin Epidemiol</source><year>2007</year><volume>60</volume><issue>1</issue><fpage>34</fpage><lpage>42</lpage><pub-id pub-id-type="doi">10.1016/j.jclinepi.2006.03.012</pub-id><pub-id pub-id-type="pmid">17161752</pub-id></element-citation></ref><ref id="CR49"><label>49.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zou</surname><given-names>GY</given-names></name></person-group><article-title>Sample size formulas for estimating intraclass correlation coefficients with precision and assurance</article-title><source>Stat Med</source><year>2012</year><volume>31</volume><issue>29</issue><fpage>3972</fpage><lpage>81</lpage><pub-id pub-id-type="doi">10.1002/sim.5466</pub-id><pub-id pub-id-type="pmid">22764084</pub-id></element-citation></ref><ref id="CR50"><label>50.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jette</surname><given-names>AM</given-names></name><name><surname>Tao</surname><given-names>W</given-names></name><name><surname>Norweg</surname><given-names>A</given-names></name><name><surname>Haley</surname><given-names>S</given-names></name></person-group><article-title>Interpreting rehabilitation outcome measurements</article-title><source>J Rehabil Med</source><year>2007</year><volume>39</volume><fpage>585</fpage><lpage>90</lpage><pub-id pub-id-type="doi">10.2340/16501977-0119</pub-id><pub-id pub-id-type="pmid">17896048</pub-id></element-citation></ref><ref id="CR51"><label>51.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schmidheiny</surname><given-names>A</given-names></name><name><surname>Swanenburg</surname><given-names>J</given-names></name><name><surname>Straumann</surname><given-names>D</given-names></name><name><surname>de Bruin</surname><given-names>ED</given-names></name><name><surname>Knols</surname><given-names>RH</given-names></name></person-group><article-title>Discriminant validity and test re-test reproducibility of a gait assessment in patients with vestibular dysfunction</article-title><source>BMC Ear Nose Throat Disord</source><year>2015</year><volume>15</volume><fpage>6</fpage><pub-id pub-id-type="doi">10.1186/s12901-015-0019-8</pub-id><pub-id pub-id-type="pmid">26500447</pub-id></element-citation></ref><ref id="CR52"><label>52.</label><mixed-citation publication-type="other">Information Brochure Armon Elemento. [<ext-link ext-link-type="uri" xlink:href="http://www.armonproducts.com/images/Information_Brochure_Armon_Elemento.pdf">http://www.armonproducts.com/images/Information_Brochure_Armon_Elemento.pdf</ext-link>].</mixed-citation></ref><ref id="CR53"><label>53.</label><mixed-citation publication-type="other">Altman DG. Practical statistics for medical research, [First CRC Press repr.] edn: Boca Raton: Chapman & Hall/CRC; 1999.</mixed-citation></ref><ref id="CR54"><label>54.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pollock</surname><given-names>A</given-names></name><name><surname>Farmer</surname><given-names>SE</given-names></name><name><surname>Brady</surname><given-names>MC</given-names></name><name><surname>Langhorne</surname><given-names>P</given-names></name><name><surname>Mead</surname><given-names>GE</given-names></name><name><surname>Mehrholz</surname><given-names>J</given-names></name><etal></etal></person-group><article-title>Interventions for improving upper limb function after stroke</article-title><source>Cochrane Database Syst Rev</source><year>2014</year><volume>11</volume><fpage>Cd010820</fpage><pub-id pub-id-type="pmid">25387001</pub-id></element-citation></ref></ref-list></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000851 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000851 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Pmc
|étape= Curation
|type= RBID
|clé= PMC:4724098
|texte= Concurrent validity and test-retest reliability of the Virtual Peg Insertion Test to quantify upper limb function in patients with chronic stroke
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:26801395" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |