Serveur d'exploration sur les dispositifs haptiques

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

The dominance of haptics over audition in controlling wrist velocity during striking movements

Identifieur interne : 000794 ( Pmc/Curation ); précédent : 000793; suivant : 000795

The dominance of haptics over audition in controlling wrist velocity during striking movements

Auteurs : Yinan Cao [Royaume-Uni] ; Bruno L. Giordano [Royaume-Uni] ; Federico Avanzini [Italie] ; Stephen Mcadams

Source :

RBID : PMC:4785215

Abstract

Skilled interactions with sounding objects, such as drumming, rely on resolving the uncertainty in the acoustical and tactual feedback signals generated by vibrating objects. Uncertainty may arise from mis-estimation of the objects’ geometry-independent mechanical properties, such as surface stiffness. How multisensory information feeds back into the fine-tuning of sound-generating actions remains unexplored. Participants (percussionists, non-percussion musicians, or non-musicians) held a stylus and learned to control their wrist velocity while repeatedly striking a virtual sounding object whose surface stiffness was under computer control. Sensory feedback was manipulated by perturbing the surface stiffness specified by audition and haptics in a congruent or incongruent manner. The compensatory changes in striking velocity were measured as the motor effects of the sensory perturbations, and sensory dominance was quantified by the asymmetry of congruency effects across audition and haptics. A pronounced dominance of haptics over audition suggested a superior utility of somatosensation developed through long-term experience with object exploration. Large interindividual differences in the motor effects of haptic perturbation potentially arose from a differential reliance on the type of tactual prediction error for which participants tend to compensate: vibrotactile force versus object deformation. Musical experience did not have much of an effect beyond a slightly greater reliance on object deformation in mallet percussionists. The bias toward haptics in the presence of crossmodal perturbations was greater when participants appeared to rely on object deformation feedback, suggesting a weaker association between haptically sensed object deformation and the acoustical structure of concomitant sound during everyday experience of actions upon objects.


Url:
DOI: 10.1007/s00221-015-4529-9
PubMed: 26790425
PubMed Central: 4785215

Links toward previous steps (curation, corpus...)


Links to Exploration step

PMC:4785215

Curation

No country items

Yinan Cao
<affiliation>
<nlm:aff id="Aff2">Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC Canada</nlm:aff>
<wicri:noCountry code="subfield">QC Canada</wicri:noCountry>
</affiliation>
Stephen Mcadams
<affiliation>
<nlm:aff id="Aff2">Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC Canada</nlm:aff>
<wicri:noCountry code="subfield">QC Canada</wicri:noCountry>
</affiliation>

Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">The dominance of haptics over audition in controlling wrist velocity during striking movements</title>
<author>
<name sortKey="Cao, Yinan" sort="Cao, Yinan" uniqKey="Cao Y" first="Yinan" last="Cao">Yinan Cao</name>
<affiliation wicri:level="1">
<nlm:aff id="Aff1">Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, Oxford, UK</nlm:aff>
<country xml:lang="fr">Royaume-Uni</country>
<wicri:regionArea>Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, Oxford</wicri:regionArea>
</affiliation>
<affiliation>
<nlm:aff id="Aff2">Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC Canada</nlm:aff>
<wicri:noCountry code="subfield">QC Canada</wicri:noCountry>
</affiliation>
</author>
<author>
<name sortKey="Giordano, Bruno L" sort="Giordano, Bruno L" uniqKey="Giordano B" first="Bruno L." last="Giordano">Bruno L. Giordano</name>
<affiliation wicri:level="1">
<nlm:aff id="Aff3">Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland, UK</nlm:aff>
<country xml:lang="fr">Royaume-Uni</country>
<wicri:regionArea>Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland</wicri:regionArea>
</affiliation>
</author>
<author>
<name sortKey="Avanzini, Federico" sort="Avanzini, Federico" uniqKey="Avanzini F" first="Federico" last="Avanzini">Federico Avanzini</name>
<affiliation wicri:level="1">
<nlm:aff id="Aff4">Department of Information Engineering, University of Padova, Padua, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Department of Information Engineering, University of Padova, Padua</wicri:regionArea>
</affiliation>
</author>
<author>
<name sortKey="Mcadams, Stephen" sort="Mcadams, Stephen" uniqKey="Mcadams S" first="Stephen" last="Mcadams">Stephen Mcadams</name>
<affiliation>
<nlm:aff id="Aff2">Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC Canada</nlm:aff>
<wicri:noCountry code="subfield">QC Canada</wicri:noCountry>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">PMC</idno>
<idno type="pmid">26790425</idno>
<idno type="pmc">4785215</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4785215</idno>
<idno type="RBID">PMC:4785215</idno>
<idno type="doi">10.1007/s00221-015-4529-9</idno>
<date when="2016">2016</date>
<idno type="wicri:Area/Pmc/Corpus">000794</idno>
<idno type="wicri:Area/Pmc/Curation">000794</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en" level="a" type="main">The dominance of haptics over audition in controlling wrist velocity during striking movements</title>
<author>
<name sortKey="Cao, Yinan" sort="Cao, Yinan" uniqKey="Cao Y" first="Yinan" last="Cao">Yinan Cao</name>
<affiliation wicri:level="1">
<nlm:aff id="Aff1">Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, Oxford, UK</nlm:aff>
<country xml:lang="fr">Royaume-Uni</country>
<wicri:regionArea>Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, Oxford</wicri:regionArea>
</affiliation>
<affiliation>
<nlm:aff id="Aff2">Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC Canada</nlm:aff>
<wicri:noCountry code="subfield">QC Canada</wicri:noCountry>
</affiliation>
</author>
<author>
<name sortKey="Giordano, Bruno L" sort="Giordano, Bruno L" uniqKey="Giordano B" first="Bruno L." last="Giordano">Bruno L. Giordano</name>
<affiliation wicri:level="1">
<nlm:aff id="Aff3">Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland, UK</nlm:aff>
<country xml:lang="fr">Royaume-Uni</country>
<wicri:regionArea>Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland</wicri:regionArea>
</affiliation>
</author>
<author>
<name sortKey="Avanzini, Federico" sort="Avanzini, Federico" uniqKey="Avanzini F" first="Federico" last="Avanzini">Federico Avanzini</name>
<affiliation wicri:level="1">
<nlm:aff id="Aff4">Department of Information Engineering, University of Padova, Padua, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Department of Information Engineering, University of Padova, Padua</wicri:regionArea>
</affiliation>
</author>
<author>
<name sortKey="Mcadams, Stephen" sort="Mcadams, Stephen" uniqKey="Mcadams S" first="Stephen" last="Mcadams">Stephen Mcadams</name>
<affiliation>
<nlm:aff id="Aff2">Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC Canada</nlm:aff>
<wicri:noCountry code="subfield">QC Canada</wicri:noCountry>
</affiliation>
</author>
</analytic>
<series>
<title level="j">Experimental Brain Research</title>
<idno type="ISSN">0014-4819</idno>
<idno type="eISSN">1432-1106</idno>
<imprint>
<date when="2016">2016</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass></textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">
<p>Skilled interactions with sounding objects, such as drumming, rely on resolving the uncertainty in the acoustical and tactual feedback signals generated by vibrating objects. Uncertainty may arise from mis-estimation of the objects’ geometry-independent mechanical properties, such as surface stiffness. How multisensory information feeds back into the fine-tuning of sound-generating actions remains unexplored. Participants (percussionists, non-percussion musicians, or non-musicians) held a stylus and learned to control their wrist velocity while repeatedly striking a virtual sounding object whose surface stiffness was under computer control. Sensory feedback was manipulated by perturbing the surface stiffness specified by audition and haptics in a congruent or incongruent manner. The compensatory changes in striking velocity were measured as the motor effects of the sensory perturbations, and sensory dominance was quantified by the asymmetry of congruency effects across audition and haptics. A pronounced dominance of haptics over audition suggested a superior utility of somatosensation developed through long-term experience with object exploration. Large interindividual differences in the motor effects of haptic perturbation potentially arose from a differential reliance on the type of tactual prediction error for which participants tend to compensate: vibrotactile force versus object deformation. Musical experience did not have much of an effect beyond a slightly greater reliance on object deformation in mallet percussionists. The bias toward haptics in the presence of crossmodal perturbations was greater when participants appeared to rely on object deformation feedback, suggesting a weaker association between haptically sensed object deformation and the acoustical structure of concomitant sound during everyday experience of actions upon objects.</p>
</div>
</front>
<back>
<div1 type="bibliography">
<listBibl>
<biblStruct>
<analytic>
<author>
<name sortKey="Avanzini, F" uniqKey="Avanzini F">F Avanzini</name>
</author>
<author>
<name sortKey="Crosato, P" uniqKey="Crosato P">P Crosato</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Bresciani, Jp" uniqKey="Bresciani J">JP Bresciani</name>
</author>
<author>
<name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
<author>
<name sortKey="Drewing, K" uniqKey="Drewing K">K Drewing</name>
</author>
<author>
<name sortKey="Bouyer, G" uniqKey="Bouyer G">G Bouyer</name>
</author>
<author>
<name sortKey="Maury, V" uniqKey="Maury V">V Maury</name>
</author>
<author>
<name sortKey="Kheddar, A" uniqKey="Kheddar A">A Kheddar</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Caclin, A" uniqKey="Caclin A">A Caclin</name>
</author>
<author>
<name sortKey="Soto Faraco, S" uniqKey="Soto Faraco S">S Soto-Faraco</name>
</author>
<author>
<name sortKey="Kingstone, A" uniqKey="Kingstone A">A Kingstone</name>
</author>
<author>
<name sortKey="Spence, C" uniqKey="Spence C">C Spence</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Chaigne, A" uniqKey="Chaigne A">A Chaigne</name>
</author>
<author>
<name sortKey="Doutaut, V" uniqKey="Doutaut V">V Doutaut</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Cicchini, Gm" uniqKey="Cicchini G">GM Cicchini</name>
</author>
<author>
<name sortKey="Arrighi, R" uniqKey="Arrighi R">R Arrighi</name>
</author>
<author>
<name sortKey="Cecchetti, L" uniqKey="Cecchetti L">L Cecchetti</name>
</author>
<author>
<name sortKey="Giusti, M" uniqKey="Giusti M">M Giusti</name>
</author>
<author>
<name sortKey="Burr, Dc" uniqKey="Burr D">DC Burr</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Dahl, S" uniqKey="Dahl S">S Dahl</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Difranco, De" uniqKey="Difranco D">DE DiFranco</name>
</author>
<author>
<name sortKey="Beauregard, Gl" uniqKey="Beauregard G">GL Beauregard</name>
</author>
<author>
<name sortKey="Srinivasan, Ma" uniqKey="Srinivasan M">MA Srinivasan</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Driver, J" uniqKey="Driver J">J Driver</name>
</author>
<author>
<name sortKey="Spence, C" uniqKey="Spence C">C Spence</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
<author>
<name sortKey="Di Luca, M" uniqKey="Di Luca M">M Di Luca</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Flanagan, Jr" uniqKey="Flanagan J">JR Flanagan</name>
</author>
<author>
<name sortKey="Wing, Am" uniqKey="Wing A">AM Wing</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Fletcher, Nh" uniqKey="Fletcher N">NH Fletcher</name>
</author>
<author>
<name sortKey="Rossing, Td" uniqKey="Rossing T">TD Rossing</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Fujii, S" uniqKey="Fujii S">S Fujii</name>
</author>
<author>
<name sortKey="Kudo, K" uniqKey="Kudo K">K Kudo</name>
</author>
<author>
<name sortKey="Ohtsuki, T" uniqKey="Ohtsuki T">T Ohtsuki</name>
</author>
<author>
<name sortKey="Oda, S" uniqKey="Oda S">S Oda</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gescheider, Ga" uniqKey="Gescheider G">GA Gescheider</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gibson, Jj" uniqKey="Gibson J">JJ Gibson</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Giordano, Bl" uniqKey="Giordano B">BL Giordano</name>
</author>
<author>
<name sortKey="Rocchesso, D" uniqKey="Rocchesso D">D Rocchesso</name>
</author>
<author>
<name sortKey="Mcadams, S" uniqKey="Mcadams S">S McAdams</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Giordano, Bl" uniqKey="Giordano B">BL Giordano</name>
</author>
<author>
<name sortKey="Visell, Y" uniqKey="Visell Y">Y Visell</name>
</author>
<author>
<name sortKey="Yao, Hy" uniqKey="Yao H">HY Yao</name>
</author>
<author>
<name sortKey="Hayward, V" uniqKey="Hayward V">V Hayward</name>
</author>
<author>
<name sortKey="Cooperstock, Jr" uniqKey="Cooperstock J">JR Cooperstock</name>
</author>
<author>
<name sortKey="Mcadams, S" uniqKey="Mcadams S">S McAdams</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Guest, S" uniqKey="Guest S">S Guest</name>
</author>
<author>
<name sortKey="Catmur, C" uniqKey="Catmur C">C Catmur</name>
</author>
<author>
<name sortKey="Lloyd, D" uniqKey="Lloyd D">D Lloyd</name>
</author>
<author>
<name sortKey="Spence, C" uniqKey="Spence C">C Spence</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Klatzky, Rl" uniqKey="Klatzky R">RL Klatzky</name>
</author>
<author>
<name sortKey="Lederman, Sj" uniqKey="Lederman S">SJ Lederman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kording, Kp" uniqKey="Kording K">KP Körding</name>
</author>
<author>
<name sortKey="Beierholm, U" uniqKey="Beierholm U">U Beierholm</name>
</author>
<author>
<name sortKey="Ma, Wj" uniqKey="Ma W">WJ Ma</name>
</author>
<author>
<name sortKey="Quartz, S" uniqKey="Quartz S">S Quartz</name>
</author>
<author>
<name sortKey="Tenenbaum, Jb" uniqKey="Tenenbaum J">JB Tenenbaum</name>
</author>
<author>
<name sortKey="Shams, L" uniqKey="Shams L">L Shams</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kuchenbuch, A" uniqKey="Kuchenbuch A">A Kuchenbuch</name>
</author>
<author>
<name sortKey="Paraskevopoulos, E" uniqKey="Paraskevopoulos E">E Paraskevopoulos</name>
</author>
<author>
<name sortKey="Herholz, Sc" uniqKey="Herholz S">SC Herholz</name>
</author>
<author>
<name sortKey="Pantev, C" uniqKey="Pantev C">C Pantev</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lametti, Dr" uniqKey="Lametti D">DR Lametti</name>
</author>
<author>
<name sortKey="Nasir, Sm" uniqKey="Nasir S">SM Nasir</name>
</author>
<author>
<name sortKey="Ostry, Dj" uniqKey="Ostry D">DJ Ostry</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lamotte, Rh" uniqKey="Lamotte R">RH LaMotte</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lederman, Sj" uniqKey="Lederman S">SJ Lederman</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lederman, Sj" uniqKey="Lederman S">SJ Lederman</name>
</author>
<author>
<name sortKey="Klatzky, Rl" uniqKey="Klatzky R">RL Klatzky</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lee, H" uniqKey="Lee H">H Lee</name>
</author>
<author>
<name sortKey="Noppeney, U" uniqKey="Noppeney U">U Noppeney</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lutfi, Ra" uniqKey="Lutfi R">RA Lutfi</name>
</author>
<author>
<name sortKey="Liu, Cj" uniqKey="Liu C">CJ Liu</name>
</author>
<author>
<name sortKey="Stoelinga, Cn" uniqKey="Stoelinga C">CN Stoelinga</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Martin, Fn" uniqKey="Martin F">FN Martin</name>
</author>
<author>
<name sortKey="Champlin, Ca" uniqKey="Champlin C">CA Champlin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Miall, R" uniqKey="Miall R">R Miall</name>
</author>
<author>
<name sortKey="Wolpert, Dm" uniqKey="Wolpert D">DM Wolpert</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Pouget, A" uniqKey="Pouget A">A Pouget</name>
</author>
<author>
<name sortKey="Snyder, Lh" uniqKey="Snyder L">LH Snyder</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Powers, Ar" uniqKey="Powers A">AR Powers</name>
</author>
<author>
<name sortKey="Hillock, Ar" uniqKey="Hillock A">AR Hillock</name>
</author>
<author>
<name sortKey="Wallace, Mt" uniqKey="Wallace M">MT Wallace</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rivin, Ei" uniqKey="Rivin E">EI Rivin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ronsse, R" uniqKey="Ronsse R">R Ronsse</name>
</author>
<author>
<name sortKey="Miall, Rc" uniqKey="Miall R">RC Miall</name>
</author>
<author>
<name sortKey="Swinnen, Sp" uniqKey="Swinnen S">SP Swinnen</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Saunders, Ja" uniqKey="Saunders J">JA Saunders</name>
</author>
<author>
<name sortKey="Knill, Dc" uniqKey="Knill D">DC Knill</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Shadmehr, R" uniqKey="Shadmehr R">R Shadmehr</name>
</author>
<author>
<name sortKey="Smith, Ma" uniqKey="Smith M">MA Smith</name>
</author>
<author>
<name sortKey="Krakauer, Jw" uniqKey="Krakauer J">JW Krakauer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Sober, Sj" uniqKey="Sober S">SJ Sober</name>
</author>
<author>
<name sortKey="Sabes, Pn" uniqKey="Sabes P">PN Sabes</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Soto Faraco, S" uniqKey="Soto Faraco S">S Soto-Faraco</name>
</author>
<author>
<name sortKey="Spence, C" uniqKey="Spence C">C Spence</name>
</author>
<author>
<name sortKey="Kingstone, A" uniqKey="Kingstone A">A Kingstone</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Soto Faraco, S" uniqKey="Soto Faraco S">S Soto-Faraco</name>
</author>
<author>
<name sortKey="Spence, C" uniqKey="Spence C">C Spence</name>
</author>
<author>
<name sortKey="Kingstone, A" uniqKey="Kingstone A">A Kingstone</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Villacorta, Vm" uniqKey="Villacorta V">VM Villacorta</name>
</author>
<author>
<name sortKey="Perkell, Js" uniqKey="Perkell J">JS Perkell</name>
</author>
<author>
<name sortKey="Guenther, Fh" uniqKey="Guenther F">FH Guenther</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Welch, Rb" uniqKey="Welch R">RB Welch</name>
</author>
<author>
<name sortKey="Warren, Dh" uniqKey="Warren D">DH Warren</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="West, B" uniqKey="West B">B West</name>
</author>
<author>
<name sortKey="Welch, Kb" uniqKey="Welch K">KB Welch</name>
</author>
<author>
<name sortKey="Galecki, At" uniqKey="Galecki A">AT Galecki</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article">
<pmc-dir>properties open_access</pmc-dir>
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">Exp Brain Res</journal-id>
<journal-id journal-id-type="iso-abbrev">Exp Brain Res</journal-id>
<journal-title-group>
<journal-title>Experimental Brain Research</journal-title>
</journal-title-group>
<issn pub-type="ppub">0014-4819</issn>
<issn pub-type="epub">1432-1106</issn>
<publisher>
<publisher-name>Springer Berlin Heidelberg</publisher-name>
<publisher-loc>Berlin/Heidelberg</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="pmid">26790425</article-id>
<article-id pub-id-type="pmc">4785215</article-id>
<article-id pub-id-type="publisher-id">4529</article-id>
<article-id pub-id-type="doi">10.1007/s00221-015-4529-9</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Research Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>The dominance of haptics over audition in controlling wrist velocity during striking movements</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" equal-contrib="yes">
<name>
<surname>Cao</surname>
<given-names>Yinan</given-names>
</name>
<address>
<email>yinan.cao@psy.ox.ac.uk</email>
</address>
<xref ref-type="aff" rid="Aff1"></xref>
<xref ref-type="aff" rid="Aff2"></xref>
</contrib>
<contrib contrib-type="author" corresp="yes" equal-contrib="yes">
<name>
<surname>Giordano</surname>
<given-names>Bruno L.</given-names>
</name>
<address>
<email>bruno.giordano@glasgow.ac.uk</email>
</address>
<xref ref-type="aff" rid="Aff3"></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Avanzini</surname>
<given-names>Federico</given-names>
</name>
<xref ref-type="aff" rid="Aff4"></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>McAdams</surname>
<given-names>Stephen</given-names>
</name>
<xref ref-type="aff" rid="Aff2"></xref>
</contrib>
<aff id="Aff1">
<label></label>
Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, Oxford, UK</aff>
<aff id="Aff2">
<label></label>
Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC Canada</aff>
<aff id="Aff3">
<label></label>
Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland, UK</aff>
<aff id="Aff4">
<label></label>
Department of Information Engineering, University of Padova, Padua, Italy</aff>
</contrib-group>
<pub-date pub-type="epub">
<day>20</day>
<month>1</month>
<year>2016</year>
</pub-date>
<pub-date pub-type="pmc-release">
<day>20</day>
<month>1</month>
<year>2016</year>
</pub-date>
<pub-date pub-type="ppub">
<year>2016</year>
</pub-date>
<volume>234</volume>
<fpage>1145</fpage>
<lpage>1158</lpage>
<history>
<date date-type="received">
<day>14</day>
<month>12</month>
<year>2014</year>
</date>
<date date-type="accepted">
<day>12</day>
<month>12</month>
<year>2015</year>
</date>
</history>
<permissions>
<copyright-statement>© The Author(s) 2016</copyright-statement>
<license license-type="OpenAccess">
<license-p>
<bold>Open Access</bold>
This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (
<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</ext-link>
), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.</license-p>
</license>
</permissions>
<abstract id="Abs1">
<p>Skilled interactions with sounding objects, such as drumming, rely on resolving the uncertainty in the acoustical and tactual feedback signals generated by vibrating objects. Uncertainty may arise from mis-estimation of the objects’ geometry-independent mechanical properties, such as surface stiffness. How multisensory information feeds back into the fine-tuning of sound-generating actions remains unexplored. Participants (percussionists, non-percussion musicians, or non-musicians) held a stylus and learned to control their wrist velocity while repeatedly striking a virtual sounding object whose surface stiffness was under computer control. Sensory feedback was manipulated by perturbing the surface stiffness specified by audition and haptics in a congruent or incongruent manner. The compensatory changes in striking velocity were measured as the motor effects of the sensory perturbations, and sensory dominance was quantified by the asymmetry of congruency effects across audition and haptics. A pronounced dominance of haptics over audition suggested a superior utility of somatosensation developed through long-term experience with object exploration. Large interindividual differences in the motor effects of haptic perturbation potentially arose from a differential reliance on the type of tactual prediction error for which participants tend to compensate: vibrotactile force versus object deformation. Musical experience did not have much of an effect beyond a slightly greater reliance on object deformation in mallet percussionists. The bias toward haptics in the presence of crossmodal perturbations was greater when participants appeared to rely on object deformation feedback, suggesting a weaker association between haptically sensed object deformation and the acoustical structure of concomitant sound during everyday experience of actions upon objects.</p>
</abstract>
<kwd-group xml:lang="en">
<title>Keywords</title>
<kwd>Striking objects</kwd>
<kwd>Surface stiffness</kwd>
<kwd>Crossmodal congruency</kwd>
<kwd>Motor control</kwd>
</kwd-group>
<custom-meta-group>
<custom-meta>
<meta-name>issue-copyright-statement</meta-name>
<meta-value>© Springer-Verlag Berlin Heidelberg 2016</meta-value>
</custom-meta>
</custom-meta-group>
</article-meta>
</front>
<body>
<sec id="Sec1">
<title>Introduction</title>
<p>Sound is known to influence properties of tactile sensations such as the perceived frequency content of a vibration at the skin (Gescheider
<xref ref-type="bibr" rid="CR13">1974</xref>
; Guest et al.
<xref ref-type="bibr" rid="CR17">2002</xref>
) or the quantity of tactile taps (Bresciani et al.
<xref ref-type="bibr" rid="CR2">2005</xref>
). Furthermore, haptic information appears to dominate auditory cues across a broad range of audio–haptic processes (Lederman
<xref ref-type="bibr" rid="CR25">1979</xref>
; Caclin et al.
<xref ref-type="bibr" rid="CR3">2002</xref>
; Lederman et al.
<xref ref-type="bibr" rid="CR27">2002</xref>
; Lederman and Klatzky
<xref ref-type="bibr" rid="CR26">2004</xref>
; Soto-Faraco et al.
<xref ref-type="bibr" rid="CR39">2004a</xref>
; Giordano et al.
<xref ref-type="bibr" rid="CR16">2012</xref>
). This dominance echoes the “modality appropriateness” principle (Welch and Warren
<xref ref-type="bibr" rid="CR42">1980</xref>
) according to which sensory feedback signals are weighted based on long-term experience in proportion to the perceptual performance they afford. However, the majority of previous empirical evidence for the mechanisms of multisensory processing has been collected by focusing on purely perceptual situations in which multiple sources of information are combined to estimate sensory attributes (e.g., object size or hardness), hindering the understanding of how they are processed and weighted to control skilled motor performance.</p>
<p>Notable exceptions to this trend are studies that have examined the effect of integrating multiple sources of non-auditory feedback (e.g., visual and proprioceptive signals) on the early planning (Sober and Sabes
<xref ref-type="bibr" rid="CR38">2003</xref>
) and online correction of limb movements (Saunders and Knill
<xref ref-type="bibr" rid="CR36">2004</xref>
; Ronsse et al.
<xref ref-type="bibr" rid="CR35">2009</xref>
) in the absence of contact with external objects. However, we make frequent direct or tool-based contacts with objects when carrying out activities such as hitting a tennis ball with a racquet or playing a percussion instrument. In such cases, the task-relevant sensory information that can be transformed into goal-directed motor commands (Pouget and Snyder
<xref ref-type="bibr" rid="CR32">2000</xref>
) will include the somatosensory and auditory signals encoding the mechanical contact states. Maintaining dexterous strike-based interactions with sounding objects (e.g., drumming) requires fast and efficient updating of the kinematic state (e.g., wrist movement velocity) to counteract any sensory mismatch such as a mis-expectation of the impact properties based on the surface stiffness of the object.
<xref ref-type="fn" rid="Fn1">1</xref>
Sensory prediction errors (Miall and Wolpert
<xref ref-type="bibr" rid="CR31">1996</xref>
; Shadmehr et al.
<xref ref-type="bibr" rid="CR37">2010</xref>
) occur when there is a discrepancy between the predicted and the observed sensory consequences of a motor command. The prediction errors may be attributable to the alteration of multiple tactual cues (cutaneous and kinesthetic) that correlate with object surface stiffness (LaMotte
<xref ref-type="bibr" rid="CR24">2000</xref>
), and may naturally come from other sensory modalities apart from haptics, particularly audition (e.g., impact sounds). It is not clear by which mechanisms the integrative processing of impact-generated auditory and haptic information guides the control of striking kinematics during the sonic interaction with objects. We investigated this issue by measuring compensatory striking kinematics in a virtual-reality setup that allowed for the alteration of both haptic and auditory feedback as sensory consequences of striking events.</p>
<p>Expert percussionists have demonstrated superior precision compared to musically untrained individuals in both motor (Fujii et al.
<xref ref-type="bibr" rid="CR12">2009</xref>
) and perceptual tasks (Lutfi et al.
<xref ref-type="bibr" rid="CR29">2011</xref>
; Cicchini et al.
<xref ref-type="bibr" rid="CR5">2012</xref>
), indicating experience-related shaping of sensorimotor skills. It remains unclear, however, whether task-specific expertise can be a factor influencing the planning of compensatory motor responses based on crossmodal prediction errors. Musical training appears to enhance the sensitivity to audio–tactile conflicts in a detection task, supporting the predictive coding account of perception (Kuchenbuch et al.
<xref ref-type="bibr" rid="CR22">2014</xref>
). Motor-based multisensory processes, by contrast, have been robustly identified as involving a generalized state inference strategy that aims for a statistical optimization in terms of the lowest possible motor uncertainty independently of prior experience with the task (Ronsse et al.
<xref ref-type="bibr" rid="CR35">2009</xref>
). To evaluate whether or not experiential factors play a role in modulating motor-based multisensory processes, the present study included a group of professional percussionists as participants as well as a group of non-percussionist musicians and a group that was musically naïve.</p>
<p>Here participants learned to maintain the target velocity of a hand-held stylus while repeatedly striking an audio–haptic virtual object. With this setup, sensory feedback of the impact properties (acoustical and tactual) was experimentally determined not only by an intrinsic parameter—the surface stiffness of the audio–haptic object—but also by an extrinsic input—the striking velocity of the user. A surreptitious perturbation to the audio–haptic stiffness of the struck object would thus confuse the estimate of the source of prediction errors from impact properties (“limb or object?”), which would drive motor corrections. We quantified individual differences in the magnitude and direction of compensatory motor responses to different types of sensory error by manipulating the acoustical and haptic feedback in isolation. We furthermore addressed the issue of modality dominance by changing the auditory and haptic stiffnesses in combination, either incongruently (e.g., an increase in auditory stiffness heard in sound accompanied by a decrease in haptic stiffness felt by touch) or congruently. Sensory dominance would be characterized by a potential asymmetry of crossmodal congruency effects across audition and haptics (Driver and Spence
<xref ref-type="bibr" rid="CR8">2004</xref>
).</p>
</sec>
<sec id="Sec2">
<title>Methods</title>
<sec id="Sec3">
<title>Participants</title>
<p>Forty-two right-handed participants (26 females; mean age = 22.5 years, SD = 4) were included in the study. They were divided into three groups of 14: non-musicians (very limited prior musical training,
<italic>M</italic>
 = 0.9 years, SD = 1.4), non-percussionist musicians (NP-musicians, hereafter; at least four years of musical training, but not in percussion,
<italic>M</italic>
 = 12.6 years, SD = 5.1), and percussionists (at least five years of professional training in percussion,
<italic>M</italic>
 = 11.6 years, SD = 3.7; currently performing or practicing). All participants had normal hearing (Martin and Champlin
<xref ref-type="bibr" rid="CR30">2000</xref>
; ISO
<xref ref-type="bibr" rid="CR18">2004</xref>
), did not report any motor or haptic deficits, and were naïve with respect to the experimental goals. The protocol was certified by the McGill Review Ethics Board (Certificate 67-0905), and all participants gave written informed consent prior to the experiment.</p>
</sec>
<sec id="Sec4">
<title>Apparatus</title>
<p>The task was performed inside an IAC model 120act-3 double-walled audiometric booth (IAC Acoustics, Bronx, NY). While seated in a chair, each participant was instructed to hold, with the dominant hand (right), the stylus of the Phantom Desktop™ (Geomagic Solutions, Morrisvelle, NC), a six-degrees-of-freedom robotic device used to deliver the haptic stimuli (Fig. 
<xref rid="Fig1" ref-type="fig">1</xref>
a). The position signal of the tip of the stylus was measured at 1 kHz by optical encoders at the joints of the linkage structure connected to the stylus. Velocity was computed from position data using numerical differentiation along the vertical axis. This haptic device was interfaced with a real-time Pd (version 0.42.5)
<xref ref-type="fn" rid="Fn2">2</xref>
program for the synthesis of impact sounds, and with a custom C++ program for the control of haptic feedback (see “
<xref rid="Sec5" ref-type="sec">Stimuli</xref>
” section below). Sound stimuli were amplified with a Grace Design m904 stereo monitor controller (Grace Digital Audio, San Diego, CA) connected to the optical port of a Windows workstation used to control the experimental variables, and were presented binaurally through Sennheiser HD280 headphones (Sennheiser Electronics GmbH, Wedemark, Germany). Verbal instructions about the task and visual feedback on the appropriateness of the participants’ performance were presented via the PC monitor (for details, see “
<xref rid="Sec8" ref-type="sec">Procedure</xref>
” section, below).
<fig id="Fig1">
<label>Fig. 1</label>
<caption>
<p>
<bold>a</bold>
Experimental apparatus.
<bold>b</bold>
Time course of one trial, comprising “training,” “maintenance,” and “change” phases. On the training phase, on-screen feedback is displayed immediately after a stroke to indicate whether the striking velocity at impact is below (“Too slow”), within (“Correct”), or above (“Too fast”) the target range.
<bold>c</bold>
Experimental conditions.
<italic>Circles</italic>
and
<italic>triangles</italic>
indicate the change-phase stiffness coefficient
<italic>K</italic>
values of the virtual object presented during the perturbed and unperturbed trials, respectively.
<italic>K</italic>
values are log-transformed and standardized for illustrative purposes. See “
<xref rid="Sec5" ref-type="sec">Stimuli</xref>
” section for the real values of
<italic>K</italic>
used in the experiment</p>
</caption>
<graphic xlink:href="221_2015_4529_Fig1_HTML" id="MO1"></graphic>
</fig>
</p>
<p>The haptic device was stabilized on a table. The participant’s right forearm (except the hand and wrist) rested on the chair’s right arm, which was of the same height (15 cm above the table) as the upper surface of the virtual object (see “
<xref rid="Sec5" ref-type="sec">Stimuli</xref>
” section). The right wrist was prone and lightly restrained with a rubber belt to the chair’s right arm so that only wrist flexion and extension could be easily used to displace the stylus. The joint angle between the upper and lower arm was adjusted to be approximately 90°. The participants’ hand, wrist, and forearm, as well as the stylus, were hidden from view.</p>
</sec>
<sec id="Sec5">
<title>Stimuli</title>
<p>Auditory stimuli were synthesized impact sounds. Haptic stimuli were generated to simulate the sensory feedback of stylus-based strikes upon a static sounding object (Avanzini and Crosato
<xref ref-type="bibr" rid="CR1">2006</xref>
; Itkowitz et al.
<xref ref-type="bibr" rid="CR19">2005</xref>
; Fig. 
<xref rid="Fig1" ref-type="fig">1</xref>
a). To impose perturbing effects on the struck object, we manipulated its mechanical parameter—surface stiffness coefficient
<italic>K</italic>
(hereafter surface stiffness will be referred to simply as stiffness). From the haptic standpoint,
<italic>K</italic>
establishes the relation between the object’s degree of deformation (surface indentation) and the perceived resistive force. From the auditory standpoint, higher values of
<italic>K</italic>
generate an increase in the subjective hardness of the struck virtual object perceived from the synthesized impact sounds (Giordano et al.
<xref ref-type="bibr" rid="CR15">2010</xref>
). Communication latency resulting from the sound synthesis was on the order of a few milliseconds, which is well below the typical experimental estimates for the temporal window of auditory–tactile integration (Bresciani et al.
<xref ref-type="bibr" rid="CR2">2005</xref>
). A previous study by Avanzini and Crosato (
<xref ref-type="bibr" rid="CR1">2006</xref>
) using the same experimental setup reported that no participant perceived a noticeable intermodal latency.</p>
<sec id="Sec6">
<title>Acoustical stimuli</title>
<p>Impact sounds (44.1 kHz, 16-bit resolution; peak intensity = 75 dB SPL) were synthesized using a real-time physically inspired model of an ideal struck bar with five independent vibrational modes and an internal dissipation (Avanzini and Crosato
<xref ref-type="bibr" rid="CR1">2006</xref>
). The resonant frequency of the lowest vibrational mode,
<italic>F</italic>
, was set to 100 Hz. Higher-order modal frequencies were tuned according to the most prominent resonances of a bar clamped at one end and free at the other (Fletcher and Rossing
<xref ref-type="bibr" rid="CR11">1991</xref>
), i.e., they were multiples of
<italic>F</italic>
by {6.26, 17.54, 34.37, 56.82}. The properties of the synthesized acoustical signal were determined in real time by two input parameters—acoustical stiffness coefficient (acoustical
<italic>K</italic>
; see Fig.
<xref rid="Fig2" ref-type="fig">2</xref>
a) and striking velocity at impact (Fig.
<xref rid="Fig2" ref-type="fig">2</xref>
b). Both the acoustical
<italic>K</italic>
and the impact velocity are inversely correlated with the contact duration (Chaigne and Doutaut
<xref ref-type="bibr" rid="CR4">1997</xref>
) in the model, which consequently affects the loudness and brightness of the attack portion of the impact sound (Giordano et al.
<xref ref-type="bibr" rid="CR15">2010</xref>
). A decrease in the contact duration would result in a more efficient excitation of the high-frequency vibrational modes of the sounding object and, consequently, an increase in the high-frequency energy of the radiated sound. In this study, acoustical
<italic>K</italic>
could vary across five log-spaced levels {
<inline-formula id="IEq7">
<alternatives>
<tex-math id="M1">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$10^{3},\,10^{3.5},\,10^{4},\,10^{4.5},\,10^{5}$$\end{document}</tex-math>
<mml:math id="M2">
<mml:mrow>
<mml:msup>
<mml:mn>10</mml:mn>
<mml:mn>3</mml:mn>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:msup>
<mml:mn>10</mml:mn>
<mml:mrow>
<mml:mn>3.5</mml:mn>
</mml:mrow>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:msup>
<mml:mn>10</mml:mn>
<mml:mn>4</mml:mn>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:msup>
<mml:mn>10</mml:mn>
<mml:mrow>
<mml:mn>4.5</mml:mn>
</mml:mrow>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:msup>
<mml:mn>10</mml:mn>
<mml:mn>5</mml:mn>
</mml:msup>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq7.gif"></inline-graphic>
</alternatives>
</inline-formula>
} N/m
<inline-formula id="IEq8">
<alternatives>
<tex-math id="M3">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{1.5}$$\end{document}</tex-math>
<mml:math id="M4">
<mml:msup>
<mml:mrow></mml:mrow>
<mml:mrow>
<mml:mn>1.5</mml:mn>
</mml:mrow>
</mml:msup>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq8.gif"></inline-graphic>
</alternatives>
</inline-formula>
centered around the baseline level of
<inline-formula id="IEq9">
<alternatives>
<tex-math id="M5">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$10^{4}$$\end{document}</tex-math>
<mml:math id="M6">
<mml:msup>
<mml:mn>10</mml:mn>
<mml:mn>4</mml:mn>
</mml:msup>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq9.gif"></inline-graphic>
</alternatives>
</inline-formula>
 N/m
<inline-formula id="IEq10">
<alternatives>
<tex-math id="M7">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{1.5}$$\end{document}</tex-math>
<mml:math id="M8">
<mml:msup>
<mml:mrow></mml:mrow>
<mml:mrow>
<mml:mn>1.5</mml:mn>
</mml:mrow>
</mml:msup>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq10.gif"></inline-graphic>
</alternatives>
</inline-formula>
.
<fig id="Fig2">
<label>Fig. 2</label>
<caption>
<p>Properties of audio–haptic stimuli as a function of stiffness coefficient
<italic>K</italic>
and striking velocity at impact.
<bold>a</bold>
,
<bold>b</bold>
Spectra of impact sound as a function of either acoustical
<italic>K</italic>
(
<bold>a</bold>
synthesized with constant impact velocity of 500 mm/s) or striking velocity (
<bold>b</bold>
acoustical
<italic>K</italic>
 = 
<inline-formula id="IEq2">
<alternatives>
<tex-math id="M9">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$10^{4}$$\end{document}</tex-math>
<mml:math id="M10">
<mml:msup>
<mml:mn>10</mml:mn>
<mml:mn>4</mml:mn>
</mml:msup>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq2.gif"></inline-graphic>
</alternatives>
</inline-formula>
 N/m
<inline-formula id="IEq3">
<alternatives>
<tex-math id="M11">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{1.5}$$\end{document}</tex-math>
<mml:math id="M12">
<mml:msup>
<mml:mrow></mml:mrow>
<mml:mrow>
<mml:mn>1.5</mml:mn>
</mml:mrow>
</mml:msup>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq3.gif"></inline-graphic>
</alternatives>
</inline-formula>
). Vibrational modes with periods longer than contact duration fail to be excited efficiently; either larger acoustical
<italic>K</italic>
or higher striking velocity leads to shorter contact duration.
<bold>c</bold>
,
<bold>d</bold>
Resistive force, reflected by the vertical acceleration (stylus–object contact starts at
<inline-formula id="IEq4">
<alternatives>
<tex-math id="M13">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t=0$$\end{document}</tex-math>
<mml:math id="M14">
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq4.gif"></inline-graphic>
</alternatives>
</inline-formula>
) of the stylus as a function of either haptic
<italic>K</italic>
(
<bold>c</bold>
equivalent striking velocities,
<italic>M</italic>
 = 491, SD = 16 mm/s) or striking velocity (
<bold>d</bold>
haptic
<italic>K</italic>
 = 525.5 N/m). The harder the object is, the greater are the magnitude and rate of resistive force produced by the object against the stylus during tapping.
<italic>Green dots</italic>
indicate force peaks. An example
<italic>red dashed line</italic>
(linear least-squares fit) shows the increment rate of the resistive force measured on the virtual object with the highest haptic
<italic>K</italic>
of 2350 N/m.
<bold>e</bold>
,
<bold>f</bold>
Deformation (indentation) cue, the maximal vertical displacement (
<italic>black bars</italic>
) of the stylus relative to the virtual object surface decreases with increasing haptic
<italic>K</italic>
(
<bold>e</bold>
equivalent striking velocities across haptic
<italic>K</italic>
s, one-way ANOVA
<inline-formula id="IEq5">
<alternatives>
<tex-math id="M15">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p>.96$$\end{document}</tex-math>
<mml:math id="M16">
<mml:mrow>
<mml:mi>p</mml:mi>
<mml:mo>></mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>96</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq5.gif"></inline-graphic>
</alternatives>
</inline-formula>
), but increases with increasing striking velocity (
<bold>f</bold>
haptic
<italic>K</italic>
 = 525.5 N/m). In
<bold>e</bold>
,
<italic>gray dots</italic>
represent the mean stylus velocities used to strike the three different haptic surfaces.
<italic>Error bars</italic>
indicate ±1 SEM (
<italic>N</italic>
 = 20 strikes). Note that the indentation of the object by the stylus reaches a maximum simultaneously with the peak resistive force in
<bold>c</bold>
and
<bold>d</bold>
(color figure online)</p>
</caption>
<graphic xlink:href="221_2015_4529_Fig2_HTML" id="MO2"></graphic>
</fig>
</p>
</sec>
<sec id="Sec7">
<title>Haptic stimuli</title>
<p>Impact-related touch feedback was simulated using a dissipative contact model when the head (gimbal) of the hand-held stylus reached the surface of the virtual object (
<inline-formula id="IEq11">
<alternatives>
<tex-math id="M17">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$15 \times 15$$\end{document}</tex-math>
<mml:math id="M18">
<mml:mrow>
<mml:mn>15</mml:mn>
<mml:mo>×</mml:mo>
<mml:mn>15</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq11.gif"></inline-graphic>
</alternatives>
</inline-formula>
 cm surface area; Fig. 
<xref rid="Fig1" ref-type="fig">1</xref>
a). A reaction torque generated by the motors inside the device was delivered to the linkage structures connected to the stylus, simulating a vertical resistive force proportional to the instantaneous normal displacement of the stylus gimbal relative to the virtual object’s upper surface. The force was determined by a linear combination of the gimbal’s vertical displacement and velocity, weighted by a haptic stiffness coefficient (haptic
<italic>K</italic>
) and a dissipative (damping) coefficient, respectively. Both the haptic
<italic>K</italic>
and the striking velocity at impact could modify the haptic feedback, but differentially for the force-related (Fig.
<xref rid="Fig2" ref-type="fig">2</xref>
c, d) and deformation-related signals (Fig.
<xref rid="Fig2" ref-type="fig">2</xref>
e, f). Haptic feedback was programmed with the OpenHaptics™ Toolkit (Itkowitz et al.
<xref ref-type="bibr" rid="CR19">2005</xref>
). In this study, haptic
<italic>K</italic>
could assume one of five log-spaced values {117.5, 248.5, 525.5 (baseline), 1111.2, 2350.0} N/m. The largest stiffness coefficient here corresponds to the maximum stiffness (along the vertical direction) that can be achieved by the Phantom Desktop.</p>
</sec>
</sec>
<sec id="Sec8">
<title>Procedure</title>
<p>A schematic that depicts the experimental design and sequence is presented in Fig.
<xref rid="Fig1" ref-type="fig">1</xref>
. Each trial was divided into three consecutive phases (Fig. 
<xref rid="Fig1" ref-type="fig">1</xref>
b). During an initial training phase, participants learned to constrain the striking velocities of their downswings within a target range (430–570 mm/s). They received on-screen feedback on a strike-by-strike basis: “Too slow,” “Correct,” or “Too fast” was displayed immediately after a stroke if the velocity at impact was below, within, or above that range, respectively. This phase ended when a participant had produced five consecutive strikes with the “correct” velocities. During a subsequent maintenance phase, participants continued striking with the same trained target velocity in the absence of feedback on correctness. This phase ended after five strikes independently of whether they were within or outside the target velocity range. The stiffness coefficient
<italic>K</italic>
of the virtual object was fixed to the baseline value across these two phases. At the beginning of a final change phase (without feedback on correctness), the values of the acoustical and/or haptic
<italic>K</italic>
either remained the same or were suddenly altered, alone or in combination, depending on the experimental condition. Participants were asked to continue striking with the same trained velocity and to ignore any changes in the properties of the object. This last phase ended after 20 strikes. Participants were required to strike with a tempo of their choice, provided that they kept it unchanged throughout an entire trial and did not exceed three strikes/second.</p>
<p>We investigated three conditions (Fig. 
<xref rid="Fig1" ref-type="fig">1</xref>
c). In the haptic-only condition (100 trials), participants were presented with the virtual haptic object and with a continuous white-noise auditory masker presented at 75 dB SPL. In the auditory-only condition (100 trials), when the stylus reached the contact position, participants were presented only with the synthesized impact sound but no impact-related haptic feedback. During the audio–haptic (crossmodal) condition (100 trials), both the impact-related haptic and acoustical feedback were available. During the change phase of a crossmodal trial, the acoustical and haptic
<italic>K</italic>
of the virtual object could assume either the baseline value (unperturbed trial) or any of the 16 factorial combinations of the non-baseline values (perturbed trial). Crossmodal perturbations also depended on audio–haptic congruency. In the congruent condition, both the acoustical and haptic
<italic>K</italic>
either increased or decreased together relative to the baseline level. In the incongruent condition, the acoustical and haptic
<italic>K</italic>
changed in opposite directions (acoustical
<italic>K</italic>
increased, whereas haptic
<italic>K</italic>
decreased, or vice versa).</p>
<p>Each participant completed 20 blocks of 15 trials for a total of 300 trials in three sessions of approximately 1.5 h each on different days. Each block was subdivided into five subblocks during which participants were presented with three trials of different conditions (random order of conditions within each subblock). The 15 trials per block comprised five auditory-only trials (different change-phase acoustical
<italic>K</italic>
values), five haptic-only trials (different change-phase haptic
<italic>K</italic>
values), and five audio–haptic trials (one unperturbed trial and equal numbers of congruent and incongruent trials). Throughout all the audio–haptic trials, each of the possible combinations of the change-phase non-baseline haptic and acoustical
<italic>K</italic>
values was repeated five times, whereas the baseline value of the haptic–acoustical
<italic>K</italic>
was repeated 20 times. This design thus balanced each of the five
<italic>K</italic>
levels of the two dimensions (acoustical vs. haptic) with an identical number of trials for the modality-specific and crossmodal conditions, e.g., the haptic
<italic>K</italic>
of 117.5 N/m occurred equivalently 20 times for the haptic-only condition and the audio–haptic condition.</p>
</sec>
</sec>
<sec id="Sec9">
<title>Results</title>
<p>Data were analyzed with two linear mixed-effects models (LMM) fitted using the SAS
<sup>®</sup>
PROC MIXED routine (West et al.
<xref ref-type="bibr" rid="CR43">2006</xref>
). The mixed models were used primarily because, in contradistinction to traditional models such as repeated-measures ANOVA, they make it possible to estimate directly the participant-specific regression coefficients for the main independent variables. The first analysis concerned the extent to which the modality-specific stiffness perturbations gave rise to motor compensations. The second analysis assessed the effects of crossmodal congruency on the interaction patterns for the motor effects of simultaneously available haptic and acoustical perturbations. The LMMs included both fixed effects (constant parameters) and random effects (assumed to follow normal distributions) measuring the average behavioral trend (mean linear motor effect of different levels of stiffness perturbation) and its interindividual variability within the population of interest, respectively. We adjusted
<italic>p</italic>
values with the Bonferroni correction for multiple post hoc comparisons.</p>
<sec id="Sec10">
<title>LMM 1: Stiffness perturbations prompted motor compensations in auditory-only and haptic-only conditions</title>
<p>The first LMM analyzed the effects of perturbing the virtual object’s stiffness coefficient
<italic>K</italic>
on the subsequent striking velocities in the two modality-specific conditions—auditory-only and haptic-only.</p>
<p>For each trial, we considered the average change-phase velocity across the last 19 strikes because the first strike of the change phase could not reflect the motor effect of the perturbed sensory feedback. These trial-specific motor measures were then collapsed into five means corresponding to the five different levels of the stiffness coefficient
<italic>K</italic>
per condition (see “
<xref rid="Sec2" ref-type="sec">Methods</xref>
” section), yielding 10 data points (five for auditory-only; five for haptic-only) for each of the 42 participants.</p>
<p>We examined the fixed effects of
<italic>K</italic>
, Condition (auditory-only vs. haptic-only), and musical Expertise, and of all the possible interactions between these factors. When fitting the models, log-transformed values of haptic and acoustical
<italic>K</italic>
were standardized (
<italic>z</italic>
scores), resulting in five linear-spaced levels from −1.26 to 1.26. Meanwhile, we included in this LMM significant random effects of both the participant-specific slope coefficients associated with
<italic>K</italic>
and the participant-specific intercepts [
<inline-formula id="IEq13">
<alternatives>
<tex-math id="M19">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\chi ^2(1,2)\,\ge\,15.1, \ p\mathrm {s}\,<\,.001$$\end{document}</tex-math>
<mml:math id="M20">
<mml:mrow>
<mml:msup>
<mml:mi mathvariant="italic">χ</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>15.1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mi mathvariant="normal">s</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq13.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. This LMM explained 73.2 % of the total variance (unadjusted
<inline-formula id="IEq14">
<alternatives>
<tex-math id="M21">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$R^2$$\end{document}</tex-math>
<mml:math id="M22">
<mml:msup>
<mml:mi>R</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq14.gif"></inline-graphic>
</alternatives>
</inline-formula>
) in the striking velocity. The results of the LMM are illustrated by the normal cumulative distribution functions (CDFs, Fig. 
<xref rid="Fig3" ref-type="fig">3</xref>
b), with the fixed-effect estimates corresponding to the abscissa values for which the CDFs reach the probability level of 0.5 and with the random-effect estimates corresponding to the variances of the CDFs.
<fig id="Fig3">
<label>Fig. 3</label>
<caption>
<p>Effects of perturbed stiffness coefficient
<italic>K</italic>
on striking velocity in modality-specific conditions.
<bold>a</bold>
Typical participants who decrease (
<italic>left</italic>
; P31) and increase (P29) striking velocity for stiffer haptic surfaces. Mean change-phase striking velocity is plotted as a function of haptic and acoustical
<italic>K</italic>
in two different modality-specific conditions (
<italic>red</italic>
haptic-only;
<italic>blue</italic>
auditory-only).
<italic>Upward pointing arrows</italic>
indicate the data of unperturbed trials (constant
<italic>K</italic>
).
<italic>Error bars</italic>
represent ±1 SEM (
<inline-formula id="IEq16">
<alternatives>
<tex-math id="M23">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N=20$$\end{document}</tex-math>
<mml:math id="M24">
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>20</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq16.gif"></inline-graphic>
</alternatives>
</inline-formula>
trials).
<bold>b</bold>
LMM estimates of the participant-specific linear effects (fixed plus random) of the stiffness coefficient
<italic>K</italic>
on striking velocity. Fixed-effect estimates correspond to the
<italic>x</italic>
-axis values for which the Gaussian cumulative distribution functions (CDFs,
<italic>dashed curves</italic>
) reach the probability level of 0.5; random-effect estimates correspond to the variances of the CDFs.
<italic>Symbol color</italic>
and
<italic>shape</italic>
correspond to Expertise and Condition, respectively. Specific
<italic>K</italic>
-effect estimates for the typical participants in
<bold>a</bold>
are identified for illustrative purposes.
<italic>NM</italic>
non-musician,
<italic>NPM</italic>
non-percussionist musician,
<italic>P</italic>
percussionist (color figure online)</p>
</caption>
<graphic xlink:href="221_2015_4529_Fig3_HTML" id="MO3"></graphic>
</fig>
</p>
<p>Overall, the participant-specific slope coefficients of
<italic>K</italic>
, which represent the linear motor effects of stiffness perturbation, were significantly different from zero [
<inline-formula id="IEq17">
<alternatives>
<tex-math id="M25">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,78)=51.1, \ p\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M26">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>78</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>51.1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq17.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. The three-way
<italic>K</italic>
× Expertise × Condition interaction was not significant [
<inline-formula id="IEq20">
<alternatives>
<tex-math id="M27">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(2,291)=2.84, \ p=.057$$\end{document}</tex-math>
<mml:math id="M28">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>291</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>2.84</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>057</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq20.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. However, 10 of the 14 percussionists (eight of whom were mallet percussionists, see “
<xref rid="Sec12" ref-type="sec">Discussion</xref>
” section) increased their striking velocity for higher values of haptic
<italic>K</italic>
(stiffer haptic surface; rightmost CDF for the effects of haptic
<italic>K</italic>
in Fig. 
<xref rid="Fig3" ref-type="fig">3</xref>
b), whereas the percentage of the non-percussionists who tended to strike with lower velocity to compensate for higher values of the same variable (leftmost CDF for the effects of haptic
<italic>K</italic>
in Fig. 
<xref rid="Fig3" ref-type="fig">3</xref>
b) was above chance (68 %). The mean fixed effect of haptic
<italic>K</italic>
was estimated to be −17.2 for non-musicians and −18.5 for NP-musicians, indicating indistinguishable patterns of motor compensation among these non-percussionists. To the contrary, percussionists had a positive (7.87) average estimate for the same fixed effect (see the
<italic>x</italic>
-axis values for which the dashed CDFs reach the model probability level of 0.5 in Fig. 
<xref rid="Fig3" ref-type="fig">3</xref>
b). Nonetheless, the amount of previous experience with percussion performance was not a robust predictor for the large interindividual differences in the direction of compensatory motor responses to the haptic perturbations as represented by the sign of the linear effect of haptic
<italic>K</italic>
on striking velocity: The effect of musicianship could not explain why nine of the 28 non-percussionists were estimated to have positive linear effects for the haptic
<italic>K</italic>
as well (i.e., increasing striking velocity for higher values of haptic
<italic>K</italic>
).</p>
<p>To the contrary, the motor effect of acoustical
<italic>K</italic>
was consistent across the three groups [
<inline-formula id="IEq23">
<alternatives>
<tex-math id="M29">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(2,291)\,<\,1$$\end{document}</tex-math>
<mml:math id="M30">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>291</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq23.gif"></inline-graphic>
</alternatives>
</inline-formula>
for the post hoc between-group contrast within the auditory-only condition]. That is, an increase in acoustical
<italic>K</italic>
led to a decrease in striking velocity in all participants (average fixed-effect estimate of acoustical
<italic>K</italic>
was −15.2,
<inline-formula id="IEq25">
<alternatives>
<tex-math id="M31">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\rm SD}\,=\,.58$$\end{document}</tex-math>
<mml:math id="M32">
<mml:mrow>
<mml:mi mathvariant="normal">SD</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>=</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>58</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq25.gif"></inline-graphic>
</alternatives>
</inline-formula>
). Note that the three CDFs for acoustical
<italic>K</italic>
(filled circles) were in close proximity in Fig.
<xref rid="Fig3" ref-type="fig">3</xref>
b.</p>
<p>Participants produced, on average, higher striking velocities in the haptic-only condition than in the auditory-only condition [
<inline-formula id="IEq26">
<alternatives>
<tex-math id="M33">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,291)=23.8, \ p<.0001$$\end{document}</tex-math>
<mml:math id="M34">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>291</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>23.8</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo><</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq26.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. This result was due to the fact that the change-phase striking velocities of the unperturbed haptic-only trials (
<inline-formula id="IEq27">
<alternatives>
<tex-math id="M35">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M=518$$\end{document}</tex-math>
<mml:math id="M36">
<mml:mrow>
<mml:mi>M</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>518</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq27.gif"></inline-graphic>
</alternatives>
</inline-formula>
 mm/s) were significantly higher than those of the unperturbed auditory-only trials (
<inline-formula id="IEq28">
<alternatives>
<tex-math id="M37">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M=485$$\end{document}</tex-math>
<mml:math id="M38">
<mml:mrow>
<mml:mi>M</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>485</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq28.gif"></inline-graphic>
</alternatives>
</inline-formula>
 mm/s), [
<inline-formula id="IEq29">
<alternatives>
<tex-math id="M39">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t(41)=4.51, \ p < .0001$$\end{document}</tex-math>
<mml:math id="M40">
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>41</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>4.51</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo><</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq29.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. The change-phase striking velocity of the unperturbed trials was not of primary interest in this study. A rank correlation analysis revealed that the absolute value of the participant-specific linear motor effect of different levels of stiffness perturbation was independent of the average striking velocity of the unperturbed trials for both modality-specific conditions [
<inline-formula id="IEq30">
<alternatives>
<tex-math id="M41">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$|\rho (40)| \,\le\,.13, p\mathrm{s}\,\ge\,.12$$\end{document}</tex-math>
<mml:math id="M42">
<mml:mrow>
<mml:mo stretchy="false">|</mml:mo>
<mml:mi mathvariant="italic">ρ</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>40</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">|</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>13</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>p</mml:mi>
<mml:mi mathvariant="normal">s</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq30.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. None of the fixed effects of Condition × Expertise,
<italic>K</italic>
× Condition,
<italic>K</italic>
× Expertise, and Expertise per se, were significant [
<inline-formula id="IEq34">
<alternatives>
<tex-math id="M43">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F\,\le\,1.73, \ p\mathrm {s}\,\ge\,.18$$\end{document}</tex-math>
<mml:math id="M44">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>1.73</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mi mathvariant="normal">s</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>18</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq34.gif"></inline-graphic>
</alternatives>
</inline-formula>
].</p>
<p>In summary, this LMM revealed negative estimates for the motor effect of acoustical perturbation across all participants. The results indicate that unexpectedly higher acoustical
<italic>K</italic>
s (and thus auditory error signals in terms of unexpected increases in loudness and brightness) consistently led to a motor compensation that was characteristic of lower striking velocities. Meanwhile, this analysis revealed 19 positive and 23 negative participant-specific estimates for the motor effect of haptic perturbation. In other words, these two
<italic>classes</italic>
of individuals compensated for an increase in the stiffness of the haptic object by increasing (
<inline-formula id="IEq35">
<alternatives>
<tex-math id="M45">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N=19$$\end{document}</tex-math>
<mml:math id="M46">
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>19</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq35.gif"></inline-graphic>
</alternatives>
</inline-formula>
) and decreasing (
<inline-formula id="IEq36">
<alternatives>
<tex-math id="M47">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N=23$$\end{document}</tex-math>
<mml:math id="M48">
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>23</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq36.gif"></inline-graphic>
</alternatives>
</inline-formula>
) the striking velocity, respectively. From now on, we refer to these classes of individuals as
<italic>haptic positive</italic>
and
<italic>haptic negative</italic>
, respectively. The results reported here suggest a preferential reliance on different tactual error signals for the control of wrist velocity among different participants, although those error signals coexisted during the haptic perturbations. Specifically, increases in the struck virtual object’s stiffness would lead to decreases in the magnitude of a source of haptic deformation feedback, the object’s maximal surface indentation by the stylus (Fig. 
<xref rid="Fig2" ref-type="fig">2</xref>
e). To compensate for the unexpectedly altered deformation feedback, the haptic-positive participants increased the striking velocity to restore the amount of indentation of the object by the stylus (Fig. 
<xref rid="Fig2" ref-type="fig">2</xref>
f). To the contrary, the harder the object is, the greater are the magnitude and rate of the resistive force produced by the struck object against the stylus during tapping (Fig. 
<xref rid="Fig2" ref-type="fig">2</xref>
c). To compensate for the suddenly increased values of these force-related cues, the haptic-negative participants decreased the striking velocities (Fig. 
<xref rid="Fig2" ref-type="fig">2</xref>
d: slower velocities result in decreased values of the force-related cues given a constant haptic stiffness). In the LMM reported next, the analysis of the effects of crossmodal congruency will allow us to further characterize the interaction patterns for the motor effects of simultaneously available haptic and auditory error signals. We will be particularly interested in examining the extent to which the two different classes of participants characterized by the opposite directions of motor compensation for the same haptic perturbation differ in their strategies for weighting the error signals from haptics and audition for motor control.</p>
</sec>
<sec id="Sec11">
<title>LMM 2: crossmodal congruency effects were asymmetrical between audition and haptics</title>
<p>The second LMM analyzed the effects of perturbing the virtual object’s stiffness on the average change-phase striking velocities (last 19 strikes) from the crossmodal perturbed trials. We adopted the idea of contrasting the behavioral effects of crossmodally congruent with incongruent conditions to investigate sensory dominance (Soto-Faraco et al.
<xref ref-type="bibr" rid="CR40">2004b</xref>
). With our experimental paradigm in particular, we concluded for the dominance of a sensory modality (e.g., haptics) if the motor effects induced by a manipulation of the modality-specific stiffness were more robust against the manipulation of crossmodal congruency than was the case for the non-dominant modality (e.g., audition).</p>
<p>For each participant, the mean striking velocity was taken for each of the 16 possible combinations of the non-baseline haptic and acoustical
<italic>K</italic>
levels. Critical to this LMM, these 16 measures were collapsed according to a
<inline-formula id="IEq37">
<alternatives>
<tex-math id="M49">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2\times 2$$\end{document}</tex-math>
<mml:math id="M50">
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mo>×</mml:mo>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq37.gif"></inline-graphic>
</alternatives>
</inline-formula>
factorial contrast between sensory modality and crossmodal congruency, yielding four independent data vectors (congruent vs. incongruent, per modality) of four data points each (see Fig. 
<xref rid="Fig4" ref-type="fig">4</xref>
). That is, we determined the motor effect of perturbation in one modality while averaging the change-phase striking velocities at different levels of perturbation in the other modality. For example, the motor effect of the four different levels of acoustical perturbation in the congruent condition (“Auditory, Congruent” in Fig. 
<xref rid="Fig4" ref-type="fig">4</xref>
) was determined by averaging the change-phase striking velocities at the two levels of congruent haptic
<italic>K</italic>
associated with each of the four non-baseline acoustical
<italic>K</italic>
levels.
<fig id="Fig4">
<label>Fig. 4</label>
<caption>
<p>Collapsing data into four vectors for the second LMM according to Modality × Congruency. Stiffness coefficient
<italic>K</italic>
s are shown in log-transformed and standardized values. The
<italic>rectangle frames</italic>
denote “averaging” operators, with the
<italic>solid</italic>
and the
<italic>dashed frames</italic>
being averaged for the congruent and the incongruent audio–haptic conditions, respectively.
<italic>Arrow</italic>
directions show increasing
<italic>K</italic>
associated with the relevant modality</p>
</caption>
<graphic xlink:href="221_2015_4529_Fig4_HTML" id="MO4"></graphic>
</fig>
</p>
<p>We examined in this model not only the fixed factors of the stiffness coefficient
<italic>K</italic>
, Modality (auditory vs. haptic), and Congruency, but also the participant-level covariates of Class (haptic positive vs. haptic negative) and musical Expertise (non-musician vs. NP-musician vs. percussionist), as well as the possible interactions among these factors. Meanwhile, we kept in the LMM significant random effects of both the participant-specific slope coefficients associated with
<italic>K</italic>
and the participant-specific intercepts [
<inline-formula id="IEq39">
<alternatives>
<tex-math id="M51">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\chi ^2(1,2)\,\ge\,61.7, \ p\mathrm {s}\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M52">
<mml:mrow>
<mml:msup>
<mml:mi mathvariant="italic">χ</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>61.7</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mi mathvariant="normal">s</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq39.gif"></inline-graphic>
</alternatives>
</inline-formula>
].</p>
<p>This model explained 87.6 % of the total variance in the input data. It revealed significant fixed effects of
<italic>K</italic>
[
<inline-formula id="IEq40">
<alternatives>
<tex-math id="M53">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,80)=5.38,\ p=.023$$\end{document}</tex-math>
<mml:math id="M54">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>80</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>5.38</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>023</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq40.gif"></inline-graphic>
</alternatives>
</inline-formula>
], Congruency [
<inline-formula id="IEq41">
<alternatives>
<tex-math id="M55">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,496)=4.02,\ p=.046$$\end{document}</tex-math>
<mml:math id="M56">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>4.02</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>046</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq41.gif"></inline-graphic>
</alternatives>
</inline-formula>
],
<italic>K</italic>
× Congruency [
<inline-formula id="IEq43">
<alternatives>
<tex-math id="M57">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,496)=20.1,\ p\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M58">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>20.1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq43.gif"></inline-graphic>
</alternatives>
</inline-formula>
], and
<italic>K</italic>
× Modality [
<inline-formula id="IEq45">
<alternatives>
<tex-math id="M59">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,80)=18.3,\ p\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M60">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>80</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>18.3</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq45.gif"></inline-graphic>
</alternatives>
</inline-formula>
], but not of Modality itself [
<inline-formula id="IEq46">
<alternatives>
<tex-math id="M61">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,80)\,<\,1$$\end{document}</tex-math>
<mml:math id="M62">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>80</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq46.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. Critical to this analysis, there was a significant three-way
<italic>K</italic>
× Congruency × Modality interaction [
<inline-formula id="IEq49">
<alternatives>
<tex-math id="M63">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,496)=29.7,\ p\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M64">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>29.7</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq49.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. A pairwise between-modality contrast (haptic minus auditory) for the congruency-related absolute changes in the estimated linear effects of
<italic>K</italic>
revealed that the altered haptic feedback dominated the altered acoustical feedback in determining the motor compensation [
<inline-formula id="IEq50">
<alternatives>
<tex-math id="M65">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t(496)=-4.90,\ p\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M66">
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mo>-</mml:mo>
<mml:mn>4.90</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq50.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. In particular, the population-averaged estimate for the motor effect of haptic
<italic>K</italic>
was shifted to a lesser degree by the crossmodal congruency (an asymmetry of the congruency effects in favor of haptics), compared with that of acoustical
<italic>K</italic>
. The mean congruency-related absolute changes in the estimated linear effects of haptic and acoustical
<italic>K</italic>
on striking velocity were 20.2 and 39.6, respectively.</p>
<p>Furthermore, the between-modality difference (haptic minus auditory) for the congruency-related absolute changes in the linear effects of
<italic>K</italic>
was greater for the haptic-positive individuals than for the haptic-negative individuals [
<inline-formula id="IEq51">
<alternatives>
<tex-math id="M67">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t(496)= 2.43,\ p\,=\,.015$$\end{document}</tex-math>
<mml:math id="M68">
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>2.43</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>=</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>015</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq51.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. This result indicates that the asymmetry of the crossmodal congruency effects between audition and haptics was more pronounced for the haptic-positive individuals than for the haptic-negative individuals. We used the population-averaged estimate for the congruency-related absolute change in the linear effect of
<italic>K</italic>
as a measure for deriving the relative weights of the two sensory modalities. For example, the relative weight of haptic feedback for the haptic-positive participants was
<inline-formula id="IEq52">
<alternatives>
<tex-math id="M69">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$41.53/(41.53+16.71)\,=\,0.71$$\end{document}</tex-math>
<mml:math id="M70">
<mml:mrow>
<mml:mn>41.53</mml:mn>
<mml:mo stretchy="false">/</mml:mo>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>41.53</mml:mn>
<mml:mo>+</mml:mo>
<mml:mn>16.71</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>=</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>0.71</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq52.gif"></inline-graphic>
</alternatives>
</inline-formula>
(Fig. 
<xref rid="Fig5" ref-type="fig">5</xref>
a, rightmost subplot). Overall, the haptic-positive individuals gave greater weight to the haptic inputs (71 %) than to the auditory inputs (29 %), which underpinned their stronger response bias toward haptics when compared with the relative weighting of haptics and audition (62 vs. 38 %, respectively) in the haptic-negative individuals (Fig. 
<xref rid="Fig5" ref-type="fig">5</xref>
b, rightmost subplot).</p>
<p>In addition, the
<italic>K</italic>
× Class effect was significant [
<inline-formula id="IEq54">
<alternatives>
<tex-math id="M71">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,496)=47.9,\ p\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M72">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>47.9</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq54.gif"></inline-graphic>
</alternatives>
</inline-formula>
], with the average linear effect of
<italic>K</italic>
for the haptic-negative participants being estimated to be 39.5 (
<inline-formula id="IEq55">
<alternatives>
<tex-math id="M73">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\rm SE} = 6.58$$\end{document}</tex-math>
<mml:math id="M74">
<mml:mrow>
<mml:mi mathvariant="normal">SE</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>6.58</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq55.gif"></inline-graphic>
</alternatives>
</inline-formula>
) units less than that of the haptic-positive participants. The Class effect per se was significant [
<inline-formula id="IEq56">
<alternatives>
<tex-math id="M75">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,496)=10.3,\ p=.0014$$\end{document}</tex-math>
<mml:math id="M76">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>10.3</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>0014</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq56.gif"></inline-graphic>
</alternatives>
</inline-formula>
], with the mean change-phase striking velocity of the haptic-negative participants being 43.4 (
<inline-formula id="IEq57">
<alternatives>
<tex-math id="M77">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\rm SE}\,=\,22.8$$\end{document}</tex-math>
<mml:math id="M78">
<mml:mrow>
<mml:mi mathvariant="normal">SE</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>=</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>22.8</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq57.gif"></inline-graphic>
</alternatives>
</inline-formula>
) mm/s lower than that of the haptic-positive participants. The LMM also revealed significant fixed effects of
<italic>K</italic>
× Modality × Class and
<italic>K</italic>
× Congruency × Class interactions [
<inline-formula id="IEq62">
<alternatives>
<tex-math id="M79">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(1,496)\ge 34.8,\ p\mathrm {s}\,<\,.0001$$\end{document}</tex-math>
<mml:math id="M80">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo></mml:mo>
<mml:mn>34.8</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mi mathvariant="normal">s</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>0001</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq62.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. To more closely inspect these effects, we compared separately for the haptic-positive and haptic-negative individuals the motor effects of
<italic>K</italic>
in each modality and congruency condition.
<fig id="Fig5">
<label>Fig. 5</label>
<caption>
<p>On each crossmodal perturbed trial, both the haptic and acoustical
<italic>K</italic>
were manipulated (congruent = both increased or decreased relative to the baseline during the change phase of each trial; incongruent = one increased while the other decreased). The
<italic>leftmost</italic>
and
<italic>middle subplots</italic>
show the across-participant means of change-phase striking velocity as a function of haptic or acoustical stiffness, averaged across levels of the stiffness values for the other modality. The
<italic>rightmost subplots</italic>
show the absolute change in the linear effect of acoustical
<italic>K</italic>
and haptic
<italic>K</italic>
on striking velocity by crossmodal congruency. The
<italic>bar height</italic>
represents the susceptibility of a sensory modality to the influence of an incongruent crossmodal perturbation.
<italic>Top</italic>
(
<bold>a</bold>
) and
<italic>bottom</italic>
(
<bold>b</bold>
) panels report results for the haptic-positive and haptic-negative participants, respectively.
<italic>NM</italic>
non-musician,
<italic>NPM</italic>
NP-musician,
<italic>P</italic>
percussionist</p>
</caption>
<graphic xlink:href="221_2015_4529_Fig5_HTML" id="MO5"></graphic>
</fig>
</p>
<p>Haptic-positive individuals tended to increase their striking velocity for an unexpectedly stiffer haptic surface that was presented alone (haptic-only), which we hypothesize shows a preference for deformation feedback. Their results were characterized by the same motor compensation strategy when receiving the acoustical and haptic perturbations simultaneously, independently of crossmodal congruency (Fig. 
<xref rid="Fig5" ref-type="fig">5</xref>
a, leftmost subplot). In particular, compared to the haptic-only perturbation, the estimated linear effect of
<italic>K</italic>
was also positive (regardless of congruency). The positive motor effect of haptic
<italic>K</italic>
was larger for the incongruent (32.9) than for the congruent (16.2) trials, indicating that a stiffer haptic object combined with a softer impact sound (or vice versa) could induce an enhancement in the magnitude of motor compensation. The motor effect of acoustical
<italic>K</italic>
, which was originally negative (e.g., striking velocity was decreased for "harder" impact sounds) when the acoustical feedback was presented alone, turned out to be reversed by the strong positive motor effect of haptic
<italic>K</italic>
in the congruent audio–haptic condition (Fig. 
<xref rid="Fig5" ref-type="fig">5</xref>
a, middle subplot).</p>
<p>Haptic-negative participants may have relied preferentially on force-related feedback, given that they compensated for a stiffer haptic surface by decreasing the striking velocity in the haptic-only condition. Adding an incongruent yet task-relevant acoustical perturbation appeared to affect more strongly their compensation for the altered haptic feedback in the crossmodal context, compared with the haptic-positive participants mentioned above (Fig. 
<xref rid="Fig5" ref-type="fig">5</xref>
b, leftmost subplot). The motor effect of haptic
<italic>K</italic>
estimated in the LMM for the incongruent crossmodal trials, albeit still negative, was quite small on average (−6.52) if compared with that for the congruent trials (−29.7). As shown in Fig.
<xref rid="Fig5" ref-type="fig">5</xref>
b (middle subplot), the haptic dominance was still pronounced here, as revealed by a positive estimate (6.14) for the motor effect of acoustical
<italic>K</italic>
in the incongruent crossmodal condition (the preceding LMM revealed negative motor effects of perturbing the same variable during the auditory-only trials).</p>
<p>Finally, the effect of musical Expertise was not significant [
<inline-formula id="IEq65">
<alternatives>
<tex-math id="M81">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(2,496)=1.50,\ p=.22$$\end{document}</tex-math>
<mml:math id="M82">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>1.50</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq65.gif"></inline-graphic>
</alternatives>
</inline-formula>
], but it was modulated by the effect of Class [
<inline-formula id="IEq66">
<alternatives>
<tex-math id="M83">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(2,496)=3.16,\ p=.043$$\end{document}</tex-math>
<mml:math id="M84">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mn>3.16</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>043</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq66.gif"></inline-graphic>
</alternatives>
</inline-formula>
], with significantly lower striking velocity on average for the NP-musicians compared with the non-musicians, but only within the haptic-negative class of participants [
<inline-formula id="IEq67">
<alternatives>
<tex-math id="M85">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t(496)=-3.78,\,p=.0012$$\end{document}</tex-math>
<mml:math id="M86">
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mo>-</mml:mo>
<mml:mn>3.78</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mo>.</mml:mo>
<mml:mn>0012</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq67.gif"></inline-graphic>
</alternatives>
</inline-formula>
;
<inline-formula id="IEq68">
<alternatives>
<tex-math id="M87">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$|t(496)|\,\le\,1.71,\,p\,\ge\,.53$$\end{document}</tex-math>
<mml:math id="M88">
<mml:mrow>
<mml:mo stretchy="false">|</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">|</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>1.71</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>53</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq68.gif"></inline-graphic>
</alternatives>
</inline-formula>
for the other contrasts between expertise-related groups]. Notably, any other expertise-relevant effects failed to reach statistical significance [
<inline-formula id="IEq69">
<alternatives>
<tex-math id="M89">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F(2,496)\,<\,1$$\end{document}</tex-math>
<mml:math id="M90">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mn>496</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo><</mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq69.gif"></inline-graphic>
</alternatives>
</inline-formula>
], indicating that the above-mentioned motor effect of
<italic>K</italic>
and its interactions with other factors (i.e., Modality, Congruency, Class, or interactions between these) were generalizable across the three expertise-related groups. We also fitted a reduced model omitting only the Class effect from the model presented above while preserving all the other effects and the variance–covariance structures. In this reduced model, musical Expertise failed to modulate any
<italic>K</italic>
-related fixed effect, i.e., the effects of
<italic>K</italic>
,
<italic>K</italic>
× Modality,
<italic>K</italic>
× Congruency or
<italic>K</italic>
× Modality × Congruency [
<inline-formula id="IEq74">
<alternatives>
<tex-math id="M91">\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F\,\le\,1.93, \ p\mathrm {s}\,\ge\,.15$$\end{document}</tex-math>
<mml:math id="M92">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mn>1.93</mml:mn>
<mml:mo>,</mml:mo>
<mml:mspace width="4pt"></mml:mspace>
<mml:mi>p</mml:mi>
<mml:mi mathvariant="normal">s</mml:mi>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo></mml:mo>
<mml:mspace width="0.166667em"></mml:mspace>
<mml:mo>.</mml:mo>
<mml:mn>15</mml:mn>
</mml:mrow>
</mml:math>
<inline-graphic xlink:href="221_2015_4529_Article_IEq74.gif"></inline-graphic>
</alternatives>
</inline-formula>
]. Taken together, these results demonstrated that the participant-level covariate of Class was more capable of predicting the behavioral variance in the weighting of auditory and haptic feedback for motor control than was the amount of previous experience with percussion performance.</p>
<p>To summarize the congruency analysis, we found that the acoustical feedback was processed differently depending on whether it was congruent with the altered information from haptics or not. The altered haptic feedback dominated the altered acoustical feedback in determining the magnitude and direction of the compensatory motor responses in cases of crossmodal perturbation. These congruency effects depended on the factor of Class: Stronger response bias toward haptics was found in the haptic-positive individuals who appeared to show greater sensitivity to the altered deformation feedback, compared with the haptic-negative individuals. Further, this dependency has the same pattern for the three expertise-related groups. Essentially, musicianship did not have an influence on the weighting of auditory and haptic feedback for motor control beyond what could be accounted for by the choice of which tactual error signal, deformation or force, was the most relevant to the motor task.</p>
</sec>
</sec>
<sec id="Sec12">
<title>Discussion</title>
<p>In this study, the impact-related haptic feedback (surface indentation and resistive force) and auditory feedback (sound loudness and brightness) were altered alone or simultaneously as participants repeatedly struck a virtual sounding object. The compensatory changes in striking velocity were measured as the motor effect of the sensory perturbation. Overall, changes in the surface stiffness of the object in both the haptic and auditory modalities led to compensatory motor responses. However, an analysis of the effects of crossmodal congruency of stiffness change in the audio–haptic context revealed a robust dominance of haptics over audition in the control of striking velocity. Further, whereas the motor effects of an auditory perturbation were largely consistent across participants, those of a haptic perturbation varied widely, revealing distinct participant-specific compensatory strategies, i.e., a consistent increase versus a consistent decrease in striking velocity following an increase in haptic stiffness across trials. We argued that these opposite compensatory strategies resulted from a reliance on two different types of tactual error signals—surface deformation and vibrotactile force.</p>
<p>Interestingly, both haptic perturbation compensatory strategies were observed for participants in all musicianship groups, albeit with a slight, but non-robust, prevalence for a velocity increase with haptic stiffness and thus a potential reliance on surface deformation in percussionists. More importantly, we observed that within a crossmodal context, the weighting of auditory and haptic information for motor control was heavily dependent on whether participants focused on surface deformation or vibrotactile force, and was largely unaffected by the amount of previous experience with percussion performance per se. This finding echoes the absence of task-relevant expertise effects on the optimality-based prediction of sensory dominance across different learning stages for motor execution in a previous study that employed a bimanual coordination task involving cyclical wrist movements (Ronsse et al.
<xref ref-type="bibr" rid="CR35">2009</xref>
). Notably, these results do not necessarily contradict previous reports of experience-dependent shaping of an enhanced sensitivity to crossmodal incompatibility (Powers et al.
<xref ref-type="bibr" rid="CR33">2009</xref>
; Lee and Noppeney
<xref ref-type="bibr" rid="CR28">2011</xref>
; Kuchenbuch et al.
<xref ref-type="bibr" rid="CR22">2014</xref>
). Indeed, those studies did not examine action-based contexts and did not focus on the weighting of sensory feedback, but on the role of experience-dependent multisensory-coupling priors on the degree of sensory cue fusion (Ernst and Di Luca
<xref ref-type="bibr" rid="CR9">2011</xref>
).</p>
<p>Previous psychophysical evidence has shown dominance of haptic information over auditory information in perceptual tasks of estimating object textures (Lederman
<xref ref-type="bibr" rid="CR25">1979</xref>
; Lederman et al.
<xref ref-type="bibr" rid="CR27">2002</xref>
), judging apparent motion (Soto-Faraco et al.
<xref ref-type="bibr" rid="CR39">2004a</xref>
) or spatial localization (Caclin et al.
<xref ref-type="bibr" rid="CR3">2002</xref>
), or identifying materials (Giordano et al.
<xref ref-type="bibr" rid="CR16">2012</xref>
). Our results provide evidence of haptic dominance over audition in a sonic interaction scenario. In particular, the acoustically induced motor responses were modulated more strongly by a synchronized haptic perturbation than vice versa, as revealed by a marked asymmetry of the congruency effects across audition and haptics. The stronger weighting of haptics than audition might be attributable, at least in part, to a bias toward focusing on a sensory modality—haptics—that is more tightly linked to the exploration and exploitation of effector-related information during active sensorimotor activities. For instance, in our experiment, the striking velocity is simply the derivative of deformation with respect to time, and given a constant mass of the hand–stylus system, it is the integral of resistive force with respect to time. As such, focusing on tactual error signals would constitute a more efficient strategy for motor control because it would potentially require fewer computationally intensive sensorimotor transformations than attending to auditory error signals (Pouget and Snyder
<xref ref-type="bibr" rid="CR32">2000</xref>
). This superior modality-specific utility could also be learned developmentally through long-term tactual experience of object manipulations and explorations. For instance, the identification of aggregate materials (e.g., gravel of different sizes) through locomotor movements involved during walking appears to be dominated by the kinesthetic information that most promptly signals a potential postural instability (Giordano et al.
<xref ref-type="bibr" rid="CR16">2012</xref>
). We also noticed that the acoustical perturbation did lead to a small but observable effect on the haptically induced motor responses, drawing a parallel with analogous reciprocal audio–tactile interactions (albeit with an asymmetry in favor of touch) at perceptual levels of motion processing (Soto-Faraco et al.
<xref ref-type="bibr" rid="CR39">2004a</xref>
). This result contrasts with the highly imbalanced modality preference during speech sensorimotor control (Lametti et al.
<xref ref-type="bibr" rid="CR23">2012</xref>
), where the motor compensation for somatosensory perturbation (altered motion path of the jaw) is not affected by a simultaneous auditory perturbation (altered spectral parameters). It remains unknown whether such mixed results are due to the neurophysiological distinction between the two sensorimotor systems (limb specific vs. vocal specific) or are the results of a methodological incompatibility: We employed an ecologically relevant manipulation of crossmodal prediction errors (based on audio–haptic stiffness), whereas Lametti et al. (
<xref ref-type="bibr" rid="CR23">2012</xref>
) manipulated the uncorrelated cues of movement path of the jaw and formant frequencies of the utterance.</p>
<p>Given the nature of our experimental manipulation of haptic feedback, an unexpected increase (decrease) in the virtual object’s haptic stiffness would result in a sudden decrease (increase) in the perceived magnitude of deformation (i.e., surface indentation) of the object by the stylus, yet a larger (smaller) magnitude and faster (slower) increment rate of the resistive force generated during the simulated mechanical contact.
<xref ref-type="fn" rid="Fn3">3</xref>
Striking an object with higher velocities (greater energy supplied to the vibrating system) would instead always generate increases in the values of various tactual cues (Fig.
<xref rid="Fig2" ref-type="fig">2</xref>
c–f). The resulting motor compensation for the altered deformation feedback versus force feedback should thus operate in opposite directions, making it possible to group participants based on whether they responded to either type of error signal consistently across experimental trials. Individual differences indeed emerged in the pattern of compensatory motor responses to the haptic perturbation, which could be most parsimoniously explained in terms of a preferential reliance upon different tactual error signals. Fifty-five percent of the participants (“haptic negative”) likely tended to compensate for the altered force cues (maximal resistive force and resistive force rate) by striking more softly (lower striking velocity) on an unexpectedly stiffer object. To the contrary, 45 % of the participants (“haptic positive”) appeared to compensate for the altered surface deformation feedback (maximal indentation) by striking harder on the stiffer object in order to indent its surface as deeply as had been experienced prior to the perturbation.</p>
<p>Although the exact origin of the observed reliance on tactual cues for motor control might open up an avenue that merits further experimentation, two plausible but not mutually exclusive explanations can be put forward. First, the individual differences in susceptibility to the perturbation of tactual signals may be partially explained by variability in the sensory acuity (Villacorta et al.
<xref ref-type="bibr" rid="CR41">2007</xref>
) for the changes in the different tactual signals that are transmitted via separate information-processing channels. These channels would represent distinct mechanoreceptor populations and afferent fibers for tactile versus kinesthetic sensations. Alternatively, these interindividual differences might originate from previous experience with tool-based interactions with objects. Notably, we found that 10 out of 14 percussionists—eight of them being mallet percussionists who specialized in xylophone, marimba, etc.—showed a preferential reliance on the deformation feedback. Increased sensitivity to a particular type of error signal during percussion may be shaped by many years of experience with striking objects of different stiffness with mallets that also vary in stiffness. To control a manipulative behavior on objects, most people potentially employ a mechanism (an internal model of the object properties, Flanagan and Wing
<xref ref-type="bibr" rid="CR10">1997</xref>
) that seems not to require special expertise: Grasp stability is achieved by adjusting the grip force in anticipation of the changes in resistive force generated by a tapped object (LaMotte
<xref ref-type="bibr" rid="CR24">2000</xref>
). Mallet percussionists, however, may have potentially developed a different strategy. They routinely relax the grip so as to allow the hand-held mallet to rotate freely around a fulcrum point (commonly between the index finger and thumb) in a vertical plane (Dahl
<xref ref-type="bibr" rid="CR6">2006</xref>
). They in fact make an effort to keep the wrist joint as compliant as possible (to prevent fatigue) during repeated percussive gestures, which is achieved through unique physiologically efficient reciprocal activities of the wrist muscles (Fujii et al.
<xref ref-type="bibr" rid="CR12">2009</xref>
). Monitoring the wrist-rotation trajectories (position-related tactual signals encoded via joint receptors and muscle afferents) rather than the grip force would possibly facilitate a mallet percussionist’s superior sensitivity to the nuances in the magnitude of object indentation by the stylus. Future studies could include “non-mallet” percussionists who have been trained most of the time to play with their bare hands and fingers (e.g., tabla and conga players) in order to examine the extent to which the observed cue reliance is associated with the specificity of mallet-based percussion training. Issues such as strict criteria for participant selection must be considered cautiously, because modern percussionists are usually known for their versatility across a broad range of percussion instruments.</p>
<p>One last important finding of this study is that within a crossmodal context, actively monitoring deformation rather than force feedback results in a greater disregard for the altered auditory feedback. Potential explanations for this result rely on the hypothesis that the causal association between haptic deformation signals, on the one hand, and auditory cues, on the other, is weaker than that observed between force signals and auditory cues. From the short-term perspective, it might instead be argued that repeated manipulations of the haptic device in this experiment may have given rise to participants’ awareness that the synthesized sounds fail to carry any information about the object’s deformation by the stylus, although they still convey spatial and temporal information about the contacts with the surface (DiFranco et al.
<xref ref-type="bibr" rid="CR7">1997</xref>
). We argue that long-term sensorimotor experience with the striking of sound-generating solid objects made of materials that range from easily deformable to rigid results in reliable associations between resistive forces and concomitant impact sounds, but not between deformation and impact sounds. Indeed, objects that generate higher resistive forces also produce louder impact sounds. And although deformable objects tend to produce softer sounds, non-deformable materials such as hard wood or steel produce a wide range of loudness levels due to variations in their intrinsic vibrational and damping properties when struck with the same velocity. For this reason, through long-term experience, we may potentially learn that deformation is less reliably associated with the structure of the concomitant sound stimulus than are force cues. Importantly, the interaction of crossmodal channels for information processing can show a tendency to break down if a process of causal inference judges that the different sensory signals originate from weakly correlated sources (Körding et al.
<xref ref-type="bibr" rid="CR21">2007</xref>
; Ernst and Di Luca
<xref ref-type="bibr" rid="CR9">2011</xref>
). As such, auditory cues are more likely to be ignored if a participant shows predominantly greater sensitivity to the deformation-related prediction errors.</p>
</sec>
</body>
<back>
<fn-group>
<fn id="Fn1">
<label>1</label>
<p>The degree of
<italic>surface stiffness</italic>
of an object is defined as the magnitude of resistive force caused by a unit measure of surface indentation by an external indentor (such as the finger or stylus) in contact with the object surface. Surface stiffness is one among various other material properties of solid objects toward which perceptual experiences are directed through “active touch” (Gibson
<xref ref-type="bibr" rid="CR14">1962</xref>
), such as surface roughness, stickiness, spatial density, and apparent temperature. The perceptual correlates of these properties have proven to be reliably orthogonal to those of geometric properties that are specific to particular objects (see taxonomy of object properties by Klatzky and Lederman
<xref ref-type="bibr" rid="CR20">1993</xref>
). As a geometry-independent material property in the tactual psychophysics literature, surface stiffness must be distinguished from the mechanical stiffness of a structure, whose value is largely affected by geometric factors (e.g., a kitchen steel scrubber deforms easily when squeezed because of its structural design and not because of the inherent surface stiffness of steel; Rivin
<xref ref-type="bibr" rid="CR34">1999</xref>
).</p>
</fn>
<fn id="Fn2">
<label>2</label>
<p>M. Puckette, PureData (Pd),
<ext-link ext-link-type="uri" xlink:href="http://www.puredata.org">http://www.puredata.org</ext-link>
, Accessed 6 April 2014.</p>
</fn>
<fn id="Fn3">
<label>3</label>
<p>These tactual cues correlate with object stiffness during active tapping with a rigid hand-held stylus (LaMotte
<xref ref-type="bibr" rid="CR24">2000</xref>
).</p>
</fn>
<fn>
<p>Yinan Cao and Bruno L. Giordano have contributed equally to this work.</p>
</fn>
</fn-group>
<ack>
<p>This work was supported by a Canadian Natural Sciences and Engineering Research Council grant (NSERC RGPIN 312774–05) and by a Special Research Opportunity Grant from NSERC awarded to S.M., as well as his Canada Research Chair. Y.C. was supported by an NSERC–Create Auditory Cognitive Neuroscience Fellowship. B.L.G was supported by the Marie Curie Intra-European Fellowships Program (FP7 PEOPLE-2011-IEF-30153, project BrainInNaturalSound) and by the Biotechnology and Biological Sciences Research Council (BBSRC; BB/M009742/1). F.A. was supported by the EU FP6 Network of Excellence “Enactive Interfaces” (IST–1–002114).</p>
</ack>
<notes notes-type="conflict-interest">
<title>Compliance with ethical standards</title>
<sec id="d30e2560">
<title>Conflict of interest</title>
<p>The authors declare that they have no conflict of interest.</p>
</sec>
</notes>
<ref-list id="Bib1">
<title>References</title>
<ref id="CR1">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Avanzini</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Crosato</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Integrating physically based sound models in a multimodal rendering architecture</article-title>
<source>Comput Animat Virtual Worlds</source>
<year>2006</year>
<volume>17</volume>
<issue>3–4</issue>
<fpage>411</fpage>
<lpage>419</lpage>
<pub-id pub-id-type="doi">10.1002/cav.144</pub-id>
</element-citation>
</ref>
<ref id="CR2">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bresciani</surname>
<given-names>JP</given-names>
</name>
<name>
<surname>Ernst</surname>
<given-names>MO</given-names>
</name>
<name>
<surname>Drewing</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Bouyer</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Maury</surname>
<given-names>V</given-names>
</name>
<name>
<surname>Kheddar</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Feeling what you hear: auditory signals can modulate tactile tap perception</article-title>
<source>Exp Brain Res</source>
<year>2005</year>
<volume>162</volume>
<issue>2</issue>
<fpage>172</fpage>
<lpage>180</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-004-2128-2</pub-id>
<pub-id pub-id-type="pmid">15791465</pub-id>
</element-citation>
</ref>
<ref id="CR3">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Caclin</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Soto-Faraco</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Kingstone</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Tactile “capture” of audition</article-title>
<source>Percept Psychophys</source>
<year>2002</year>
<volume>64</volume>
<issue>4</issue>
<fpage>616</fpage>
<lpage>630</lpage>
<pub-id pub-id-type="doi">10.3758/BF03194730</pub-id>
<pub-id pub-id-type="pmid">12132762</pub-id>
</element-citation>
</ref>
<ref id="CR4">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chaigne</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Doutaut</surname>
<given-names>V</given-names>
</name>
</person-group>
<article-title>Numerical simulations of xylophones. I. Time-domain modeling of the vibrating bars</article-title>
<source>J Acoust Soc Am</source>
<year>1997</year>
<volume>101</volume>
<issue>1</issue>
<fpage>539</fpage>
<lpage>557</lpage>
<pub-id pub-id-type="doi">10.1121/1.418117</pub-id>
</element-citation>
</ref>
<ref id="CR5">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cicchini</surname>
<given-names>GM</given-names>
</name>
<name>
<surname>Arrighi</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Cecchetti</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Giusti</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Burr</surname>
<given-names>DC</given-names>
</name>
</person-group>
<article-title>Optimal encoding of interval timing in expert percussionists</article-title>
<source>J Neurosci</source>
<year>2012</year>
<volume>32</volume>
<issue>3</issue>
<fpage>1056</fpage>
<lpage>1060</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.3411-11.2012</pub-id>
<pub-id pub-id-type="pmid">22262903</pub-id>
</element-citation>
</ref>
<ref id="CR6">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Dahl</surname>
<given-names>S</given-names>
</name>
</person-group>
<person-group person-group-type="editor">
<name>
<surname>Altenmüller</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Wiesendanger</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Kesselring</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Movements and analysis of drumming</article-title>
<source>Music motor control and the brain</source>
<year>2006</year>
<publisher-loc>Oxford</publisher-loc>
<publisher-name>Oxford University Press</publisher-name>
<fpage>125</fpage>
<lpage>138</lpage>
</element-citation>
</ref>
<ref id="CR7">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>DiFranco</surname>
<given-names>DE</given-names>
</name>
<name>
<surname>Beauregard</surname>
<given-names>GL</given-names>
</name>
<name>
<surname>Srinivasan</surname>
<given-names>MA</given-names>
</name>
</person-group>
<article-title>The effect of auditory cues on the haptic perception of stiffness in virtual environments</article-title>
<source>Proc ASME Dyn Syst Control Div Am Soc Mech Eng</source>
<year>1997</year>
<volume>61</volume>
<fpage>17</fpage>
<lpage>22</lpage>
</element-citation>
</ref>
<ref id="CR8">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Driver</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C</given-names>
</name>
</person-group>
<person-group person-group-type="editor">
<name>
<surname>Spence</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Driver</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Crossmodal spatial attention: evidence from human performance</article-title>
<source>Crossmodal space and crossmodal attention</source>
<year>2004</year>
<publisher-loc>Oxford</publisher-loc>
<publisher-name>Oxford University Press</publisher-name>
<fpage>217</fpage>
<lpage>220</lpage>
</element-citation>
</ref>
<ref id="CR9">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Ernst</surname>
<given-names>MO</given-names>
</name>
<name>
<surname>Di Luca</surname>
<given-names>M</given-names>
</name>
</person-group>
<person-group person-group-type="editor">
<name>
<surname>Landy</surname>
<given-names>MS</given-names>
</name>
<name>
<surname>Trommershäuse</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Konrad Kording</surname>
<given-names>K</given-names>
</name>
</person-group>
<article-title>Multisensory perception: from integration to remapping</article-title>
<source>Sensory cue integration</source>
<year>2011</year>
<publisher-loc>Oxford</publisher-loc>
<publisher-name>Oxford University Press</publisher-name>
<fpage>224</fpage>
<lpage>250</lpage>
</element-citation>
</ref>
<ref id="CR10">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Flanagan</surname>
<given-names>JR</given-names>
</name>
<name>
<surname>Wing</surname>
<given-names>AM</given-names>
</name>
</person-group>
<article-title>The role of internal models in motion planning and control: evidence from grip force adjustments during movements of hand-held loads</article-title>
<source>J Neurosci</source>
<year>1997</year>
<volume>17</volume>
<issue>4</issue>
<fpage>1519</fpage>
<lpage>1528</lpage>
<pub-id pub-id-type="pmid">9006993</pub-id>
</element-citation>
</ref>
<ref id="CR11">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Fletcher</surname>
<given-names>NH</given-names>
</name>
<name>
<surname>Rossing</surname>
<given-names>TD</given-names>
</name>
</person-group>
<source>The physics of musical instruments</source>
<year>1991</year>
<publisher-loc>New York, NY</publisher-loc>
<publisher-name>Springer</publisher-name>
</element-citation>
</ref>
<ref id="CR12">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fujii</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Kudo</surname>
<given-names>K</given-names>
</name>
<name>
<surname>Ohtsuki</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Oda</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Tapping performance and underlying wrist muscle activity of non-drummers, drummers, and the world’s fastest drummer</article-title>
<source>Neurosci Lett</source>
<year>2009</year>
<volume>459</volume>
<issue>2</issue>
<fpage>69</fpage>
<lpage>73</lpage>
<pub-id pub-id-type="doi">10.1016/j.neulet.2009.04.055</pub-id>
<pub-id pub-id-type="pmid">19409958</pub-id>
</element-citation>
</ref>
<ref id="CR13">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gescheider</surname>
<given-names>GA</given-names>
</name>
</person-group>
<article-title>Effects of signal probability on vibrotactile signal recognition</article-title>
<source>Percept Mot Skills</source>
<year>1974</year>
<volume>38</volume>
<issue>1</issue>
<fpage>15</fpage>
<lpage>23</lpage>
<pub-id pub-id-type="doi">10.2466/pms.1974.38.1.15</pub-id>
<pub-id pub-id-type="pmid">4815486</pub-id>
</element-citation>
</ref>
<ref id="CR14">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gibson</surname>
<given-names>JJ</given-names>
</name>
</person-group>
<article-title>Observations on active touch</article-title>
<source>Psychol Rev</source>
<year>1962</year>
<volume>69</volume>
<issue>6</issue>
<fpage>477</fpage>
<lpage>491</lpage>
<pub-id pub-id-type="doi">10.1037/h0046962</pub-id>
<pub-id pub-id-type="pmid">13947730</pub-id>
</element-citation>
</ref>
<ref id="CR15">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Giordano</surname>
<given-names>BL</given-names>
</name>
<name>
<surname>Rocchesso</surname>
<given-names>D</given-names>
</name>
<name>
<surname>McAdams</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Integration of acoustical information in the perception of impacted sound sources: the role of information accuracy and exploitability</article-title>
<source>J Exp Psychol Hum Percept Perform</source>
<year>2010</year>
<volume>36</volume>
<issue>2</issue>
<fpage>462</fpage>
<lpage>476</lpage>
<pub-id pub-id-type="doi">10.1037/a0018388</pub-id>
<pub-id pub-id-type="pmid">20364930</pub-id>
</element-citation>
</ref>
<ref id="CR16">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Giordano</surname>
<given-names>BL</given-names>
</name>
<name>
<surname>Visell</surname>
<given-names>Y</given-names>
</name>
<name>
<surname>Yao</surname>
<given-names>HY</given-names>
</name>
<name>
<surname>Hayward</surname>
<given-names>V</given-names>
</name>
<name>
<surname>Cooperstock</surname>
<given-names>JR</given-names>
</name>
<name>
<surname>McAdams</surname>
<given-names>S</given-names>
</name>
</person-group>
<article-title>Identification of walked-upon materials in auditory, kinesthetic, haptic, and audio-haptic conditions</article-title>
<source>J Acoust Soc Am</source>
<year>2012</year>
<volume>131</volume>
<issue>5</issue>
<fpage>4002</fpage>
<lpage>4012</lpage>
<pub-id pub-id-type="doi">10.1121/1.3699205</pub-id>
<pub-id pub-id-type="pmid">22559373</pub-id>
</element-citation>
</ref>
<ref id="CR17">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Guest</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Catmur</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Lloyd</surname>
<given-names>D</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Audiotactile interactions in roughness perception</article-title>
<source>Exp Brain Res</source>
<year>2002</year>
<volume>146</volume>
<issue>2</issue>
<fpage>161</fpage>
<lpage>171</lpage>
<pub-id pub-id-type="doi">10.1007/s00221-002-1164-z</pub-id>
<pub-id pub-id-type="pmid">12195518</pub-id>
</element-citation>
</ref>
<ref id="CR18">
<mixed-citation publication-type="other">ISO (2004) Acoustics—reference zero for the calibration of audiometric equipment—part 8: reference equivalent threshold sound pressure levels for pure tones and circumaural earphones (ISO 389-8). Technical report. International Organization for Standardization, Geneva</mixed-citation>
</ref>
<ref id="CR19">
<mixed-citation publication-type="other">Itkowitz B, Handley J, Zhu W (2005) The openhaptics™ toolkit: a library for adding 3d touch™ navigation and haptics to graphics applications. In: Proceedings of the joint eurohaptics conference symposium on haptic interfaces for virtual Environment and teleoperator systems. IEEE, Pisa, Italy, pp 590–591</mixed-citation>
</ref>
<ref id="CR20">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Klatzky</surname>
<given-names>RL</given-names>
</name>
<name>
<surname>Lederman</surname>
<given-names>SJ</given-names>
</name>
</person-group>
<article-title>Toward a computational model of constraint-driven exploration and haptic object identification</article-title>
<source>Perception</source>
<year>1993</year>
<volume>22</volume>
<issue>5</issue>
<fpage>597</fpage>
<lpage>621</lpage>
<pub-id pub-id-type="doi">10.1068/p220597</pub-id>
<pub-id pub-id-type="pmid">8414884</pub-id>
</element-citation>
</ref>
<ref id="CR21">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Körding</surname>
<given-names>KP</given-names>
</name>
<name>
<surname>Beierholm</surname>
<given-names>U</given-names>
</name>
<name>
<surname>Ma</surname>
<given-names>WJ</given-names>
</name>
<name>
<surname>Quartz</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Tenenbaum</surname>
<given-names>JB</given-names>
</name>
<name>
<surname>Shams</surname>
<given-names>L</given-names>
</name>
</person-group>
<article-title>Causal inference in multisensory perception</article-title>
<source>PLoS One</source>
<year>2007</year>
<volume>2</volume>
<issue>9</issue>
<fpage>e943</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pone.0000943</pub-id>
<pub-id pub-id-type="pmid">17895984</pub-id>
</element-citation>
</ref>
<ref id="CR22">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kuchenbuch</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Paraskevopoulos</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Herholz</surname>
<given-names>SC</given-names>
</name>
<name>
<surname>Pantev</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Audio-tactile integration and the influence of musical training</article-title>
<source>PLoS One</source>
<year>2014</year>
<volume>9</volume>
<issue>1</issue>
<fpage>e85743</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pone.0085743</pub-id>
<pub-id pub-id-type="pmid">24465675</pub-id>
</element-citation>
</ref>
<ref id="CR23">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lametti</surname>
<given-names>DR</given-names>
</name>
<name>
<surname>Nasir</surname>
<given-names>SM</given-names>
</name>
<name>
<surname>Ostry</surname>
<given-names>DJ</given-names>
</name>
</person-group>
<article-title>Sensory preference in speech production revealed by simultaneous alteration of auditory and somatosensory feedback</article-title>
<source>J Neurosci</source>
<year>2012</year>
<volume>32</volume>
<issue>27</issue>
<fpage>9351</fpage>
<lpage>9358</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.0404-12.2012</pub-id>
<pub-id pub-id-type="pmid">22764242</pub-id>
</element-citation>
</ref>
<ref id="CR24">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>LaMotte</surname>
<given-names>RH</given-names>
</name>
</person-group>
<article-title>Softness discrimination with a tool</article-title>
<source>J Neurophysiol</source>
<year>2000</year>
<volume>83</volume>
<issue>4</issue>
<fpage>1777</fpage>
<lpage>1786</lpage>
<pub-id pub-id-type="pmid">10758090</pub-id>
</element-citation>
</ref>
<ref id="CR25">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lederman</surname>
<given-names>SJ</given-names>
</name>
</person-group>
<article-title>Auditory texture perception</article-title>
<source>Perception</source>
<year>1979</year>
<volume>8</volume>
<issue>1</issue>
<fpage>93</fpage>
<lpage>103</lpage>
<pub-id pub-id-type="doi">10.1068/p080093</pub-id>
<pub-id pub-id-type="pmid">432084</pub-id>
</element-citation>
</ref>
<ref id="CR26">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Lederman</surname>
<given-names>SJ</given-names>
</name>
<name>
<surname>Klatzky</surname>
<given-names>RL</given-names>
</name>
</person-group>
<person-group person-group-type="editor">
<name>
<surname>Calvert</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Stein</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>Multisensory texture perception</article-title>
<source>Handbook of multisensory processes</source>
<year>2004</year>
<publisher-loc>Cambridge, MA</publisher-loc>
<publisher-name>MIT Press</publisher-name>
<fpage>107</fpage>
<lpage>122</lpage>
</element-citation>
</ref>
<ref id="CR27">
<mixed-citation publication-type="other">Lederman SJ, Klatzky RL, Morgan T, Hamilton C (2002) Integrating multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sound sources. In: Proceedings of the symposium haptic interfaces for virtual environment and teleoperator systems. IEEE, Orlando, FL, pp 97–104</mixed-citation>
</ref>
<ref id="CR28">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lee</surname>
<given-names>H</given-names>
</name>
<name>
<surname>Noppeney</surname>
<given-names>U</given-names>
</name>
</person-group>
<article-title>Long-term music training tunes how the brain temporally binds signals from multiple senses</article-title>
<source>Proc Natl Acad Sci USA</source>
<year>2011</year>
<volume>108</volume>
<issue>51</issue>
<fpage>E1441</fpage>
<lpage>E1450</lpage>
<pub-id pub-id-type="doi">10.1073/pnas.1115267108</pub-id>
<pub-id pub-id-type="pmid">22114191</pub-id>
</element-citation>
</ref>
<ref id="CR29">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lutfi</surname>
<given-names>RA</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>CJ</given-names>
</name>
<name>
<surname>Stoelinga</surname>
<given-names>CN</given-names>
</name>
</person-group>
<article-title>Auditory discrimination of force of impact</article-title>
<source>J Acoust Soc Am</source>
<year>2011</year>
<volume>129</volume>
<issue>4</issue>
<fpage>2104</fpage>
<lpage>2111</lpage>
<pub-id pub-id-type="doi">10.1121/1.3543969</pub-id>
<pub-id pub-id-type="pmid">21476666</pub-id>
</element-citation>
</ref>
<ref id="CR30">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Martin</surname>
<given-names>FN</given-names>
</name>
<name>
<surname>Champlin</surname>
<given-names>CA</given-names>
</name>
</person-group>
<article-title>Reconsidering the limits of normal hearing</article-title>
<source>J Am Acad Audiol</source>
<year>2000</year>
<volume>11</volume>
<issue>2</issue>
<fpage>64</fpage>
<lpage>66</lpage>
<pub-id pub-id-type="pmid">10685671</pub-id>
</element-citation>
</ref>
<ref id="CR31">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Miall</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Wolpert</surname>
<given-names>DM</given-names>
</name>
</person-group>
<article-title>Forward models for physiological motor control</article-title>
<source>Neural Netw</source>
<year>1996</year>
<volume>9</volume>
<issue>8</issue>
<fpage>1265</fpage>
<lpage>1279</lpage>
<pub-id pub-id-type="doi">10.1016/S0893-6080(96)00035-4</pub-id>
<pub-id pub-id-type="pmid">12662535</pub-id>
</element-citation>
</ref>
<ref id="CR32">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pouget</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Snyder</surname>
<given-names>LH</given-names>
</name>
</person-group>
<article-title>Computational approaches to sensorimotor transformations</article-title>
<source>Nat Neurosci</source>
<year>2000</year>
<volume>3</volume>
<fpage>1192</fpage>
<lpage>1198</lpage>
<pub-id pub-id-type="doi">10.1038/81469</pub-id>
<pub-id pub-id-type="pmid">11127837</pub-id>
</element-citation>
</ref>
<ref id="CR33">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Powers</surname>
<given-names>AR</given-names>
</name>
<name>
<surname>Hillock</surname>
<given-names>AR</given-names>
</name>
<name>
<surname>Wallace</surname>
<given-names>MT</given-names>
</name>
</person-group>
<article-title>Perceptual training narrows the temporal window of multisensory binding</article-title>
<source>J Neurosci</source>
<year>2009</year>
<volume>29</volume>
<issue>39</issue>
<fpage>12265</fpage>
<lpage>12274</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.3501-09.2009</pub-id>
<pub-id pub-id-type="pmid">19793985</pub-id>
</element-citation>
</ref>
<ref id="CR34">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Rivin</surname>
<given-names>EI</given-names>
</name>
</person-group>
<source>Stiffness and damping in mechanical design</source>
<year>1999</year>
<publisher-loc>New York</publisher-loc>
<publisher-name>Marcel Dekker Inc.</publisher-name>
</element-citation>
</ref>
<ref id="CR35">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ronsse</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Miall</surname>
<given-names>RC</given-names>
</name>
<name>
<surname>Swinnen</surname>
<given-names>SP</given-names>
</name>
</person-group>
<article-title>Multisensory integration in dynamical behaviors: maximum likelihood estimation across bimanual skill learning</article-title>
<source>J Neurosci</source>
<year>2009</year>
<volume>29</volume>
<issue>26</issue>
<fpage>8419</fpage>
<lpage>8428</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5734-08.2009</pub-id>
<pub-id pub-id-type="pmid">19571132</pub-id>
</element-citation>
</ref>
<ref id="CR36">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Saunders</surname>
<given-names>JA</given-names>
</name>
<name>
<surname>Knill</surname>
<given-names>DC</given-names>
</name>
</person-group>
<article-title>Visual feedback control of hand movements</article-title>
<source>J Neurosci</source>
<year>2004</year>
<volume>24</volume>
<issue>13</issue>
<fpage>3223</fpage>
<lpage>3234</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4319-03.2004</pub-id>
<pub-id pub-id-type="pmid">15056701</pub-id>
</element-citation>
</ref>
<ref id="CR37">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shadmehr</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Smith</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Krakauer</surname>
<given-names>JW</given-names>
</name>
</person-group>
<article-title>Error correction, sensory prediction, and adaptation in motor control</article-title>
<source>Annu Rev Neurosci</source>
<year>2010</year>
<volume>33</volume>
<fpage>89</fpage>
<lpage>108</lpage>
<pub-id pub-id-type="doi">10.1146/annurev-neuro-060909-153135</pub-id>
<pub-id pub-id-type="pmid">20367317</pub-id>
</element-citation>
</ref>
<ref id="CR38">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sober</surname>
<given-names>SJ</given-names>
</name>
<name>
<surname>Sabes</surname>
<given-names>PN</given-names>
</name>
</person-group>
<article-title>Multisensory integration during motor planning</article-title>
<source>J Neurosci</source>
<year>2003</year>
<volume>23</volume>
<issue>18</issue>
<fpage>6982</fpage>
<lpage>6992</lpage>
<pub-id pub-id-type="pmid">12904459</pub-id>
</element-citation>
</ref>
<ref id="CR39">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Soto-Faraco</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Kingstone</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Congruency effects between auditory and tactile motion: extending the phenomenon of cross-modal dynamic capture</article-title>
<source>Cogn Affect Behav Neurosci</source>
<year>2004</year>
<volume>4</volume>
<issue>2</issue>
<fpage>208</fpage>
<lpage>217</lpage>
<pub-id pub-id-type="doi">10.3758/CABN.4.2.208</pub-id>
<pub-id pub-id-type="pmid">15460927</pub-id>
</element-citation>
</ref>
<ref id="CR40">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Soto-Faraco</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Kingstone</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities</article-title>
<source>J Exp Psychol Hum</source>
<year>2004</year>
<volume>30</volume>
<issue>2</issue>
<fpage>330</fpage>
<lpage>345</lpage>
<pub-id pub-id-type="doi">10.1037/0096-1523.30.2.330</pub-id>
</element-citation>
</ref>
<ref id="CR41">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Villacorta</surname>
<given-names>VM</given-names>
</name>
<name>
<surname>Perkell</surname>
<given-names>JS</given-names>
</name>
<name>
<surname>Guenther</surname>
<given-names>FH</given-names>
</name>
</person-group>
<article-title>Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception</article-title>
<source>J Acoust Soc Am</source>
<year>2007</year>
<volume>122</volume>
<issue>4</issue>
<fpage>2306</fpage>
<lpage>2319</lpage>
<pub-id pub-id-type="doi">10.1121/1.2773966</pub-id>
<pub-id pub-id-type="pmid">17902866</pub-id>
</element-citation>
</ref>
<ref id="CR42">
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Welch</surname>
<given-names>RB</given-names>
</name>
<name>
<surname>Warren</surname>
<given-names>DH</given-names>
</name>
</person-group>
<article-title>Immediate perceptual response to intersensory discrepancy</article-title>
<source>Psychol Bull</source>
<year>1980</year>
<volume>88</volume>
<issue>3</issue>
<fpage>638</fpage>
<lpage>667</lpage>
<pub-id pub-id-type="doi">10.1037/0033-2909.88.3.638</pub-id>
<pub-id pub-id-type="pmid">7003641</pub-id>
</element-citation>
</ref>
<ref id="CR43">
<element-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>West</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Welch</surname>
<given-names>KB</given-names>
</name>
<name>
<surname>Galecki</surname>
<given-names>AT</given-names>
</name>
</person-group>
<source>Linear mixed models: a practical guide using statistical software</source>
<year>2006</year>
<publisher-loc>Boca Raton, FL</publisher-loc>
<publisher-name>Chapman & Hall/CRC Press</publisher-name>
</element-citation>
</ref>
</ref-list>
</back>
</pmc>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000794 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000794 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Ticri/CIDE
   |area=    HapticV1
   |flux=    Pmc
   |étape=   Curation
   |type=    RBID
   |clé=     PMC:4785215
   |texte=   The dominance of haptics over audition in controlling wrist velocity during striking movements
}}

Pour générer des pages wiki

HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i   -Sk "pubmed:26790425" \
       | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd   \
       | NlmPubMed2Wicri -a HapticV1 

Wicri

This area was generated with Dilib version V0.6.23.
Data generation: Mon Jun 13 01:09:46 2016. Site generation: Wed Mar 6 09:54:07 2024