Touching Sounds: Audio Virtual Surfaces
Identifieur interne : 000357 ( Main/Exploration ); précédent : 000356; suivant : 000358Touching Sounds: Audio Virtual Surfaces
Auteurs : Eric O. Boyer [France] ; Lucyle Vandervoorde [France] ; Frédéric Bevilacqua [France] ; Sylvain Hanneton [France]Source :
Abstract
This prospective study concerning the perception of audio virtual surfaces (AVSs) was inspired by two different research fields: sensory substitution and haptic and touch perception. We define Audio Virtual Surfaces as regions of space that trigger sounds when the user touches it or moves into it. First, we describe an example of interactive setup using an AVS to simulate a sonic interaction with a virtual water tank. Then, we present an experiment designed to investigate the ability of blindfolded adults to discriminate between concave and convex auditory virtual surfaces using only the gesture-sound interaction. Two groups received different sound feedback, a static one indicating presence in the AVS, and a static+dynamic one (related to the component of the hand velocity tangential to the surface). In order to demonstrate that curvature direction was correctly perceived, we estimated their discrimination thresholds with a psychophysical staircase procedure. Results show that most of the participants were able to learn the task. The best results were obtained with the additional dynamic feedback. Gestural patterns emerged from the interaction, suggesting the use of auditory representation of the virtual object. This work proposes a contribution to the introduction in virtual reality of sonic interactions with auditory virtual objects. The setups we present raise new questions, at both experimental (sensory substitution) and application levels (design of gesture-sound interaction for virtual reality).
Url:
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Hal, to step Corpus: 000535
- to stream Hal, to step Curation: 000535
- to stream Hal, to step Checkpoint: 000032
- to stream Main, to step Merge: 000357
- to stream Main, to step Curation: 000357
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Touching Sounds: Audio Virtual Surfaces</title><author><name sortKey="Boyer, Eric O" sort="Boyer, Eric O" uniqKey="Boyer E" first="Eric O" last="Boyer">Eric O. Boyer</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55516" status="VALID"><idno type="IdRef">148418074</idno><idno type="RNSR">201420751Z</idno><orgName>Laboratoire Psychologie de la Perception</orgName><orgName type="acronym">LPP</orgName><date type="start">2014</date><desc><address><addrLine>Centre Biomédical des Saints Pères 45 rue des Saints Pères 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://lpp.psycho.univ-paris5.fr/</ref></desc><listRelation><relation name="UMR 8242" active="#struct-301664" type="direct"></relation><relation name="UMR 8242" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle name="UMR 8242" active="#struct-301664" type="direct"><org type="institution" xml:id="struct-301664" status="VALID"><idno type="IdRef">026404788</idno><idno type="ISNI">0000 0001 2188 0914 </idno><orgName>Université Paris Descartes - Paris 5</orgName><orgName type="acronym">UPD5</orgName><desc><address><addrLine>12, rue de l'École de Médecine - 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://www.parisdescartes.fr/</ref></desc></org></tutelle><tutelle name="UMR 8242" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Vandervoorde, Lucyle" sort="Vandervoorde, Lucyle" uniqKey="Vandervoorde L" first="Lucyle" last="Vandervoorde">Lucyle Vandervoorde</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55516" status="VALID"><idno type="IdRef">148418074</idno><idno type="RNSR">201420751Z</idno><orgName>Laboratoire Psychologie de la Perception</orgName><orgName type="acronym">LPP</orgName><date type="start">2014</date><desc><address><addrLine>Centre Biomédical des Saints Pères 45 rue des Saints Pères 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://lpp.psycho.univ-paris5.fr/</ref></desc><listRelation><relation name="UMR 8242" active="#struct-301664" type="direct"></relation><relation name="UMR 8242" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle name="UMR 8242" active="#struct-301664" type="direct"><org type="institution" xml:id="struct-301664" status="VALID"><idno type="IdRef">026404788</idno><idno type="ISNI">0000 0001 2188 0914 </idno><orgName>Université Paris Descartes - Paris 5</orgName><orgName type="acronym">UPD5</orgName><desc><address><addrLine>12, rue de l'École de Médecine - 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://www.parisdescartes.fr/</ref></desc></org></tutelle><tutelle name="UMR 8242" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Bevilacqua, Frederic" sort="Bevilacqua, Frederic" uniqKey="Bevilacqua F" first="Frédéric" last="Bevilacqua">Frédéric Bevilacqua</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-390438" status="INCOMING"><orgName>Interactions Son Musique Mouvement</orgName><desc><address><country key="FR"></country></address></desc><listRelation><relation active="#struct-1374" type="direct"></relation><relation active="#struct-93591" type="indirect"></relation><relation active="#struct-300476" type="indirect"></relation><relation name="UMR9912" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-1374" type="direct"><org type="laboratory" xml:id="struct-1374" status="VALID"><idno type="RNSR">198319352N</idno><orgName>Sciences et Technologies de la Musique et du Son</orgName><orgName type="acronym">STMS</orgName><desc><address><addrLine>1 Place Igor Stravinsky 75004 PARIS</addrLine><country key="FR"></country></address><ref type="url">http://www.ircam.fr/</ref></desc><listRelation><relation active="#struct-93591" type="direct"></relation><relation active="#struct-300476" type="direct"></relation><relation name="UMR9912" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-93591" type="indirect"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle><tutelle active="#struct-300476" type="indirect"><org type="institution" xml:id="struct-300476" status="VALID"><orgName>IRCAM</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle name="UMR9912" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Hanneton, Sylvain" sort="Hanneton, Sylvain" uniqKey="Hanneton S" first="Sylvain" last="Hanneton">Sylvain Hanneton</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55516" status="VALID"><idno type="IdRef">148418074</idno><idno type="RNSR">201420751Z</idno><orgName>Laboratoire Psychologie de la Perception</orgName><orgName type="acronym">LPP</orgName><date type="start">2014</date><desc><address><addrLine>Centre Biomédical des Saints Pères 45 rue des Saints Pères 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://lpp.psycho.univ-paris5.fr/</ref></desc><listRelation><relation name="UMR 8242" active="#struct-301664" type="direct"></relation><relation name="UMR 8242" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle name="UMR 8242" active="#struct-301664" type="direct"><org type="institution" xml:id="struct-301664" status="VALID"><idno type="IdRef">026404788</idno><idno type="ISNI">0000 0001 2188 0914 </idno><orgName>Université Paris Descartes - Paris 5</orgName><orgName type="acronym">UPD5</orgName><desc><address><addrLine>12, rue de l'École de Médecine - 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://www.parisdescartes.fr/</ref></desc></org></tutelle><tutelle name="UMR 8242" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:hal-01265581</idno><idno type="halId">hal-01265581</idno><idno type="halUri">http://hal.upmc.fr/hal-01265581</idno><idno type="url">http://hal.upmc.fr/hal-01265581</idno><date when="2015-03-24">2015-03-24</date><idno type="wicri:Area/Hal/Corpus">000535</idno><idno type="wicri:Area/Hal/Curation">000535</idno><idno type="wicri:Area/Hal/Checkpoint">000032</idno><idno type="wicri:Area/Main/Merge">000357</idno><idno type="wicri:Area/Main/Curation">000357</idno><idno type="wicri:Area/Main/Exploration">000357</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Touching Sounds: Audio Virtual Surfaces</title><author><name sortKey="Boyer, Eric O" sort="Boyer, Eric O" uniqKey="Boyer E" first="Eric O" last="Boyer">Eric O. Boyer</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55516" status="VALID"><idno type="IdRef">148418074</idno><idno type="RNSR">201420751Z</idno><orgName>Laboratoire Psychologie de la Perception</orgName><orgName type="acronym">LPP</orgName><date type="start">2014</date><desc><address><addrLine>Centre Biomédical des Saints Pères 45 rue des Saints Pères 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://lpp.psycho.univ-paris5.fr/</ref></desc><listRelation><relation name="UMR 8242" active="#struct-301664" type="direct"></relation><relation name="UMR 8242" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle name="UMR 8242" active="#struct-301664" type="direct"><org type="institution" xml:id="struct-301664" status="VALID"><idno type="IdRef">026404788</idno><idno type="ISNI">0000 0001 2188 0914 </idno><orgName>Université Paris Descartes - Paris 5</orgName><orgName type="acronym">UPD5</orgName><desc><address><addrLine>12, rue de l'École de Médecine - 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://www.parisdescartes.fr/</ref></desc></org></tutelle><tutelle name="UMR 8242" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Vandervoorde, Lucyle" sort="Vandervoorde, Lucyle" uniqKey="Vandervoorde L" first="Lucyle" last="Vandervoorde">Lucyle Vandervoorde</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55516" status="VALID"><idno type="IdRef">148418074</idno><idno type="RNSR">201420751Z</idno><orgName>Laboratoire Psychologie de la Perception</orgName><orgName type="acronym">LPP</orgName><date type="start">2014</date><desc><address><addrLine>Centre Biomédical des Saints Pères 45 rue des Saints Pères 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://lpp.psycho.univ-paris5.fr/</ref></desc><listRelation><relation name="UMR 8242" active="#struct-301664" type="direct"></relation><relation name="UMR 8242" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle name="UMR 8242" active="#struct-301664" type="direct"><org type="institution" xml:id="struct-301664" status="VALID"><idno type="IdRef">026404788</idno><idno type="ISNI">0000 0001 2188 0914 </idno><orgName>Université Paris Descartes - Paris 5</orgName><orgName type="acronym">UPD5</orgName><desc><address><addrLine>12, rue de l'École de Médecine - 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://www.parisdescartes.fr/</ref></desc></org></tutelle><tutelle name="UMR 8242" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Bevilacqua, Frederic" sort="Bevilacqua, Frederic" uniqKey="Bevilacqua F" first="Frédéric" last="Bevilacqua">Frédéric Bevilacqua</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-390438" status="INCOMING"><orgName>Interactions Son Musique Mouvement</orgName><desc><address><country key="FR"></country></address></desc><listRelation><relation active="#struct-1374" type="direct"></relation><relation active="#struct-93591" type="indirect"></relation><relation active="#struct-300476" type="indirect"></relation><relation name="UMR9912" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-1374" type="direct"><org type="laboratory" xml:id="struct-1374" status="VALID"><idno type="RNSR">198319352N</idno><orgName>Sciences et Technologies de la Musique et du Son</orgName><orgName type="acronym">STMS</orgName><desc><address><addrLine>1 Place Igor Stravinsky 75004 PARIS</addrLine><country key="FR"></country></address><ref type="url">http://www.ircam.fr/</ref></desc><listRelation><relation active="#struct-93591" type="direct"></relation><relation active="#struct-300476" type="direct"></relation><relation name="UMR9912" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-93591" type="indirect"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle><tutelle active="#struct-300476" type="indirect"><org type="institution" xml:id="struct-300476" status="VALID"><orgName>IRCAM</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle name="UMR9912" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Hanneton, Sylvain" sort="Hanneton, Sylvain" uniqKey="Hanneton S" first="Sylvain" last="Hanneton">Sylvain Hanneton</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55516" status="VALID"><idno type="IdRef">148418074</idno><idno type="RNSR">201420751Z</idno><orgName>Laboratoire Psychologie de la Perception</orgName><orgName type="acronym">LPP</orgName><date type="start">2014</date><desc><address><addrLine>Centre Biomédical des Saints Pères 45 rue des Saints Pères 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://lpp.psycho.univ-paris5.fr/</ref></desc><listRelation><relation name="UMR 8242" active="#struct-301664" type="direct"></relation><relation name="UMR 8242" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle name="UMR 8242" active="#struct-301664" type="direct"><org type="institution" xml:id="struct-301664" status="VALID"><idno type="IdRef">026404788</idno><idno type="ISNI">0000 0001 2188 0914 </idno><orgName>Université Paris Descartes - Paris 5</orgName><orgName type="acronym">UPD5</orgName><desc><address><addrLine>12, rue de l'École de Médecine - 75270 Paris cedex 06</addrLine><country key="FR"></country></address><ref type="url">http://www.parisdescartes.fr/</ref></desc></org></tutelle><tutelle name="UMR 8242" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">This prospective study concerning the perception of audio virtual surfaces (AVSs) was inspired by two different research fields: sensory substitution and haptic and touch perception. We define Audio Virtual Surfaces as regions of space that trigger sounds when the user touches it or moves into it. First, we describe an example of interactive setup using an AVS to simulate a sonic interaction with a virtual water tank. Then, we present an experiment designed to investigate the ability of blindfolded adults to discriminate between concave and convex auditory virtual surfaces using only the gesture-sound interaction. Two groups received different sound feedback, a static one indicating presence in the AVS, and a static+dynamic one (related to the component of the hand velocity tangential to the surface). In order to demonstrate that curvature direction was correctly perceived, we estimated their discrimination thresholds with a psychophysical staircase procedure. Results show that most of the participants were able to learn the task. The best results were obtained with the additional dynamic feedback. Gestural patterns emerged from the interaction, suggesting the use of auditory representation of the virtual object. This work proposes a contribution to the introduction in virtual reality of sonic interactions with auditory virtual objects. The setups we present raise new questions, at both experimental (sensory substitution) and application levels (design of gesture-sound interaction for virtual reality).</div></front></TEI><affiliations><list><country><li>France</li></country></list><tree><country name="France"><noRegion><name sortKey="Boyer, Eric O" sort="Boyer, Eric O" uniqKey="Boyer E" first="Eric O" last="Boyer">Eric O. Boyer</name></noRegion><name sortKey="Bevilacqua, Frederic" sort="Bevilacqua, Frederic" uniqKey="Bevilacqua F" first="Frédéric" last="Bevilacqua">Frédéric Bevilacqua</name><name sortKey="Hanneton, Sylvain" sort="Hanneton, Sylvain" uniqKey="Hanneton S" first="Sylvain" last="Hanneton">Sylvain Hanneton</name><name sortKey="Vandervoorde, Lucyle" sort="Vandervoorde, Lucyle" uniqKey="Vandervoorde L" first="Lucyle" last="Vandervoorde">Lucyle Vandervoorde</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000357 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000357 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= Hal:hal-01265581
|texte= Touching Sounds: Audio Virtual Surfaces
}}
| This area was generated with Dilib version V0.6.23. |  |