Visuo-Haptic Mixed Reality with Unobstructed Tool-Hand Integration.
Identifieur interne : 001F82 ( Ncbi/Checkpoint ); précédent : 001F81; suivant : 001F83Visuo-Haptic Mixed Reality with Unobstructed Tool-Hand Integration.
Auteurs : Francesco Cosco ; Carlos Garre ; Fabio Bruno ; Maurizio Muzzupappa ; Miguel A. OtaduySource :
- IEEE transactions on visualization and computer graphics [ 1941-0506 ] ; 2013.
Abstract
Visuo-haptic mixed reality consists of adding to a real scene the ability to see and touch virtual objects. It requires the use of see-through display technology for visually mixing real and virtual objects, and haptic devices for adding haptic interaction with the virtual objects. Unfortunately, the use of commodity haptic devices poses obstruction and misalignment issues that complicate the correct integration of a virtual tool and the user's real hand in the mixed reality scene. In this work, we propose a novel mixed reality paradigm where it is possible to touch and see virtual objects in combination with a real scene, using commodity haptic devices, and with a visually consistent integration of the user's hand and the virtual tool. We discuss the visual obstruction and misalignment issues introduced by commodity haptic devices, and then propose a solution that relies on four simple technical steps: color-based segmentation of the hand, tracking-based segmentation of the haptic device, background repainting using image-based models, and misalignment-free compositing of the user's hand. We have developed a successful proof-of-concept implementation, where a user can touch virtual objects and interact with them in the context of a real scene, and we have evaluated the impact on user performance of obstruction and misalignment correction.
DOI: 10.1109/TVCG.2012.107
PubMed: 22508901
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream PubMed, to step Corpus: 000C13
- to stream PubMed, to step Curation: 000C13
- to stream PubMed, to step Checkpoint: 000741
- to stream Ncbi, to step Merge: 001F82
- to stream Ncbi, to step Curation: 001F82
Links to Exploration step
pubmed:22508901Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Visuo-Haptic Mixed Reality with Unobstructed Tool-Hand Integration.</title><author><name sortKey="Cosco, Francesco" sort="Cosco, Francesco" uniqKey="Cosco F" first="Francesco" last="Cosco">Francesco Cosco</name></author><author><name sortKey="Garre, Carlos" sort="Garre, Carlos" uniqKey="Garre C" first="Carlos" last="Garre">Carlos Garre</name></author><author><name sortKey="Bruno, Fabio" sort="Bruno, Fabio" uniqKey="Bruno F" first="Fabio" last="Bruno">Fabio Bruno</name></author><author><name sortKey="Muzzupappa, Maurizio" sort="Muzzupappa, Maurizio" uniqKey="Muzzupappa M" first="Maurizio" last="Muzzupappa">Maurizio Muzzupappa</name></author><author><name sortKey="Otaduy, Miguel A" sort="Otaduy, Miguel A" uniqKey="Otaduy M" first="Miguel A" last="Otaduy">Miguel A. Otaduy</name></author></titleStmt><publicationStmt><idno type="wicri:source">PubMed</idno><date when="2013">2013</date><idno type="doi">10.1109/TVCG.2012.107</idno><idno type="RBID">pubmed:22508901</idno><idno type="pmid">22508901</idno><idno type="wicri:Area/PubMed/Corpus">000C13</idno><idno type="wicri:Area/PubMed/Curation">000C13</idno><idno type="wicri:Area/PubMed/Checkpoint">000741</idno><idno type="wicri:Area/Ncbi/Merge">001F82</idno><idno type="wicri:Area/Ncbi/Curation">001F82</idno><idno type="wicri:Area/Ncbi/Checkpoint">001F82</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Visuo-Haptic Mixed Reality with Unobstructed Tool-Hand Integration.</title><author><name sortKey="Cosco, Francesco" sort="Cosco, Francesco" uniqKey="Cosco F" first="Francesco" last="Cosco">Francesco Cosco</name></author><author><name sortKey="Garre, Carlos" sort="Garre, Carlos" uniqKey="Garre C" first="Carlos" last="Garre">Carlos Garre</name></author><author><name sortKey="Bruno, Fabio" sort="Bruno, Fabio" uniqKey="Bruno F" first="Fabio" last="Bruno">Fabio Bruno</name></author><author><name sortKey="Muzzupappa, Maurizio" sort="Muzzupappa, Maurizio" uniqKey="Muzzupappa M" first="Maurizio" last="Muzzupappa">Maurizio Muzzupappa</name></author><author><name sortKey="Otaduy, Miguel A" sort="Otaduy, Miguel A" uniqKey="Otaduy M" first="Miguel A" last="Otaduy">Miguel A. Otaduy</name></author></analytic><series><title level="j">IEEE transactions on visualization and computer graphics</title><idno type="eISSN">1941-0506</idno><imprint><date when="2013" type="published">2013</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Visuo-haptic mixed reality consists of adding to a real scene the ability to see and touch virtual objects. It requires the use of see-through display technology for visually mixing real and virtual objects, and haptic devices for adding haptic interaction with the virtual objects. Unfortunately, the use of commodity haptic devices poses obstruction and misalignment issues that complicate the correct integration of a virtual tool and the user's real hand in the mixed reality scene. In this work, we propose a novel mixed reality paradigm where it is possible to touch and see virtual objects in combination with a real scene, using commodity haptic devices, and with a visually consistent integration of the user's hand and the virtual tool. We discuss the visual obstruction and misalignment issues introduced by commodity haptic devices, and then propose a solution that relies on four simple technical steps: color-based segmentation of the hand, tracking-based segmentation of the haptic device, background repainting using image-based models, and misalignment-free compositing of the user's hand. We have developed a successful proof-of-concept implementation, where a user can touch virtual objects and interact with them in the context of a real scene, and we have evaluated the impact on user performance of obstruction and misalignment correction.</div></front></TEI><affiliations><list></list><tree><noCountry><name sortKey="Bruno, Fabio" sort="Bruno, Fabio" uniqKey="Bruno F" first="Fabio" last="Bruno">Fabio Bruno</name><name sortKey="Cosco, Francesco" sort="Cosco, Francesco" uniqKey="Cosco F" first="Francesco" last="Cosco">Francesco Cosco</name><name sortKey="Garre, Carlos" sort="Garre, Carlos" uniqKey="Garre C" first="Carlos" last="Garre">Carlos Garre</name><name sortKey="Muzzupappa, Maurizio" sort="Muzzupappa, Maurizio" uniqKey="Muzzupappa M" first="Maurizio" last="Muzzupappa">Maurizio Muzzupappa</name><name sortKey="Otaduy, Miguel A" sort="Otaduy, Miguel A" uniqKey="Otaduy M" first="Miguel A" last="Otaduy">Miguel A. Otaduy</name></noCountry></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Ncbi/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001F82 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Ncbi/Checkpoint/biblio.hfd -nk 001F82 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Ncbi
|étape= Checkpoint
|type= RBID
|clé= pubmed:22508901
|texte= Visuo-Haptic Mixed Reality with Unobstructed Tool-Hand Integration.
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Ncbi/Checkpoint/RBID.i -Sk "pubmed:22508901" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Ncbi/Checkpoint/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |