Vision-based haptic feedback for remote micromanipulation in-SEM environment.
Identifieur interne : 000236 ( Hal/Checkpoint ); précédent : 000235; suivant : 000237Vision-based haptic feedback for remote micromanipulation in-SEM environment.
Auteurs : Aude Bolopion [France] ; Christian Dahmen [Allemagne] ; Christian Stolle [Allemagne] ; Sinan Haliyo [France] ; Stéphane Régnier [France] ; Sergej Fatikow [Allemagne]Source :
- International Journal of Optomechatronics [ 1559-9612 ] ; 2012.
Abstract
This paper presents an intuitive environment for remote micromanipulation composed of both haptic feedback and virtual reconstruction of the scene. To enable non expert users to perform complex teleoperated micromanipulation tasks it is of utmost importance to provide them with information about the 3D relative positions of the objects and the tools. Haptic feedback is an intuitive way to transmit such information. Since position sensors are not available at this scale, visual feedback is used to derive information about the scene. In this work, three different techniques are implemented, evaluated and compared to derive the object positions from scanning electron microscope images. The modified correlation matching with generated template algorithm is accurate and provides reliable detection of objects. To track the tool, a marker based approach is chosen since fast detection is required for stable haptic feedback. Information derived from these algorithms is used to propose an intuitive remote manipulation system, that enables users situated in geographically distant sites to benefit from specific equipments such as SEMs. Stability of the haptic feedback is ensured by the minimization of the delays, the computational efficiency of vision algorithms and the proper tuning of the haptic coupling. Virtual guides are proposed to avoid any involuntary collisions between the tool and the objects. This approach is validated by a teleoperation involving melamine microspheres with a diameter of less than 2 m between Paris, France and Oldenburg, Germany.
Url:
DOI: 10.1080/15599612.2012.701370
Links toward previous steps (curation, corpus...)
Links to Exploration step
Hal:hal-00737607Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Vision-based haptic feedback for remote micromanipulation in-SEM environment.</title><author><name sortKey="Bolopion, Aude" sort="Bolopion, Aude" uniqKey="Bolopion A" first="Aude" last="Bolopion">Aude Bolopion</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-389879" status="INCOMING"><orgName>AS2M/MINAROB</orgName><desc><address><country key="FR"></country></address></desc><listRelation><relation active="#struct-866" type="direct"></relation><relation active="#struct-300261" type="indirect"></relation><relation active="#struct-300360" type="indirect"></relation><relation name="UMR6174" active="#struct-441569" type="indirect"></relation><relation active="#struct-458810" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-866" type="direct"><org type="laboratory" xml:id="struct-866" status="VALID"><idno type="IdRef">152639071</idno><idno type="RNSR">200412232H</idno><orgName>Franche-Comté Électronique Mécanique, Thermique et Optique - Sciences et Technologies</orgName><orgName type="acronym">FEMTO-ST</orgName><desc><address><addrLine>32 avenue de l'Observatoire 25044 BESANCON CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.femto-st.fr</ref></desc><listRelation><relation active="#struct-300261" type="direct"></relation><relation active="#struct-300360" type="direct"></relation><relation name="UMR6174" active="#struct-441569" type="direct"></relation><relation active="#struct-458810" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300261" type="indirect"><org type="institution" xml:id="struct-300261" status="VALID"><orgName>Université de Technologie de Belfort-Montbeliard</orgName><orgName type="acronym">UTBM</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-300360" type="indirect"><org type="institution" xml:id="struct-300360" status="VALID"><orgName>Ecole Nationale Supérieure de Mécanique et des Microtechniques</orgName><orgName type="acronym">ENSMM</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle name="UMR6174" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-458810" type="indirect"><org type="institution" xml:id="struct-458810" status="INCOMING"><idno type="IdRef">026403188</idno><idno type="ISNI">0000 0001 2188 3779 </idno><orgName>Université de Franche-Comté</orgName><orgName type="acronym">UFC</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.univ-fcomte.fr</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city" wicri:auto="siege">Belfort</settlement><region type="region" nuts="2">Franche-Comté</region></placeName><orgName type="university">Université de technologie de Belfort-Montbéliard</orgName><placeName><settlement type="city" wicri:auto="siege">Besançon</settlement><region type="region" nuts="2">Franche-Comté</region></placeName><orgName type="university">Université de Franche-Comté</orgName><orgName type="institution" wicri:auto="newGroup">Université de Bourgogne Franche-Comté</orgName></affiliation></author><author><name sortKey="Dahmen, Christian" sort="Dahmen, Christian" uniqKey="Dahmen C" first="Christian" last="Dahmen">Christian Dahmen</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55315" status="VALID"><orgName>Department für Informatik [Oldenburg]</orgName><desc><address><addrLine>Universität Oldenburg Fakultät II Department für Informatik 26111 Oldenburg</addrLine><country key="DE"></country></address><ref type="url">http://parsys.informatik.uni-oldenburg.de/</ref></desc><listRelation><relation active="#struct-367056" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-367056" type="direct"><org type="institution" xml:id="struct-367056" status="INCOMING"><orgName>University of Oldenburg</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>Allemagne</country></affiliation></author><author><name sortKey="Stolle, Christian" sort="Stolle, Christian" uniqKey="Stolle C" first="Christian" last="Stolle">Christian Stolle</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55315" status="VALID"><orgName>Department für Informatik [Oldenburg]</orgName><desc><address><addrLine>Universität Oldenburg Fakultät II Department für Informatik 26111 Oldenburg</addrLine><country key="DE"></country></address><ref type="url">http://parsys.informatik.uni-oldenburg.de/</ref></desc><listRelation><relation active="#struct-367056" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-367056" type="direct"><org type="institution" xml:id="struct-367056" status="INCOMING"><orgName>University of Oldenburg</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>Allemagne</country></affiliation></author><author><name sortKey="Haliyo, Sinan" sort="Haliyo, Sinan" uniqKey="Haliyo S" first="Sinan" last="Haliyo">Sinan Haliyo</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-96164" status="VALID"><idno type="RNSR">200918463J</idno><orgName>Institut des Systèmes Intelligents et de Robotique</orgName><orgName type="acronym">ISIR</orgName><desc><address><addrLine>Université Pierre et Marie Curie - Paris VI Boite courrier 173 4 Place JUSSIEU 75252 Paris cedex 05</addrLine><country key="FR"></country></address><ref type="url">http://www.isir.upmc.fr</ref></desc><listRelation><relation active="#struct-93591" type="direct"></relation><relation name="UMR7222" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle><tutelle name="UMR7222" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Regnier, Stephane" sort="Regnier, Stephane" uniqKey="Regnier S" first="Stéphane" last="Régnier">Stéphane Régnier</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-96164" status="VALID"><idno type="RNSR">200918463J</idno><orgName>Institut des Systèmes Intelligents et de Robotique</orgName><orgName type="acronym">ISIR</orgName><desc><address><addrLine>Université Pierre et Marie Curie - Paris VI Boite courrier 173 4 Place JUSSIEU 75252 Paris cedex 05</addrLine><country key="FR"></country></address><ref type="url">http://www.isir.upmc.fr</ref></desc><listRelation><relation active="#struct-93591" type="direct"></relation><relation name="UMR7222" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle><tutelle name="UMR7222" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Fatikow, Sergej" sort="Fatikow, Sergej" uniqKey="Fatikow S" first="Sergej" last="Fatikow">Sergej Fatikow</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55315" status="VALID"><orgName>Department für Informatik [Oldenburg]</orgName><desc><address><addrLine>Universität Oldenburg Fakultät II Department für Informatik 26111 Oldenburg</addrLine><country key="DE"></country></address><ref type="url">http://parsys.informatik.uni-oldenburg.de/</ref></desc><listRelation><relation active="#struct-367056" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-367056" type="direct"><org type="institution" xml:id="struct-367056" status="INCOMING"><orgName>University of Oldenburg</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>Allemagne</country></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:hal-00737607</idno><idno type="halId">hal-00737607</idno><idno type="halUri">https://hal.archives-ouvertes.fr/hal-00737607</idno><idno type="url">https://hal.archives-ouvertes.fr/hal-00737607</idno><idno type="doi">10.1080/15599612.2012.701370</idno><date when="2012">2012</date><idno type="wicri:Area/Hal/Corpus">000576</idno><idno type="wicri:Area/Hal/Curation">000576</idno><idno type="wicri:Area/Hal/Checkpoint">000236</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Vision-based haptic feedback for remote micromanipulation in-SEM environment.</title><author><name sortKey="Bolopion, Aude" sort="Bolopion, Aude" uniqKey="Bolopion A" first="Aude" last="Bolopion">Aude Bolopion</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-389879" status="INCOMING"><orgName>AS2M/MINAROB</orgName><desc><address><country key="FR"></country></address></desc><listRelation><relation active="#struct-866" type="direct"></relation><relation active="#struct-300261" type="indirect"></relation><relation active="#struct-300360" type="indirect"></relation><relation name="UMR6174" active="#struct-441569" type="indirect"></relation><relation active="#struct-458810" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-866" type="direct"><org type="laboratory" xml:id="struct-866" status="VALID"><idno type="IdRef">152639071</idno><idno type="RNSR">200412232H</idno><orgName>Franche-Comté Électronique Mécanique, Thermique et Optique - Sciences et Technologies</orgName><orgName type="acronym">FEMTO-ST</orgName><desc><address><addrLine>32 avenue de l'Observatoire 25044 BESANCON CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.femto-st.fr</ref></desc><listRelation><relation active="#struct-300261" type="direct"></relation><relation active="#struct-300360" type="direct"></relation><relation name="UMR6174" active="#struct-441569" type="direct"></relation><relation active="#struct-458810" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300261" type="indirect"><org type="institution" xml:id="struct-300261" status="VALID"><orgName>Université de Technologie de Belfort-Montbeliard</orgName><orgName type="acronym">UTBM</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle active="#struct-300360" type="indirect"><org type="institution" xml:id="struct-300360" status="VALID"><orgName>Ecole Nationale Supérieure de Mécanique et des Microtechniques</orgName><orgName type="acronym">ENSMM</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle><tutelle name="UMR6174" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-458810" type="indirect"><org type="institution" xml:id="struct-458810" status="INCOMING"><idno type="IdRef">026403188</idno><idno type="ISNI">0000 0001 2188 3779 </idno><orgName>Université de Franche-Comté</orgName><orgName type="acronym">UFC</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.univ-fcomte.fr</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city" wicri:auto="siege">Belfort</settlement><region type="region" nuts="2">Franche-Comté</region></placeName><orgName type="university">Université de technologie de Belfort-Montbéliard</orgName><placeName><settlement type="city" wicri:auto="siege">Besançon</settlement><region type="region" nuts="2">Franche-Comté</region></placeName><orgName type="university">Université de Franche-Comté</orgName><orgName type="institution" wicri:auto="newGroup">Université de Bourgogne Franche-Comté</orgName></affiliation></author><author><name sortKey="Dahmen, Christian" sort="Dahmen, Christian" uniqKey="Dahmen C" first="Christian" last="Dahmen">Christian Dahmen</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55315" status="VALID"><orgName>Department für Informatik [Oldenburg]</orgName><desc><address><addrLine>Universität Oldenburg Fakultät II Department für Informatik 26111 Oldenburg</addrLine><country key="DE"></country></address><ref type="url">http://parsys.informatik.uni-oldenburg.de/</ref></desc><listRelation><relation active="#struct-367056" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-367056" type="direct"><org type="institution" xml:id="struct-367056" status="INCOMING"><orgName>University of Oldenburg</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>Allemagne</country></affiliation></author><author><name sortKey="Stolle, Christian" sort="Stolle, Christian" uniqKey="Stolle C" first="Christian" last="Stolle">Christian Stolle</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55315" status="VALID"><orgName>Department für Informatik [Oldenburg]</orgName><desc><address><addrLine>Universität Oldenburg Fakultät II Department für Informatik 26111 Oldenburg</addrLine><country key="DE"></country></address><ref type="url">http://parsys.informatik.uni-oldenburg.de/</ref></desc><listRelation><relation active="#struct-367056" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-367056" type="direct"><org type="institution" xml:id="struct-367056" status="INCOMING"><orgName>University of Oldenburg</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>Allemagne</country></affiliation></author><author><name sortKey="Haliyo, Sinan" sort="Haliyo, Sinan" uniqKey="Haliyo S" first="Sinan" last="Haliyo">Sinan Haliyo</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-96164" status="VALID"><idno type="RNSR">200918463J</idno><orgName>Institut des Systèmes Intelligents et de Robotique</orgName><orgName type="acronym">ISIR</orgName><desc><address><addrLine>Université Pierre et Marie Curie - Paris VI Boite courrier 173 4 Place JUSSIEU 75252 Paris cedex 05</addrLine><country key="FR"></country></address><ref type="url">http://www.isir.upmc.fr</ref></desc><listRelation><relation active="#struct-93591" type="direct"></relation><relation name="UMR7222" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle><tutelle name="UMR7222" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Regnier, Stephane" sort="Regnier, Stephane" uniqKey="Regnier S" first="Stéphane" last="Régnier">Stéphane Régnier</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-96164" status="VALID"><idno type="RNSR">200918463J</idno><orgName>Institut des Systèmes Intelligents et de Robotique</orgName><orgName type="acronym">ISIR</orgName><desc><address><addrLine>Université Pierre et Marie Curie - Paris VI Boite courrier 173 4 Place JUSSIEU 75252 Paris cedex 05</addrLine><country key="FR"></country></address><ref type="url">http://www.isir.upmc.fr</ref></desc><listRelation><relation active="#struct-93591" type="direct"></relation><relation name="UMR7222" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle><tutelle name="UMR7222" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Fatikow, Sergej" sort="Fatikow, Sergej" uniqKey="Fatikow S" first="Sergej" last="Fatikow">Sergej Fatikow</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-55315" status="VALID"><orgName>Department für Informatik [Oldenburg]</orgName><desc><address><addrLine>Universität Oldenburg Fakultät II Department für Informatik 26111 Oldenburg</addrLine><country key="DE"></country></address><ref type="url">http://parsys.informatik.uni-oldenburg.de/</ref></desc><listRelation><relation active="#struct-367056" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-367056" type="direct"><org type="institution" xml:id="struct-367056" status="INCOMING"><orgName>University of Oldenburg</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>Allemagne</country></affiliation></author></analytic><idno type="DOI">10.1080/15599612.2012.701370</idno><series><title level="j">International Journal of Optomechatronics</title><idno type="ISSN">1559-9612</idno><imprint><date type="datePub">2012</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">This paper presents an intuitive environment for remote micromanipulation composed of both haptic feedback and virtual reconstruction of the scene. To enable non expert users to perform complex teleoperated micromanipulation tasks it is of utmost importance to provide them with information about the 3D relative positions of the objects and the tools. Haptic feedback is an intuitive way to transmit such information. Since position sensors are not available at this scale, visual feedback is used to derive information about the scene. In this work, three different techniques are implemented, evaluated and compared to derive the object positions from scanning electron microscope images. The modified correlation matching with generated template algorithm is accurate and provides reliable detection of objects. To track the tool, a marker based approach is chosen since fast detection is required for stable haptic feedback. Information derived from these algorithms is used to propose an intuitive remote manipulation system, that enables users situated in geographically distant sites to benefit from specific equipments such as SEMs. Stability of the haptic feedback is ensured by the minimization of the delays, the computational efficiency of vision algorithms and the proper tuning of the haptic coupling. Virtual guides are proposed to avoid any involuntary collisions between the tool and the objects. This approach is validated by a teleoperation involving melamine microspheres with a diameter of less than 2 m between Paris, France and Oldenburg, Germany.</div></front></TEI><hal api="V3"><titleStmt><title xml:lang="en">Vision-based haptic feedback for remote micromanipulation in-SEM environment.</title><author role="aut"><persName><forename type="first">Aude</forename><surname>Bolopion</surname></persName><email>aude.bolopion@femto-st.fr</email><idno type="halauthor">768182</idno><affiliation ref="#struct-389879"></affiliation></author><author role="aut"><persName><forename type="first">Christian</forename><surname>Dahmen</surname></persName><email>christian.dahmen@uni-oldenburg.de</email><idno type="halauthor">768183</idno><affiliation ref="#struct-55315"></affiliation></author><author role="aut"><persName><forename type="first">Christian</forename><surname>Stolle</surname></persName><email>christian.stolle@uni-oldenburg.de</email><idno type="halauthor">768184</idno><affiliation ref="#struct-55315"></affiliation></author><author role="aut"><persName><forename type="first">Sinan</forename><surname>Haliyo</surname></persName><email>sinan.haliyo@isir.upmc.fr</email><idno type="halauthor">768185</idno><affiliation ref="#struct-96164"></affiliation></author><author role="aut"><persName><forename type="first">Stéphane</forename><surname>Régnier</surname></persName><email>stephane.regnier@isir.upmc.fr</email><idno type="halauthor">650964</idno><affiliation ref="#struct-96164"></affiliation></author><author role="aut"><persName><forename type="first">Sergej</forename><surname>Fatikow</surname></persName><email>sergej.fatikow@uni-oldenburg.de</email><idno type="halauthor">768186</idno><affiliation ref="#struct-55315"></affiliation></author><editor role="depositor"><persName><forename>Martine</forename><surname>Azema</surname></persName><email>mazema@ens2m.fr</email></editor></titleStmt><editionStmt><edition n="v1" type="current"><date type="whenSubmitted">2012-10-02 12:13:21</date><date type="whenWritten">2011</date><date type="whenModified">2014-10-28 18:04:51</date><date type="whenReleased">2012-10-02 16:17:02</date><date type="whenProduced">2012</date><date type="whenEndEmbargoed">2012-10-02</date><ref type="file" target="https://hal.archives-ouvertes.fr/hal-00737607/document"><date notBefore="2012-10-02"></date></ref><ref type="file" subtype="author" n="1" target="https://hal.archives-ouvertes.fr/hal-00737607/file/journal-1.pdf"><date notBefore="2012-10-02"></date></ref></edition><respStmt><resp>contributor</resp><name key="117362"><persName><forename>Martine</forename><surname>Azema</surname></persName><email>mazema@ens2m.fr</email></name></respStmt></editionStmt><publicationStmt><distributor>CCSD</distributor><idno type="halId">hal-00737607</idno><idno type="halUri">https://hal.archives-ouvertes.fr/hal-00737607</idno><idno type="halBibtex">bolopion:hal-00737607</idno><idno type="halRefHtml">International Journal of Optomechatronics, Taylor & Francis, 2012, 6 (3), pp.236-252. <10.1080/15599612.2012.701370></idno><idno type="halRef">International Journal of Optomechatronics, Taylor & Francis, 2012, 6 (3), pp.236-252. <10.1080/15599612.2012.701370></idno></publicationStmt><seriesStmt><idno type="stamp" n="CNRS">CNRS - Centre national de la recherche scientifique</idno><idno type="stamp" n="UNIV-FCOMTE">Université de Franche-Comté</idno><idno type="stamp" n="UNIV-BM">Université de Technologie de Belfort-Montbeliard</idno><idno type="stamp" n="ENSMM">Ecole Nationale Supérieure de Mécanique et des Microtechniques</idno><idno type="stamp" n="FEMTO-ST" p="UNIV-FCOMTE">Franche-Comté Electronique, Mécanique, Thermique et Optique - Sciences et Technologies</idno><idno type="stamp" n="UPMC">Université Pierre et Marie Curie</idno><idno type="stamp" n="ISIR" p="UPMC">Institut des Systèmes Intelligents et de Robotique</idno><idno type="stamp" n="UNIV-BM-THESE">Université de Technologie de Belfort-Montbeliard</idno></seriesStmt><notesStmt><note type="audience" n="2">International</note><note type="popular" n="0">No</note><note type="peer" n="1">Yes</note></notesStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Vision-based haptic feedback for remote micromanipulation in-SEM environment.</title><author role="aut"><persName><forename type="first">Aude</forename><surname>Bolopion</surname></persName><email>aude.bolopion@femto-st.fr</email><idno type="halAuthorId">768182</idno><affiliation ref="#struct-389879"></affiliation></author><author role="aut"><persName><forename type="first">Christian</forename><surname>Dahmen</surname></persName><email>christian.dahmen@uni-oldenburg.de</email><idno type="halAuthorId">768183</idno><affiliation ref="#struct-55315"></affiliation></author><author role="aut"><persName><forename type="first">Christian</forename><surname>Stolle</surname></persName><email>christian.stolle@uni-oldenburg.de</email><idno type="halAuthorId">768184</idno><affiliation ref="#struct-55315"></affiliation></author><author role="aut"><persName><forename type="first">Sinan</forename><surname>Haliyo</surname></persName><email>sinan.haliyo@isir.upmc.fr</email><idno type="halAuthorId">768185</idno><affiliation ref="#struct-96164"></affiliation></author><author role="aut"><persName><forename type="first">Stéphane</forename><surname>Régnier</surname></persName><email>stephane.regnier@isir.upmc.fr</email><idno type="halAuthorId">650964</idno><affiliation ref="#struct-96164"></affiliation></author><author role="aut"><persName><forename type="first">Sergej</forename><surname>Fatikow</surname></persName><email>sergej.fatikow@uni-oldenburg.de</email><idno type="halAuthorId">768186</idno><affiliation ref="#struct-55315"></affiliation></author></analytic><monogr><idno type="halJournalId" status="VALID">39425</idno><idno type="issn">1559-9612</idno><idno type="eissn">1559-9620</idno><title level="j">International Journal of Optomechatronics</title><imprint><publisher>Taylor & Francis</publisher><biblScope unit="volume">6</biblScope><biblScope unit="issue">3</biblScope><biblScope unit="pp">236-252</biblScope><date type="datePub">2012</date></imprint></monogr><idno type="doi">10.1080/15599612.2012.701370</idno></biblStruct></sourceDesc><profileDesc><langUsage><language ident="en">English</language></langUsage><textClass><classCode scheme="halDomain" n="spi.nano">Engineering Sciences [physics]/Micro and nanotechnologies/Microelectronics</classCode><classCode scheme="halTypology" n="ART">Journal articles</classCode></textClass><abstract xml:lang="en">This paper presents an intuitive environment for remote micromanipulation composed of both haptic feedback and virtual reconstruction of the scene. To enable non expert users to perform complex teleoperated micromanipulation tasks it is of utmost importance to provide them with information about the 3D relative positions of the objects and the tools. Haptic feedback is an intuitive way to transmit such information. Since position sensors are not available at this scale, visual feedback is used to derive information about the scene. In this work, three different techniques are implemented, evaluated and compared to derive the object positions from scanning electron microscope images. The modified correlation matching with generated template algorithm is accurate and provides reliable detection of objects. To track the tool, a marker based approach is chosen since fast detection is required for stable haptic feedback. Information derived from these algorithms is used to propose an intuitive remote manipulation system, that enables users situated in geographically distant sites to benefit from specific equipments such as SEMs. Stability of the haptic feedback is ensured by the minimization of the delays, the computational efficiency of vision algorithms and the proper tuning of the haptic coupling. Virtual guides are proposed to avoid any involuntary collisions between the tool and the objects. This approach is validated by a teleoperation involving melamine microspheres with a diameter of less than 2 m between Paris, France and Oldenburg, Germany.</abstract></profileDesc></hal></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Hal/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000236 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Hal/Checkpoint/biblio.hfd -nk 000236 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Hal
|étape= Checkpoint
|type= RBID
|clé= Hal:hal-00737607
|texte= Vision-based haptic feedback for remote micromanipulation in-SEM environment.
}}
| This area was generated with Dilib version V0.6.23. |  |