Haptic interaction with objects in a picture based on pose estimation
Identifieur interne : 000038 ( PascalFrancis/Corpus ); précédent : 000037; suivant : 000039Haptic interaction with objects in a picture based on pose estimation
Auteurs : Seung-Chan Kim ; Dong-Soo KwonSource :
- Multimedia tools and applications [ 1380-7501 ] ; 2014.
Descripteurs français
- Pascal (Inist)
English descriptors
- KwdEn :
Abstract
In pictures, every object is displayed in 2D space. Seeing the 2D image, people can perceptually reconstruct and understand information regarding the scene. To enable users to haptically interact with an object that appears in the image, the present study proposes a geometry-based haptic rendering method. More specifically, our approach is intended to estimate haptic information from the object's structure contained in an image while preserving the two-dimensional visual information. Of the many types of objects that can be seen in everyday pictures, this paper mainly deals with polyhedron figures or objects composed of rectangular faces, some of which might be shown in a slanted configuration in the picture. To obtain the geometric layout of the object being viewed from the image plane, we first estimate homographic information that describes a mapping from the object coordinate to the target image coordinate. Then, we transform the surface normals of the object face using the extrinsic part of homography that locates the face of the object we are viewing. Because the transformed normals are utilized for calculating the force in the image space, we call this process normal vector perturbation in the 2D image space. To physically represent the estimated normal vector without distorting the visual information, we employed a lateral haptic rendering scheme in that it fits with our interaction styles on 2D images. The active force value at a given position on the slanted faces is calculated during the interaction phase. To evaluate our approach, we conducted an experiment with different stimulus conditions, in which it was found that participants could reliably estimate the geometric layout that appears in the picture. We conclude with explorations of applications and a discussion of future work.
Notice en format standard (ISO 2709)
Pour connaître la documentation sur le format Inist Standard.
| pA |
|
|---|
Format Inist (serveur)
| NO : | PASCAL 14-0217539 INIST |
|---|---|
| ET : | Haptic interaction with objects in a picture based on pose estimation |
| AU : | KIM (Seung-Chan); KWON (Dong-Soo) |
| AF : | Telerobotics and Control Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 335 Gwahangno/Yuseong-gu, Daejeon 305-701/Corée, République de (1 aut., 2 aut.) |
| DT : | Publication en série; Niveau analytique |
| SO : | Multimedia tools and applications; ISSN 1380-7501; Allemagne; Da. 2014; Vol. 72; No. 2; Pp. 2041-2062; Bibl. 50 ref. |
| LA : | Anglais |
| EA : | In pictures, every object is displayed in 2D space. Seeing the 2D image, people can perceptually reconstruct and understand information regarding the scene. To enable users to haptically interact with an object that appears in the image, the present study proposes a geometry-based haptic rendering method. More specifically, our approach is intended to estimate haptic information from the object's structure contained in an image while preserving the two-dimensional visual information. Of the many types of objects that can be seen in everyday pictures, this paper mainly deals with polyhedron figures or objects composed of rectangular faces, some of which might be shown in a slanted configuration in the picture. To obtain the geometric layout of the object being viewed from the image plane, we first estimate homographic information that describes a mapping from the object coordinate to the target image coordinate. Then, we transform the surface normals of the object face using the extrinsic part of homography that locates the face of the object we are viewing. Because the transformed normals are utilized for calculating the force in the image space, we call this process normal vector perturbation in the 2D image space. To physically represent the estimated normal vector without distorting the visual information, we employed a lateral haptic rendering scheme in that it fits with our interaction styles on 2D images. The active force value at a given position on the slanted faces is calculated during the interaction phase. To evaluate our approach, we conducted an experiment with different stimulus conditions, in which it was found that participants could reliably estimate the geometric layout that appears in the picture. We conclude with explorations of applications and a discussion of future work. |
| CC : | 001D02B04; 001D02C03 |
| FD : | Orienté objet; Vision ordinateur; Reconstruction image; Interface utilisateur; Information visuelle; Interprétation image; Sensibilité tactile; Posture; Perception sensorielle; Homographe; Stimulus; Polyèdre; Normale surface; Méthode vectorielle; Méthode perturbation; .; Precodage |
| ED : | Object oriented; Computer vision; Image reconstruction; User interface; Visual information; Image interpretation; Tactile sensitivity; Posture; Sensorial perception; Homograph; Stimulus; Polyhedron; Surface normal; Vector method; Perturbation method; Precoding |
| SD : | Orientado objeto; Visión ordenador; Reconstrucción imagen; Interfase usuario; Información visual; Interpretación imágen; Sensibilidad tactil; Postura; Percepción sensorial; Homógrafo; Estímulo; Poliedro; Normal superficie; Método vectorial; Método perturbación; Precodificación |
| LO : | INIST-28305.354000150352080450 |
| ID : | 14-0217539 |
Links to Exploration step
Pascal:14-0217539Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" level="a">Haptic interaction with objects in a picture based on pose estimation</title><author><name sortKey="Kim, Seung Chan" sort="Kim, Seung Chan" uniqKey="Kim S" first="Seung-Chan" last="Kim">Seung-Chan Kim</name><affiliation><inist:fA14 i1="01"><s1>Telerobotics and Control Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 335 Gwahangno</s1><s2>Yuseong-gu, Daejeon 305-701</s2><s3>KOR</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ></inist:fA14></affiliation></author><author><name sortKey="Kwon, Dong Soo" sort="Kwon, Dong Soo" uniqKey="Kwon D" first="Dong-Soo" last="Kwon">Dong-Soo Kwon</name><affiliation><inist:fA14 i1="01"><s1>Telerobotics and Control Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 335 Gwahangno</s1><s2>Yuseong-gu, Daejeon 305-701</s2><s3>KOR</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ></inist:fA14></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">INIST</idno><idno type="inist">14-0217539</idno><date when="2014">2014</date><idno type="stanalyst">PASCAL 14-0217539 INIST</idno><idno type="RBID">Pascal:14-0217539</idno><idno type="wicri:Area/PascalFrancis/Corpus">000038</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a">Haptic interaction with objects in a picture based on pose estimation</title><author><name sortKey="Kim, Seung Chan" sort="Kim, Seung Chan" uniqKey="Kim S" first="Seung-Chan" last="Kim">Seung-Chan Kim</name><affiliation><inist:fA14 i1="01"><s1>Telerobotics and Control Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 335 Gwahangno</s1><s2>Yuseong-gu, Daejeon 305-701</s2><s3>KOR</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ></inist:fA14></affiliation></author><author><name sortKey="Kwon, Dong Soo" sort="Kwon, Dong Soo" uniqKey="Kwon D" first="Dong-Soo" last="Kwon">Dong-Soo Kwon</name><affiliation><inist:fA14 i1="01"><s1>Telerobotics and Control Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 335 Gwahangno</s1><s2>Yuseong-gu, Daejeon 305-701</s2><s3>KOR</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ></inist:fA14></affiliation></author></analytic><series><title level="j" type="main">Multimedia tools and applications</title><title level="j" type="abbreviated">Multimed. tools appl.</title><idno type="ISSN">1380-7501</idno><imprint><date when="2014">2014</date></imprint></series></biblStruct></sourceDesc><seriesStmt><title level="j" type="main">Multimedia tools and applications</title><title level="j" type="abbreviated">Multimed. tools appl.</title><idno type="ISSN">1380-7501</idno></seriesStmt></fileDesc><profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Computer vision</term><term>Homograph</term><term>Image interpretation</term><term>Image reconstruction</term><term>Object oriented</term><term>Perturbation method</term><term>Polyhedron</term><term>Posture</term><term>Precoding</term><term>Sensorial perception</term><term>Stimulus</term><term>Surface normal</term><term>Tactile sensitivity</term><term>User interface</term><term>Vector method</term><term>Visual information</term></keywords><keywords scheme="Pascal" xml:lang="fr"><term>Orienté objet</term><term>Vision ordinateur</term><term>Reconstruction image</term><term>Interface utilisateur</term><term>Information visuelle</term><term>Interprétation image</term><term>Sensibilité tactile</term><term>Posture</term><term>Perception sensorielle</term><term>Homographe</term><term>Stimulus</term><term>Polyèdre</term><term>Normale surface</term><term>Méthode vectorielle</term><term>Méthode perturbation</term><term>.</term><term>Precodage</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">In pictures, every object is displayed in 2D space. Seeing the 2D image, people can perceptually reconstruct and understand information regarding the scene. To enable users to haptically interact with an object that appears in the image, the present study proposes a geometry-based haptic rendering method. More specifically, our approach is intended to estimate haptic information from the object's structure contained in an image while preserving the two-dimensional visual information. Of the many types of objects that can be seen in everyday pictures, this paper mainly deals with polyhedron figures or objects composed of rectangular faces, some of which might be shown in a slanted configuration in the picture. To obtain the geometric layout of the object being viewed from the image plane, we first estimate homographic information that describes a mapping from the object coordinate to the target image coordinate. Then, we transform the surface normals of the object face using the extrinsic part of homography that locates the face of the object we are viewing. Because the transformed normals are utilized for calculating the force in the image space, we call this process normal vector perturbation in the 2D image space. To physically represent the estimated normal vector without distorting the visual information, we employed a lateral haptic rendering scheme in that it fits with our interaction styles on 2D images. The active force value at a given position on the slanted faces is calculated during the interaction phase. To evaluate our approach, we conducted an experiment with different stimulus conditions, in which it was found that participants could reliably estimate the geometric layout that appears in the picture. We conclude with explorations of applications and a discussion of future work.</div></front></TEI><inist><standard h6="B"><pA><fA01 i1="01" i2="1"><s0>1380-7501</s0></fA01><fA03 i2="1"><s0>Multimed. tools appl.</s0></fA03><fA05><s2>72</s2></fA05><fA06><s2>2</s2></fA06><fA08 i1="01" i2="1" l="ENG"><s1>Haptic interaction with objects in a picture based on pose estimation</s1></fA08><fA11 i1="01" i2="1"><s1>KIM (Seung-Chan)</s1></fA11><fA11 i1="02" i2="1"><s1>KWON (Dong-Soo)</s1></fA11><fA14 i1="01"><s1>Telerobotics and Control Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 335 Gwahangno</s1><s2>Yuseong-gu, Daejeon 305-701</s2><s3>KOR</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ></fA14><fA20><s1>2041-2062</s1></fA20><fA21><s1>2014</s1></fA21><fA23 i1="01"><s0>ENG</s0></fA23><fA43 i1="01"><s1>INIST</s1><s2>28305</s2><s5>354000150352080450</s5></fA43><fA44><s0>0000</s0><s1>© 2014 INIST-CNRS. All rights reserved.</s1></fA44><fA45><s0>50 ref.</s0></fA45><fA47 i1="01" i2="1"><s0>14-0217539</s0></fA47><fA60><s1>P</s1></fA60><fA61><s0>A</s0></fA61><fA64 i1="01" i2="1"><s0>Multimedia tools and applications</s0></fA64><fA66 i1="01"><s0>DEU</s0></fA66><fC01 i1="01" l="ENG"><s0>In pictures, every object is displayed in 2D space. Seeing the 2D image, people can perceptually reconstruct and understand information regarding the scene. To enable users to haptically interact with an object that appears in the image, the present study proposes a geometry-based haptic rendering method. More specifically, our approach is intended to estimate haptic information from the object's structure contained in an image while preserving the two-dimensional visual information. Of the many types of objects that can be seen in everyday pictures, this paper mainly deals with polyhedron figures or objects composed of rectangular faces, some of which might be shown in a slanted configuration in the picture. To obtain the geometric layout of the object being viewed from the image plane, we first estimate homographic information that describes a mapping from the object coordinate to the target image coordinate. Then, we transform the surface normals of the object face using the extrinsic part of homography that locates the face of the object we are viewing. Because the transformed normals are utilized for calculating the force in the image space, we call this process normal vector perturbation in the 2D image space. To physically represent the estimated normal vector without distorting the visual information, we employed a lateral haptic rendering scheme in that it fits with our interaction styles on 2D images. The active force value at a given position on the slanted faces is calculated during the interaction phase. To evaluate our approach, we conducted an experiment with different stimulus conditions, in which it was found that participants could reliably estimate the geometric layout that appears in the picture. We conclude with explorations of applications and a discussion of future work.</s0></fC01><fC02 i1="01" i2="X"><s0>001D02B04</s0></fC02><fC02 i1="02" i2="X"><s0>001D02C03</s0></fC02><fC03 i1="01" i2="X" l="FRE"><s0>Orienté objet</s0><s5>06</s5></fC03><fC03 i1="01" i2="X" l="ENG"><s0>Object oriented</s0><s5>06</s5></fC03><fC03 i1="01" i2="X" l="SPA"><s0>Orientado objeto</s0><s5>06</s5></fC03><fC03 i1="02" i2="X" l="FRE"><s0>Vision ordinateur</s0><s5>07</s5></fC03><fC03 i1="02" i2="X" l="ENG"><s0>Computer vision</s0><s5>07</s5></fC03><fC03 i1="02" i2="X" l="SPA"><s0>Visión ordenador</s0><s5>07</s5></fC03><fC03 i1="03" i2="X" l="FRE"><s0>Reconstruction image</s0><s5>08</s5></fC03><fC03 i1="03" i2="X" l="ENG"><s0>Image reconstruction</s0><s5>08</s5></fC03><fC03 i1="03" i2="X" l="SPA"><s0>Reconstrucción imagen</s0><s5>08</s5></fC03><fC03 i1="04" i2="X" l="FRE"><s0>Interface utilisateur</s0><s5>09</s5></fC03><fC03 i1="04" i2="X" l="ENG"><s0>User interface</s0><s5>09</s5></fC03><fC03 i1="04" i2="X" l="SPA"><s0>Interfase usuario</s0><s5>09</s5></fC03><fC03 i1="05" i2="X" l="FRE"><s0>Information visuelle</s0><s5>10</s5></fC03><fC03 i1="05" i2="X" l="ENG"><s0>Visual information</s0><s5>10</s5></fC03><fC03 i1="05" i2="X" l="SPA"><s0>Información visual</s0><s5>10</s5></fC03><fC03 i1="06" i2="X" l="FRE"><s0>Interprétation image</s0><s5>11</s5></fC03><fC03 i1="06" i2="X" l="ENG"><s0>Image interpretation</s0><s5>11</s5></fC03><fC03 i1="06" i2="X" l="SPA"><s0>Interpretación imágen</s0><s5>11</s5></fC03><fC03 i1="07" i2="X" l="FRE"><s0>Sensibilité tactile</s0><s5>18</s5></fC03><fC03 i1="07" i2="X" l="ENG"><s0>Tactile sensitivity</s0><s5>18</s5></fC03><fC03 i1="07" i2="X" l="SPA"><s0>Sensibilidad tactil</s0><s5>18</s5></fC03><fC03 i1="08" i2="X" l="FRE"><s0>Posture</s0><s5>19</s5></fC03><fC03 i1="08" i2="X" l="ENG"><s0>Posture</s0><s5>19</s5></fC03><fC03 i1="08" i2="X" l="SPA"><s0>Postura</s0><s5>19</s5></fC03><fC03 i1="09" i2="X" l="FRE"><s0>Perception sensorielle</s0><s5>20</s5></fC03><fC03 i1="09" i2="X" l="ENG"><s0>Sensorial perception</s0><s5>20</s5></fC03><fC03 i1="09" i2="X" l="SPA"><s0>Percepción sensorial</s0><s5>20</s5></fC03><fC03 i1="10" i2="X" l="FRE"><s0>Homographe</s0><s5>21</s5></fC03><fC03 i1="10" i2="X" l="ENG"><s0>Homograph</s0><s5>21</s5></fC03><fC03 i1="10" i2="X" l="SPA"><s0>Homógrafo</s0><s5>21</s5></fC03><fC03 i1="11" i2="X" l="FRE"><s0>Stimulus</s0><s5>22</s5></fC03><fC03 i1="11" i2="X" l="ENG"><s0>Stimulus</s0><s5>22</s5></fC03><fC03 i1="11" i2="X" l="SPA"><s0>Estímulo</s0><s5>22</s5></fC03><fC03 i1="12" i2="X" l="FRE"><s0>Polyèdre</s0><s5>23</s5></fC03><fC03 i1="12" i2="X" l="ENG"><s0>Polyhedron</s0><s5>23</s5></fC03><fC03 i1="12" i2="X" l="SPA"><s0>Poliedro</s0><s5>23</s5></fC03><fC03 i1="13" i2="X" l="FRE"><s0>Normale surface</s0><s5>24</s5></fC03><fC03 i1="13" i2="X" l="ENG"><s0>Surface normal</s0><s5>24</s5></fC03><fC03 i1="13" i2="X" l="SPA"><s0>Normal superficie</s0><s5>24</s5></fC03><fC03 i1="14" i2="X" l="FRE"><s0>Méthode vectorielle</s0><s5>25</s5></fC03><fC03 i1="14" i2="X" l="ENG"><s0>Vector method</s0><s5>25</s5></fC03><fC03 i1="14" i2="X" l="SPA"><s0>Método vectorial</s0><s5>25</s5></fC03><fC03 i1="15" i2="X" l="FRE"><s0>Méthode perturbation</s0><s5>26</s5></fC03><fC03 i1="15" i2="X" l="ENG"><s0>Perturbation method</s0><s5>26</s5></fC03><fC03 i1="15" i2="X" l="SPA"><s0>Método perturbación</s0><s5>26</s5></fC03><fC03 i1="16" i2="X" l="FRE"><s0>.</s0><s4>INC</s4><s5>82</s5></fC03><fC03 i1="17" i2="X" l="FRE"><s0>Precodage</s0><s4>CD</s4><s5>96</s5></fC03><fC03 i1="17" i2="X" l="ENG"><s0>Precoding</s0><s4>CD</s4><s5>96</s5></fC03><fC03 i1="17" i2="X" l="SPA"><s0>Precodificación</s0><s4>CD</s4><s5>96</s5></fC03><fN21><s1>265</s1></fN21><fN44 i1="01"><s1>OTO</s1></fN44><fN82><s1>OTO</s1></fN82></pA></standard><server><NO>PASCAL 14-0217539 INIST</NO><ET>Haptic interaction with objects in a picture based on pose estimation</ET><AU>KIM (Seung-Chan); KWON (Dong-Soo)</AU><AF>Telerobotics and Control Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 335 Gwahangno/Yuseong-gu, Daejeon 305-701/Corée, République de (1 aut., 2 aut.)</AF><DT>Publication en série; Niveau analytique</DT><SO>Multimedia tools and applications; ISSN 1380-7501; Allemagne; Da. 2014; Vol. 72; No. 2; Pp. 2041-2062; Bibl. 50 ref.</SO><LA>Anglais</LA><EA>In pictures, every object is displayed in 2D space. Seeing the 2D image, people can perceptually reconstruct and understand information regarding the scene. To enable users to haptically interact with an object that appears in the image, the present study proposes a geometry-based haptic rendering method. More specifically, our approach is intended to estimate haptic information from the object's structure contained in an image while preserving the two-dimensional visual information. Of the many types of objects that can be seen in everyday pictures, this paper mainly deals with polyhedron figures or objects composed of rectangular faces, some of which might be shown in a slanted configuration in the picture. To obtain the geometric layout of the object being viewed from the image plane, we first estimate homographic information that describes a mapping from the object coordinate to the target image coordinate. Then, we transform the surface normals of the object face using the extrinsic part of homography that locates the face of the object we are viewing. Because the transformed normals are utilized for calculating the force in the image space, we call this process normal vector perturbation in the 2D image space. To physically represent the estimated normal vector without distorting the visual information, we employed a lateral haptic rendering scheme in that it fits with our interaction styles on 2D images. The active force value at a given position on the slanted faces is calculated during the interaction phase. To evaluate our approach, we conducted an experiment with different stimulus conditions, in which it was found that participants could reliably estimate the geometric layout that appears in the picture. We conclude with explorations of applications and a discussion of future work.</EA><CC>001D02B04; 001D02C03</CC><FD>Orienté objet; Vision ordinateur; Reconstruction image; Interface utilisateur; Information visuelle; Interprétation image; Sensibilité tactile; Posture; Perception sensorielle; Homographe; Stimulus; Polyèdre; Normale surface; Méthode vectorielle; Méthode perturbation; .; Precodage</FD><ED>Object oriented; Computer vision; Image reconstruction; User interface; Visual information; Image interpretation; Tactile sensitivity; Posture; Sensorial perception; Homograph; Stimulus; Polyhedron; Surface normal; Vector method; Perturbation method; Precoding</ED><SD>Orientado objeto; Visión ordenador; Reconstrucción imagen; Interfase usuario; Información visual; Interpretación imágen; Sensibilidad tactil; Postura; Percepción sensorial; Homógrafo; Estímulo; Poliedro; Normal superficie; Método vectorial; Método perturbación; Precodificación</SD><LO>INIST-28305.354000150352080450</LO><ID>14-0217539</ID></server></inist></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/PascalFrancis/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000038 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/PascalFrancis/Corpus/biblio.hfd -nk 000038 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= PascalFrancis
|étape= Corpus
|type= RBID
|clé= Pascal:14-0217539
|texte= Haptic interaction with objects in a picture based on pose estimation
}}
| This area was generated with Dilib version V0.6.23. |  |