Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind
Identifieur interne : 000E25 ( Main/Merge ); précédent : 000E24; suivant : 000E26Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind
Auteurs : Donghun Kim ; Kwangtaek Kim [Corée du Sud] ; Sangyoun Lee [Corée du Sud]Source :
- Sensors (Basel, Switzerland) [ 1424-8220 ] ; 2014.
English descriptors
- KwdEn :
- Blindness (rehabilitation), Canes, Equipment Design, Equipment Failure Analysis, Feedback, Physiological, Humans, Imaging, Three-Dimensional (instrumentation), Orientation, Pattern Recognition, Automated (methods), Physical Stimulation (instrumentation), Self-Help Devices, Signal Processing, Computer-Assisted (instrumentation), Touch, Transducers, User-Computer Interface.
- MESH :
- instrumentation : Imaging, Three-Dimensional, Physical Stimulation, Signal Processing, Computer-Assisted.
- methods : Pattern Recognition, Automated.
- rehabilitation : Blindness.
- Canes, Equipment Design, Equipment Failure Analysis, Feedback, Physiological, Humans, Orientation, Self-Help Devices, Touch, Transducers, User-Computer Interface.
Abstract
In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.
Url:
DOI: 10.3390/s140610412
PubMed: 24932864
PubMed Central: 4118356
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 002481
- to stream Pmc, to step Curation: 002481
- to stream Pmc, to step Checkpoint: 000939
- to stream PubMed, to step Corpus: 000623
- to stream PubMed, to step Curation: 000623
- to stream PubMed, to step Checkpoint: 000530
- to stream Ncbi, to step Merge: 003073
- to stream Ncbi, to step Curation: 003073
- to stream Ncbi, to step Checkpoint: 003073
Links to Exploration step
PMC:4118356Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind</title><author><name sortKey="Kim, Donghun" sort="Kim, Donghun" uniqKey="Kim D" first="Donghun" last="Kim">Donghun Kim</name><affiliation><nlm:aff id="af1-sensors-14-10412"> School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47906, USA; E-Mail:<email>zava@purdue.edu</email></nlm:aff></affiliation></author><author><name sortKey="Kim, Kwangtaek" sort="Kim, Kwangtaek" uniqKey="Kim K" first="Kwangtaek" last="Kim">Kwangtaek Kim</name><affiliation wicri:level="1"><nlm:aff id="af2-sensors-14-10412"> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea</nlm:aff><country xml:lang="fr">Corée du Sud</country><wicri:regionArea> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749</wicri:regionArea><placeName><settlement type="city">Séoul</settlement></placeName></affiliation></author><author><name sortKey="Lee, Sangyoun" sort="Lee, Sangyoun" uniqKey="Lee S" first="Sangyoun" last="Lee">Sangyoun Lee</name><affiliation wicri:level="1"><nlm:aff id="af2-sensors-14-10412"> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea</nlm:aff><country xml:lang="fr">Corée du Sud</country><wicri:regionArea> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749</wicri:regionArea><placeName><settlement type="city">Séoul</settlement></placeName></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">24932864</idno><idno type="pmc">4118356</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4118356</idno><idno type="RBID">PMC:4118356</idno><idno type="doi">10.3390/s140610412</idno><date when="2014">2014</date><idno type="wicri:Area/Pmc/Corpus">002481</idno><idno type="wicri:Area/Pmc/Curation">002481</idno><idno type="wicri:Area/Pmc/Checkpoint">000939</idno><idno type="wicri:source">PubMed</idno><idno type="wicri:Area/PubMed/Corpus">000623</idno><idno type="wicri:Area/PubMed/Curation">000623</idno><idno type="wicri:Area/PubMed/Checkpoint">000530</idno><idno type="wicri:Area/Ncbi/Merge">003073</idno><idno type="wicri:Area/Ncbi/Curation">003073</idno><idno type="wicri:Area/Ncbi/Checkpoint">003073</idno><idno type="wicri:Area/Main/Merge">000E25</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind</title><author><name sortKey="Kim, Donghun" sort="Kim, Donghun" uniqKey="Kim D" first="Donghun" last="Kim">Donghun Kim</name><affiliation><nlm:aff id="af1-sensors-14-10412"> School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47906, USA; E-Mail:<email>zava@purdue.edu</email></nlm:aff></affiliation></author><author><name sortKey="Kim, Kwangtaek" sort="Kim, Kwangtaek" uniqKey="Kim K" first="Kwangtaek" last="Kim">Kwangtaek Kim</name><affiliation wicri:level="1"><nlm:aff id="af2-sensors-14-10412"> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea</nlm:aff><country xml:lang="fr">Corée du Sud</country><wicri:regionArea> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749</wicri:regionArea><placeName><settlement type="city">Séoul</settlement></placeName></affiliation></author><author><name sortKey="Lee, Sangyoun" sort="Lee, Sangyoun" uniqKey="Lee S" first="Sangyoun" last="Lee">Sangyoun Lee</name><affiliation wicri:level="1"><nlm:aff id="af2-sensors-14-10412"> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea</nlm:aff><country xml:lang="fr">Corée du Sud</country><wicri:regionArea> Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749</wicri:regionArea><placeName><settlement type="city">Séoul</settlement></placeName></affiliation></author></analytic><series><title level="j">Sensors (Basel, Switzerland)</title><idno type="eISSN">1424-8220</idno><imprint><date when="2014">2014</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Blindness (rehabilitation)</term><term>Canes</term><term>Equipment Design</term><term>Equipment Failure Analysis</term><term>Feedback, Physiological</term><term>Humans</term><term>Imaging, Three-Dimensional (instrumentation)</term><term>Orientation</term><term>Pattern Recognition, Automated (methods)</term><term>Physical Stimulation (instrumentation)</term><term>Self-Help Devices</term><term>Signal Processing, Computer-Assisted (instrumentation)</term><term>Touch</term><term>Transducers</term><term>User-Computer Interface</term></keywords><keywords scheme="MESH" qualifier="instrumentation" xml:lang="en"><term>Imaging, Three-Dimensional</term><term>Physical Stimulation</term><term>Signal Processing, Computer-Assisted</term></keywords><keywords scheme="MESH" qualifier="methods" xml:lang="en"><term>Pattern Recognition, Automated</term></keywords><keywords scheme="MESH" qualifier="rehabilitation" xml:lang="en"><term>Blindness</term></keywords><keywords scheme="MESH" xml:lang="en"><term>Canes</term><term>Equipment Design</term><term>Equipment Failure Analysis</term><term>Feedback, Physiological</term><term>Humans</term><term>Orientation</term><term>Self-Help Devices</term><term>Touch</term><term>Transducers</term><term>User-Computer Interface</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Vera, P" uniqKey="Vera P">P. Vera</name></author><author><name sortKey="Zenteno, D" uniqKey="Zenteno D">D. Zenteno</name></author><author><name sortKey="Salas, J" uniqKey="Salas J">J. Salas</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dakopoulos, D" uniqKey="Dakopoulos D">D. Dakopoulos</name></author><author><name sortKey="Bourbakis, N" uniqKey="Bourbakis N">N. Bourbakis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Yuan, D" uniqKey="Yuan D">D. Yuan</name></author><author><name sortKey="Manduchi, R" uniqKey="Manduchi R">R. Manduchi</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Manduchi, R" uniqKey="Manduchi R">R. Manduchi</name></author><author><name sortKey="Coughlan, J" uniqKey="Coughlan J">J. Coughlan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dramas, F" uniqKey="Dramas F">F. Dramas</name></author><author><name sortKey="Thorpe, S J" uniqKey="Thorpe S">S.J. Thorpe</name></author><author><name sortKey="Jouffrais, C" uniqKey="Jouffrais C">C. Jouffrais</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jose, J" uniqKey="Jose J">J. José</name></author><author><name sortKey="Farrajota, M" uniqKey="Farrajota M">M. Farrajota</name></author><author><name sortKey="Rodrigues, J M" uniqKey="Rodrigues J">J.M. Rodrigues</name></author><author><name sortKey="Du Buf, J H" uniqKey="Du Buf J">J.H. du Buf</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fernandes, H" uniqKey="Fernandes H">H. Fernandes</name></author><author><name sortKey="Costa, P" uniqKey="Costa P">P. Costa</name></author><author><name sortKey="Filipe, V" uniqKey="Filipe V">V. Filipe</name></author><author><name sortKey="Hadjileontiadis, L" uniqKey="Hadjileontiadis L">L. Hadjileontiadis</name></author><author><name sortKey="Barroso, J" uniqKey="Barroso J">J. Barroso</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brilhault, A" uniqKey="Brilhault A">A. Brilhault</name></author><author><name sortKey="Kammoun, S" uniqKey="Kammoun S">S. Kammoun</name></author><author><name sortKey="Gutierrez, O" uniqKey="Gutierrez O">O. Gutierrez</name></author><author><name sortKey="Truillet, P" uniqKey="Truillet P">P. Truillet</name></author><author><name sortKey="Jouffrais, C" uniqKey="Jouffrais C">C. Jouffrais</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Denis, G" uniqKey="Denis G">G. Denis</name></author><author><name sortKey="Jouffrais, C" uniqKey="Jouffrais C">C. Jouffrais</name></author><author><name sortKey="Vergnieux, V" uniqKey="Vergnieux V">V. Vergnieux</name></author><author><name sortKey="Mace, M" uniqKey="Mace M">M. Macé</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Asano, H" uniqKey="Asano H">H. Asano</name></author><author><name sortKey="Nagayasu, T" uniqKey="Nagayasu T">T. Nagayasu</name></author><author><name sortKey="Orimo, T" uniqKey="Orimo T">T. Orimo</name></author><author><name sortKey="Terabayashi, K" uniqKey="Terabayashi K">K. Terabayashi</name></author><author><name sortKey="Ohta, M" uniqKey="Ohta M">M. Ohta</name></author><author><name sortKey="Umeda, K" uniqKey="Umeda K">K. Umeda</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kim, D" uniqKey="Kim D">D. Kim</name></author><author><name sortKey="Hong, K" uniqKey="Hong K">K. Hong</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wachs, J P" uniqKey="Wachs J">J.P. Wachs</name></author><author><name sortKey="Kolsch, M" uniqKey="Kolsch M">M. Kölsch</name></author><author><name sortKey="Stern, H" uniqKey="Stern H">H. Stern</name></author><author><name sortKey="Edan, Y" uniqKey="Edan Y">Y. Edan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Matikainen, P" uniqKey="Matikainen P">P. Matikainen</name></author><author><name sortKey="Pillai, P" uniqKey="Pillai P">P. Pillai</name></author><author><name sortKey="Mummert, L" uniqKey="Mummert L">L. Mummert</name></author><author><name sortKey="Sukthankar, R" uniqKey="Sukthankar R">R. Sukthankar</name></author><author><name sortKey="Hebert, M" uniqKey="Hebert M">M. Hebert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lee, M" uniqKey="Lee M">M. Lee</name></author><author><name sortKey="Green, R" uniqKey="Green R">R. Green</name></author><author><name sortKey="Billinghurst, M" uniqKey="Billinghurst M">M. Billinghurst</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nickel, K" uniqKey="Nickel K">K. Nickel</name></author><author><name sortKey="Stiefelhagen, R" uniqKey="Stiefelhagen R">R. Stiefelhagen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Thomas, B" uniqKey="Thomas B">B. Thomas</name></author><author><name sortKey="Piekarski, W" uniqKey="Piekarski W">W. Piekarski</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Segen, J" uniqKey="Segen J">J. Segen</name></author><author><name sortKey="Kumar, S" uniqKey="Kumar S">S. Kumar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rehg, J" uniqKey="Rehg J">J. Rehg</name></author><author><name sortKey="Kanade, T" uniqKey="Kanade T">T. Kanade</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ong, E" uniqKey="Ong E">E. Ong</name></author><author><name sortKey="Bowden, R" uniqKey="Bowden R">R. Bowden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Starner, T" uniqKey="Starner T">T. Starner</name></author><author><name sortKey="Weaver, J" uniqKey="Weaver J">J. Weaver</name></author><author><name sortKey="Pentland, A" uniqKey="Pentland A">A. Pentland</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kolsch, M" uniqKey="Kolsch M">M. Kolsch</name></author><author><name sortKey="Turk, M" uniqKey="Turk M">M. Turk</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Trucco, E" uniqKey="Trucco E">E. Trucco</name></author><author><name sortKey="Verri, A" uniqKey="Verri A">A. Verri</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hartley, R" uniqKey="Hartley R">R. Hartley</name></author><author><name sortKey="Zisserman, A" uniqKey="Zisserman A">A. Zisserman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zhang, Z" uniqKey="Zhang Z">Z. Zhang</name></author><author><name sortKey="Faugeras, O" uniqKey="Faugeras O">O. Faugeras</name></author><author><name sortKey="Deriche, R" uniqKey="Deriche R">R. Deriche</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Tsai, R" uniqKey="Tsai R">R. Tsai</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pressey, N" uniqKey="Pressey N">N. Pressey</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ertan, S" uniqKey="Ertan S">S. Ertan</name></author><author><name sortKey="Lee, C" uniqKey="Lee C">C. Lee</name></author><author><name sortKey="Willets, A" uniqKey="Willets A">A. Willets</name></author><author><name sortKey="Tan, H" uniqKey="Tan H">H. Tan</name></author><author><name sortKey="Pentland, A" uniqKey="Pentland A">A. Pentland</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Velazquez, R" uniqKey="Velazquez R">R. Velázquez</name></author><author><name sortKey="Maingreaud, F" uniqKey="Maingreaud F">F. Maingreaud</name></author><author><name sortKey="Pissaloux, E" uniqKey="Pissaloux E">E. Pissaloux</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hirose, M" uniqKey="Hirose M">M. Hirose</name></author><author><name sortKey="Amemiya, T" uniqKey="Amemiya T">T. Amemiya</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Goldstein, E B" uniqKey="Goldstein E">E.B. Goldstein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Miller, G A" uniqKey="Miller G">G.A. Miller</name></author></analytic></biblStruct></listBibl></div1></back></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000E25 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 000E25 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Main
|étape= Merge
|type= RBID
|clé= PMC:4118356
|texte= Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Merge/RBID.i -Sk "pubmed:24932864" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Merge/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |