Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments
Identifieur interne : 000241 ( Main/Merge ); précédent : 000240; suivant : 000242Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments
Auteurs : Yingli Tian [États-Unis] ; Xiaodong Yang [États-Unis] ; Chucai Yi [États-Unis] ; Aries Arditi [États-Unis]Source :
- Machine vision and applications [ 0932-8092 ] ; 2012.
Abstract
Independent travel is a well known challenge for blind and visually impaired persons. In this paper, we propose a proof-of-concept computer vision-based wayfinding aid for blind people to independently access unfamiliar indoor environments. In order to find different rooms (e.g. an office, a lab, or a bathroom) and other building amenities (e.g. an exit or an elevator), we incorporate object detection with text recognition. First we develop a robust and efficient algorithm to detect doors, elevators, and cabinets based on their general geometric shape, by combining edges and corners. The algorithm is general enough to handle large intra-class variations of objects with different appearances among different indoor environments, as well as small inter-class differences between different objects such as doors and door-like cabinets. Next, in order to distinguish intra-class objects (e.g. an office door from a bathroom door), we extract and recognize text information associated with the detected objects. For text recognition, we first extract text regions from signs with multiple colors and possibly complex backgrounds, and then apply character localization and topological analysis to filter out background interference. The extracted text is recognized using off-the-shelf optical character recognition (OCR) software products. The object type, orientation, location, and text information are presented to the blind traveler as speech.
Url:
DOI: 10.1007/s00138-012-0431-7
PubMed: 23630409
PubMed Central: 3636776
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000139
- to stream Pmc, to step Curation: 000139
- to stream Pmc, to step Checkpoint: 000085
- to stream PubMed, to step Corpus: 000022
- to stream PubMed, to step Curation: 000022
- to stream PubMed, to step Checkpoint: 000022
- to stream Ncbi, to step Merge: 000162
- to stream Ncbi, to step Curation: 000162
- to stream Ncbi, to step Checkpoint: 000162
Links to Exploration step
PMC:3636776Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments</title>
<author><name sortKey="Tian, Yingli" sort="Tian, Yingli" uniqKey="Tian Y" first="Yingli" last="Tian">Yingli Tian</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York, NY 10031</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York</wicri:cityArea>
</affiliation>
</author>
<author><name sortKey="Yang, Xiaodong" sort="Yang, Xiaodong" uniqKey="Yang X" first="Xiaodong" last="Yang">Xiaodong Yang</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York, NY 10031</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York</wicri:cityArea>
</affiliation>
</author>
<author><name sortKey="Yi, Chucai" sort="Yi, Chucai" uniqKey="Yi C" first="Chucai" last="Yi">Chucai Yi</name>
<affiliation wicri:level="2"><nlm:aff id="A2">The Graduate Center, City University of New York, New York, NY 10036</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>The Graduate Center, City University of New York, New York</wicri:cityArea>
</affiliation>
</author>
<author><name sortKey="Arditi, Aries" sort="Arditi, Aries" uniqKey="Arditi A" first="Aries" last="Arditi">Aries Arditi</name>
<affiliation wicri:level="2"><nlm:aff id="A3">Visibility Metrics LLC, Chappaqua, NY 10514 USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>Visibility Metrics LLC, Chappaqua</wicri:cityArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">23630409</idno>
<idno type="pmc">3636776</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3636776</idno>
<idno type="RBID">PMC:3636776</idno>
<idno type="doi">10.1007/s00138-012-0431-7</idno>
<date when="2012">2012</date>
<idno type="wicri:Area/Pmc/Corpus">000139</idno>
<idno type="wicri:Area/Pmc/Curation">000139</idno>
<idno type="wicri:Area/Pmc/Checkpoint">000085</idno>
<idno type="wicri:source">PubMed</idno>
<idno type="wicri:Area/PubMed/Corpus">000022</idno>
<idno type="wicri:Area/PubMed/Curation">000022</idno>
<idno type="wicri:Area/PubMed/Checkpoint">000022</idno>
<idno type="wicri:Area/Ncbi/Merge">000162</idno>
<idno type="wicri:Area/Ncbi/Curation">000162</idno>
<idno type="wicri:Area/Ncbi/Checkpoint">000162</idno>
<idno type="wicri:doubleKey">0932-8092:2012:Tian Y:toward:a:computer</idno>
<idno type="wicri:Area/Main/Merge">000241</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments</title>
<author><name sortKey="Tian, Yingli" sort="Tian, Yingli" uniqKey="Tian Y" first="Yingli" last="Tian">Yingli Tian</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York, NY 10031</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York</wicri:cityArea>
</affiliation>
</author>
<author><name sortKey="Yang, Xiaodong" sort="Yang, Xiaodong" uniqKey="Yang X" first="Xiaodong" last="Yang">Xiaodong Yang</name>
<affiliation wicri:level="2"><nlm:aff id="A1">Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York, NY 10031</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>Electrical Engineering Department, The City College, and Graduate Center, City University of New York, New York</wicri:cityArea>
</affiliation>
</author>
<author><name sortKey="Yi, Chucai" sort="Yi, Chucai" uniqKey="Yi C" first="Chucai" last="Yi">Chucai Yi</name>
<affiliation wicri:level="2"><nlm:aff id="A2">The Graduate Center, City University of New York, New York, NY 10036</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>The Graduate Center, City University of New York, New York</wicri:cityArea>
</affiliation>
</author>
<author><name sortKey="Arditi, Aries" sort="Arditi, Aries" uniqKey="Arditi A" first="Aries" last="Arditi">Aries Arditi</name>
<affiliation wicri:level="2"><nlm:aff id="A3">Visibility Metrics LLC, Chappaqua, NY 10514 USA</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<placeName><region type="state">État de New York</region>
</placeName>
<wicri:cityArea>Visibility Metrics LLC, Chappaqua</wicri:cityArea>
</affiliation>
</author>
</analytic>
<series><title level="j">Machine vision and applications</title>
<idno type="ISSN">0932-8092</idno>
<idno type="eISSN">1432-1769</idno>
<imprint><date when="2012">2012</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p id="P1">Independent travel is a well known challenge for blind and visually impaired persons. In this paper, we propose a proof-of-concept computer vision-based wayfinding aid for blind people to independently access unfamiliar indoor environments. In order to find different rooms (e.g. an office, a lab, or a bathroom) and other building amenities (e.g. an exit or an elevator), we incorporate object detection with text recognition. First we develop a robust and efficient algorithm to detect doors, elevators, and cabinets based on their general geometric shape, by combining edges and corners. The algorithm is general enough to handle large intra-class variations of objects with different appearances among different indoor environments, as well as small inter-class differences between different objects such as doors and door-like cabinets. Next, in order to distinguish intra-class objects (e.g. an office door from a bathroom door), we extract and recognize text information associated with the detected objects. For text recognition, we first extract text regions from signs with multiple colors and possibly complex backgrounds, and then apply character localization and topological analysis to filter out background interference. The extracted text is recognized using off-the-shelf optical character recognition (OCR) software products. The object type, orientation, location, and text information are presented to the blind traveler as speech.</p>
</div>
</front>
</TEI>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000241 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 000241 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= OcrV1 |flux= Main |étape= Merge |type= RBID |clé= PMC:3636776 |texte= Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Merge/RBID.i -Sk "pubmed:23630409" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Main/Merge/biblio.hfd \ | NlmPubMed2Wicri -a OcrV1
This area was generated with Dilib version V0.6.32. |