Probabilistic Automaton Model for Fuzzy English-Text Retrieval
Identifieur interne : 001E26 ( Main/Merge ); précédent : 001E25; suivant : 001E27Probabilistic Automaton Model for Fuzzy English-Text Retrieval
Auteurs : Manabu Ohta [Japon] ; Atsuhiro Takasu [Japon] ; Jun Adachi [Japon]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2000.
Abstract
Abstract: Optical character reader (OCR) misrecognition is a serious problem when searching against OCR-scanned documents in databases such as digital libraries. This paper proposes fuzzy retrieval methods for English text that contains errors in the recognized text without cor- recting the errors manually. Costs are thereby reduced. The proposed methods generate multiple search terms for each input query term based on probabilistic automata reflecting both error-occurrence probabilities and character-connection probabilities. Experimental results of test-set retrieval indicate that one of the proposed methods improves the recall rate from 95.56% to 97.88% at the cost of a decrease in precision rate from 100.00% to 95.52% with 20 expanded search terms.
Url:
DOI: 10.1007/3-540-45268-0_4
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 000129
- to stream Istex, to step Curation: 000127
- to stream Istex, to step Checkpoint: 001329
Links to Exploration step
ISTEX:7A84C4BC65B7B2EB89AF505B34B703625606EB1BLe document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Probabilistic Automaton Model for Fuzzy English-Text Retrieval</title>
<author><name sortKey="Ohta, Manabu" sort="Ohta, Manabu" uniqKey="Ohta M" first="Manabu" last="Ohta">Manabu Ohta</name>
</author>
<author><name sortKey="Takasu, Atsuhiro" sort="Takasu, Atsuhiro" uniqKey="Takasu A" first="Atsuhiro" last="Takasu">Atsuhiro Takasu</name>
</author>
<author><name sortKey="Adachi, Jun" sort="Adachi, Jun" uniqKey="Adachi J" first="Jun" last="Adachi">Jun Adachi</name>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">ISTEX</idno>
<idno type="RBID">ISTEX:7A84C4BC65B7B2EB89AF505B34B703625606EB1B</idno>
<date when="2000" year="2000">2000</date>
<idno type="doi">10.1007/3-540-45268-0_4</idno>
<idno type="url">https://api.istex.fr/document/7A84C4BC65B7B2EB89AF505B34B703625606EB1B/fulltext/pdf</idno>
<idno type="wicri:Area/Istex/Corpus">000129</idno>
<idno type="wicri:Area/Istex/Curation">000127</idno>
<idno type="wicri:Area/Istex/Checkpoint">001329</idno>
<idno type="wicri:doubleKey">0302-9743:2000:Ohta M:probabilistic:automaton:model</idno>
<idno type="wicri:Area/Main/Merge">001E26</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Probabilistic Automaton Model for Fuzzy English-Text Retrieval</title>
<author><name sortKey="Ohta, Manabu" sort="Ohta, Manabu" uniqKey="Ohta M" first="Manabu" last="Ohta">Manabu Ohta</name>
<affiliation wicri:level="1"><country xml:lang="fr">Japon</country>
<wicri:regionArea>National Institute of Informatics (NII), Hitotsubashi 2-1-2, 101-8430, Tokyo, Chiyoda-ku</wicri:regionArea>
<wicri:noRegion>Chiyoda-ku</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Japon</country>
</affiliation>
</author>
<author><name sortKey="Takasu, Atsuhiro" sort="Takasu, Atsuhiro" uniqKey="Takasu A" first="Atsuhiro" last="Takasu">Atsuhiro Takasu</name>
<affiliation wicri:level="1"><country xml:lang="fr">Japon</country>
<wicri:regionArea>National Institute of Informatics (NII), Hitotsubashi 2-1-2, 101-8430, Tokyo, Chiyoda-ku</wicri:regionArea>
<wicri:noRegion>Chiyoda-ku</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Japon</country>
</affiliation>
</author>
<author><name sortKey="Adachi, Jun" sort="Adachi, Jun" uniqKey="Adachi J" first="Jun" last="Adachi">Jun Adachi</name>
<affiliation wicri:level="1"><country xml:lang="fr">Japon</country>
<wicri:regionArea>National Institute of Informatics (NII), Hitotsubashi 2-1-2, 101-8430, Tokyo, Chiyoda-ku</wicri:regionArea>
<wicri:noRegion>Chiyoda-ku</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Japon</country>
</affiliation>
</author>
</analytic>
<monogr></monogr>
<series><title level="s">Lecture Notes in Computer Science</title>
<imprint><date>2000</date>
</imprint>
<idno type="ISSN">0302-9743</idno>
<idno type="ISSN">0302-9743</idno>
</series>
<idno type="istex">7A84C4BC65B7B2EB89AF505B34B703625606EB1B</idno>
<idno type="DOI">10.1007/3-540-45268-0_4</idno>
<idno type="ChapterID">4</idno>
<idno type="ChapterID">Chap4</idno>
</biblStruct>
</sourceDesc>
<seriesStmt><idno type="ISSN">0302-9743</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass></textClass>
<langUsage><language ident="en">en</language>
</langUsage>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Abstract: Optical character reader (OCR) misrecognition is a serious problem when searching against OCR-scanned documents in databases such as digital libraries. This paper proposes fuzzy retrieval methods for English text that contains errors in the recognized text without cor- recting the errors manually. Costs are thereby reduced. The proposed methods generate multiple search terms for each input query term based on probabilistic automata reflecting both error-occurrence probabilities and character-connection probabilities. Experimental results of test-set retrieval indicate that one of the proposed methods improves the recall rate from 95.56% to 97.88% at the cost of a decrease in precision rate from 100.00% to 95.52% with 20 expanded search terms.</div>
</front>
</TEI>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001E26 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 001E26 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= OcrV1 |flux= Main |étape= Merge |type= RBID |clé= ISTEX:7A84C4BC65B7B2EB89AF505B34B703625606EB1B |texte= Probabilistic Automaton Model for Fuzzy English-Text Retrieval }}
This area was generated with Dilib version V0.6.32. |