Intelligent Multi-Modal Recognition Interface Using Voice-XML and Embedded KSSL Recognizer
Identifieur interne : 004A40 ( Istex/Curation ); précédent : 004A39; suivant : 004A41Intelligent Multi-Modal Recognition Interface Using Voice-XML and Embedded KSSL Recognizer
Auteurs : Jung-Hyun Kim [Corée du Sud, États-Unis] ; Kwang-Seok Hong [Corée du Sud]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2006.
Abstract
Abstract: A desktop PC and wire communications net-based traditional studies on pattern recognition and multimodal interaction have some restrictions (e.g. limitation of motion, conditionality in space and so on) and general problems according to using of the vision technologies for recognition and representation of the haptic-gesture information. In this paper, we propose and implement Multi-Modal Recognition Interface (hereinafter, MMRI) integrating speech using Voice-XML and gesture based on wireless networks, it have purposes that recognizes and represents the Korean Standard Sign Language (hereinafter, KSSL) which is a dialog system and interactive elements in the Korean deaf communities, and the need to dialogue with deaf person in their own language, sign language, is well recognized and is widely accepted as being a positive influence on communication. The advantages of our approach are as follows: 1) it improves efficiency of the MMRI input module according to the technology of wireless communication, 2) it shows higher recognition performance than uni-modal recognition system 3) it recognizes and represents continuous sign language of users with flexibility in real time and offer to user a wider range of personalized and differentiated information using the MMRI more effectively. Experimental results, the MMRI deduces an average recognition rate of 96.23% for significant, dynamic and continuous the KSSL and speech of various users.
Url:
DOI: 10.1007/11892960_96
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: Pour aller vers cette notice dans l'étape Curation :004A40
Links to Exploration step
ISTEX:3F263E5D526FC27A192A8DE169BB215404CA6115Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct:series"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Intelligent Multi-Modal Recognition Interface Using Voice-XML and Embedded KSSL Recognizer</title><author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name><affiliation wicri:level="1"><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do, Korea</mods:affiliation><country xml:lang="fr">Corée du Sud</country><wicri:regionArea>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do</wicri:regionArea></affiliation><affiliation wicri:level="1"><mods:affiliation>E-mail: kjh0328@skku.edu</mods:affiliation><country wicri:rule="url">États-Unis</country></affiliation></author><author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name><affiliation wicri:level="1"><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do, Korea</mods:affiliation><country xml:lang="fr">Corée du Sud</country><wicri:regionArea>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do</wicri:regionArea></affiliation><affiliation wicri:level="1"><mods:affiliation>E-mail: kshong@skku.ac.kr</mods:affiliation><country wicri:rule="url">Corée du Sud</country></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:3F263E5D526FC27A192A8DE169BB215404CA6115</idno><date when="2006" year="2006">2006</date><idno type="doi">10.1007/11892960_96</idno><idno type="url">https://api.istex.fr/document/3F263E5D526FC27A192A8DE169BB215404CA6115/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">004A40</idno><idno type="wicri:Area/Istex/Curation">004A40</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Intelligent Multi-Modal Recognition Interface Using Voice-XML and Embedded KSSL Recognizer</title><author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name><affiliation wicri:level="1"><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do, Korea</mods:affiliation><country xml:lang="fr">Corée du Sud</country><wicri:regionArea>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do</wicri:regionArea></affiliation><affiliation wicri:level="1"><mods:affiliation>E-mail: kjh0328@skku.edu</mods:affiliation><country wicri:rule="url">États-Unis</country></affiliation></author><author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name><affiliation wicri:level="1"><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do, Korea</mods:affiliation><country xml:lang="fr">Corée du Sud</country><wicri:regionArea>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, 440-746, Suwon, KyungKi-do</wicri:regionArea></affiliation><affiliation wicri:level="1"><mods:affiliation>E-mail: kshong@skku.ac.kr</mods:affiliation><country wicri:rule="url">Corée du Sud</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2006</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series><idno type="istex">3F263E5D526FC27A192A8DE169BB215404CA6115</idno><idno type="DOI">10.1007/11892960_96</idno><idno type="ChapterID">96</idno><idno type="ChapterID">Chap96</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: A desktop PC and wire communications net-based traditional studies on pattern recognition and multimodal interaction have some restrictions (e.g. limitation of motion, conditionality in space and so on) and general problems according to using of the vision technologies for recognition and representation of the haptic-gesture information. In this paper, we propose and implement Multi-Modal Recognition Interface (hereinafter, MMRI) integrating speech using Voice-XML and gesture based on wireless networks, it have purposes that recognizes and represents the Korean Standard Sign Language (hereinafter, KSSL) which is a dialog system and interactive elements in the Korean deaf communities, and the need to dialogue with deaf person in their own language, sign language, is well recognized and is widely accepted as being a positive influence on communication. The advantages of our approach are as follows: 1) it improves efficiency of the MMRI input module according to the technology of wireless communication, 2) it shows higher recognition performance than uni-modal recognition system 3) it recognizes and represents continuous sign language of users with flexibility in real time and offer to user a wider range of personalized and differentiated information using the MMRI more effectively. Experimental results, the MMRI deduces an average recognition rate of 96.23% for significant, dynamic and continuous the KSSL and speech of various users.</div></front></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Istex/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 004A40 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Curation/biblio.hfd -nk 004A40 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Istex
|étape= Curation
|type= RBID
|clé= ISTEX:3F263E5D526FC27A192A8DE169BB215404CA6115
|texte= Intelligent Multi-Modal Recognition Interface Using Voice-XML and Embedded KSSL Recognizer
}}
| This area was generated with Dilib version V0.6.23. |  |