Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value
Identifieur interne : 005684 ( Main/Merge ); précédent : 005683; suivant : 005685Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value
Auteurs : Jung-Hyun Kim [Corée du Sud, États-Unis] ; Jeh-Seon Youn [Corée du Sud] ; Kwang-Seok Hong [Corée du Sud]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2007.
Abstract
Abstract: This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.
Url:
DOI: 10.1007/978-3-540-74819-9_31
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 002870
- to stream Istex, to step Curation: 002870
- to stream Istex, to step Checkpoint: 001661
Links to Exploration step
ISTEX:E10D2759B623E1013FDE3C04DE3218A885A57CB0Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct:series"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title><author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name></author><author><name sortKey="Youn, Jeh Seon" sort="Youn, Jeh Seon" uniqKey="Youn J" first="Jeh-Seon" last="Youn">Jeh-Seon Youn</name></author><author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:E10D2759B623E1013FDE3C04DE3218A885A57CB0</idno><date when="2007" year="2007">2007</date><idno type="doi">10.1007/978-3-540-74819-9_31</idno><idno type="url">https://api.istex.fr/document/E10D2759B623E1013FDE3C04DE3218A885A57CB0/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">002870</idno><idno type="wicri:Area/Istex/Curation">002870</idno><idno type="wicri:Area/Istex/Checkpoint">001661</idno><idno type="wicri:doubleKey">0302-9743:2007:Kim J:toward:a:novel</idno><idno type="wicri:Area/Main/Merge">005684</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title><author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name><affiliation wicri:level="1"><country xml:lang="fr">Corée du Sud</country><wicri:regionArea>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746</wicri:regionArea><wicri:noRegion>440-746</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">États-Unis</country></affiliation></author><author><name sortKey="Youn, Jeh Seon" sort="Youn, Jeh Seon" uniqKey="Youn J" first="Jeh-Seon" last="Youn">Jeh-Seon Youn</name><affiliation wicri:level="1"><country xml:lang="fr">Corée du Sud</country><wicri:regionArea>HCILAB Co., LTD., 235-2, Guro-Dong, Guro-Gu, Seoul, 152-740</wicri:regionArea><wicri:noRegion>152-740</wicri:noRegion></affiliation><affiliation><wicri:noCountry code="no comma">E-mail: sunhci@hotmail.com</wicri:noCountry></affiliation></author><author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name><affiliation wicri:level="1"><country xml:lang="fr">Corée du Sud</country><wicri:regionArea>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746</wicri:regionArea><wicri:noRegion>440-746</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Corée du Sud</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2007</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series><idno type="istex">E10D2759B623E1013FDE3C04DE3218A885A57CB0</idno><idno type="DOI">10.1007/978-3-540-74819-9_31</idno><idno type="ChapterID">31</idno><idno type="ChapterID">Chap31</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.</div></front></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 005684 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 005684 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Main
|étape= Merge
|type= RBID
|clé= ISTEX:E10D2759B623E1013FDE3C04DE3218A885A57CB0
|texte= Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value
}}
| This area was generated with Dilib version V0.6.23. |  |