Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value
Identifieur interne : 002870 ( Istex/Corpus ); précédent : 002869; suivant : 002871Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value
Auteurs : Jung-Hyun Kim ; Jeh-Seon Youn ; Kwang-Seok HongSource :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2007.
Abstract
Abstract: This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.
Url:
DOI: 10.1007/978-3-540-74819-9_31
Links to Exploration step
ISTEX:E10D2759B623E1013FDE3C04DE3218A885A57CB0Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct:series"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title><author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name><affiliation><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: kjh0328@skku.edu</mods:affiliation></affiliation></author><author><name sortKey="Youn, Jeh Seon" sort="Youn, Jeh Seon" uniqKey="Youn J" first="Jeh-Seon" last="Youn">Jeh-Seon Youn</name><affiliation><mods:affiliation>HCILAB Co., LTD., 235-2, Guro-Dong, Guro-Gu, Seoul, 152-740, Korea</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: sunhci@hotmail.com</mods:affiliation></affiliation></author><author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name><affiliation><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: kshong@skku.ac.kr</mods:affiliation></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:E10D2759B623E1013FDE3C04DE3218A885A57CB0</idno><date when="2007" year="2007">2007</date><idno type="doi">10.1007/978-3-540-74819-9_31</idno><idno type="url">https://api.istex.fr/document/E10D2759B623E1013FDE3C04DE3218A885A57CB0/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">002870</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title><author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name><affiliation><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: kjh0328@skku.edu</mods:affiliation></affiliation></author><author><name sortKey="Youn, Jeh Seon" sort="Youn, Jeh Seon" uniqKey="Youn J" first="Jeh-Seon" last="Youn">Jeh-Seon Youn</name><affiliation><mods:affiliation>HCILAB Co., LTD., 235-2, Guro-Dong, Guro-Gu, Seoul, 152-740, Korea</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: sunhci@hotmail.com</mods:affiliation></affiliation></author><author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name><affiliation><mods:affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: kshong@skku.ac.kr</mods:affiliation></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2007</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series><idno type="istex">E10D2759B623E1013FDE3C04DE3218A885A57CB0</idno><idno type="DOI">10.1007/978-3-540-74819-9_31</idno><idno type="ChapterID">31</idno><idno type="ChapterID">Chap31</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.</div></front></TEI><istex><corpusName>springer</corpusName><author><json:item><name>Jung-Hyun Kim</name><affiliations><json:string>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</json:string><json:string>E-mail: kjh0328@skku.edu</json:string></affiliations></json:item><json:item><name>Jeh-Seon Youn</name><affiliations><json:string>HCILAB Co., LTD., 235-2, Guro-Dong, Guro-Gu, Seoul, 152-740, Korea</json:string><json:string>E-mail: sunhci@hotmail.com</json:string></affiliations></json:item><json:item><name>Kwang-Seok Hong</name><affiliations><json:string>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</json:string><json:string>E-mail: kshong@skku.ac.kr</json:string></affiliations></json:item></author><language><json:string>eng</json:string></language><abstract>Abstract: This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.</abstract><qualityIndicators><score>4.125</score><pdfVersion>1.3</pdfVersion><pdfPageSize>430 x 660 pts</pdfPageSize><refBibsNative>false</refBibsNative><keywordCount>0</keywordCount><abstractCharCount>718</abstractCharCount><pdfWordCount>2889</pdfWordCount><pdfCharCount>17404</pdfCharCount><pdfPageCount>8</pdfPageCount><abstractWordCount>103</abstractWordCount></qualityIndicators><title>Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title><chapterId><json:string>31</json:string><json:string>Chap31</json:string></chapterId><serie><volume>I</volume><issn><json:string>0302-9743</json:string></issn><language><json:string>unknown</json:string></language><eissn><json:string>1611-3349</json:string></eissn><title>Lecture Notes in Computer Science</title><copyrightDate>2007</copyrightDate></serie><host><editor><json:item><name>Bruno Apolloni</name></json:item><json:item><name>Robert J. Howlett</name></json:item><json:item><name>Lakhmi Jain</name></json:item></editor><subject><json:item><value>Computer Science</value></json:item><json:item><value>Computer Science</value></json:item><json:item><value>Artificial Intelligence (incl. Robotics)</value></json:item><json:item><value>Information Systems Applications (incl.Internet)</value></json:item><json:item><value>Data Mining and Knowledge Discovery</value></json:item><json:item><value>Computer Appl. in Administrative Data Processing</value></json:item><json:item><value>Computers and Society</value></json:item><json:item><value>Management of Computing and Information Systems</value></json:item></subject><isbn><json:string>978-3-540-74817-5</json:string></isbn><language><json:string>unknown</json:string></language><eissn><json:string>1611-3349</json:string></eissn><title>Knowledge-Based Intelligent Information and Engineering Systems</title><genre.original><json:string>Proceedings</json:string></genre.original><bookId><json:string>978-3-540-74819-9</json:string></bookId><volume>4692</volume><pages><last>253</last><first>246</first></pages><issn><json:string>0302-9743</json:string></issn><genre><json:string>Book Series</json:string></genre><eisbn><json:string>978-3-540-74819-9</json:string></eisbn><copyrightDate>2007</copyrightDate><doi><json:string>10.1007/978-3-540-74819-9</json:string></doi></host><publicationDate>2007</publicationDate><copyrightDate>2007</copyrightDate><doi><json:string>10.1007/978-3-540-74819-9_31</json:string></doi><id>E10D2759B623E1013FDE3C04DE3218A885A57CB0</id><score>1</score><fulltext><json:item><original>true</original><mimetype>application/pdf</mimetype><extension>pdf</extension><uri>https://api.istex.fr/document/E10D2759B623E1013FDE3C04DE3218A885A57CB0/fulltext/pdf</uri></json:item><json:item><original>false</original><mimetype>application/zip</mimetype><extension>zip</extension><uri>https://api.istex.fr/document/E10D2759B623E1013FDE3C04DE3218A885A57CB0/fulltext/zip</uri></json:item><istex:fulltextTEI uri="https://api.istex.fr/document/E10D2759B623E1013FDE3C04DE3218A885A57CB0/fulltext/tei"><teiHeader><fileDesc><titleStmt><title level="a" type="main" xml:lang="en">Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title><respStmt xml:id="ISTEX-API" resp="Références bibliographiques récupérées via GROBID" name="ISTEX-API (INIST-CNRS)"></respStmt></titleStmt><publicationStmt><authority>ISTEX</authority><publisher>Springer Berlin Heidelberg</publisher><pubPlace>Berlin, Heidelberg</pubPlace><availability><p>SPRINGER</p></availability><date>2007</date></publicationStmt><sourceDesc><biblStruct type="inbook"><analytic><title level="a" type="main" xml:lang="en">Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title><author><persName><forename type="first">Jung-Hyun</forename><surname>Kim</surname></persName><email>kjh0328@skku.edu</email><affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</affiliation></author><author><persName><forename type="first">Jeh-Seon</forename><surname>Youn</surname></persName><email>sunhci@hotmail.com</email><affiliation>HCILAB Co., LTD., 235-2, Guro-Dong, Guro-Gu, Seoul, 152-740, Korea</affiliation></author><author><persName><forename type="first">Kwang-Seok</forename><surname>Hong</surname></persName><email>kshong@skku.ac.kr</email><affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</affiliation></author></analytic><monogr><title level="m">Knowledge-Based Intelligent Information and Engineering Systems</title><title level="m" type="sub">11th International Conference, KES 2007, XVII Italian Workshop on Neural Networks, Vietri sul Mare, Italy, September 12-14, 2007. Proceedings, Part I</title><idno type="pISBN">978-3-540-74817-5</idno><idno type="eISBN">978-3-540-74819-9</idno><idno type="pISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="DOI">10.1007/978-3-540-74819-9</idno><idno type="BookID">978-3-540-74819-9</idno><idno type="BookTitleID">152491</idno><idno type="BookSequenceNumber">4692</idno><idno type="BookVolumeNumber">4692</idno><idno type="BookChapterCount">106</idno><editor><persName><forename type="first">Bruno</forename><surname>Apolloni</surname></persName></editor><editor><persName><forename type="first">Robert</forename><forename type="first">J.</forename><surname>Howlett</surname></persName></editor><editor><persName><forename type="first">Lakhmi</forename><surname>Jain</surname></persName></editor><imprint><publisher>Springer Berlin Heidelberg</publisher><pubPlace>Berlin, Heidelberg</pubPlace><date type="published" when="2007"></date><biblScope unit="volume">4692</biblScope><biblScope unit="page" from="246">246</biblScope><biblScope unit="page" to="253">253</biblScope></imprint></monogr><series><title level="s">Lecture Notes in Computer Science</title><biblScope><date>2007</date></biblScope><biblScope unit="volume">I</biblScope><idno type="pISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="seriesId">558</idno></series><series><title level="s">Lecture Notes in Artificial Intelligence</title><editor><persName><forename type="first">Jaime</forename><forename type="first">G.</forename><surname>Carbonell</surname></persName></editor><editor><persName><forename type="first">J\"org</forename><surname>Siekmann</surname></persName></editor><editor><persName><forename type="first">Bruno</forename><surname>Apolloni</surname></persName></editor><editor><persName><forename type="first">Robert</forename><forename type="first">J.</forename><surname>Howlett</surname></persName></editor><editor><persName><forename type="first">Lakhmi</forename><surname>Jain</surname></persName></editor><idno type="pISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><biblScope type="seriesId">1244</biblScope></series><idno type="istex">E10D2759B623E1013FDE3C04DE3218A885A57CB0</idno><idno type="DOI">10.1007/978-3-540-74819-9_31</idno><idno type="ChapterID">31</idno><idno type="ChapterID">Chap31</idno></biblStruct></sourceDesc></fileDesc><profileDesc><creation><date>2007</date></creation><langUsage><language ident="en">en</language></langUsage><abstract xml:lang="en"><p>Abstract: This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.</p></abstract><textClass><keywords scheme="Book Subject Collection"><list><label>SUCO11645</label><item><term>Computer Science</term></item></list></keywords></textClass><textClass><keywords scheme="Book Subject Group"><list><label>I</label><label>I21017</label><label>I18040</label><label>I18030</label><label>I2301X</label><label>I24040</label><label>I24067</label><item><term>Computer Science</term></item><item><term>Artificial Intelligence (incl. Robotics)</term></item><item><term>Information Systems Applications (incl.Internet)</term></item><item><term>Data Mining and Knowledge Discovery</term></item><item><term>Computer Appl. in Administrative Data Processing</term></item><item><term>Computers and Society</term></item><item><term>Management of Computing and Information Systems</term></item></list></keywords></textClass></profileDesc><revisionDesc><change when="2007">Published</change><change xml:id="refBibs-istex" who="#ISTEX-API" when="2016-3-19">References added</change></revisionDesc></teiHeader></istex:fulltextTEI><json:item><original>false</original><mimetype>text/plain</mimetype><extension>txt</extension><uri>https://api.istex.fr/document/E10D2759B623E1013FDE3C04DE3218A885A57CB0/fulltext/txt</uri></json:item></fulltext><metadata><istex:metadataXml wicri:clean="Springer, Publisher found" wicri:toSee="no header"><istex:xmlDeclaration>version="1.0" encoding="UTF-8"</istex:xmlDeclaration><istex:docType PUBLIC="-//Springer-Verlag//DTD A++ V2.4//EN" URI="http://devel.springer.de/A++/V2.4/DTD/A++V2.4.dtd" name="istex:docType"></istex:docType><istex:document><Publisher><PublisherInfo><PublisherName>Springer Berlin Heidelberg</PublisherName><PublisherLocation>Berlin, Heidelberg</PublisherLocation></PublisherInfo><Series><SeriesInfo SeriesType="Series" TocLevels="0"><SeriesID>558</SeriesID><SeriesPrintISSN>0302-9743</SeriesPrintISSN><SeriesElectronicISSN>1611-3349</SeriesElectronicISSN><SeriesTitle Language="En">Lecture Notes in Computer Science</SeriesTitle></SeriesInfo><SubSeries><SubSeriesInfo><SubSeriesID>1244</SubSeriesID><SubSeriesPrintISSN>0302-9743</SubSeriesPrintISSN><SubSeriesElectronicISSN>1611-3349</SubSeriesElectronicISSN><SubSeriesTitle Language="En">Lecture Notes in Artificial Intelligence</SubSeriesTitle></SubSeriesInfo><SubSeriesHeader><EditorGroup><Editor><EditorName DisplayOrder="Western"><GivenName>Jaime</GivenName><GivenName>G.</GivenName><FamilyName>Carbonell</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>J\"org</GivenName><FamilyName>Siekmann</FamilyName></EditorName></Editor></EditorGroup></SubSeriesHeader></SubSeries><Book Language="En"><BookInfo BookProductType="Proceedings" ContainsESM="No" Language="En" MediaType="eBook" NumberingStyle="Unnumbered" OutputMedium="All" TocLevels="0"><BookID>978-3-540-74819-9</BookID><BookTitle>Knowledge-Based Intelligent Information and Engineering Systems</BookTitle><BookSubTitle>11th International Conference, KES 2007, XVII Italian Workshop on Neural Networks, Vietri sul Mare, Italy, September 12-14, 2007. Proceedings, Part I</BookSubTitle><BookVolumeNumber>4692</BookVolumeNumber><BookSequenceNumber>4692</BookSequenceNumber><BookDOI>10.1007/978-3-540-74819-9</BookDOI><BookTitleID>152491</BookTitleID><BookPrintISBN>978-3-540-74817-5</BookPrintISBN><BookElectronicISBN>978-3-540-74819-9</BookElectronicISBN><BookChapterCount>106</BookChapterCount><BookCopyright><CopyrightHolderName>Springer-Verlag Berlin Heidelberg</CopyrightHolderName><CopyrightYear>2007</CopyrightYear></BookCopyright><BookSubjectGroup><BookSubject Code="I" Type="Primary">Computer Science</BookSubject><BookSubject Code="I21017" Priority="1" Type="Secondary">Artificial Intelligence (incl. Robotics)</BookSubject><BookSubject Code="I18040" Priority="2" Type="Secondary">Information Systems Applications (incl.Internet)</BookSubject><BookSubject Code="I18030" Priority="3" Type="Secondary">Data Mining and Knowledge Discovery</BookSubject><BookSubject Code="I2301X" Priority="4" Type="Secondary">Computer Appl. in Administrative Data Processing</BookSubject><BookSubject Code="I24040" Priority="5" Type="Secondary">Computers and Society</BookSubject><BookSubject Code="I24067" Priority="6" Type="Secondary">Management of Computing and Information Systems</BookSubject><SubjectCollection Code="SUCO11645">Computer Science</SubjectCollection></BookSubjectGroup></BookInfo><BookHeader><EditorGroup><Editor><EditorName DisplayOrder="Western"><GivenName>Bruno</GivenName><FamilyName>Apolloni</FamilyName></EditorName><Contact><Email>apolloni@dsi.unimi.it</Email></Contact></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Robert</GivenName><GivenName>J.</GivenName><FamilyName>Howlett</FamilyName></EditorName><Contact><Email>R.J.Howlett@bton.ac.uk</Email></Contact></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Lakhmi</GivenName><FamilyName>Jain</FamilyName></EditorName><Contact><Email>lakhmi.jain@unisa.edu.au</Email></Contact></Editor></EditorGroup></BookHeader><Part ID="Part1"><PartInfo TocLevels="0"><PartID>1</PartID><PartNumber>I</PartNumber><PartSequenceNumber>1</PartSequenceNumber><PartTitle>General Tracks</PartTitle><PartChapterCount>106</PartChapterCount><PartContext><SeriesID>558</SeriesID><BookTitle>Knowledge-Based Intelligent Information and Engineering Systems</BookTitle></PartContext></PartInfo><SubPart ID="SubPart4"><SubPartInfo><SubPartID>4</SubPartID><SubPartSequenceNumber>4</SubPartSequenceNumber><SubPartTitle>Agent Systems</SubPartTitle><SubPartChapterCount>12</SubPartChapterCount></SubPartInfo><Chapter ID="Chap31" Language="En"><ChapterInfo ChapterType="OriginalPaper" ContainsESM="No" NumberingStyle="Unnumbered" TocLevels="0"><ChapterID>31</ChapterID><ChapterDOI>10.1007/978-3-540-74819-9_31</ChapterDOI><ChapterSequenceNumber>31</ChapterSequenceNumber><ChapterTitle Language="En">Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</ChapterTitle><ChapterFirstPage>246</ChapterFirstPage><ChapterLastPage>253</ChapterLastPage><ChapterCopyright><CopyrightHolderName>Springer-Verlag Berlin Heidelberg</CopyrightHolderName><CopyrightYear>2007</CopyrightYear></ChapterCopyright><ChapterGrants Type="Regular"><MetadataGrant Grant="OpenAccess"></MetadataGrant><AbstractGrant Grant="OpenAccess"></AbstractGrant><BodyPDFGrant Grant="Restricted"></BodyPDFGrant><BodyHTMLGrant Grant="Restricted"></BodyHTMLGrant><BibliographyGrant Grant="Restricted"></BibliographyGrant><ESMGrant Grant="Restricted"></ESMGrant></ChapterGrants><ChapterContext><SeriesID>558</SeriesID><PartID>1</PartID><BookID>978-3-540-74819-9</BookID><BookTitle>Knowledge-Based Intelligent Information and Engineering Systems</BookTitle></ChapterContext></ChapterInfo><ChapterHeader><AuthorGroup><Author AffiliationIDS="Aff1"><AuthorName DisplayOrder="Western"><GivenName>Jung-Hyun</GivenName><FamilyName>Kim</FamilyName></AuthorName><Contact><Email>kjh0328@skku.edu</Email><URL>http://hci.skku.ac.kr</URL></Contact></Author><Author AffiliationIDS="Aff2"><AuthorName DisplayOrder="Western"><GivenName>Jeh-Seon</GivenName><FamilyName>Youn</FamilyName></AuthorName><Contact><Email>sunhci@hotmail.com</Email></Contact></Author><Author AffiliationIDS="Aff1"><AuthorName DisplayOrder="Western"><GivenName>Kwang-Seok</GivenName><FamilyName>Hong</FamilyName></AuthorName><Contact><Email>kshong@skku.ac.kr</Email><URL>http://hci.skku.ac.kr</URL></Contact></Author><Affiliation ID="Aff1"><OrgName>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746</OrgName><OrgAddress><Country>Korea</Country></OrgAddress></Affiliation><Affiliation ID="Aff2"><OrgName>HCILAB Co., LTD., 235-2, Guro-Dong, Guro-Gu, Seoul, 152-740</OrgName><OrgAddress><Country>Korea</Country></OrgAddress></Affiliation></AuthorGroup><Abstract ID="Abs1" Language="En"><Heading>Abstract</Heading><Para>This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.</Para></Abstract></ChapterHeader><NoBody></NoBody></Chapter></SubPart></Part></Book></Series></Publisher></istex:document></istex:metadataXml><mods version="3.6"><titleInfo lang="en"><title>Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title></titleInfo><titleInfo type="alternative" contentType="CDATA" lang="en"><title>Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value</title></titleInfo><name type="personal"><namePart type="given">Jung-Hyun</namePart><namePart type="family">Kim</namePart><affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</affiliation><affiliation>E-mail: kjh0328@skku.edu</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Jeh-Seon</namePart><namePart type="family">Youn</namePart><affiliation>HCILAB Co., LTD., 235-2, Guro-Dong, Guro-Gu, Seoul, 152-740, Korea</affiliation><affiliation>E-mail: sunhci@hotmail.com</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Kwang-Seok</namePart><namePart type="family">Hong</namePart><affiliation>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, 440-746, Korea</affiliation><affiliation>E-mail: kshong@skku.ac.kr</affiliation><role><roleTerm type="text">author</roleTerm></role></name><typeOfResource>text</typeOfResource><originInfo><publisher>Springer Berlin Heidelberg</publisher><place><placeTerm type="text">Berlin, Heidelberg</placeTerm></place><dateIssued encoding="w3cdtf">2007</dateIssued><copyrightDate encoding="w3cdtf">2007</copyrightDate></originInfo><language><languageTerm type="code" authority="rfc3066">en</languageTerm><languageTerm type="code" authority="iso639-2b">eng</languageTerm></language><physicalDescription><internetMediaType>text/html</internetMediaType></physicalDescription><abstract lang="en">Abstract: This paper describes a wireless PDA-based Multi-Modal Interaction Architecture (hereinafter, MMIA) fusing 3 sensory channels, which are a detachable stylus that can be used on the touch screen by coupling embedded speech and KSSL recognizer. The MMIA fuses and recognizes 15 word-based instruction models that are represented by stylus (or touching), speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. The experimental results, each average recognition rate for the MMIA fusing 3 sensory channels was 95.73% in clean environments, and 93.29% was shown in noisy environments.</abstract><relatedItem type="host"><titleInfo><title>Knowledge-Based Intelligent Information and Engineering Systems</title><subTitle>11th International Conference, KES 2007, XVII Italian Workshop on Neural Networks, Vietri sul Mare, Italy, September 12-14, 2007. Proceedings, Part I</subTitle></titleInfo><name type="personal"><namePart type="given">Bruno</namePart><namePart type="family">Apolloni</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Robert</namePart><namePart type="given">J.</namePart><namePart type="family">Howlett</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Lakhmi</namePart><namePart type="family">Jain</namePart><role><roleTerm type="text">editor</roleTerm></role></name><genre type="Book Series" displayLabel="Proceedings"></genre><originInfo><copyrightDate encoding="w3cdtf">2007</copyrightDate><issuance>monographic</issuance></originInfo><subject><genre>Book Subject Collection</genre><topic authority="SpringerSubjectCodes" authorityURI="SUCO11645">Computer Science</topic></subject><subject><genre>Book Subject Group</genre><topic authority="SpringerSubjectCodes" authorityURI="I">Computer Science</topic><topic authority="SpringerSubjectCodes" authorityURI="I21017">Artificial Intelligence (incl. Robotics)</topic><topic authority="SpringerSubjectCodes" authorityURI="I18040">Information Systems Applications (incl.Internet)</topic><topic authority="SpringerSubjectCodes" authorityURI="I18030">Data Mining and Knowledge Discovery</topic><topic authority="SpringerSubjectCodes" authorityURI="I2301X">Computer Appl. in Administrative Data Processing</topic><topic authority="SpringerSubjectCodes" authorityURI="I24040">Computers and Society</topic><topic authority="SpringerSubjectCodes" authorityURI="I24067">Management of Computing and Information Systems</topic></subject><identifier type="DOI">10.1007/978-3-540-74819-9</identifier><identifier type="ISBN">978-3-540-74817-5</identifier><identifier type="eISBN">978-3-540-74819-9</identifier><identifier type="ISSN">0302-9743</identifier><identifier type="eISSN">1611-3349</identifier><identifier type="BookTitleID">152491</identifier><identifier type="BookID">978-3-540-74819-9</identifier><identifier type="BookChapterCount">106</identifier><identifier type="BookVolumeNumber">4692</identifier><identifier type="BookSequenceNumber">4692</identifier><identifier type="PartChapterCount">106</identifier><part><date>2007</date><detail type="part"><title>I: General Tracks</title></detail><detail type="volume"><number>4692</number><caption>vol.</caption></detail><extent unit="pages"><start>246</start><end>253</end></extent></part><recordInfo><recordOrigin>Springer-Verlag Berlin Heidelberg, 2007</recordOrigin></recordInfo></relatedItem><relatedItem type="series"><titleInfo><title>Lecture Notes in Computer Science</title></titleInfo><originInfo><copyrightDate encoding="w3cdtf">2007</copyrightDate><issuance>serial</issuance></originInfo><relatedItem type="constituent"><titleInfo><title>Lecture Notes in Artificial Intelligence</title></titleInfo><name type="personal"><namePart type="given">Jaime</namePart><namePart type="given">G.</namePart><namePart type="family">Carbonell</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">J\"org</namePart><namePart type="family">Siekmann</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Bruno</namePart><namePart type="family">Apolloni</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Robert</namePart><namePart type="given">J.</namePart><namePart type="family">Howlett</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Lakhmi</namePart><namePart type="family">Jain</namePart><role><roleTerm type="text">editor</roleTerm></role></name><genre type="Sub-Series"></genre><identifier type="ISSN">0302-9743</identifier><identifier type="eISSN">1611-3349</identifier><identifier type="SubSeriesID">1244</identifier></relatedItem><identifier type="ISSN">0302-9743</identifier><identifier type="eISSN">1611-3349</identifier><identifier type="SeriesID">558</identifier><part><detail type="volume"><number>I</number><caption>vol.</caption></detail></part><recordInfo><recordOrigin>Springer-Verlag Berlin Heidelberg, 2007</recordOrigin></recordInfo></relatedItem><identifier type="istex">E10D2759B623E1013FDE3C04DE3218A885A57CB0</identifier><identifier type="DOI">10.1007/978-3-540-74819-9_31</identifier><identifier type="ChapterID">31</identifier><identifier type="ChapterID">Chap31</identifier><accessCondition type="use and reproduction" contentType="copyright">Springer-Verlag Berlin Heidelberg, 2007</accessCondition><recordInfo><recordContentSource>SPRINGER</recordContentSource><recordOrigin>Springer-Verlag Berlin Heidelberg, 2007</recordOrigin></recordInfo></mods></metadata><enrichments><istex:refBibTEI uri="https://api.istex.fr/document/E10D2759B623E1013FDE3C04DE3218A885A57CB0/enrichments/refBib"><teiHeader></teiHeader><text><front></front><body></body><back><listBibl><biblStruct xml:id="b0"><analytic><title level="a" type="main">A brief history of human-computer interaction technology</title><author><persName><forename type="first">B</forename><forename type="middle">A</forename><surname>Myers</surname></persName></author></analytic><monogr><title level="j">Interactions. ACM Press</title><imprint><biblScope unit="volume">5</biblScope><biblScope unit="issue">2</biblScope><biblScope unit="page" from="44" to="54"></biblScope><date type="published" when="1998"></date></imprint></monogr></biblStruct><biblStruct xml:id="b1"><monogr><title level="m" type="main">Handbook for Human Computer Interaction</title><author><persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Jacko</surname></persName></author><imprint><date type="published" when="2003"></date><publisher>Lawrence Erlbaum & Associates</publisher><pubPlace>Mahwah</pubPlace></imprint></monogr></biblStruct><biblStruct xml:id="b2"><analytic><title level="a" type="main">Intelligent agents: Theory and practice</title><author><persName><forename type="first">M</forename><forename type="middle">J</forename><surname>Wooldridge</surname></persName></author><author><persName><forename type="first">N</forename><forename type="middle">R</forename><surname>Jennings</surname></persName></author></analytic><monogr><title level="j">Know. Eng. Review</title><imprint><biblScope unit="volume">10</biblScope><biblScope unit="issue">2</biblScope><biblScope unit="page" from="115" to="152"></biblScope><date type="published" when="1995"></date></imprint></monogr></biblStruct><biblStruct xml:id="b3"><monogr><title level="m" type="main">Multi-Touch Systems that I Have Known and Loved, Microsoft Re- search</title><author><persName><forename type="first">B</forename><surname>Buxton</surname></persName></author><imprint><date type="published" when="2007"></date></imprint></monogr></biblStruct><biblStruct xml:id="b4"><analytic><title level="a" type="main">Architecture of Multi-modal Dialogue System</title><author><persName><forename type="first">P</forename><forename type="middle">M</forename><surname>Fuchs</surname></persName></author></analytic><monogr><title level="m">TSD 2000</title><editor>Sojka, P., Kopeček, I., Pala, K.</editor><meeting><address><addrLine>Heidelberg</addrLine></address></meeting><imprint><publisher>Springer</publisher><date type="published" when="2000"></date><biblScope unit="page" from="433" to="438"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b5"><analytic><title level="a" type="main">When it Gets More Difficult, Use BothHhands -Exploring Bimanual Curve Manipulation</title><author><persName><forename type="first">R</forename><surname>Owen</surname></persName></author></analytic><monogr><title level="m">Proc. Graphics Interface, GI'05</title><meeting>. Graphics Interface, GI'05</meeting><imprint><date type="published" when="2005"></date><biblScope unit="page" from="17" to="24"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b6"><monogr><title level="m" type="main">Korean Standard Sign Language Tutor, 1st edn</title><author><persName><forename type="first">S.-G</forename><surname>Kim</surname></persName></author><imprint><date type="published" when="2000"></date><publisher>Osung Publishing Company</publisher><pubPlace>Seoul</pubPlace></imprint></monogr></biblStruct><biblStruct xml:id="b7"><analytic><title level="a" type="main">Hand Gesture Recognition System using Fuzzy Algorithm and RDBMS for Post PC</title><author><persName><forename type="first">J.-H</forename><surname>Kim</surname></persName></author></analytic><monogr><title level="m">FSKD 2005</title><editor>Wang, L., Jin, Y.</editor><meeting><address><addrLine>Heidelberg</addrLine></address></meeting><imprint><publisher>Springer</publisher><date type="published" when="2005"></date><biblScope unit="page" from="170" to="175"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b8"><analytic><title level="a" type="main">An Implementation of KSSL Recognizer for HCI Based on Post Wearable PC and Wireless Networks</title><author><persName><forename type="first">J.-H</forename><surname>Kim</surname></persName></author></analytic><monogr><title level="m">KES 2006</title><editor>Gabrys, B., Howlett, R.J., Jain, L.C.</editor><meeting><address><addrLine>Heidelberg</addrLine></address></meeting><imprint><publisher>Springer</publisher><date type="published" when="2006"></date></imprint></monogr></biblStruct><biblStruct xml:id="b9"><monogr><title level="m" type="main">Smaranda Fuzzy Algebra</title><author><persName><forename type="first">W</forename><forename type="middle">B V</forename><surname>Kandasamy</surname></persName></author><imprint><date type="published" when="2003"></date><publisher>American Research Press</publisher><pubPlace>Seattle</pubPlace></imprint></monogr></biblStruct><biblStruct xml:id="b10"><monogr><title level="m" type="main">Digital Signal Processing: A Computer Science Perspective</title><author><persName><forename type="first">J</forename><forename type="middle">Y</forename><surname>Stein</surname></persName></author><imprint><date type="published" when="2000"></date><publisher>John Wiley & Sons</publisher><pubPlace>Chichester</pubPlace></imprint></monogr></biblStruct></listBibl></back></text></istex:refBibTEI></enrichments></istex></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Istex/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002870 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Corpus/biblio.hfd -nk 002870 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Istex
|étape= Corpus
|type= RBID
|clé= ISTEX:E10D2759B623E1013FDE3C04DE3218A885A57CB0
|texte= Toward a Novel Multi-modal HCI: Fusion Architecture Using Confidence Score and Fuzzy Value
}}
| This area was generated with Dilib version V0.6.23. |  |