HapticV1, Main, Merge, bibRecord, 006322

MMSDS : Ubiquitous computing and WWW-based multi-modal sentential dialog system

Identifieur interne : 006322 ( Main/Merge ); précédent : 006321; suivant : 006323

MMSDS : Ubiquitous computing and WWW-based multi-modal sentential dialog system

Auteurs : Jung-Hyun Kim [Corée du Sud] ; Kwang-Seok Hong [Corée du Sud]

Source :

Lecture notes in computer science [ 0302-9743 ] ; 2006.

RBID : Pascal:08-0009649

Descripteurs français

Pascal (Inist)
- Calculateur embarqué, Système réparti, Informatique diffuse, Système conversationnel, Interface utilisateur, Education, Langage gestuel, Synthèse parole, Temps réel, Mobilité, Informatique mobile, Sensibilité tactile, Trouble de l'audition, Coréen, Personnalisation, Besoin de l'utilisateur, Modélisation, ..

English descriptors

KwdEn :
- Auditory disorder, Boarded computer, Customization, Distributed system, Education, Interactive system, Korean, Mobile computing, Mobility, Modeling, Pervasive computing, Real time, Sign language, Speech synthesis, Tactile sensitivity, User interface, User need.

Abstract

In this study, we suggest and implement Multi-Modal Sentential Dialog System (MMSDS) integrating 2 sensory channels with speech and haptic information based on ubiquitous computing and WWW for clear communication. The importance and necessity of MMSDS for HCI as following: 1) it can allow more interactive and natural communication functions between the hearing-impaired and hearing person without special learning and education, 2) according as it recognizes a sentential Korean Standard Sign Language (KSSL) which is represented with speech and haptics and then translates recognition results into a synthetic speech and visual illustration in real-time, it may provide a wider range of personalized and differentiated information more effectively to them, and 3) above all things, a user need not be constrained by the limitations of a particular interaction mode at any given moment because it can guarantee mobility of WPS (Wearable Personal Station for the post PC) with a built-in sentential sign language recognizer. In experiment results, while an average recognition rate of uni-modal recognizer using KSSL only is 93.1% and speech only is 95.5%, advanced MMSDS deduced an average recognition rate of 96.1% for 32 sentential KSSL recognition models.

Links toward previous steps (curation, corpus...)

to stream PascalFrancis, to step Corpus: 000A30
to stream PascalFrancis, to step Curation: 000A31
to stream PascalFrancis, to step Checkpoint: 000965

Links to Exploration step

Pascal:08-0009649

Le document en format XML

<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" level="a">MMSDS : Ubiquitous computing and WWW-based multi-modal sentential dialog system</title>
<author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name>
<affiliation wicri:level="1"><inist:fA14 i1="01"><s1>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu</s1>
<s2>Suwon, KyungKi-do, 440-746</s2>
<s3>KOR</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
</inist:fA14>
<country>Corée du Sud</country>
<wicri:noRegion>Suwon, KyungKi-do, 440-746</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name>
<affiliation wicri:level="1"><inist:fA14 i1="01"><s1>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu</s1>
<s2>Suwon, KyungKi-do, 440-746</s2>
<s3>KOR</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
</inist:fA14>
<country>Corée du Sud</country>
<wicri:noRegion>Suwon, KyungKi-do, 440-746</wicri:noRegion>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">INIST</idno>
<idno type="inist">08-0009649</idno>
<date when="2006">2006</date>
<idno type="stanalyst">PASCAL 08-0009649 INIST</idno>
<idno type="RBID">Pascal:08-0009649</idno>
<idno type="wicri:Area/PascalFrancis/Corpus">000A30</idno>
<idno type="wicri:Area/PascalFrancis/Curation">000A31</idno>
<idno type="wicri:Area/PascalFrancis/Checkpoint">000965</idno>
<idno type="wicri:doubleKey">0302-9743:2006:Kim J:mmsds:ubiquitous:computing</idno>
<idno type="wicri:Area/Main/Merge">006322</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a">MMSDS : Ubiquitous computing and WWW-based multi-modal sentential dialog system</title>
<author><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name>
<affiliation wicri:level="1"><inist:fA14 i1="01"><s1>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu</s1>
<s2>Suwon, KyungKi-do, 440-746</s2>
<s3>KOR</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
</inist:fA14>
<country>Corée du Sud</country>
<wicri:noRegion>Suwon, KyungKi-do, 440-746</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name>
<affiliation wicri:level="1"><inist:fA14 i1="01"><s1>School of Information and Communication Engineering, Sungkyunkwan University, 300, Chunchun-dong, Jangan-gu</s1>
<s2>Suwon, KyungKi-do, 440-746</s2>
<s3>KOR</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
</inist:fA14>
<country>Corée du Sud</country>
<wicri:noRegion>Suwon, KyungKi-do, 440-746</wicri:noRegion>
</affiliation>
</author>
</analytic>
<series><title level="j" type="main">Lecture notes in computer science</title>
<idno type="ISSN">0302-9743</idno>
<imprint><date when="2006">2006</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
<seriesStmt><title level="j" type="main">Lecture notes in computer science</title>
<idno type="ISSN">0302-9743</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Auditory disorder</term>
<term>Boarded computer</term>
<term>Customization</term>
<term>Distributed system</term>
<term>Education</term>
<term>Interactive system</term>
<term>Korean</term>
<term>Mobile computing</term>
<term>Mobility</term>
<term>Modeling</term>
<term>Pervasive computing</term>
<term>Real time</term>
<term>Sign language</term>
<term>Speech synthesis</term>
<term>Tactile sensitivity</term>
<term>User interface</term>
<term>User need</term>
</keywords>
<keywords scheme="Pascal" xml:lang="fr"><term>Calculateur embarqué</term>
<term>Système réparti</term>
<term>Informatique diffuse</term>
<term>Système conversationnel</term>
<term>Interface utilisateur</term>
<term>Education</term>
<term>Langage gestuel</term>
<term>Synthèse parole</term>
<term>Temps réel</term>
<term>Mobilité</term>
<term>Informatique mobile</term>
<term>Sensibilité tactile</term>
<term>Trouble de l'audition</term>
<term>Coréen</term>
<term>Personnalisation</term>
<term>Besoin de l'utilisateur</term>
<term>Modélisation</term>
<term>.</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">In this study, we suggest and implement Multi-Modal Sentential Dialog System (MMSDS) integrating 2 sensory channels with speech and haptic information based on ubiquitous computing and WWW for clear communication. The importance and necessity of MMSDS for HCI as following: 1) it can allow more interactive and natural communication functions between the hearing-impaired and hearing person without special learning and education, 2) according as it recognizes a sentential Korean Standard Sign Language (KSSL) which is represented with speech and haptics and then translates recognition results into a synthetic speech and visual illustration in real-time, it may provide a wider range of personalized and differentiated information more effectively to them, and 3) above all things, a user need not be constrained by the limitations of a particular interaction mode at any given moment because it can guarantee mobility of WPS (Wearable Personal Station for the post PC) with a built-in sentential sign language recognizer. In experiment results, while an average recognition rate of uni-modal recognizer using KSSL only is 93.1% and speech only is 95.5%, advanced MMSDS deduced an average recognition rate of 96.1% for 32 sentential KSSL recognition models.</div>
</front>
</TEI>
<affiliations><list><country><li>Corée du Sud</li>
</country>
</list>
<tree><country name="Corée du Sud"><noRegion><name sortKey="Kim, Jung Hyun" sort="Kim, Jung Hyun" uniqKey="Kim J" first="Jung-Hyun" last="Kim">Jung-Hyun Kim</name>
</noRegion>
<name sortKey="Hong, Kwang Seok" sort="Hong, Kwang Seok" uniqKey="Hong K" first="Kwang-Seok" last="Hong">Kwang-Seok Hong</name>
</country>
</tree>
</affiliations>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Merge

HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 006322 | SxmlIndent | more

HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 006322 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Ticri/CIDE
   |area=    HapticV1
   |flux=    Main
   |étape=   Merge
   |type=    RBID
   |clé=     Pascal:08-0009649
   |texte=   MMSDS : Ubiquitous computing and WWW-based multi-modal sentential dialog system
}}

This area was generated with Dilib version V0.6.23.
Data generation: Mon Jun 13 01:09:46 2016. Site generation: Wed Mar 6 09:54:07 2024

	Serveur d'exploration sur les dispositifs haptiques
	Attention, ce site est en cours de développement ! Attention, site généré par des moyens informatiques à partir de corpus bruts. Les informations ne sont donc pas validées.

Serveur d'exploration sur les dispositifs haptiques

MMSDS : Ubiquitous computing and WWW-based multi-modal sentential dialog system

MMSDS : Ubiquitous computing and WWW-based multi-modal sentential dialog system

Source :

Descripteurs français

English descriptors

Abstract

Links toward previous steps (curation, corpus...)

Links to Exploration step

Le document en format XML

Pour manipuler ce document sous Unix (Dilib)

Pour mettre un lien sur cette page dans le réseau Wicri