Dialogue History Modelling for Multimodal Human-Computer Interaction
Identifieur interne : 006894 ( Main/Exploration ); précédent : 006893; suivant : 006895Dialogue History Modelling for Multimodal Human-Computer Interaction
Auteurs : Frédéric Landragin ; Laurent RomarySource :
English descriptors
Abstract
The design of multimodal dialogue systems requires a particular attention on the way of managing heterogeneous information. We present a theoretical model of a multimodal dialogue history, that includes a global history and local histories linked to the various modalities. We describe the nature of these components and the relations they entertain. To save the information and to exploit and confront them during the interpretation of an utterance from the user, we need an unified representation format. We developed the MMIL (MultiModal Interface Language) model that we present here with two aspects : the representation of a simple utterance and the representation of a dialogue structure. Then, we draw some conclusions concerning the exploitation of this framework in the OZONE system, with an interest on the management of attentional scores inside the dialogue history.
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Crin, to step Corpus: 003D83
- to stream Crin, to step Curation: 003D83
- to stream Crin, to step Checkpoint: 000722
- to stream Main, to step Merge: 006B97
- to stream Main, to step Curation: 006894
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" wicri:score="381">Dialogue History Modelling for Multimodal Human-Computer Interaction</title></titleStmt><publicationStmt><idno type="RBID">CRIN:landragin04d</idno><date when="2004" year="2004">2004</date><idno type="wicri:Area/Crin/Corpus">003D83</idno><idno type="wicri:Area/Crin/Curation">003D83</idno><idno type="wicri:explorRef" wicri:stream="Crin" wicri:step="Curation">003D83</idno><idno type="wicri:Area/Crin/Checkpoint">000722</idno><idno type="wicri:explorRef" wicri:stream="Crin" wicri:step="Checkpoint">000722</idno><idno type="wicri:Area/Main/Merge">006B97</idno><idno type="wicri:Area/Main/Curation">006894</idno><idno type="wicri:Area/Main/Exploration">006894</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Dialogue History Modelling for Multimodal Human-Computer Interaction</title><author><name sortKey="Landragin, Frederic" sort="Landragin, Frederic" uniqKey="Landragin F" first="Frédéric" last="Landragin">Frédéric Landragin</name></author><author><name sortKey="Romary, Laurent" sort="Romary, Laurent" uniqKey="Romary L" first="Laurent" last="Romary">Laurent Romary</name></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>dialogue system</term><term>information representation</term><term>multimodality</term><term>semantic content</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en" wicri:score="2886">The design of multimodal dialogue systems requires a particular attention on the way of managing heterogeneous information. We present a theoretical model of a multimodal dialogue history, that includes a global history and local histories linked to the various modalities. We describe the nature of these components and the relations they entertain. To save the information and to exploit and confront them during the interpretation of an utterance from the user, we need an unified representation format. We developed the MMIL (MultiModal Interface Language) model that we present here with two aspects : the representation of a simple utterance and the representation of a dialogue structure. Then, we draw some conclusions concerning the exploitation of this framework in the OZONE system, with an interest on the management of attentional scores inside the dialogue history.</div></front></TEI><affiliations><list></list><tree><noCountry><name sortKey="Landragin, Frederic" sort="Landragin, Frederic" uniqKey="Landragin F" first="Frédéric" last="Landragin">Frédéric Landragin</name><name sortKey="Romary, Laurent" sort="Romary, Laurent" uniqKey="Romary L" first="Laurent" last="Romary">Laurent Romary</name></noCountry></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 006894 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 006894 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Main
|étape= Exploration
|type= RBID
|clé= CRIN:landragin04d
|texte= Dialogue History Modelling for Multimodal Human-Computer Interaction
}}
| This area was generated with Dilib version V0.6.33. |  |