Multimodal Designation : Experimental Data on User Strategies
Identifieur interne : 00DD33 ( Main/Merge ); précédent : 00DD32; suivant : 00DD34Multimodal Designation : Experimental Data on User Strategies
Auteurs : N. Carbonell ; Jean-Marie Pierrel [France]Source :
Abstract
We have designed an experiment on the `Wizard of Oz' paradigm. Ten subjects interacted with various standard applications (MacDraw, Word,...) through a dialogue interface which includes\, : \begin{itemize} \item[-]software driven keyboard and graphical display \item[-]simulated speech input and output \item[-]a touch panel (for 2xD selection and drawing) with additional simulated functions. \end{itemize} Experimental results are discussed with respect to the following issues\, : \begin {itemize} \item[-]to what extend does multimodality influence user designation strategies ? Does speech play as prominent a role here as in human dialogue ? Is anaphora used as frequently ?... \item[-]How do subjects combine speech and pointing (concurrently or sequentially) ? Do they associate deictics with gestures ? Or do they replace words such as ``her{e}'', ``this'', etc., by pointing ? \item[-]At which level should incoming information from various modes be synchronized and merged ? What form and granularity should be resulting unified representation take ? \item[-]Are current models of linguistic reference mechanisms (cf. for instance, Sidner's and Grosz's models) applicable in a multimodal human-computer environment despite their known limitations ? \end{itemize}
Links toward previous steps (curation, corpus...)
- to stream Crin, to step Corpus: 000F16
- to stream Crin, to step Curation: 000F16
- to stream Crin, to step Checkpoint: 003713
Links to Exploration step
CRIN:carbonell92aLe document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" wicri:score="274">Multimodal Designation : Experimental Data on User Strategies</title></titleStmt><publicationStmt><idno type="RBID">CRIN:carbonell92a</idno><date when="1992" year="1992">1992</date><idno type="wicri:Area/Crin/Corpus">000F16</idno><idno type="wicri:Area/Crin/Curation">000F16</idno><idno type="wicri:explorRef" wicri:stream="Crin" wicri:step="Curation">000F16</idno><idno type="wicri:Area/Crin/Checkpoint">003713</idno><idno type="wicri:explorRef" wicri:stream="Crin" wicri:step="Checkpoint">003713</idno><idno type="wicri:Area/Main/Merge">00DD33</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Multimodal Designation : Experimental Data on User Strategies</title><author><name sortKey="Carbonell, N" sort="Carbonell, N" uniqKey="Carbonell N" first="N." last="Carbonell">N. Carbonell</name></author><author><name sortKey="Pierrel, J M" sort="Pierrel, J M" uniqKey="Pierrel J" first="J.-M." last="Pierrel">Jean-Marie Pierrel</name><affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><region type="region" nuts="2">Grand Est</region><region type="region" nuts="2">Lorraine (région)</region></placeName><orgName type="laboratoire" n="5">Laboratoire lorrain de recherche en informatique et ses applications</orgName><orgName type="university">Université de Lorraine</orgName><orgName type="institution">Centre national de la recherche scientifique</orgName><orgName type="institution">Institut national de recherche en informatique et en automatique</orgName></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en" wicri:score="2997">We have designed an experiment on the `Wizard of Oz' paradigm. Ten subjects interacted with various standard applications (MacDraw, Word,...) through a dialogue interface which includes\, : \begin{itemize} \item[-]software driven keyboard and graphical display \item[-]simulated speech input and output \item[-]a touch panel (for 2xD selection and drawing) with additional simulated functions. \end{itemize} Experimental results are discussed with respect to the following issues\, : \begin {itemize} \item[-]to what extend does multimodality influence user designation strategies ? Does speech play as prominent a role here as in human dialogue ? Is anaphora used as frequently ?... \item[-]How do subjects combine speech and pointing (concurrently or sequentially) ? Do they associate deictics with gestures ? Or do they replace words such as ``her{e}'', ``this'', etc., by pointing ? \item[-]At which level should incoming information from various modes be synchronized and merged ? What form and granularity should be resulting unified representation take ? \item[-]Are current models of linguistic reference mechanisms (cf. for instance, Sidner's and Grosz's models) applicable in a multimodal human-computer environment despite their known limitations ? \end{itemize}</div></front></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 00DD33 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 00DD33 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Main
|étape= Merge
|type= RBID
|clé= CRIN:carbonell92a
|texte= Multimodal Designation : Experimental Data on User Strategies
}}
| This area was generated with Dilib version V0.6.33. |  |