Multimodal feedback: an assessment of performance and mental workload
Identifieur interne : 001205 ( PascalFrancis/Corpus ); précédent : 001204; suivant : 001206Multimodal feedback: an assessment of performance and mental workload
Auteurs : H. S. Vitense ; J. A. Jacko ; V. K. EmerySource :
- Ergonomics [ 0014-0139 ] ; 2003.
Descripteurs français
- Pascal (Inist)
English descriptors
- KwdEn :
Abstract
Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.
Notice en format standard (ISO 2709)
Pour connaître la documentation sur le format Inist Standard.
pA |
|
---|
Format Inist (serveur)
NO : | PASCAL 03-0083024 INIST |
---|---|
ET : | Multimodal feedback: an assessment of performance and mental workload |
AU : | VITENSE (H. S.); JACKO (J. A.); EMERY (V. K.) |
AF : | Medtronic, 7000 Central Avenue N.E., B173/Minneapolis, MN 55432/Etats-Unis (1 aut.); School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive/Atlanta, GA 30332-0205/Etats-Unis (2 aut., 3 aut.) |
DT : | Publication en série; Niveau analytique |
SO : | Ergonomics; ISSN 0014-0139; Coden ERGOAX; Royaume-Uni; Da. 2003; Vol. 46; No. 1-3; Pp. 68-87; Bibl. 2 p.1/4 |
LA : | Anglais |
EA : | Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand. |
CC : | 002A26L07 |
FD : | Interface multimodale; Rétroaction; Charge mentale; Charge travail; Interaction; Système homme machine; Ordinateur; Relation homme machine; Performance; Utilisateur; Recommandation; Homme |
ED : | Multimodal interface; Feedback regulation; Mental load; Workload; Interaction; Man machine system; Computer; Man machine relation; Performance; User; Recommendation; Human |
SD : | Interfaz multimodal; Retroacción; Carga mental; Carga trabajo; Interacción; Sistema hombre máquina; Computadora; Relación hombre máquina; Rendimiento; Usuario; Recomendación; Hombre |
LO : | INIST-9268.354000103616740050 |
ID : | 03-0083024 |
Links to Exploration step
Pascal:03-0083024Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" level="a">Multimodal feedback: an assessment of performance and mental workload</title>
<author><name sortKey="Vitense, H S" sort="Vitense, H S" uniqKey="Vitense H" first="H. S." last="Vitense">H. S. Vitense</name>
<affiliation><inist:fA14 i1="01"><s1>Medtronic, 7000 Central Avenue N.E., B173</s1>
<s2>Minneapolis, MN 55432</s2>
<s3>USA</s3>
<sZ>1 aut.</sZ>
</inist:fA14>
</affiliation>
</author>
<author><name sortKey="Jacko, J A" sort="Jacko, J A" uniqKey="Jacko J" first="J. A." last="Jacko">J. A. Jacko</name>
<affiliation><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
</affiliation>
</author>
<author><name sortKey="Emery, V K" sort="Emery, V K" uniqKey="Emery V" first="V. K." last="Emery">V. K. Emery</name>
<affiliation><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">INIST</idno>
<idno type="inist">03-0083024</idno>
<date when="2003">2003</date>
<idno type="stanalyst">PASCAL 03-0083024 INIST</idno>
<idno type="RBID">Pascal:03-0083024</idno>
<idno type="wicri:Area/PascalFrancis/Corpus">001205</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a">Multimodal feedback: an assessment of performance and mental workload</title>
<author><name sortKey="Vitense, H S" sort="Vitense, H S" uniqKey="Vitense H" first="H. S." last="Vitense">H. S. Vitense</name>
<affiliation><inist:fA14 i1="01"><s1>Medtronic, 7000 Central Avenue N.E., B173</s1>
<s2>Minneapolis, MN 55432</s2>
<s3>USA</s3>
<sZ>1 aut.</sZ>
</inist:fA14>
</affiliation>
</author>
<author><name sortKey="Jacko, J A" sort="Jacko, J A" uniqKey="Jacko J" first="J. A." last="Jacko">J. A. Jacko</name>
<affiliation><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
</affiliation>
</author>
<author><name sortKey="Emery, V K" sort="Emery, V K" uniqKey="Emery V" first="V. K." last="Emery">V. K. Emery</name>
<affiliation><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
</affiliation>
</author>
</analytic>
<series><title level="j" type="main">Ergonomics</title>
<title level="j" type="abbreviated">Ergonomics</title>
<idno type="ISSN">0014-0139</idno>
<imprint><date when="2003">2003</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
<seriesStmt><title level="j" type="main">Ergonomics</title>
<title level="j" type="abbreviated">Ergonomics</title>
<idno type="ISSN">0014-0139</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Computer</term>
<term>Feedback regulation</term>
<term>Human</term>
<term>Interaction</term>
<term>Man machine relation</term>
<term>Man machine system</term>
<term>Mental load</term>
<term>Multimodal interface</term>
<term>Performance</term>
<term>Recommendation</term>
<term>User</term>
<term>Workload</term>
</keywords>
<keywords scheme="Pascal" xml:lang="fr"><term>Interface multimodale</term>
<term>Rétroaction</term>
<term>Charge mentale</term>
<term>Charge travail</term>
<term>Interaction</term>
<term>Système homme machine</term>
<term>Ordinateur</term>
<term>Relation homme machine</term>
<term>Performance</term>
<term>Utilisateur</term>
<term>Recommandation</term>
<term>Homme</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.</div>
</front>
</TEI>
<inist><standard h6="B"><pA><fA01 i1="01" i2="1"><s0>0014-0139</s0>
</fA01>
<fA02 i1="01"><s0>ERGOAX</s0>
</fA02>
<fA03 i2="1"><s0>Ergonomics</s0>
</fA03>
<fA05><s2>46</s2>
</fA05>
<fA06><s2>1-3</s2>
</fA06>
<fA08 i1="01" i2="1" l="ENG"><s1>Multimodal feedback: an assessment of performance and mental workload</s1>
</fA08>
<fA11 i1="01" i2="1"><s1>VITENSE (H. S.)</s1>
</fA11>
<fA11 i1="02" i2="1"><s1>JACKO (J. A.)</s1>
</fA11>
<fA11 i1="03" i2="1"><s1>EMERY (V. K.)</s1>
</fA11>
<fA14 i1="01"><s1>Medtronic, 7000 Central Avenue N.E., B173</s1>
<s2>Minneapolis, MN 55432</s2>
<s3>USA</s3>
<sZ>1 aut.</sZ>
</fA14>
<fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</fA14>
<fA20><s1>68-87</s1>
</fA20>
<fA21><s1>2003</s1>
</fA21>
<fA23 i1="01"><s0>ENG</s0>
</fA23>
<fA43 i1="01"><s1>INIST</s1>
<s2>9268</s2>
<s5>354000103616740050</s5>
</fA43>
<fA44><s0>0000</s0>
<s1>© 2003 INIST-CNRS. All rights reserved.</s1>
</fA44>
<fA45><s0>2 p.1/4</s0>
</fA45>
<fA47 i1="01" i2="1"><s0>03-0083024</s0>
</fA47>
<fA60><s1>P</s1>
</fA60>
<fA61><s0>A</s0>
</fA61>
<fA64 i1="01" i2="1"><s0>Ergonomics</s0>
</fA64>
<fA66 i1="01"><s0>GBR</s0>
</fA66>
<fC01 i1="01" l="ENG"><s0>Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.</s0>
</fC01>
<fC02 i1="01" i2="X"><s0>002A26L07</s0>
</fC02>
<fC03 i1="01" i2="X" l="FRE"><s0>Interface multimodale</s0>
<s5>01</s5>
</fC03>
<fC03 i1="01" i2="X" l="ENG"><s0>Multimodal interface</s0>
<s5>01</s5>
</fC03>
<fC03 i1="01" i2="X" l="SPA"><s0>Interfaz multimodal</s0>
<s5>01</s5>
</fC03>
<fC03 i1="02" i2="X" l="FRE"><s0>Rétroaction</s0>
<s5>02</s5>
</fC03>
<fC03 i1="02" i2="X" l="ENG"><s0>Feedback regulation</s0>
<s5>02</s5>
</fC03>
<fC03 i1="02" i2="X" l="SPA"><s0>Retroacción</s0>
<s5>02</s5>
</fC03>
<fC03 i1="03" i2="X" l="FRE"><s0>Charge mentale</s0>
<s5>03</s5>
</fC03>
<fC03 i1="03" i2="X" l="ENG"><s0>Mental load</s0>
<s5>03</s5>
</fC03>
<fC03 i1="03" i2="X" l="SPA"><s0>Carga mental</s0>
<s5>03</s5>
</fC03>
<fC03 i1="04" i2="X" l="FRE"><s0>Charge travail</s0>
<s5>04</s5>
</fC03>
<fC03 i1="04" i2="X" l="ENG"><s0>Workload</s0>
<s5>04</s5>
</fC03>
<fC03 i1="04" i2="X" l="SPA"><s0>Carga trabajo</s0>
<s5>04</s5>
</fC03>
<fC03 i1="05" i2="X" l="FRE"><s0>Interaction</s0>
<s5>05</s5>
</fC03>
<fC03 i1="05" i2="X" l="ENG"><s0>Interaction</s0>
<s5>05</s5>
</fC03>
<fC03 i1="05" i2="X" l="SPA"><s0>Interacción</s0>
<s5>05</s5>
</fC03>
<fC03 i1="06" i2="X" l="FRE"><s0>Système homme machine</s0>
<s5>06</s5>
</fC03>
<fC03 i1="06" i2="X" l="ENG"><s0>Man machine system</s0>
<s5>06</s5>
</fC03>
<fC03 i1="06" i2="X" l="SPA"><s0>Sistema hombre máquina</s0>
<s5>06</s5>
</fC03>
<fC03 i1="07" i2="X" l="FRE"><s0>Ordinateur</s0>
<s5>07</s5>
</fC03>
<fC03 i1="07" i2="X" l="ENG"><s0>Computer</s0>
<s5>07</s5>
</fC03>
<fC03 i1="07" i2="X" l="SPA"><s0>Computadora</s0>
<s5>07</s5>
</fC03>
<fC03 i1="08" i2="X" l="FRE"><s0>Relation homme machine</s0>
<s5>08</s5>
</fC03>
<fC03 i1="08" i2="X" l="ENG"><s0>Man machine relation</s0>
<s5>08</s5>
</fC03>
<fC03 i1="08" i2="X" l="SPA"><s0>Relación hombre máquina</s0>
<s5>08</s5>
</fC03>
<fC03 i1="09" i2="X" l="FRE"><s0>Performance</s0>
<s5>10</s5>
</fC03>
<fC03 i1="09" i2="X" l="ENG"><s0>Performance</s0>
<s5>10</s5>
</fC03>
<fC03 i1="09" i2="X" l="SPA"><s0>Rendimiento</s0>
<s5>10</s5>
</fC03>
<fC03 i1="10" i2="X" l="FRE"><s0>Utilisateur</s0>
<s5>11</s5>
</fC03>
<fC03 i1="10" i2="X" l="ENG"><s0>User</s0>
<s5>11</s5>
</fC03>
<fC03 i1="10" i2="X" l="SPA"><s0>Usuario</s0>
<s5>11</s5>
</fC03>
<fC03 i1="11" i2="X" l="FRE"><s0>Recommandation</s0>
<s5>13</s5>
</fC03>
<fC03 i1="11" i2="X" l="ENG"><s0>Recommendation</s0>
<s5>13</s5>
</fC03>
<fC03 i1="11" i2="X" l="SPA"><s0>Recomendación</s0>
<s5>13</s5>
</fC03>
<fC03 i1="12" i2="X" l="FRE"><s0>Homme</s0>
<s5>54</s5>
</fC03>
<fC03 i1="12" i2="X" l="ENG"><s0>Human</s0>
<s5>54</s5>
</fC03>
<fC03 i1="12" i2="X" l="SPA"><s0>Hombre</s0>
<s5>54</s5>
</fC03>
<fN21><s1>048</s1>
</fN21>
</pA>
</standard>
<server><NO>PASCAL 03-0083024 INIST</NO>
<ET>Multimodal feedback: an assessment of performance and mental workload</ET>
<AU>VITENSE (H. S.); JACKO (J. A.); EMERY (V. K.)</AU>
<AF>Medtronic, 7000 Central Avenue N.E., B173/Minneapolis, MN 55432/Etats-Unis (1 aut.); School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive/Atlanta, GA 30332-0205/Etats-Unis (2 aut., 3 aut.)</AF>
<DT>Publication en série; Niveau analytique</DT>
<SO>Ergonomics; ISSN 0014-0139; Coden ERGOAX; Royaume-Uni; Da. 2003; Vol. 46; No. 1-3; Pp. 68-87; Bibl. 2 p.1/4</SO>
<LA>Anglais</LA>
<EA>Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.</EA>
<CC>002A26L07</CC>
<FD>Interface multimodale; Rétroaction; Charge mentale; Charge travail; Interaction; Système homme machine; Ordinateur; Relation homme machine; Performance; Utilisateur; Recommandation; Homme</FD>
<ED>Multimodal interface; Feedback regulation; Mental load; Workload; Interaction; Man machine system; Computer; Man machine relation; Performance; User; Recommendation; Human</ED>
<SD>Interfaz multimodal; Retroacción; Carga mental; Carga trabajo; Interacción; Sistema hombre máquina; Computadora; Relación hombre máquina; Rendimiento; Usuario; Recomendación; Hombre</SD>
<LO>INIST-9268.354000103616740050</LO>
<ID>03-0083024</ID>
</server>
</inist>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/PascalFrancis/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001205 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/PascalFrancis/Corpus/biblio.hfd -nk 001205 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= PascalFrancis |étape= Corpus |type= RBID |clé= Pascal:03-0083024 |texte= Multimodal feedback: an assessment of performance and mental workload }}
![]() | This area was generated with Dilib version V0.6.23. | ![]() |