Multimodal feedback: an assessment of performance and mental workload
Identifieur interne : 006F93 ( Main/Exploration ); précédent : 006F92; suivant : 006F94Multimodal feedback: an assessment of performance and mental workload
Auteurs : H. S. Vitense [États-Unis] ; J. A. Jacko [États-Unis] ; V. K. Emery [États-Unis]Source :
- Ergonomics [ 0014-0139 ] ; 2003.
Descripteurs français
- Pascal (Inist)
- Wicri :
- topic : Ordinateur, Recommandation, Homme.
English descriptors
- KwdEn :
- Adult, Computer, Feedback, Feedback regulation, Human, Human Engineering (methods), Human Engineering (psychology), Humans, Interaction, Man machine relation, Man machine system, Mental Fatigue (physiopathology), Mental load, Models, Psychological, Multimodal interface, Performance, Recommendation, Software, Surveys and Questionnaires, Task Performance and Analysis, Touch (physiology), User, User-Computer Interface, Vision, Ocular (physiology), Workload, Workload (psychology).
- MESH :
- methods : Human Engineering.
- physiology : Touch, Vision, Ocular.
- physiopathology : Mental Fatigue.
- psychology : Human Engineering, Workload.
- Adult, Feedback, Humans, Models, Psychological, Software, Surveys and Questionnaires, Task Performance and Analysis, User-Computer Interface.
Abstract
Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream PascalFrancis, to step Corpus: 001205
- to stream PascalFrancis, to step Curation: 000306
- to stream PascalFrancis, to step Checkpoint: 000E39
- to stream Main, to step Merge: 007471
- to stream PubMed, to step Corpus: 001C31
- to stream PubMed, to step Curation: 001C31
- to stream PubMed, to step Checkpoint: 001913
- to stream Ncbi, to step Merge: 000355
- to stream Ncbi, to step Curation: 000355
- to stream Ncbi, to step Checkpoint: 000355
- to stream Main, to step Merge: 007176
- to stream Main, to step Curation: 006F93
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" level="a">Multimodal feedback: an assessment of performance and mental workload</title>
<author><name sortKey="Vitense, H S" sort="Vitense, H S" uniqKey="Vitense H" first="H. S." last="Vitense">H. S. Vitense</name>
<affiliation wicri:level="2"><inist:fA14 i1="01"><s1>Medtronic, 7000 Central Avenue N.E., B173</s1>
<s2>Minneapolis, MN 55432</s2>
<s3>USA</s3>
<sZ>1 aut.</sZ>
</inist:fA14>
<country>États-Unis</country>
<placeName><region type="state">Minnesota</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Jacko, J A" sort="Jacko, J A" uniqKey="Jacko J" first="J. A." last="Jacko">J. A. Jacko</name>
<affiliation wicri:level="2"><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>États-Unis</country>
<placeName><region type="state">Géorgie (États-Unis)</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Emery, V K" sort="Emery, V K" uniqKey="Emery V" first="V. K." last="Emery">V. K. Emery</name>
<affiliation wicri:level="2"><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>États-Unis</country>
<placeName><region type="state">Géorgie (États-Unis)</region>
</placeName>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">INIST</idno>
<idno type="inist">03-0083024</idno>
<date when="2003">2003</date>
<idno type="stanalyst">PASCAL 03-0083024 INIST</idno>
<idno type="RBID">Pascal:03-0083024</idno>
<idno type="wicri:Area/PascalFrancis/Corpus">001205</idno>
<idno type="wicri:Area/PascalFrancis/Curation">000306</idno>
<idno type="wicri:Area/PascalFrancis/Checkpoint">000E39</idno>
<idno type="wicri:doubleKey">0014-0139:2003:Vitense H:multimodal:feedback:an</idno>
<idno type="wicri:Area/Main/Merge">007471</idno>
<idno type="wicri:source">PubMed</idno>
<idno type="RBID">pubmed:12554399</idno>
<idno type="wicri:Area/PubMed/Corpus">001C31</idno>
<idno type="wicri:Area/PubMed/Curation">001C31</idno>
<idno type="wicri:Area/PubMed/Checkpoint">001913</idno>
<idno type="wicri:Area/Ncbi/Merge">000355</idno>
<idno type="wicri:Area/Ncbi/Curation">000355</idno>
<idno type="wicri:Area/Ncbi/Checkpoint">000355</idno>
<idno type="wicri:doubleKey">0014-0139:2003:Vitense H:multimodal:feedback:an</idno>
<idno type="wicri:Area/Main/Merge">007176</idno>
<idno type="wicri:Area/Main/Curation">006F93</idno>
<idno type="wicri:Area/Main/Exploration">006F93</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a">Multimodal feedback: an assessment of performance and mental workload</title>
<author><name sortKey="Vitense, H S" sort="Vitense, H S" uniqKey="Vitense H" first="H. S." last="Vitense">H. S. Vitense</name>
<affiliation wicri:level="2"><inist:fA14 i1="01"><s1>Medtronic, 7000 Central Avenue N.E., B173</s1>
<s2>Minneapolis, MN 55432</s2>
<s3>USA</s3>
<sZ>1 aut.</sZ>
</inist:fA14>
<country>États-Unis</country>
<placeName><region type="state">Minnesota</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Jacko, J A" sort="Jacko, J A" uniqKey="Jacko J" first="J. A." last="Jacko">J. A. Jacko</name>
<affiliation wicri:level="2"><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>États-Unis</country>
<placeName><region type="state">Géorgie (États-Unis)</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Emery, V K" sort="Emery, V K" uniqKey="Emery V" first="V. K." last="Emery">V. K. Emery</name>
<affiliation wicri:level="2"><inist:fA14 i1="02"><s1>School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive</s1>
<s2>Atlanta, GA 30332-0205</s2>
<s3>USA</s3>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>États-Unis</country>
<placeName><region type="state">Géorgie (États-Unis)</region>
</placeName>
</affiliation>
</author>
</analytic>
<series><title level="j" type="main">Ergonomics</title>
<title level="j" type="abbreviated">Ergonomics</title>
<idno type="ISSN">0014-0139</idno>
<imprint><date when="2003">2003</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
<seriesStmt><title level="j" type="main">Ergonomics</title>
<title level="j" type="abbreviated">Ergonomics</title>
<idno type="ISSN">0014-0139</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Adult</term>
<term>Computer</term>
<term>Feedback</term>
<term>Feedback regulation</term>
<term>Human</term>
<term>Human Engineering (methods)</term>
<term>Human Engineering (psychology)</term>
<term>Humans</term>
<term>Interaction</term>
<term>Man machine relation</term>
<term>Man machine system</term>
<term>Mental Fatigue (physiopathology)</term>
<term>Mental load</term>
<term>Models, Psychological</term>
<term>Multimodal interface</term>
<term>Performance</term>
<term>Recommendation</term>
<term>Software</term>
<term>Surveys and Questionnaires</term>
<term>Task Performance and Analysis</term>
<term>Touch (physiology)</term>
<term>User</term>
<term>User-Computer Interface</term>
<term>Vision, Ocular (physiology)</term>
<term>Workload</term>
<term>Workload (psychology)</term>
</keywords>
<keywords scheme="MESH" qualifier="methods" xml:lang="en"><term>Human Engineering</term>
</keywords>
<keywords scheme="MESH" qualifier="physiology" xml:lang="en"><term>Touch</term>
<term>Vision, Ocular</term>
</keywords>
<keywords scheme="MESH" qualifier="physiopathology" xml:lang="en"><term>Mental Fatigue</term>
</keywords>
<keywords scheme="MESH" qualifier="psychology" xml:lang="en"><term>Human Engineering</term>
<term>Workload</term>
</keywords>
<keywords scheme="MESH" xml:lang="en"><term>Adult</term>
<term>Feedback</term>
<term>Humans</term>
<term>Models, Psychological</term>
<term>Software</term>
<term>Surveys and Questionnaires</term>
<term>Task Performance and Analysis</term>
<term>User-Computer Interface</term>
</keywords>
<keywords scheme="Pascal" xml:lang="fr"><term>Interface multimodale</term>
<term>Rétroaction</term>
<term>Charge mentale</term>
<term>Charge travail</term>
<term>Interaction</term>
<term>Système homme machine</term>
<term>Ordinateur</term>
<term>Relation homme machine</term>
<term>Performance</term>
<term>Utilisateur</term>
<term>Recommandation</term>
<term>Homme</term>
</keywords>
<keywords scheme="Wicri" type="topic" xml:lang="fr"><term>Ordinateur</term>
<term>Recommandation</term>
<term>Homme</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of 'drag-and-drops' while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.</div>
</front>
</TEI>
<affiliations><list><country><li>États-Unis</li>
</country>
<region><li>Géorgie (États-Unis)</li>
<li>Minnesota</li>
</region>
</list>
<tree><country name="États-Unis"><region name="Minnesota"><name sortKey="Vitense, H S" sort="Vitense, H S" uniqKey="Vitense H" first="H. S." last="Vitense">H. S. Vitense</name>
</region>
<name sortKey="Emery, V K" sort="Emery, V K" uniqKey="Emery V" first="V. K." last="Emery">V. K. Emery</name>
<name sortKey="Jacko, J A" sort="Jacko, J A" uniqKey="Jacko J" first="J. A." last="Jacko">J. A. Jacko</name>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 006F93 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 006F93 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Main |étape= Exploration |type= RBID |clé= Pascal:03-0083024 |texte= Multimodal feedback: an assessment of performance and mental workload }}
This area was generated with Dilib version V0.6.23. |