Sign Language Avatars: Animation and Comprehensibility
Identifieur interne : 000F56 ( Istex/Curation ); précédent : 000F55; suivant : 000F57Sign Language Avatars: Animation and Comprehensibility
Auteurs : Michael Kipp [Allemagne] ; Alexis Heloir [Allemagne] ; Quan Nguyen [Allemagne]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2011.
English descriptors
- Teeft :
- American sign language, American sign language generation, Animation, Autonomous agents, Avatar, Avatar extensions, Avatar technology, Avatar version, Basic vocabulary, Behaviorbuilder tool, Cambridge university press, Comprehensibility, Comprehensibility levels, Control condition, Conversational agents, Coverbal gesture, Deaf assistant, Deaf experts, Deaf individuals, Deaf people, Deaf users, Delta evaluation, Delta testing, Embr, Evaluation methods, Evaluation studies, Facial expression, German sign language, Gloss, Hamnosys, Hand shape, Hand shapes, Hearing students, Heloir, Human signers, International conference, Internet pages, Kipp, Language resources, Limited comprehensibility, Lower boundary, Morph targets, Multiagent systems, Native language, Necessary tools, Nguyen, Nonmanual components, Nonmanuals, Notable exception, Notation, Objective measure, Original video, Production cost, Second language, Short development time, Sign language, Sign language avatars, Sign language studies, Sign language synthesis, Sign languages, Signer, Single glosses, Single sign, Single signs, Technical feasibility, Upper body control, Utterance, Utterance level, Video, Video recordings.
Abstract
Abstract: Many deaf people have significant reading problems. Written content, e.g. on internet pages, is therefore not fully accessible for them. Embodied agents have the potential to communicate in the native language of this cultural group: sign language. However, state-of-the-art systems have limited comprehensibility and standard evaluation methods are missing. In this paper, we present methods and discuss challenges for the creation and evaluation of a signing avatar. We extended the existing EMBR character animation system with prerequisite functionality, created a gloss-based animation tool and developed a cyclic content creation workflow with the help of two deaf sign language experts. For evaluation, we introduce delta testing, a novel way of assessing comprehensibility by comparing avatars with human signers. While our system reached state-of-the-art comprehensibility in a short development time we argue that future research needs to focus on nonmanual aspects and prosody to reach the comprehensibility levels of human signers.
Url:
DOI: 10.1007/978-3-642-23974-8_13
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: Pour aller vers cette notice dans l'étape Curation :001035
Links to Exploration step
ISTEX:9E3CC0BF8B95B5811B302268F27E8B29029DEF59Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct:series"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Sign Language Avatars: Animation and Comprehensibility</title>
<author><name sortKey="Kipp, Michael" sort="Kipp, Michael" uniqKey="Kipp M" first="Michael" last="Kipp">Michael Kipp</name>
<affiliation wicri:level="1"><mods:affiliation>DFKI, Embodied Agents Research Group, Saarbrücken, Germany</mods:affiliation>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><mods:affiliation>E-mail: Michael.Kipp@dfki.de</mods:affiliation>
<country wicri:rule="url">Allemagne</country>
</affiliation>
</author>
<author><name sortKey="Heloir, Alexis" sort="Heloir, Alexis" uniqKey="Heloir A" first="Alexis" last="Heloir">Alexis Heloir</name>
<affiliation wicri:level="1"><mods:affiliation>DFKI, Embodied Agents Research Group, Saarbrücken, Germany</mods:affiliation>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><mods:affiliation>E-mail: Alexis.Heloir@dfki.de</mods:affiliation>
<country wicri:rule="url">Allemagne</country>
</affiliation>
</author>
<author><name sortKey="Nguyen, Quan" sort="Nguyen, Quan" uniqKey="Nguyen Q" first="Quan" last="Nguyen">Quan Nguyen</name>
<affiliation wicri:level="1"><mods:affiliation>DFKI, Embodied Agents Research Group, Saarbrücken, Germany</mods:affiliation>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><mods:affiliation>E-mail: Quan.Nguyen@dfki.de</mods:affiliation>
<country wicri:rule="url">Allemagne</country>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">ISTEX</idno>
<idno type="RBID">ISTEX:9E3CC0BF8B95B5811B302268F27E8B29029DEF59</idno>
<date when="2011" year="2011">2011</date>
<idno type="doi">10.1007/978-3-642-23974-8_13</idno>
<idno type="url">https://api.istex.fr/document/9E3CC0BF8B95B5811B302268F27E8B29029DEF59/fulltext/pdf</idno>
<idno type="wicri:Area/Istex/Corpus">001035</idno>
<idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">001035</idno>
<idno type="wicri:Area/Istex/Curation">000F56</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Sign Language Avatars: Animation and Comprehensibility</title>
<author><name sortKey="Kipp, Michael" sort="Kipp, Michael" uniqKey="Kipp M" first="Michael" last="Kipp">Michael Kipp</name>
<affiliation wicri:level="1"><mods:affiliation>DFKI, Embodied Agents Research Group, Saarbrücken, Germany</mods:affiliation>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><mods:affiliation>E-mail: Michael.Kipp@dfki.de</mods:affiliation>
<country wicri:rule="url">Allemagne</country>
</affiliation>
</author>
<author><name sortKey="Heloir, Alexis" sort="Heloir, Alexis" uniqKey="Heloir A" first="Alexis" last="Heloir">Alexis Heloir</name>
<affiliation wicri:level="1"><mods:affiliation>DFKI, Embodied Agents Research Group, Saarbrücken, Germany</mods:affiliation>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><mods:affiliation>E-mail: Alexis.Heloir@dfki.de</mods:affiliation>
<country wicri:rule="url">Allemagne</country>
</affiliation>
</author>
<author><name sortKey="Nguyen, Quan" sort="Nguyen, Quan" uniqKey="Nguyen Q" first="Quan" last="Nguyen">Quan Nguyen</name>
<affiliation wicri:level="1"><mods:affiliation>DFKI, Embodied Agents Research Group, Saarbrücken, Germany</mods:affiliation>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><mods:affiliation>E-mail: Quan.Nguyen@dfki.de</mods:affiliation>
<country wicri:rule="url">Allemagne</country>
</affiliation>
</author>
</analytic>
<monogr></monogr>
<series><title level="s">Lecture Notes in Computer Science</title>
<imprint><date>2011</date>
</imprint>
<idno type="ISSN">0302-9743</idno>
<idno type="eISSN">1611-3349</idno>
<idno type="ISSN">0302-9743</idno>
</series>
</biblStruct>
</sourceDesc>
<seriesStmt><idno type="ISSN">0302-9743</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass><keywords scheme="Teeft" xml:lang="en"><term>American sign language</term>
<term>American sign language generation</term>
<term>Animation</term>
<term>Autonomous agents</term>
<term>Avatar</term>
<term>Avatar extensions</term>
<term>Avatar technology</term>
<term>Avatar version</term>
<term>Basic vocabulary</term>
<term>Behaviorbuilder tool</term>
<term>Cambridge university press</term>
<term>Comprehensibility</term>
<term>Comprehensibility levels</term>
<term>Control condition</term>
<term>Conversational agents</term>
<term>Coverbal gesture</term>
<term>Deaf assistant</term>
<term>Deaf experts</term>
<term>Deaf individuals</term>
<term>Deaf people</term>
<term>Deaf users</term>
<term>Delta evaluation</term>
<term>Delta testing</term>
<term>Embr</term>
<term>Evaluation methods</term>
<term>Evaluation studies</term>
<term>Facial expression</term>
<term>German sign language</term>
<term>Gloss</term>
<term>Hamnosys</term>
<term>Hand shape</term>
<term>Hand shapes</term>
<term>Hearing students</term>
<term>Heloir</term>
<term>Human signers</term>
<term>International conference</term>
<term>Internet pages</term>
<term>Kipp</term>
<term>Language resources</term>
<term>Limited comprehensibility</term>
<term>Lower boundary</term>
<term>Morph targets</term>
<term>Multiagent systems</term>
<term>Native language</term>
<term>Necessary tools</term>
<term>Nguyen</term>
<term>Nonmanual components</term>
<term>Nonmanuals</term>
<term>Notable exception</term>
<term>Notation</term>
<term>Objective measure</term>
<term>Original video</term>
<term>Production cost</term>
<term>Second language</term>
<term>Short development time</term>
<term>Sign language</term>
<term>Sign language avatars</term>
<term>Sign language studies</term>
<term>Sign language synthesis</term>
<term>Sign languages</term>
<term>Signer</term>
<term>Single glosses</term>
<term>Single sign</term>
<term>Single signs</term>
<term>Technical feasibility</term>
<term>Upper body control</term>
<term>Utterance</term>
<term>Utterance level</term>
<term>Video</term>
<term>Video recordings</term>
</keywords>
</textClass>
<langUsage><language ident="en">en</language>
</langUsage>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Abstract: Many deaf people have significant reading problems. Written content, e.g. on internet pages, is therefore not fully accessible for them. Embodied agents have the potential to communicate in the native language of this cultural group: sign language. However, state-of-the-art systems have limited comprehensibility and standard evaluation methods are missing. In this paper, we present methods and discuss challenges for the creation and evaluation of a signing avatar. We extended the existing EMBR character animation system with prerequisite functionality, created a gloss-based animation tool and developed a cyclic content creation workflow with the help of two deaf sign language experts. For evaluation, we introduce delta testing, a novel way of assessing comprehensibility by comparing avatars with human signers. While our system reached state-of-the-art comprehensibility in a short development time we argue that future research needs to focus on nonmanual aspects and prosody to reach the comprehensibility levels of human signers.</div>
</front>
</TEI>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Sarre/explor/MusicSarreV3/Data/Istex/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000F56 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Curation/biblio.hfd -nk 000F56 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Wicri/Sarre |area= MusicSarreV3 |flux= Istex |étape= Curation |type= RBID |clé= ISTEX:9E3CC0BF8B95B5811B302268F27E8B29029DEF59 |texte= Sign Language Avatars: Animation and Comprehensibility }}
This area was generated with Dilib version V0.6.33. |