An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception
Identifieur interne : 002D12 ( Main/Curation ); précédent : 002D11; suivant : 002D13An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception
Auteurs : Nicholas Altieri [États-Unis] ; James T. Townsend [États-Unis]Source :
- Frontiers in Psychology [ 1664-1078 ] ; 2011.
Abstract
Research has shown that visual speech perception can assist accuracy in identification of spoken words. However, little is known about the dynamics of the processing mechanisms involved in audiovisual integration. In particular, architecture and capacity, measured using response time methodologies, have not been investigated. An issue related to architecture concerns whether the auditory and visual sources of the speech signal are integrated “early” or “late.” We propose that “early” integration most naturally corresponds to coactive processing whereas “late” integration corresponds to separate decisions parallel processing. We implemented the double factorial paradigm in two studies. First, we carried out a pilot study using a two-alternative forced-choice discrimination task to assess architecture, decision rule, and provide a preliminary assessment of capacity (integration efficiency). Next, Experiment 1 was designed to specifically assess audiovisual integration efficiency in an ecologically valid way by including lower auditory S/N ratios and a larger response set size. Results from the pilot study support a separate decisions parallel, late integration model. Results from both studies showed that capacity was severely limited for high auditory signal-to-noise ratios. However, Experiment 1 demonstrated that capacity improved as the auditory signal became more degraded. This evidence strongly suggests that integration efficiency is vitally affected by the S/N ratio.
Url:
DOI: 10.3389/fpsyg.2011.00238
PubMed: 21980314
PubMed Central: 3180170
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :001F54
- to stream Pmc, to step Curation: Pour aller vers cette notice dans l'étape Curation :001F54
- to stream Pmc, to step Checkpoint: Pour aller vers cette notice dans l'étape Curation :001C45
- to stream Ncbi, to step Merge: Pour aller vers cette notice dans l'étape Curation :001C36
- to stream Ncbi, to step Curation: Pour aller vers cette notice dans l'étape Curation :001C36
- to stream Ncbi, to step Checkpoint: Pour aller vers cette notice dans l'étape Curation :001C36
- to stream Main, to step Merge: Pour aller vers cette notice dans l'étape Curation :002D51
Links to Exploration step
PMC:3180170Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception</title><author><name sortKey="Altieri, Nicholas" sort="Altieri, Nicholas" uniqKey="Altieri N" first="Nicholas" last="Altieri">Nicholas Altieri</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Psychology, The University of Oklahoma</institution><country>Norman, OK, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author><author><name sortKey="Townsend, James T" sort="Townsend, James T" uniqKey="Townsend J" first="James T." last="Townsend">James T. Townsend</name><affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Department of Psychological and Brain Sciences, Indiana University</institution><country>Bloomington, IN, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">21980314</idno><idno type="pmc">3180170</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3180170</idno><idno type="RBID">PMC:3180170</idno><idno type="doi">10.3389/fpsyg.2011.00238</idno><date when="2011">2011</date><idno type="wicri:Area/Pmc/Corpus">001F54</idno><idno type="wicri:Area/Pmc/Curation">001F54</idno><idno type="wicri:Area/Pmc/Checkpoint">001C45</idno><idno type="wicri:Area/Ncbi/Merge">001C36</idno><idno type="wicri:Area/Ncbi/Curation">001C36</idno><idno type="wicri:Area/Ncbi/Checkpoint">001C36</idno><idno type="wicri:Area/Main/Merge">002D51</idno><idno type="wicri:Area/Main/Curation">002D12</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception</title><author><name sortKey="Altieri, Nicholas" sort="Altieri, Nicholas" uniqKey="Altieri N" first="Nicholas" last="Altieri">Nicholas Altieri</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Psychology, The University of Oklahoma</institution><country>Norman, OK, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author><author><name sortKey="Townsend, James T" sort="Townsend, James T" uniqKey="Townsend J" first="James T." last="Townsend">James T. Townsend</name><affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Department of Psychological and Brain Sciences, Indiana University</institution><country>Bloomington, IN, USA</country></nlm:aff><country xml:lang="fr">États-Unis</country><wicri:regionArea></wicri:regionArea><wicri:regionArea># see nlm:aff region in country</wicri:regionArea></affiliation></author></analytic><series><title level="j">Frontiers in Psychology</title><idno type="eISSN">1664-1078</idno><imprint><date when="2011">2011</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Research has shown that visual speech perception can assist accuracy in identification of spoken words. However, little is known about the dynamics of the processing mechanisms involved in audiovisual integration. In particular, architecture and capacity, measured using response time methodologies, have not been investigated. An issue related to architecture concerns whether the auditory and visual sources of the speech signal are integrated “early” or “late.” We propose that “early” integration most naturally corresponds to coactive processing whereas “late” integration corresponds to separate decisions parallel processing. We implemented the double factorial paradigm in two studies. First, we carried out a pilot study using a two-alternative forced-choice discrimination task to assess architecture, decision rule, and provide a preliminary assessment of capacity (integration efficiency). Next, Experiment 1 was designed to specifically assess audiovisual integration efficiency in an ecologically valid way by including lower auditory S/N ratios and a larger response set size. Results from the pilot study support a separate decisions parallel, late integration model. Results from both studies showed that capacity was severely limited for high auditory signal-to-noise ratios. However, Experiment 1 demonstrated that capacity improved as the auditory signal became more degraded. This evidence strongly suggests that integration efficiency is vitally affected by the S/N ratio.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Altieri, N" uniqKey="Altieri N">N. Altieri</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Altieri, N" uniqKey="Altieri N">N. Altieri</name></author><author><name sortKey="Wenger, M J" uniqKey="Wenger M">M. J. Wenger</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Arnold, D H" uniqKey="Arnold D">D. H. Arnold</name></author><author><name sortKey="Tear, M" uniqKey="Tear M">M. Tear</name></author><author><name sortKey="Schindel, R" uniqKey="Schindel R">R. Schindel</name></author><author><name sortKey="Roseboom, W" uniqKey="Roseboom W">W. Roseboom</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Barutchu, A" uniqKey="Barutchu A">A. Barutchu</name></author><author><name sortKey="Crewther, D P" uniqKey="Crewther D">D. P. Crewther</name></author><author><name sortKey="Crewther, S G" uniqKey="Crewther S">S. G. Crewther</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Barutchu, A" uniqKey="Barutchu A">A. Barutchu</name></author><author><name sortKey="Danaher, J" uniqKey="Danaher J">J. Danaher</name></author><author><name sortKey="Crewther, S G" uniqKey="Crewther S">S. G. Crewther</name></author><author><name sortKey="Innes Brown, H" uniqKey="Innes Brown H">H. Innes-Brown</name></author><author><name sortKey="Shivdasani, M N" uniqKey="Shivdasani M">M. N. Shivdasani</name></author><author><name sortKey="Paolini, A G" uniqKey="Paolini A">A. G. Paolini</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bergeson, T R" uniqKey="Bergeson T">T. R. Bergeson</name></author><author><name sortKey="Pisoni, D B" uniqKey="Pisoni D">D. B. Pisoni</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bernstein, L E" uniqKey="Bernstein L">L. E. Bernstein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bernstein, L E" uniqKey="Bernstein L">L. E. Bernstein</name></author><author><name sortKey="Auer, E T" uniqKey="Auer E">E. T. Auer</name></author><author><name sortKey="Moore, J K" uniqKey="Moore J">J. K. Moore</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Berryhill, M" uniqKey="Berryhill M">M. Berryhill</name></author><author><name sortKey="Kveraga, K" uniqKey="Kveraga K">K. Kveraga</name></author><author><name sortKey="Webb, L" uniqKey="Webb L">L. Webb</name></author><author><name sortKey="Hughes, H C" uniqKey="Hughes H">H. C. Hughes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Braida, L D" uniqKey="Braida L">L. D. Braida</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bundesen, C" uniqKey="Bundesen C">C. Bundesen</name></author><author><name sortKey="Habekost, T" uniqKey="Habekost T">T. Habekost</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Colonius, H" uniqKey="Colonius H">H. Colonius</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eidels, A" uniqKey="Eidels A">A. Eidels</name></author><author><name sortKey="Houpt, J" uniqKey="Houpt J">J. Houpt</name></author><author><name sortKey="Altieri, N" uniqKey="Altieri N">N. Altieri</name></author><author><name sortKey="Pei, L" uniqKey="Pei L">L. Pei</name></author><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fournier, L R" uniqKey="Fournier L">L. R. Fournier</name></author><author><name sortKey="Eriksen, C W" uniqKey="Eriksen C">C. W. Eriksen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fowler, C A" uniqKey="Fowler C">C. A. Fowler</name></author><author><name sortKey="Dekle, D J" uniqKey="Dekle D">D. J. Dekle</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fowler, C A" uniqKey="Fowler C">C. A. Fowler</name></author><author><name sortKey="Rosenblum, L D" uniqKey="Rosenblum L">L. D. Rosenblum</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Grant, K W" uniqKey="Grant K">K. W. Grant</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Grant, K W" uniqKey="Grant K">K. W. Grant</name></author><author><name sortKey="Walden, B E" uniqKey="Walden B">B. E. Walden</name></author><author><name sortKey="Seitz, P F" uniqKey="Seitz P">P. F. Seitz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Green, K P" uniqKey="Green K">K. P. Green</name></author><author><name sortKey="Miller, J L" uniqKey="Miller J">J. L. Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Grice, G R" uniqKey="Grice G">G. R. Grice</name></author><author><name sortKey="Canham, L" uniqKey="Canham L">L. Canham</name></author><author><name sortKey="Gwynne, J W" uniqKey="Gwynne J">J. W. Gwynne</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jesse, A" uniqKey="Jesse A">A. Jesse</name></author><author><name sortKey="Massaro, D W" uniqKey="Massaro D">D. W. Massaro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Liberman, A M" uniqKey="Liberman A">A. M. Liberman</name></author><author><name sortKey="Mattingly, I G" uniqKey="Mattingly I">I. G. Mattingly</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ma, W J" uniqKey="Ma W">W. J. Ma</name></author><author><name sortKey="Zhou, X" uniqKey="Zhou X">X. Zhou</name></author><author><name sortKey="Ross, L A" uniqKey="Ross L">L. A. Ross</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author><author><name sortKey="Parra, L C" uniqKey="Parra L">L. C. Parra</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Massaro, D W" uniqKey="Massaro D">D. W. Massaro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Massaro, D W" uniqKey="Massaro D">D. W. Massaro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Massaro, D W" uniqKey="Massaro D">D. W. Massaro</name></author><author><name sortKey="Cohen, M M" uniqKey="Cohen M">M. M. Cohen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Massaro, D W" uniqKey="Massaro D">D. W. Massaro</name></author><author><name sortKey="Cohen, M M" uniqKey="Cohen M">M. M. Cohen</name></author><author><name sortKey="Smeele, P M T" uniqKey="Smeele P">P. M. T. Smeele</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mcgurk, H" uniqKey="Mcgurk H">H. McGurk</name></author><author><name sortKey="Macdonald, J W" uniqKey="Macdonald J">J. W. MacDonald</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meredith, M A" uniqKey="Meredith M">M. A. Meredith</name></author><author><name sortKey="Stein, B E" uniqKey="Stein B">B. E. Stein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Miller, J" uniqKey="Miller J">J. Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Miller, J" uniqKey="Miller J">J. Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Molholm, S" uniqKey="Molholm S">S. Molholm</name></author><author><name sortKey="Ritter, W" uniqKey="Ritter W">W. Ritter</name></author><author><name sortKey="Javitt, D C" uniqKey="Javitt D">D. C. Javitt</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pilling, M" uniqKey="Pilling M">M. Pilling</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ponton, C W" uniqKey="Ponton C">C. W. Ponton</name></author><author><name sortKey="Bernstein, L E" uniqKey="Bernstein L">L. E. Bernstein</name></author><author><name sortKey="Auer, E T" uniqKey="Auer E">E. T. Auer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Raab, D H" uniqKey="Raab D">D. H. Raab</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rosenblum, L D" uniqKey="Rosenblum L">L. D. Rosenblum</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ross, L A" uniqKey="Ross L">L. A. Ross</name></author><author><name sortKey="Saint Amour, D" uniqKey="Saint Amour D">D. Saint-Amour</name></author><author><name sortKey="Leavitt, V M" uniqKey="Leavitt V">V. M. Leavitt</name></author><author><name sortKey="Javitt, D C" uniqKey="Javitt D">D. C. Javitt</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sekiyama, K" uniqKey="Sekiyama K">K. Sekiyama</name></author><author><name sortKey="Tohkura, Y" uniqKey="Tohkura Y">Y. Tohkura</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sherffert, S" uniqKey="Sherffert S">S. Sherffert</name></author><author><name sortKey="Lachs, L" uniqKey="Lachs L">L. Lachs</name></author><author><name sortKey="Hernandez, L R" uniqKey="Hernandez L">L. R. Hernandez</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sommers, M" uniqKey="Sommers M">M. Sommers</name></author><author><name sortKey="Tye Murray, N" uniqKey="Tye Murray N">N. Tye-Murray</name></author><author><name sortKey="Spehar, B" uniqKey="Spehar B">B. Spehar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sternberg, S" uniqKey="Sternberg S">S. Sternberg</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stevenson, R A" uniqKey="Stevenson R">R. A. Stevenson</name></author><author><name sortKey="James, T W" uniqKey="James T">T. W. James</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sumby, W H" uniqKey="Sumby W">W. H. Sumby</name></author><author><name sortKey="Pollack, I" uniqKey="Pollack I">I. Pollack</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Summerfield, Q" uniqKey="Summerfield Q">Q. Summerfield</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author><author><name sortKey="Ashby, F G" uniqKey="Ashby F">F. G. Ashby</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author><author><name sortKey="Nozawa, G" uniqKey="Nozawa G">G. Nozawa</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author><author><name sortKey="Schweickert, R" uniqKey="Schweickert R">R. Schweickert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author><author><name sortKey="Wenger, M J" uniqKey="Wenger M">M. J. Wenger</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author><author><name sortKey="Wenger, M J" uniqKey="Wenger M">M. J. Wenger</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Wassenhove, V" uniqKey="Van Wassenhove V">V. van Wassenhove</name></author><author><name sortKey="Grant, K W" uniqKey="Grant K">K. W. Grant</name></author><author><name sortKey="Poeppel, D" uniqKey="Poeppel D">D. Poeppel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Walker, S" uniqKey="Walker S">S. Walker</name></author><author><name sortKey="Bruce, V" uniqKey="Bruce V">V. Bruce</name></author><author><name sortKey="O Alley, C" uniqKey="O Alley C">C. O’Malley</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wenger, M J" uniqKey="Wenger M">M. J. Wenger</name></author><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wenger, M J" uniqKey="Wenger M">M. J. Wenger</name></author><author><name sortKey="Townsend, J T" uniqKey="Townsend J">J. T. Townsend</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Winneke, A H" uniqKey="Winneke A">A. H. Winneke</name></author><author><name sortKey="Phillips, N A" uniqKey="Phillips N">N. A. Phillips</name></author></analytic></biblStruct></listBibl></div1></back></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002D12 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Curation/biblio.hfd -nk 002D12 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Main
|étape= Curation
|type= RBID
|clé= PMC:3180170
|texte= An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Curation/RBID.i -Sk "pubmed:21980314" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Curation/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |