A Comprehensive Model of Audiovisual Perception: Both Percept and Temporal Dynamics
Identifieur interne : 002D51 ( Main/Exploration ); précédent : 002D50; suivant : 002D52A Comprehensive Model of Audiovisual Perception: Both Percept and Temporal Dynamics
Auteurs : Patricia Besson ; Christophe Bourdin ; Lionel BringouxSource :
- PLoS ONE [ 1932-6203 ] ; 2011.
Abstract
The sparse information captured by the sensory systems is used by the brain to apprehend the environment, for example, to spatially locate the source of audiovisual stimuli. This is an ill-posed inverse problem whose inherent uncertainty can be solved by jointly processing the information, as well as introducing constraints during this process, on the way this multisensory information is handled. This process and its result - the percept - depend on the contextual conditions perception takes place in. To date, perception has been investigated and modeled on the basis of either one of two of its dimensions: the percept or the temporal dynamics of the process. Here, we extend our previously proposed audiovisual perception model to predict both these dimensions to capture the phenomenon as a whole. Starting from a behavioral analysis, we use a data-driven approach to elicit a Bayesian network which infers the different percepts and dynamics of the process. Context-specific independence analyses enable us to use the model's structure to directly explore how different contexts affect the way subjects handle the same available information. Hence, we establish that, while the percepts yielded by a unisensory stimulus or by the non-fusion of multisensory stimuli may be similar, they result from different processes, as shown by their differing temporal dynamics. Moreover, our model predicts the impact of bottom-up (stimulus driven) factors as well as of top-down factors (induced by instruction manipulation) on both the perception process and the percept itself.
Url:
DOI: 10.1371/journal.pone.0023811
PubMed: 21887324
PubMed Central: 3161793
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 002415
- to stream Pmc, to step Curation: 002415
- to stream Pmc, to step Checkpoint: 001C69
- to stream Ncbi, to step Merge: 001B76
- to stream Ncbi, to step Curation: 001B76
- to stream Ncbi, to step Checkpoint: 001B76
- to stream Main, to step Merge: 002D90
- to stream Main, to step Curation: 002D51
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">A Comprehensive Model of Audiovisual Perception: Both Percept and Temporal Dynamics</title>
<author><name sortKey="Besson, Patricia" sort="Besson, Patricia" uniqKey="Besson P" first="Patricia" last="Besson">Patricia Besson</name>
<affiliation><nlm:aff id="aff1"></nlm:aff>
</affiliation>
</author>
<author><name sortKey="Bourdin, Christophe" sort="Bourdin, Christophe" uniqKey="Bourdin C" first="Christophe" last="Bourdin">Christophe Bourdin</name>
<affiliation><nlm:aff id="aff1"></nlm:aff>
</affiliation>
</author>
<author><name sortKey="Bringoux, Lionel" sort="Bringoux, Lionel" uniqKey="Bringoux L" first="Lionel" last="Bringoux">Lionel Bringoux</name>
<affiliation><nlm:aff id="aff1"></nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">21887324</idno>
<idno type="pmc">3161793</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3161793</idno>
<idno type="RBID">PMC:3161793</idno>
<idno type="doi">10.1371/journal.pone.0023811</idno>
<date when="2011">2011</date>
<idno type="wicri:Area/Pmc/Corpus">002415</idno>
<idno type="wicri:Area/Pmc/Curation">002415</idno>
<idno type="wicri:Area/Pmc/Checkpoint">001C69</idno>
<idno type="wicri:Area/Ncbi/Merge">001B76</idno>
<idno type="wicri:Area/Ncbi/Curation">001B76</idno>
<idno type="wicri:Area/Ncbi/Checkpoint">001B76</idno>
<idno type="wicri:Area/Main/Merge">002D90</idno>
<idno type="wicri:Area/Main/Curation">002D51</idno>
<idno type="wicri:Area/Main/Exploration">002D51</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">A Comprehensive Model of Audiovisual Perception: Both Percept and Temporal Dynamics</title>
<author><name sortKey="Besson, Patricia" sort="Besson, Patricia" uniqKey="Besson P" first="Patricia" last="Besson">Patricia Besson</name>
<affiliation><nlm:aff id="aff1"></nlm:aff>
</affiliation>
</author>
<author><name sortKey="Bourdin, Christophe" sort="Bourdin, Christophe" uniqKey="Bourdin C" first="Christophe" last="Bourdin">Christophe Bourdin</name>
<affiliation><nlm:aff id="aff1"></nlm:aff>
</affiliation>
</author>
<author><name sortKey="Bringoux, Lionel" sort="Bringoux, Lionel" uniqKey="Bringoux L" first="Lionel" last="Bringoux">Lionel Bringoux</name>
<affiliation><nlm:aff id="aff1"></nlm:aff>
</affiliation>
</author>
</analytic>
<series><title level="j">PLoS ONE</title>
<idno type="eISSN">1932-6203</idno>
<imprint><date when="2011">2011</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>The sparse information captured by the sensory systems is used by the brain to apprehend the environment, for example, to spatially locate the source of audiovisual stimuli. This is an ill-posed inverse problem whose inherent uncertainty can be solved by jointly processing the information, as well as introducing constraints during this process, on the way this multisensory information is handled. This process and its result - the percept - depend on the contextual conditions perception takes place in. To date, perception has been investigated and modeled on the basis of either one of two of its dimensions: the percept or the temporal dynamics of the process. Here, we extend our previously proposed audiovisual perception model to predict both these dimensions to capture the phenomenon as a whole. Starting from a behavioral analysis, we use a data-driven approach to elicit a Bayesian network which infers the different percepts and dynamics of the process. Context-specific independence analyses enable us to use the model's structure to directly explore how different contexts affect the way subjects handle the same available information. Hence, we establish that, while the percepts yielded by a unisensory stimulus or by the non-fusion of multisensory stimuli may be similar, they result from different processes, as shown by their differing temporal dynamics. Moreover, our model predicts the impact of bottom-up (stimulus driven) factors as well as of top-down factors (induced by instruction manipulation) on both the perception process and the percept itself.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Clark, Jj" uniqKey="Clark J">JJ Clark</name>
</author>
<author><name sortKey="Yuille, Al" uniqKey="Yuille A">AL Yuille</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
<author><name sortKey="Bulthoff, Hh" uniqKey="Bulthoff H">HH Bülthoff</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sato, Y" uniqKey="Sato Y">Y Sato</name>
</author>
<author><name sortKey="Toyoizumi, T" uniqKey="Toyoizumi T">T Toyoizumi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kording, Kp" uniqKey="Kording K">KP Körding</name>
</author>
<author><name sortKey="Beierholm, U" uniqKey="Beierholm U">U Beierholm</name>
</author>
<author><name sortKey="Ma, Wj" uniqKey="Ma W">WJ Ma</name>
</author>
<author><name sortKey="Quartz, S" uniqKey="Quartz S">S Quartz</name>
</author>
<author><name sortKey="Tenenbaum, Jb" uniqKey="Tenenbaum J">JB Tenenbaum</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
<author><name sortKey="Banks, Ms" uniqKey="Banks M">MS Banks</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Battaglia, Pw" uniqKey="Battaglia P">PW Battaglia</name>
</author>
<author><name sortKey="Jacobs, Ra" uniqKey="Jacobs R">RA Jacobs</name>
</author>
<author><name sortKey="Aslin, Rn" uniqKey="Aslin R">RN Aslin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shams, L" uniqKey="Shams L">L Shams</name>
</author>
<author><name sortKey="Ma, Wj" uniqKey="Ma W">WJ Ma</name>
</author>
<author><name sortKey="Beierholm, U" uniqKey="Beierholm U">U Beierholm</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bernstein, Hi" uniqKey="Bernstein H">HI Bernstein</name>
</author>
<author><name sortKey="Clark, Hm" uniqKey="Clark H">HM Clark</name>
</author>
<author><name sortKey="Edelstein, Ab" uniqKey="Edelstein A">AB Edelstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bernstein, Hi" uniqKey="Bernstein H">HI Bernstein</name>
</author>
<author><name sortKey="Clark, Hm" uniqKey="Clark H">HM Clark</name>
</author>
<author><name sortKey="Edelstein, Ab" uniqKey="Edelstein A">AB Edelstein</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hecht, D" uniqKey="Hecht D">D Hecht</name>
</author>
<author><name sortKey="Reiner, M" uniqKey="Reiner M">M Reiner</name>
</author>
<author><name sortKey="Karni, A" uniqKey="Karni A">A Karni</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Besson, P" uniqKey="Besson P">P Besson</name>
</author>
<author><name sortKey="Richiardi, J" uniqKey="Richiardi J">J Richiardi</name>
</author>
<author><name sortKey="Bourdin, C" uniqKey="Bourdin C">C Bourdin</name>
</author>
<author><name sortKey="Bringoux, L" uniqKey="Bringoux L">L Bringoux</name>
</author>
<author><name sortKey="Mestre, Dr" uniqKey="Mestre D">DR Mestre</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Besson, P" uniqKey="Besson P">P Besson</name>
</author>
<author><name sortKey="Richiardi, J" uniqKey="Richiardi J">J Richiardi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Knill, Dc" uniqKey="Knill D">DC Knill</name>
</author>
<author><name sortKey="Richards, W" uniqKey="Richards W">W Richards</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Roach, Nw" uniqKey="Roach N">NW Roach</name>
</author>
<author><name sortKey="Heron, J" uniqKey="Heron J">J Heron</name>
</author>
<author><name sortKey="Mcgraw, Pv" uniqKey="Mcgraw P">PV McGraw</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wozny, Dr" uniqKey="Wozny D">DR Wozny</name>
</author>
<author><name sortKey="Beierholm, Ur" uniqKey="Beierholm U">UR Beierholm</name>
</author>
<author><name sortKey="Shams, L" uniqKey="Shams L">L Shams</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Molholm, S" uniqKey="Molholm S">S Molholm</name>
</author>
<author><name sortKey="Ritter, W" uniqKey="Ritter W">W Ritter</name>
</author>
<author><name sortKey="Murray, Mm" uniqKey="Murray M">MM Murray</name>
</author>
<author><name sortKey="Javitt, Dc" uniqKey="Javitt D">DC Javitt</name>
</author>
<author><name sortKey="Schroeder, Ce" uniqKey="Schroeder C">CE Schroeder</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Diederich, A" uniqKey="Diederich A">A Diederich</name>
</author>
<author><name sortKey="Colonius, H" uniqKey="Colonius H">H Colonius</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Jepma, M" uniqKey="Jepma M">M Jepma</name>
</author>
<author><name sortKey="Wagenmakers, Ej" uniqKey="Wagenmakers E">EJ Wagenmakers</name>
</author>
<author><name sortKey="Band, Gph" uniqKey="Band G">GPH Band</name>
</author>
<author><name sortKey="Nieuwenhuis, S" uniqKey="Nieuwenhuis S">S Nieuwenhuis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rowland, Ba" uniqKey="Rowland B">BA Rowland</name>
</author>
<author><name sortKey="Quessy, S" uniqKey="Quessy S">S Quessy</name>
</author>
<author><name sortKey="Stanford, Tr" uniqKey="Stanford T">TR Stanford</name>
</author>
<author><name sortKey="Stein, Be" uniqKey="Stein B">BE Stein</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nickerson, Rs" uniqKey="Nickerson R">RS Nickerson</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Braun, Da" uniqKey="Braun D">DA Braun</name>
</author>
<author><name sortKey="Mehring, C" uniqKey="Mehring C">C Mehring</name>
</author>
<author><name sortKey="Wolpert, Dm" uniqKey="Wolpert D">DM Wolpert</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Warren, Dh" uniqKey="Warren D">DH Warren</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sarlegna, F" uniqKey="Sarlegna F">F Sarlegna</name>
</author>
<author><name sortKey="Malfait, N" uniqKey="Malfait N">N Malfait</name>
</author>
<author><name sortKey="Bringoux, L" uniqKey="Bringoux L">L Bringoux</name>
</author>
<author><name sortKey="Bourdin, C" uniqKey="Bourdin C">C Bourdin</name>
</author>
<author><name sortKey="Vercher, J" uniqKey="Vercher J">J Vercher</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Neapolitan, Re" uniqKey="Neapolitan R">RE Neapolitan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Pearl, J" uniqKey="Pearl J">J Pearl</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Verma, T" uniqKey="Verma T">T Verma</name>
</author>
<author><name sortKey="Pearl, J" uniqKey="Pearl J">J Pearl</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Boutilier, C" uniqKey="Boutilier C">C Boutilier</name>
</author>
<author><name sortKey="Friedman, N" uniqKey="Friedman N">N Friedman</name>
</author>
<author><name sortKey="Goldszmidt, M" uniqKey="Goldszmidt M">M Goldszmidt</name>
</author>
<author><name sortKey="Koller, D" uniqKey="Koller D">D Koller</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Geiger, D" uniqKey="Geiger D">D Geiger</name>
</author>
<author><name sortKey="Heckerman, D" uniqKey="Heckerman D">D Heckerman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Geiger, D" uniqKey="Geiger D">D Geiger</name>
</author>
<author><name sortKey="Heckerman, D" uniqKey="Heckerman D">D Heckerman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bilmes, J" uniqKey="Bilmes J">J Bilmes</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cano, A" uniqKey="Cano A">A Cano</name>
</author>
<author><name sortKey="Castellano, J" uniqKey="Castellano J">J Castellano</name>
</author>
<author><name sortKey="Masegosa, A" uniqKey="Masegosa A">A Masegosa</name>
</author>
<author><name sortKey="Moral, S" uniqKey="Moral S">S Moral</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zhang, Nl" uniqKey="Zhang N">NL Zhang</name>
</author>
<author><name sortKey="Poole, D" uniqKey="Poole D">D Poole</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Theodoridis, S" uniqKey="Theodoridis S">S Theodoridis</name>
</author>
<author><name sortKey="Koutroumbas, K" uniqKey="Koutroumbas K">K Koutroumbas</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Murphy, Kp" uniqKey="Murphy K">KP Murphy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hospedales, T" uniqKey="Hospedales T">T Hospedales</name>
</author>
<author><name sortKey="Vijayakumar, S" uniqKey="Vijayakumar S">S Vijayakumar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Talsma, D" uniqKey="Talsma D">D Talsma</name>
</author>
<author><name sortKey="Senkowski, D" uniqKey="Senkowski D">D Senkowski</name>
</author>
<author><name sortKey="Soto Faraco, S" uniqKey="Soto Faraco S">S Soto-Faraco</name>
</author>
<author><name sortKey="Woldorff, Mg" uniqKey="Woldorff M">MG Woldorff</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Koelewijn, T" uniqKey="Koelewijn T">T Koelewijn</name>
</author>
<author><name sortKey="Bronkhorst, A" uniqKey="Bronkhorst A">A Bronkhorst</name>
</author>
<author><name sortKey="Theeuwes, J" uniqKey="Theeuwes J">J Theeuwes</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hospedales, Tm" uniqKey="Hospedales T">TM Hospedales</name>
</author>
<author><name sortKey="Vijayakumar, S" uniqKey="Vijayakumar S">S Vijayakumar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shams, L" uniqKey="Shams L">L Shams</name>
</author>
<author><name sortKey="Beierholm, U" uniqKey="Beierholm U">U Beierholm</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Spence, C" uniqKey="Spence C">C Spence</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<affiliations><list></list>
<tree><noCountry><name sortKey="Besson, Patricia" sort="Besson, Patricia" uniqKey="Besson P" first="Patricia" last="Besson">Patricia Besson</name>
<name sortKey="Bourdin, Christophe" sort="Bourdin, Christophe" uniqKey="Bourdin C" first="Christophe" last="Bourdin">Christophe Bourdin</name>
<name sortKey="Bringoux, Lionel" sort="Bringoux, Lionel" uniqKey="Bringoux L" first="Lionel" last="Bringoux">Lionel Bringoux</name>
</noCountry>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002D51 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 002D51 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Main |étape= Exploration |type= RBID |clé= PMC:3161793 |texte= A Comprehensive Model of Audiovisual Perception: Both Percept and Temporal Dynamics }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Exploration/RBID.i -Sk "pubmed:21887324" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |