Spatial Orienting in Complex Audiovisual Environments
Identifieur interne : 001006 ( Pmc/Checkpoint ); précédent : 001005; suivant : 001007Spatial Orienting in Complex Audiovisual Environments
Auteurs : Davide Nardo [Italie] ; Valerio Santangelo [Italie] ; Emiliano Macaluso [Italie]Source :
- Human brain mapping [ 1065-9471 ] ; 2013.
Abstract
Previous studies on crossmodal spatial orienting typically used simple and stereotyped stimuli in the absence of any meaningful context. This study combined computational models, behavioural measures and functional magnetic resonance imaging to investigate audiovisual spatial interactions in naturalistic settings. We created short videos portraying everyday life situations that included a lateralised visual event and a co-occurring sound, either on the same or on the opposite side of space. Subjects viewed the videos with or without eye-movements allowed (overt or covert orienting). For each video, visual and auditory saliency maps were used to index the strength of stimulus-driven signals, and eye-movements were used as a measure of the efficacy of the audiovisual events for spatial orienting. Results showed that visual salience modulated activity in higher-order visual areas, whereas auditory salience modulated activity in the superior temporal cortex. Auditory salience modulated activity also in the posterior parietal cortex, but only when audiovisual stimuli occurred on the same side of space (multisensory spatial congruence). Orienting efficacy affected activity in the visual cortex, within the same regions modulated by visual salience. These patterns of activation were comparable in overt and covert orienting conditions. Our results demonstrate that, during viewing of complex multisensory stimuli, activity in sensory areas reflects both stimulus-driven signals and their efficacy for spatial orienting; and that the posterior parietal cortex combines spatial information about the visual and the auditory modality.
Url:
DOI: 10.1002/hbm.22276
PubMed: 23616340
PubMed Central: 3786006
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
PMC:3786006Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Spatial Orienting in Complex Audiovisual Environments</title>
<author><name sortKey="Nardo, Davide" sort="Nardo, Davide" uniqKey="Nardo D" first="Davide" last="Nardo">Davide Nardo</name>
<affiliation wicri:level="3"><nlm:aff id="A1">Neuroimaging Laboratory, Santa Lucia Foundation, Rome, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Neuroimaging Laboratory, Santa Lucia Foundation, Rome</wicri:regionArea>
<placeName><settlement type="city">Rome</settlement>
<region nuts="2">Latium</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Santangelo, Valerio" sort="Santangelo, Valerio" uniqKey="Santangelo V" first="Valerio" last="Santangelo">Valerio Santangelo</name>
<affiliation wicri:level="3"><nlm:aff id="A1">Neuroimaging Laboratory, Santa Lucia Foundation, Rome, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Neuroimaging Laboratory, Santa Lucia Foundation, Rome</wicri:regionArea>
<placeName><settlement type="city">Rome</settlement>
<region nuts="2">Latium</region>
</placeName>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="A2">Department of Human and Educational Sciences, University of Perugia, Perugia, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Department of Human and Educational Sciences, University of Perugia, Perugia</wicri:regionArea>
<wicri:noRegion>Perugia</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Macaluso, Emiliano" sort="Macaluso, Emiliano" uniqKey="Macaluso E" first="Emiliano" last="Macaluso">Emiliano Macaluso</name>
<affiliation wicri:level="3"><nlm:aff id="A1">Neuroimaging Laboratory, Santa Lucia Foundation, Rome, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Neuroimaging Laboratory, Santa Lucia Foundation, Rome</wicri:regionArea>
<placeName><settlement type="city">Rome</settlement>
<region nuts="2">Latium</region>
</placeName>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">23616340</idno>
<idno type="pmc">3786006</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3786006</idno>
<idno type="RBID">PMC:3786006</idno>
<idno type="doi">10.1002/hbm.22276</idno>
<date when="2013">2013</date>
<idno type="wicri:Area/Pmc/Corpus">001B09</idno>
<idno type="wicri:Area/Pmc/Curation">001B09</idno>
<idno type="wicri:Area/Pmc/Checkpoint">001006</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Spatial Orienting in Complex Audiovisual Environments</title>
<author><name sortKey="Nardo, Davide" sort="Nardo, Davide" uniqKey="Nardo D" first="Davide" last="Nardo">Davide Nardo</name>
<affiliation wicri:level="3"><nlm:aff id="A1">Neuroimaging Laboratory, Santa Lucia Foundation, Rome, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Neuroimaging Laboratory, Santa Lucia Foundation, Rome</wicri:regionArea>
<placeName><settlement type="city">Rome</settlement>
<region nuts="2">Latium</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Santangelo, Valerio" sort="Santangelo, Valerio" uniqKey="Santangelo V" first="Valerio" last="Santangelo">Valerio Santangelo</name>
<affiliation wicri:level="3"><nlm:aff id="A1">Neuroimaging Laboratory, Santa Lucia Foundation, Rome, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Neuroimaging Laboratory, Santa Lucia Foundation, Rome</wicri:regionArea>
<placeName><settlement type="city">Rome</settlement>
<region nuts="2">Latium</region>
</placeName>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="A2">Department of Human and Educational Sciences, University of Perugia, Perugia, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Department of Human and Educational Sciences, University of Perugia, Perugia</wicri:regionArea>
<wicri:noRegion>Perugia</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Macaluso, Emiliano" sort="Macaluso, Emiliano" uniqKey="Macaluso E" first="Emiliano" last="Macaluso">Emiliano Macaluso</name>
<affiliation wicri:level="3"><nlm:aff id="A1">Neuroimaging Laboratory, Santa Lucia Foundation, Rome, Italy</nlm:aff>
<country xml:lang="fr">Italie</country>
<wicri:regionArea>Neuroimaging Laboratory, Santa Lucia Foundation, Rome</wicri:regionArea>
<placeName><settlement type="city">Rome</settlement>
<region nuts="2">Latium</region>
</placeName>
</affiliation>
</author>
</analytic>
<series><title level="j">Human brain mapping</title>
<idno type="ISSN">1065-9471</idno>
<idno type="eISSN">1097-0193</idno>
<imprint><date when="2013">2013</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p id="P1">Previous studies on crossmodal spatial orienting typically used simple and stereotyped stimuli in the absence of any meaningful context. This study combined computational models, behavioural measures and functional magnetic resonance imaging to investigate audiovisual spatial interactions in naturalistic settings. We created short videos portraying everyday life situations that included a lateralised visual event and a co-occurring sound, either on the same or on the opposite side of space. Subjects viewed the videos with or without eye-movements allowed (overt or covert orienting). For each video, visual and auditory saliency maps were used to index the strength of stimulus-driven signals, and eye-movements were used as a measure of the efficacy of the audiovisual events for spatial orienting. Results showed that visual salience modulated activity in higher-order visual areas, whereas auditory salience modulated activity in the superior temporal cortex. Auditory salience modulated activity also in the posterior parietal cortex, but only when audiovisual stimuli occurred on the same side of space (multisensory spatial congruence). Orienting efficacy affected activity in the visual cortex, within the same regions modulated by visual salience. These patterns of activation were comparable in overt and covert orienting conditions. Our results demonstrate that, during viewing of complex multisensory stimuli, activity in sensory areas reflects both stimulus-driven signals and their efficacy for spatial orienting; and that the posterior parietal cortex combines spatial information about the visual and the auditory modality.</p>
</div>
</front>
</TEI>
<pmc article-type="research-article"><pmc-comment>The publisher of this article does not allow downloading of the full text in XML form.</pmc-comment>
<pmc-dir>properties manuscript</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-journal-id">9419065</journal-id>
<journal-id journal-id-type="pubmed-jr-id">21028</journal-id>
<journal-id journal-id-type="nlm-ta">Hum Brain Mapp</journal-id>
<journal-id journal-id-type="iso-abbrev">Hum Brain Mapp</journal-id>
<journal-title-group><journal-title>Human brain mapping</journal-title>
</journal-title-group>
<issn pub-type="ppub">1065-9471</issn>
<issn pub-type="epub">1097-0193</issn>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">23616340</article-id>
<article-id pub-id-type="pmc">3786006</article-id>
<article-id pub-id-type="doi">10.1002/hbm.22276</article-id>
<article-id pub-id-type="manuscript">EMS53756</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Article</subject>
</subj-group>
</article-categories>
<title-group><article-title>Spatial Orienting in Complex Audiovisual Environments</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Nardo</surname>
<given-names>Davide</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
<xref ref-type="corresp" rid="CR1">*</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Santangelo</surname>
<given-names>Valerio</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Macaluso</surname>
<given-names>Emiliano</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
</contrib>
</contrib-group>
<aff id="A1"><label>1</label>
Neuroimaging Laboratory, Santa Lucia Foundation, Rome, Italy</aff>
<aff id="A2"><label>2</label>
Department of Human and Educational Sciences, University of Perugia, Perugia, Italy</aff>
<author-notes><corresp id="CR1"><label>*</label>
Correspondence to: Davide Nardo, Neuroimaging Laboratory, Santa Lucia Foundation, Via Ardeatina 306, Rome 00179, Italy. <email>davidenardo@gmail.com</email>
</corresp>
</author-notes>
<pub-date pub-type="nihms-submitted"><day>21</day>
<month>6</month>
<year>2013</year>
</pub-date>
<pub-date pub-type="epub"><day>24</day>
<month>4</month>
<year>2013</year>
</pub-date>
<pub-date pub-type="ppub"><month>4</month>
<year>2014</year>
</pub-date>
<pub-date pub-type="pmc-release"><day>01</day>
<month>4</month>
<year>2014</year>
</pub-date>
<volume>35</volume>
<issue>4</issue>
<fpage>1597</fpage>
<lpage>1614</lpage>
<pmc-comment>elocation-id from pubmed: 10.1002/hbm.22276</pmc-comment>
<permissions><copyright-statement>© 2013 Wiley-Periodicals, Inc.</copyright-statement>
<copyright-year>2013</copyright-year>
</permissions>
<abstract><p id="P1">Previous studies on crossmodal spatial orienting typically used simple and stereotyped stimuli in the absence of any meaningful context. This study combined computational models, behavioural measures and functional magnetic resonance imaging to investigate audiovisual spatial interactions in naturalistic settings. We created short videos portraying everyday life situations that included a lateralised visual event and a co-occurring sound, either on the same or on the opposite side of space. Subjects viewed the videos with or without eye-movements allowed (overt or covert orienting). For each video, visual and auditory saliency maps were used to index the strength of stimulus-driven signals, and eye-movements were used as a measure of the efficacy of the audiovisual events for spatial orienting. Results showed that visual salience modulated activity in higher-order visual areas, whereas auditory salience modulated activity in the superior temporal cortex. Auditory salience modulated activity also in the posterior parietal cortex, but only when audiovisual stimuli occurred on the same side of space (multisensory spatial congruence). Orienting efficacy affected activity in the visual cortex, within the same regions modulated by visual salience. These patterns of activation were comparable in overt and covert orienting conditions. Our results demonstrate that, during viewing of complex multisensory stimuli, activity in sensory areas reflects both stimulus-driven signals and their efficacy for spatial orienting; and that the posterior parietal cortex combines spatial information about the visual and the auditory modality.</p>
</abstract>
<kwd-group><kwd>attention</kwd>
<kwd>space</kwd>
<kwd>visual</kwd>
<kwd>auditory</kwd>
<kwd>multisensory</kwd>
<kwd>eye movements</kwd>
<kwd>saliency</kwd>
<kwd>orienting</kwd>
<kwd>ecological</kwd>
<kwd>posterior parietal cortex</kwd>
</kwd-group>
</article-meta>
</front>
</pmc>
<affiliations><list><country><li>Italie</li>
</country>
<region><li>Latium</li>
</region>
<settlement><li>Rome</li>
</settlement>
</list>
<tree><country name="Italie"><region name="Latium"><name sortKey="Nardo, Davide" sort="Nardo, Davide" uniqKey="Nardo D" first="Davide" last="Nardo">Davide Nardo</name>
</region>
<name sortKey="Macaluso, Emiliano" sort="Macaluso, Emiliano" uniqKey="Macaluso E" first="Emiliano" last="Macaluso">Emiliano Macaluso</name>
<name sortKey="Santangelo, Valerio" sort="Santangelo, Valerio" uniqKey="Santangelo V" first="Valerio" last="Santangelo">Valerio Santangelo</name>
<name sortKey="Santangelo, Valerio" sort="Santangelo, Valerio" uniqKey="Santangelo V" first="Valerio" last="Santangelo">Valerio Santangelo</name>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001006 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd -nk 001006 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Checkpoint |type= RBID |clé= PMC:3786006 |texte= Spatial Orienting in Complex Audiovisual Environments }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/RBID.i -Sk "pubmed:23616340" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |