Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools
Identifieur interne : 000808 ( Pmc/Curation ); précédent : 000807; suivant : 000809Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools
Auteurs : Marcus J. Naumer [Allemagne, Pays-Bas] ; Jasper J. F. Van Den Bosch [Allemagne] ; Michael Wibral [Allemagne] ; Axel Kohler [Suisse] ; Wolf Singer [Allemagne] ; Jochen Kaiser [Allemagne] ; Vincent Van De Ven [Pays-Bas] ; Lars Muckli [Royaume-Uni]Source :
- Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale [ 0014-4819 ] ; 2011.
Abstract
Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.
The online version of this article (doi:10.1007/s00221-011-2669-0) contains supplementary material, which is available to authorized users.
Url:
DOI: 10.1007/s00221-011-2669-0
PubMed: 21503649
PubMed Central: 3155044
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :000808
Links to Exploration step
PMC:3155044Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools</title><author><name sortKey="Naumer, Marcus J" sort="Naumer, Marcus J" uniqKey="Naumer M" first="Marcus J." last="Naumer">Marcus J. Naumer</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff2">Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Faculty of Psychology and Neuroscience, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Van Den Bosch, Jasper J F" sort="Van Den Bosch, Jasper J F" uniqKey="Van Den Bosch J" first="Jasper J. F." last="Van Den Bosch">Jasper J. F. Van Den Bosch</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Wibral, Michael" sort="Wibral, Michael" uniqKey="Wibral M" first="Michael" last="Wibral">Michael Wibral</name><affiliation wicri:level="1"><nlm:aff id="Aff3">Brain Imaging Center, Goethe-University, Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Brain Imaging Center, Goethe-University, Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Kohler, Axel" sort="Kohler, Axel" uniqKey="Kohler A" first="Axel" last="Kohler">Axel Kohler</name><affiliation wicri:level="1"><nlm:aff id="Aff4">Department of Psychiatric Neurophysiology, University Hospital of Psychiatry, Bern, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Department of Psychiatric Neurophysiology, University Hospital of Psychiatry, Bern</wicri:regionArea></affiliation></author><author><name sortKey="Singer, Wolf" sort="Singer, Wolf" uniqKey="Singer W" first="Wolf" last="Singer">Wolf Singer</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Max Planck Institute for Brain Research, Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Max Planck Institute for Brain Research, Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Kaiser, Jochen" sort="Kaiser, Jochen" uniqKey="Kaiser J" first="Jochen" last="Kaiser">Jochen Kaiser</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Van De Ven, Vincent" sort="Van De Ven, Vincent" uniqKey="Van De Ven V" first="Vincent" last="Van De Ven">Vincent Van De Ven</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Faculty of Psychology and Neuroscience, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Muckli, Lars" sort="Muckli, Lars" uniqKey="Muckli L" first="Lars" last="Muckli">Lars Muckli</name><affiliation wicri:level="1"><nlm:aff id="Aff6">Centre for Cognitive Neuroimaging (CCNi), Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK</nlm:aff><country xml:lang="fr">Royaume-Uni</country><wicri:regionArea>Centre for Cognitive Neuroimaging (CCNi), Institute of Neuroscience and Psychology, University of Glasgow, Glasgow</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff7">School of Psychology, University of Glasgow, Glasgow, UK</nlm:aff><country xml:lang="fr">Royaume-Uni</country><wicri:regionArea>School of Psychology, University of Glasgow, Glasgow</wicri:regionArea></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">21503649</idno><idno type="pmc">3155044</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3155044</idno><idno type="RBID">PMC:3155044</idno><idno type="doi">10.1007/s00221-011-2669-0</idno><date when="2011">2011</date><idno type="wicri:Area/Pmc/Corpus">000808</idno><idno type="wicri:Area/Pmc/Curation">000808</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools</title><author><name sortKey="Naumer, Marcus J" sort="Naumer, Marcus J" uniqKey="Naumer M" first="Marcus J." last="Naumer">Marcus J. Naumer</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff2">Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Faculty of Psychology and Neuroscience, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Van Den Bosch, Jasper J F" sort="Van Den Bosch, Jasper J F" uniqKey="Van Den Bosch J" first="Jasper J. F." last="Van Den Bosch">Jasper J. F. Van Den Bosch</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Wibral, Michael" sort="Wibral, Michael" uniqKey="Wibral M" first="Michael" last="Wibral">Michael Wibral</name><affiliation wicri:level="1"><nlm:aff id="Aff3">Brain Imaging Center, Goethe-University, Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Brain Imaging Center, Goethe-University, Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Kohler, Axel" sort="Kohler, Axel" uniqKey="Kohler A" first="Axel" last="Kohler">Axel Kohler</name><affiliation wicri:level="1"><nlm:aff id="Aff4">Department of Psychiatric Neurophysiology, University Hospital of Psychiatry, Bern, Switzerland</nlm:aff><country xml:lang="fr">Suisse</country><wicri:regionArea>Department of Psychiatric Neurophysiology, University Hospital of Psychiatry, Bern</wicri:regionArea></affiliation></author><author><name sortKey="Singer, Wolf" sort="Singer, Wolf" uniqKey="Singer W" first="Wolf" last="Singer">Wolf Singer</name><affiliation wicri:level="1"><nlm:aff id="Aff5">Max Planck Institute for Brain Research, Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Max Planck Institute for Brain Research, Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Kaiser, Jochen" sort="Kaiser, Jochen" uniqKey="Kaiser J" first="Jochen" last="Kaiser">Jochen Kaiser</name><affiliation wicri:level="1"><nlm:aff id="Aff1">Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany</nlm:aff><country xml:lang="fr">Allemagne</country><wicri:regionArea>Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main</wicri:regionArea></affiliation></author><author><name sortKey="Van De Ven, Vincent" sort="Van De Ven, Vincent" uniqKey="Van De Ven V" first="Vincent" last="Van De Ven">Vincent Van De Ven</name><affiliation wicri:level="1"><nlm:aff id="Aff2">Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands</nlm:aff><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Faculty of Psychology and Neuroscience, Maastricht University, Maastricht</wicri:regionArea></affiliation></author><author><name sortKey="Muckli, Lars" sort="Muckli, Lars" uniqKey="Muckli L" first="Lars" last="Muckli">Lars Muckli</name><affiliation wicri:level="1"><nlm:aff id="Aff6">Centre for Cognitive Neuroimaging (CCNi), Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK</nlm:aff><country xml:lang="fr">Royaume-Uni</country><wicri:regionArea>Centre for Cognitive Neuroimaging (CCNi), Institute of Neuroscience and Psychology, University of Glasgow, Glasgow</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="Aff7">School of Psychology, University of Glasgow, Glasgow, UK</nlm:aff><country xml:lang="fr">Royaume-Uni</country><wicri:regionArea>School of Psychology, University of Glasgow, Glasgow</wicri:regionArea></affiliation></author></analytic><series><title level="j">Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale</title><idno type="ISSN">0014-4819</idno><idno type="eISSN">1432-1106</idno><imprint><date when="2011">2011</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.</p><sec><title>Electronic supplementary material</title><p>The online version of this article (doi:10.1007/s00221-011-2669-0) contains supplementary material, which is available to authorized users.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Amedi, A" uniqKey="Amedi A">A Amedi</name></author><author><name sortKey="Kriegstein, K" uniqKey="Kriegstein K">K Kriegstein</name></author><author><name sortKey="Atteveldt, Nm" uniqKey="Atteveldt N">NM Atteveldt</name></author><author><name sortKey="Beauchamp, Ms" uniqKey="Beauchamp M">MS Beauchamp</name></author><author><name sortKey="Naumer, Mj" uniqKey="Naumer M">MJ Naumer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Angelaki, De" uniqKey="Angelaki D">DE Angelaki</name></author><author><name sortKey="Gu, Y" uniqKey="Gu Y">Y Gu</name></author><author><name sortKey="Deangelis, Gc" uniqKey="Deangelis G">GC DeAngelis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Baier, B" uniqKey="Baier B">B Baier</name></author><author><name sortKey="Kleinschmidt, A" uniqKey="Kleinschmidt A">A Kleinschmidt</name></author><author><name sortKey="Muller, Ng" uniqKey="Muller N">NG Müller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bartels, A" uniqKey="Bartels A">A Bartels</name></author><author><name sortKey="Zeki, S" uniqKey="Zeki S">S Zeki</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beauchamp, Ms" uniqKey="Beauchamp M">MS Beauchamp</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beauchamp, Ms" uniqKey="Beauchamp M">MS Beauchamp</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beauchamp, Ms" uniqKey="Beauchamp M">MS Beauchamp</name></author><author><name sortKey="Lee, Ke" uniqKey="Lee K">KE Lee</name></author><author><name sortKey="Argall, Bd" uniqKey="Argall B">BD Argall</name></author><author><name sortKey="Martin, A" uniqKey="Martin A">A Martin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Belardinelli, Mo" uniqKey="Belardinelli M">MO Belardinelli</name></author><author><name sortKey="Sestieri, C" uniqKey="Sestieri C">C Sestieri</name></author><author><name sortKey="Di Matteo, R" uniqKey="Di Matteo R">R Di Matteo</name></author><author><name sortKey="Delogu, F" uniqKey="Delogu F">F Delogu</name></author><author><name sortKey="Del Gratta, C" uniqKey="Del Gratta C">C Del Gratta</name></author><author><name sortKey="Ferretti, A" uniqKey="Ferretti A">A Ferretti</name></author><author><name sortKey="Caulo, M" uniqKey="Caulo M">M Caulo</name></author><author><name sortKey="Tartaro, A" uniqKey="Tartaro A">A Tartaro</name></author><author><name sortKey="Romani, Gl" uniqKey="Romani G">GL Romani</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bell, Aj" uniqKey="Bell A">AJ Bell</name></author><author><name sortKey="Sejnowski, Tj" uniqKey="Sejnowski T">TJ Sejnowski</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Boynton, Gm" uniqKey="Boynton G">GM Boynton</name></author><author><name sortKey="Engel, Sa" uniqKey="Engel S">SA Engel</name></author><author><name sortKey="Glover, Gh" uniqKey="Glover G">GH Glover</name></author><author><name sortKey="Heeger, Dj" uniqKey="Heeger D">DJ Heeger</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Calhoun, Vd" uniqKey="Calhoun V">VD Calhoun</name></author><author><name sortKey="Adali, T" uniqKey="Adali T">T Adali</name></author><author><name sortKey="Pearlson, Gd" uniqKey="Pearlson G">GD Pearlson</name></author><author><name sortKey="Pekar, Jj" uniqKey="Pekar J">JJ Pekar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Calhoun, V" uniqKey="Calhoun V">V Calhoun</name></author><author><name sortKey="Adali, T" uniqKey="Adali T">T Adali</name></author><author><name sortKey="Pekar, J" uniqKey="Pekar J">J Pekar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Calvert, G" uniqKey="Calvert G">G Calvert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Castelo Branco, M" uniqKey="Castelo Branco M">M Castelo-Branco</name></author><author><name sortKey="Formisano, E" uniqKey="Formisano E">E Formisano</name></author><author><name sortKey="Backes, W" uniqKey="Backes W">W Backes</name></author><author><name sortKey="Zanella, F" uniqKey="Zanella F">F Zanella</name></author><author><name sortKey="Neuenschwander, S" uniqKey="Neuenschwander S">S Neuenschwander</name></author><author><name sortKey="Singer, W" uniqKey="Singer W">W Singer</name></author><author><name sortKey="Goebel, R" uniqKey="Goebel R">R Goebel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Doehrmann, O" uniqKey="Doehrmann O">O Doehrmann</name></author><author><name sortKey="Naumer, Mj" uniqKey="Naumer M">MJ Naumer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Doehrmann, O" uniqKey="Doehrmann O">O Doehrmann</name></author><author><name sortKey="Weigelt, S" uniqKey="Weigelt S">S Weigelt</name></author><author><name sortKey="Altmann, Cf" uniqKey="Altmann C">CF Altmann</name></author><author><name sortKey="Kaiser, J" uniqKey="Kaiser J">J Kaiser</name></author><author><name sortKey="Naumer, Mj" uniqKey="Naumer M">MJ Naumer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Driver, J" uniqKey="Driver J">J Driver</name></author><author><name sortKey="Noesselt, T" uniqKey="Noesselt T">T Noesselt</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eckert, Ma" uniqKey="Eckert M">MA Eckert</name></author><author><name sortKey="Kamdar, Nv" uniqKey="Kamdar N">NV Kamdar</name></author><author><name sortKey="Chang, Ce" uniqKey="Chang C">CE Chang</name></author><author><name sortKey="Beckmann, Cf" uniqKey="Beckmann C">CF Beckmann</name></author><author><name sortKey="Greicius, Md" uniqKey="Greicius M">MD Greicius</name></author><author><name sortKey="Menon, V" uniqKey="Menon V">V Menon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Esposito, F" uniqKey="Esposito F">F Esposito</name></author><author><name sortKey="Scarabino, T" uniqKey="Scarabino T">T Scarabino</name></author><author><name sortKey="Hyv Rinen, A" uniqKey="Hyv Rinen A">A Hyvärinen</name></author><author><name sortKey="Himberg, J" uniqKey="Himberg J">J Himberg</name></author><author><name sortKey="Formisano, E" uniqKey="Formisano E">E Formisano</name></author><author><name sortKey="Comani, S" uniqKey="Comani S">S Comani</name></author><author><name sortKey="Tedeschi, G" uniqKey="Tedeschi G">G Tedeschi</name></author><author><name sortKey="Goebel, R" uniqKey="Goebel R">R Goebel</name></author><author><name sortKey="Seifritz, E" uniqKey="Seifritz E">E Seifritz</name></author><author><name sortKey="Di Salle, F" uniqKey="Di Salle F">F Di Salle</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Forman, Sd" uniqKey="Forman S">SD Forman</name></author><author><name sortKey="Cohen, Jd" uniqKey="Cohen J">JD Cohen</name></author><author><name sortKey="Fitzgerald, M" uniqKey="Fitzgerald M">M Fitzgerald</name></author><author><name sortKey="Eddy, Wf" uniqKey="Eddy W">WF Eddy</name></author><author><name sortKey="Mintun, Ma" uniqKey="Mintun M">MA Mintun</name></author><author><name sortKey="Noll, Dc" uniqKey="Noll D">DC Noll</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Friston, Kj" uniqKey="Friston K">KJ Friston</name></author><author><name sortKey="Frith, Cd" uniqKey="Frith C">CD Frith</name></author><author><name sortKey="Liddle, Pf" uniqKey="Liddle P">PF Liddle</name></author><author><name sortKey="Frackowiak, Rs" uniqKey="Frackowiak R">RS Frackowiak</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Friston, Kj" uniqKey="Friston K">KJ Friston</name></author><author><name sortKey="Harrison, L" uniqKey="Harrison L">L Harrison</name></author><author><name sortKey="Penny, W" uniqKey="Penny W">W Penny</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ghazanfar, A" uniqKey="Ghazanfar A">A Ghazanfar</name></author><author><name sortKey="Schroeder, C" uniqKey="Schroeder C">C Schroeder</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Greicius, Md" uniqKey="Greicius M">MD Greicius</name></author><author><name sortKey="Krasnow, B" uniqKey="Krasnow B">B Krasnow</name></author><author><name sortKey="Reiss, Al" uniqKey="Reiss A">AL Reiss</name></author><author><name sortKey="Menon, V" uniqKey="Menon V">V Menon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hein, G" uniqKey="Hein G">G Hein</name></author><author><name sortKey="Doehrmann, O" uniqKey="Doehrmann O">O Doehrmann</name></author><author><name sortKey="Muller, Ng" uniqKey="Muller N">NG Müller</name></author><author><name sortKey="Kaiser, J" uniqKey="Kaiser J">J Kaiser</name></author><author><name sortKey="Muckli, L" uniqKey="Muckli L">L Muckli</name></author><author><name sortKey="Naumer, Mj" uniqKey="Naumer M">MJ Naumer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Himberg, J" uniqKey="Himberg J">J Himberg</name></author><author><name sortKey="Hyv Rinen, A" uniqKey="Hyv Rinen A">A Hyvärinen</name></author><author><name sortKey="Esposito, F" uniqKey="Esposito F">F Esposito</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hocking, J" uniqKey="Hocking J">J Hocking</name></author><author><name sortKey="Price, Cj" uniqKey="Price C">CJ Price</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hyv Rinen, A" uniqKey="Hyv Rinen A">A Hyvärinen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kayser, C" uniqKey="Kayser C">C Kayser</name></author><author><name sortKey="Logothetis, Nk" uniqKey="Logothetis N">NK Logothetis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lewis, Jw" uniqKey="Lewis J">JW Lewis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Liao, R" uniqKey="Liao R">R Liao</name></author><author><name sortKey="Mckeown, Mj" uniqKey="Mckeown M">MJ McKeown</name></author><author><name sortKey="Krolik, Jl" uniqKey="Krolik J">JL Krolik</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Macaluso, E" uniqKey="Macaluso E">E Macaluso</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Malinen, S" uniqKey="Malinen S">S Malinen</name></author><author><name sortKey="Hlushchuk, Y" uniqKey="Hlushchuk Y">Y Hlushchuk</name></author><author><name sortKey="Hari, R" uniqKey="Hari R">R Hari</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Martuzzi, R" uniqKey="Martuzzi R">R Martuzzi</name></author><author><name sortKey="Murray, Mm" uniqKey="Murray M">MM Murray</name></author><author><name sortKey="Michel, C" uniqKey="Michel C">C Michel</name></author><author><name sortKey="Thiran, J" uniqKey="Thiran J">J Thiran</name></author><author><name sortKey="Maeder, P" uniqKey="Maeder P">P Maeder</name></author><author><name sortKey="Clarke, S" uniqKey="Clarke S">S Clarke</name></author><author><name sortKey="Meuli, Ra" uniqKey="Meuli R">RA Meuli</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mckeown, Mj" uniqKey="Mckeown M">MJ McKeown</name></author><author><name sortKey="Makeig, S" uniqKey="Makeig S">S Makeig</name></author><author><name sortKey="Brown, Gg" uniqKey="Brown G">GG Brown</name></author><author><name sortKey="Jung, Tp" uniqKey="Jung T">TP Jung</name></author><author><name sortKey="Kindermann, Ss" uniqKey="Kindermann S">SS Kindermann</name></author><author><name sortKey="Bell, Aj" uniqKey="Bell A">AJ Bell</name></author><author><name sortKey="Sejnowski, Tj" uniqKey="Sejnowski T">TJ Sejnowski</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meienbrock, A" uniqKey="Meienbrock A">A Meienbrock</name></author><author><name sortKey="Naumer, Mj" uniqKey="Naumer M">MJ Naumer</name></author><author><name sortKey="Doehrmann, O" uniqKey="Doehrmann O">O Doehrmann</name></author><author><name sortKey="Singer, W" uniqKey="Singer W">W Singer</name></author><author><name sortKey="Muckli, L" uniqKey="Muckli L">L Muckli</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Moritz, Ch" uniqKey="Moritz C">CH Moritz</name></author><author><name sortKey="Rogers, Bp" uniqKey="Rogers B">BP Rogers</name></author><author><name sortKey="Meyerand, Me" uniqKey="Meyerand M">ME Meyerand</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Naumer, Mj" uniqKey="Naumer M">MJ Naumer</name></author><author><name sortKey="Kaiser, J" uniqKey="Kaiser J">J Kaiser</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Naumer, Mj" uniqKey="Naumer M">MJ Naumer</name></author><author><name sortKey="Doehrmann, O" uniqKey="Doehrmann O">O Doehrmann</name></author><author><name sortKey="Muller, Ng" uniqKey="Muller N">NG Müller</name></author><author><name sortKey="Muckli, L" uniqKey="Muckli L">L Muckli</name></author><author><name sortKey="Kaiser, J" uniqKey="Kaiser J">J Kaiser</name></author><author><name sortKey="Hein, G" uniqKey="Hein G">G Hein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Noesselt, T" uniqKey="Noesselt T">T Noesselt</name></author><author><name sortKey="Rieder, Jw" uniqKey="Rieder J">JW Rieder</name></author><author><name sortKey="Schoenfeld, Ma" uniqKey="Schoenfeld M">MA Schoenfeld</name></author><author><name sortKey="Kanowski, M" uniqKey="Kanowski M">M Kanowski</name></author><author><name sortKey="Hinrichs, H" uniqKey="Hinrichs H">H Hinrichs</name></author><author><name sortKey="Heinze, Hj" uniqKey="Heinze H">HJ Heinze</name></author><author><name sortKey="Driver, J" uniqKey="Driver J">J Driver</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Noppeney, U" uniqKey="Noppeney U">U Noppeney</name></author><author><name sortKey="Josephs, O" uniqKey="Josephs O">O Josephs</name></author><author><name sortKey="Hocking, J" uniqKey="Hocking J">J Hocking</name></author><author><name sortKey="Price, Cj" uniqKey="Price C">CJ Price</name></author><author><name sortKey="Friston, Kj" uniqKey="Friston K">KJ Friston</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Noppeney, U" uniqKey="Noppeney U">U Noppeney</name></author><author><name sortKey="Ostwald, D" uniqKey="Ostwald D">D Ostwald</name></author><author><name sortKey="Werner, S" uniqKey="Werner S">S Werner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rajapakse, Jc" uniqKey="Rajapakse J">JC Rajapakse</name></author><author><name sortKey="Tan, Cl" uniqKey="Tan C">CL Tan</name></author><author><name sortKey="Zheng, X" uniqKey="Zheng X">X Zheng</name></author><author><name sortKey="Mukhopadhyay, S" uniqKey="Mukhopadhyay S">S Mukhopadhyay</name></author><author><name sortKey="Yang, K" uniqKey="Yang K">K Yang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rogers, Bp" uniqKey="Rogers B">BP Rogers</name></author><author><name sortKey="Morgan, Vl" uniqKey="Morgan V">VL Morgan</name></author><author><name sortKey="Newton, At" uniqKey="Newton A">AT Newton</name></author><author><name sortKey="Gore, Jc" uniqKey="Gore J">JC Gore</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sadaghiani, S" uniqKey="Sadaghiani S">S Sadaghiani</name></author><author><name sortKey="Maier, Jx" uniqKey="Maier J">JX Maier</name></author><author><name sortKey="Noppeney, U" uniqKey="Noppeney U">U Noppeney</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schroeder, Ce" uniqKey="Schroeder C">CE Schroeder</name></author><author><name sortKey="Foxe, Jj" uniqKey="Foxe J">JJ Foxe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stein, Be" uniqKey="Stein B">BE Stein</name></author><author><name sortKey="Meredith, Ma" uniqKey="Meredith M">MA Meredith</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stevenson, R" uniqKey="Stevenson R">R Stevenson</name></author><author><name sortKey="Geoghegan, M" uniqKey="Geoghegan M">M Geoghegan</name></author><author><name sortKey="James, T" uniqKey="James T">T James</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stevenson, Ra" uniqKey="Stevenson R">RA Stevenson</name></author><author><name sortKey="Kim, S" uniqKey="Kim S">S Kim</name></author><author><name sortKey="James, Tw" uniqKey="James T">TW James</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Talairach, J" uniqKey="Talairach J">J Talairach</name></author><author><name sortKey="Tournoux, P" uniqKey="Tournoux P">P Tournoux</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Thomas, Cg" uniqKey="Thomas C">CG Thomas</name></author><author><name sortKey="Harshman, Ra" uniqKey="Harshman R">RA Harshman</name></author><author><name sortKey="Menon, Rs" uniqKey="Menon R">RS Menon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Atteveldt, Nm" uniqKey="Atteveldt N">NM Atteveldt</name></author><author><name sortKey="Formisano, E" uniqKey="Formisano E">E Formisano</name></author><author><name sortKey="Goebel, R" uniqKey="Goebel R">R Goebel</name></author><author><name sortKey="Blomert, L" uniqKey="Blomert L">L Blomert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Atteveldt, Nm" uniqKey="Atteveldt N">NM Atteveldt</name></author><author><name sortKey="Blau, Vc" uniqKey="Blau V">VC Blau</name></author><author><name sortKey="Blomert, L" uniqKey="Blomert L">L Blomert</name></author><author><name sortKey="Goebel, R" uniqKey="Goebel R">R Goebel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ven, Vg" uniqKey="Ven V">VG Ven</name></author><author><name sortKey="Formisano, E" uniqKey="Formisano E">E Formisano</name></author><author><name sortKey="Prvulovic, D" uniqKey="Prvulovic D">D Prvulovic</name></author><author><name sortKey="Roeder, Ch" uniqKey="Roeder C">CH Roeder</name></author><author><name sortKey="Linden, Dej" uniqKey="Linden D">DEJ Linden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ven, Vg" uniqKey="Ven V">VG Ven</name></author><author><name sortKey="Bledowski, C" uniqKey="Bledowski C">C Bledowski</name></author><author><name sortKey="Prvulovic, D" uniqKey="Prvulovic D">D Prvulovic</name></author><author><name sortKey="Goebel, R" uniqKey="Goebel R">R Goebel</name></author><author><name sortKey="Formisano, E" uniqKey="Formisano E">E Formisano</name></author><author><name sortKey="Linden, Dej" uniqKey="Linden D">DEJ Linden</name></author><author><name sortKey="Di Salle, F" uniqKey="Di Salle F">F Di Salle</name></author><author><name sortKey="Esposito, F" uniqKey="Esposito F">F Esposito</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ven, V" uniqKey="Ven V">V Ven</name></author><author><name sortKey="Esposito, F" uniqKey="Esposito F">F Esposito</name></author><author><name sortKey="Christoffels, Ik" uniqKey="Christoffels I">IK Christoffels</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Werner, S" uniqKey="Werner S">S Werner</name></author><author><name sortKey="Noppeney, U" uniqKey="Noppeney U">U Noppeney</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Werner, S" uniqKey="Werner S">S Werner</name></author><author><name sortKey="Noppeney, U" uniqKey="Noppeney U">U Noppeney</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Exp Brain Res</journal-id><journal-title-group><journal-title>Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale</journal-title></journal-title-group><issn pub-type="ppub">0014-4819</issn><issn pub-type="epub">1432-1106</issn><publisher><publisher-name>Springer-Verlag</publisher-name><publisher-loc>Berlin/Heidelberg</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">21503649</article-id><article-id pub-id-type="pmc">3155044</article-id><article-id pub-id-type="publisher-id">2669</article-id><article-id pub-id-type="doi">10.1007/s00221-011-2669-0</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Naumer</surname><given-names>Marcus J.</given-names></name><address><phone>+49-69-6301-6581</phone><fax>+49-69-6301-7606</fax><email>M.J.Naumer@med.uni-frankfurt.de</email></address><xref ref-type="aff" rid="Aff1">1</xref><xref ref-type="aff" rid="Aff2">2</xref></contrib><contrib contrib-type="author"><name><surname>van den Bosch</surname><given-names>Jasper J. F.</given-names></name><xref ref-type="aff" rid="Aff1">1</xref></contrib><contrib contrib-type="author"><name><surname>Wibral</surname><given-names>Michael</given-names></name><xref ref-type="aff" rid="Aff3">3</xref></contrib><contrib contrib-type="author"><name><surname>Kohler</surname><given-names>Axel</given-names></name><xref ref-type="aff" rid="Aff4">4</xref></contrib><contrib contrib-type="author"><name><surname>Singer</surname><given-names>Wolf</given-names></name><xref ref-type="aff" rid="Aff5">5</xref></contrib><contrib contrib-type="author"><name><surname>Kaiser</surname><given-names>Jochen</given-names></name><xref ref-type="aff" rid="Aff1">1</xref></contrib><contrib contrib-type="author"><name><surname>van de Ven</surname><given-names>Vincent</given-names></name><xref ref-type="aff" rid="Aff2">2</xref></contrib><contrib contrib-type="author"><name><surname>Muckli</surname><given-names>Lars</given-names></name><xref ref-type="aff" rid="Aff6">6</xref><xref ref-type="aff" rid="Aff7">7</xref></contrib><aff id="Aff1"><label>1</label>Crossmodal Neuroimaging Lab, Institute of Medical Psychology, Goethe-University of Frankfurt, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany</aff><aff id="Aff2"><label>2</label>Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands</aff><aff id="Aff3"><label>3</label>Brain Imaging Center, Goethe-University, Frankfurt am Main, Germany</aff><aff id="Aff4"><label>4</label>Department of Psychiatric Neurophysiology, University Hospital of Psychiatry, Bern, Switzerland</aff><aff id="Aff5"><label>5</label>Max Planck Institute for Brain Research, Frankfurt am Main, Germany</aff><aff id="Aff6"><label>6</label>Centre for Cognitive Neuroimaging (CCNi), Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK</aff><aff id="Aff7"><label>7</label>School of Psychology, University of Glasgow, Glasgow, UK</aff></contrib-group><pub-date pub-type="epub"><day>19</day><month>4</month><year>2011</year></pub-date><pub-date pub-type="pmc-release"><day>19</day><month>4</month><year>2011</year></pub-date><pub-date pub-type="ppub"><month>9</month><year>2011</year></pub-date><volume>213</volume><issue>2-3</issue><fpage>309</fpage><lpage>320</lpage><history><date date-type="received"><day>1</day><month>11</month><year>2010</year></date><date date-type="accepted"><day>28</day><month>3</month><year>2011</year></date></history><permissions><copyright-statement>© The Author(s) 2011</copyright-statement></permissions><abstract id="Abs1"><p>Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.</p><sec><title>Electronic supplementary material</title><p>The online version of this article (doi:10.1007/s00221-011-2669-0) contains supplementary material, which is available to authorized users.</p></sec></abstract><kwd-group><title>Keywords</title><kwd>Crossmodal</kwd><kwd>Functional connectivity</kwd><kwd>Functional magnetic resonance imaging</kwd><kwd>Independent component analysis</kwd><kwd>Multisensory</kwd><kwd>Object perception</kwd></kwd-group><custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name><meta-value>© Springer-Verlag 2011</meta-value></custom-meta></custom-meta-group></article-meta></front><body><sec id="Sec1"><title>Introduction</title><p>In everyday situations, we perceive common objects via multiple senses. For humans, vision and audition are arguably most important in this regard. Despite recent efforts to elucidate where and how auditory and visual object features are integrated in the brain into coherent audio-visual (AV) representations, several important questions have remained unanswered. In particular, there is an ongoing debate about whether such integration predominantly occurs at higher levels of cortical processing (i.e., in so-called heteromodal regions; Calvert <xref ref-type="bibr" rid="CR10">2001</xref>; Beauchamp <xref ref-type="bibr" rid="CR5">2005a</xref>; Amedi et al. <xref ref-type="bibr" rid="CR1">2005</xref>; Hein et al. <xref ref-type="bibr" rid="CR22">2007</xref>; Doehrmann and Naumer <xref ref-type="bibr" rid="CR12">2008</xref>; Naumer et al. <xref ref-type="bibr" rid="CR37">2009</xref>; Werner and Noppeney <xref ref-type="bibr" rid="CR56">2010a</xref>) or at rather low-level cortical processing stages, i.e., in regions traditionally assumed to serve strictly unisensory functions (Schroeder and Foxe <xref ref-type="bibr" rid="CR45">2005</xref>; Ghazanfar and Schroeder <xref ref-type="bibr" rid="CR21">2006</xref>; Macaluso <xref ref-type="bibr" rid="CR29">2006</xref>; Kayser and Logothetis <xref ref-type="bibr" rid="CR26">2007</xref>; Meienbrock et al. <xref ref-type="bibr" rid="CR34">2007</xref>; Driver and Noesselt <xref ref-type="bibr" rid="CR14">2008</xref>; Doehrmann et al. <xref ref-type="bibr" rid="CR13">2010</xref>). Irrespective of whether multisensory integration mainly takes place in parallel or subsequent to unisensory processing, most researchers agree that multisensory object perception generally involves networks of widely distributed brain regions (Naumer and Kaiser <xref ref-type="bibr" rid="CR36">2010</xref>). Within those distributed neural representations, the issue of functional connectivity (i.e., networks of co-activated regions) has been rather neglected. Closing this gap appears to be especially relevant with regard to audio-visual (AV) processing of common objects, as it involves the integration of both multiple higher-level stimulus features and semantic memory processes (Doehrmann and Naumer <xref ref-type="bibr" rid="CR12">2008</xref>).</p><p>Functional connectivity is typically formalized as the timepoint-by-timepoint covariation between activation time courses of pairs of spatially separated brain regions (Friston et al. <xref ref-type="bibr" rid="CR18">1993</xref>). Investigating patterns of covariations between brain regions may provide information on how these regions specifically interact in different contexts, such as different stimuli, task instructions, cognitive sets, or mental states (Friston et al. <xref ref-type="bibr" rid="CR18">1993</xref>; Rogers et al. <xref ref-type="bibr" rid="CR43">2007</xref>). Recently, it has been demonstrated that the application of spatial independent component analysis (sICA, McKeown et al. <xref ref-type="bibr" rid="CR32">1998</xref>) to human functional magnetic resonance imaging (fMRI) data can provide a robust non-invasive measure of functional connectivity (van de Ven et al. <xref ref-type="bibr" rid="CR53">2004</xref>; Bartels and Zeki <xref ref-type="bibr" rid="CR4">2005</xref>; Rajapakse et al. <xref ref-type="bibr" rid="CR41">2006</xref>; Rogers et al. <xref ref-type="bibr" rid="CR43">2007</xref>). In spatial ICA, “spatial independence” refers to the assumption of statistical independence between spatially distributed processes, which combine linearly to constitute the measured functional time series. In fMRI, spatial ICA aims to estimate a weighting matrix of the data that will project the data into a space in which the spatial modes are as independent as possible, while leaving the timecourses of the spatial modes unconstraint. This is done by maximizing or minimizing some objective criterion, such as minimizing mutual information (Bell and Sejnowski <xref ref-type="bibr" rid="CR101">1995</xref>) or maximizing negentropy (Hyvärinen <xref ref-type="bibr" rid="CR25">1999</xref>). Spatial maps are then interpreted as maps of functional connectivity—with maximized independence between maps being similar to high dependence within maps. For example, we have used a group-level ICA approach to reveal networks of functionally connected cortical regions involved in overt speech production and speech monitoring (van de Ven et al. <xref ref-type="bibr" rid="CR55">2009</xref>).</p><p>In the present study, we used sICA to map the cortical AV object perception network by means of functional connectivity and used the results to predict their associations to uni- and multisensory processing in an independent second dataset. FMRI data of a passive AV experiment (experiment 1) were decomposed individually for each subject (fully data-driven) into spatial independent components (ICs) and clustered in the subject space using an extension of self-organized grouping ICA (sogICA) (Esposito et al. <xref ref-type="bibr" rid="CR16">2005</xref>; van de Ven et al. <xref ref-type="bibr" rid="CR55">2009</xref>) to obtain a representation of the spatial modes and associated time courses on the group level (schematically illustrated in Fig. <xref rid="Fig1" ref-type="fig">1</xref>b. The statistics of spatial modes and time courses can then be further investigated using random-effects-like statistics, such as <italic>t-</italic>tests of component values across participants. The group-level connectivity modes were then classified according to spatial (presence of key uni- and multisensory brain regions in the spatial modes) and temporal information (using the knowledge about the sequence of experimental conditions during the first experiment) as auditory, visual, or multisensory networks. Due to the weighted mixing of all independent components into the measured fMRI data (McKeown et al. <xref ref-type="bibr" rid="CR32">1998</xref>; Calhoun et al. <xref ref-type="bibr" rid="CR9">2001</xref>; van de Ven et al. <xref ref-type="bibr" rid="CR53">2004</xref>; Fig. <xref rid="Fig1" ref-type="fig">1</xref>c), we hypothesized that the voxel time courses in potential AV integration regions should mainly reflect substantial contributions of at least two of these three spatial connectivity maps. More specifically, we investigate possible relations between components, by looking at compartments of their spatial distribution that overlap. We show that these overlaps can be explained in a meaningful way: Unisensory regions—found in unisensory ICA maps—can show multisensory effects, with overlap between unisensory components indicating low-level interactions, and overlap between uni- and multisensory regions indicating an interaction of low- and higher level processes. Thus, sogICA of the first experiment allowed us to reveal a bilateral network of multisensory candidate regions including superior temporal (pSTS), ventral occipito-temporal (VOT), ventro-medial occipital (VMO), posterior parietal (PPC), and prefrontal cortices (PFC). In order to explicitly test these regions for their integrative capacities, we conducted a region-of-interest (ROI)-based analysis of an independent second AV experiment using a conventional general linear model (GLM)-based approach. We hypothesized that activation in all ROIs should fulfill the max-criterion for AV convergence (AV > max[A, V]). Based on the recent literature on effects of semantic congruency versus incongruency during AV object processing (Lewis <xref ref-type="bibr" rid="CR27">2010</xref>; Meyer et al. in press; Noppeney et al. <xref ref-type="bibr" rid="CR40">2010</xref>; van Atteveldt et al. <xref ref-type="bibr" rid="CR52">2010</xref>), we expected higher BOLD signal increases for semantically congruent AV stimuli in pSTS and VOT ROIs and for incongruent AV pairings in VMO, PPC, and PFC ROIs, respectively.<fig id="Fig1"><label>Fig. 1</label><caption><p>Relationship between spatial independent component analysis (sICA) and voxel-based GLM analysis. FMRI raw data (<bold>a</bold>) were decomposed into spatially independent components (<bold>b</bold>) that, mixed together (<bold>c</bold>) reproduced the data for each voxel. Otherwise, the data can be analyzed using the knowledge on the stimulation time course (<bold>d</bold>) via a hypothesis-driven voxel-based GLM, resulting in statistical information based on the individual voxel time courses (<bold>e</bold>). SICA a results in spatially independent maps <bold>b</bold>, <italic>left column</italic> that cover the whole geometrical extent of the raw data and contain weights that vary strongly within each map, such that clusters of voxel weights may appear after thresholding. Each map is associated with a single time course <bold>b</bold>, <italic>right column</italic>. When these component time courses are tested using the knowledge about the stimulation time course <bold>d</bold> the components may be classified as mainly auditory, visual, or AV (among others like physiological components related to breathing, heartbeat, etc.). The voxel time courses (<bold>e</bold>) can be thought of as the sum of all component time courses weighted by the values of the respective component maps at that voxel (<bold>c</bold>). This can result in a variety of voxel characteristics: voxels in a region where only one spatial component has large map values will show a time course very similar to the respective component time course, e.g., mainly auditory (voxel 1 in <bold>c</bold> and <bold>e</bold>, <italic>top row</italic>) or mainly visual activation (voxel 2 in <bold>c</bold> and <bold>e</bold><italic>, second row</italic>). Due to the weighted mixing of components c, both visual and auditory unisensory components can contribute equally to a voxel time course (voxel 3 in <bold>c</bold> and <bold>e</bold>, <italic>third row</italic>). In a GLM analysis, the effects of auditory and visual stimulation may be simply additive at this voxel. If the mixing comprises non-zero coefficients for components that describe purely multisensory processing, i.e., processing that is absent during purely unimodal stimulation, the respective voxel might show superadditive effects (voxel 4 in <bold>c</bold> and <bold>e</bold><italic>, bottom row</italic>). Inferences of sICA results refer to systems-level (i.e., multivariate) behavior, whereas inferences of GLM results refer to voxel (or voxel-cluster) behavior. <italic>M</italic> multisensory</p></caption><graphic xlink:href="221_2011_2669_Fig1_HTML" id="MO1"></graphic></fig></p></sec><sec id="Sec2" sec-type="materials|methods"><title>Materials and methods</title><sec id="Sec3"><title>Subjects</title><p>Twelve subjects (three female) participated in this study; their mean age was 28.8 years (range 21–38 years). All subjects had normal or corrected-to-normal (four subjects) vision. Of these subjects, 10 participated in experiment 1 and six in experiment 2. All participants received information on MRI and a questionnaire to check for potential health risks and contraindications. Volunteers gave their written informed consent after having been introduced to the procedure in accordance with the declaration of Helsinki.</p></sec><sec id="Sec4"><title>Stimuli</title><p>Visual stimulation consisted of eight gray-scale common object photographs (mean stimulus size 12.8° visual angle). Each visual stimulation block consisted of eight photographs that were presented in the center of the screen at a rate of 0.5 Hz. In the center of the white screen, a black fixation cross was displayed during the entire experiment. Auditory stimulation consisted of complex sounds related to the same eight common objects. Each auditory stimulation block consisted of eight of these sounds that were presented at a rate of 0.5 Hz.</p></sec><sec id="Sec5"><title>Procedure</title><p>In both experiments, stimuli were presented in a block design with a block length of approximately 16 s (eight measurement volumes), separated from the next stimulation block by a fixation period of equal length. In experiment 1, we employed the following conditions: common sounds (A), common sounds played backwards (A-bw), gray-scale images of common objects (V), AV combinations that were semantically congruent (CON), and AV combinations that were semantically incongruent (INC) (see Fig. <xref rid="Fig2" ref-type="fig">2</xref> for an overview). In addition to the A, V, and CON conditions of experiment 1, experiment 2 comprised two different types of semantically incongruent AV combinations consisting of auditory and visual stimuli stemming either from the same (“low incongruency,” INL) or from different object categories (“high incongruency,” INH). Both experiments consisted of two runs each. Within each run, each of the experimental conditions was repeated four times. While subjects were asked to fixate and be attentive during experiment 1, they had to perform a repetition detection task in experiment 2.<fig id="Fig2"><label>Fig. 2</label><caption><p>Experimental conditions. We employed the following experimental conditions: unimodal auditory (<italic>yellow</italic>), unimodal visual (<italic>blue</italic>), semantically congruent audio-visual (AV; <italic>light green</italic>), semantically incongruent AV stimuli (from the same semantic category; <italic>medium green</italic>), and semantically incongruent AV stimuli (from different semantic categories; <italic>dark green</italic>)</p></caption><graphic xlink:href="221_2011_2669_Fig2_HTML" id="MO2"></graphic></fig></p></sec><sec id="Sec6"><title>Imaging</title><p>FMRI scanning was performed on a 1.5 Tesla Siemens Magnetom Vision scanner (Siemens, Erlangen, Germany) at the Institute of Neuroradiology of Frankfurt Medical School. An echo-planar-imaging (EPI) sequence was used with the following parameters: 16 slices, oriented approximately in parallel to the AC-PC plane (AC, anterior commisure; PC, posterior commissure); TR, 2081 ms; TE, 60 ms; FA, 90°; FOV, 200 mm; in-plane resolution, 3.13 × 3.13 mm<sup>2</sup>; slice thickness, 5 mm; gap thickness, 1 mm. In addition, a detailed T1-weighted anatomical scan was acquired for all subjects using a Siemens fast low-angle-shot (FLASH) sequence (isotropic voxel size 1 mm<sup>3</sup>). For each subject, an additional magnetization-prepared rapid-acquisition gradient-echo (MP-RAGE) sequence was used (TR = 9.7 ms, TE = 4 ms, FA = 12°, matrix = 256 × 256, voxel size 2.0 × 1.0 × 1.0 mm<sup>3</sup>) in each fMRI scanning session for later realignment with the detailed anatomical scan that had been measured in a separate session.</p></sec><sec id="Sec7"><title>Data analysis</title><sec id="Sec8"><title>Preprocessing</title><p>Data were preprocessed using the BrainVoyager™ QX (version 1.8) software package (Brain Innovation, Maastricht, The Netherlands). The first four volumes of each experimental run were discarded to preclude T1 saturation effects. Preprocessing of functional data included the following steps: (1) linear trend removal and temporal high-pass filtering at ~ 0.01 Hz (2) slice-scan-time correction with sinc interpolation, (3) spatial smoothing using Gaussian kernels of 6 mm (experiment 1) and 8 mm (experiment 2), and (4) three-dimensional motion correction (only for experiment 2). The functional data were then resampled into a 3-dimensional standardized space (Talairach and Tournoux <xref ref-type="bibr" rid="CR49">1998</xref>) with a resampled voxel size of 3 × 3 × 3 mm<sup>3</sup>.</p></sec><sec id="Sec9"><title>Hypothesis-generating functional connectivity analysis of experiment 1</title><p>Functional connectivity modes of the time series of experiment 1 were analyzed using an extension of a multi-subject data-driven analysis (sogICA, Esposito et al. <xref ref-type="bibr" rid="CR16">2005</xref>; van de Ven et al. <xref ref-type="bibr" rid="CR55">2009</xref>) in Matlab (Mathworks Inc.) using freely available toolboxes (FastICA, Hyvärinen <xref ref-type="bibr" rid="CR25">1999</xref>; Icasso, Himberg et al. <xref ref-type="bibr" rid="CR23">2004</xref>) and custom-made routines. Individual runs were decomposed using spatial ICA (McKeown et al. <xref ref-type="bibr" rid="CR32">1998</xref>; Calhoun et al. <xref ref-type="bibr" rid="CR9">2001</xref>; van de Ven et al. <xref ref-type="bibr" rid="CR53">2004</xref>) into 35 spatially independent components and associated activation profiles, than clustered in a data-driven hierarchical sense (over runs, then over subjects) based on similarity between component pairs, with an average group-level activation profile. See Electronic Supplementary Material for more details. Selection of target maps obtained from a data-driven analysis can be done by utilizing (a combination of) spatial (van de Ven et al. <xref ref-type="bibr" rid="CR53">2004</xref>, <xref ref-type="bibr" rid="CR55">2009</xref>; Greicius et al. <xref ref-type="bibr" rid="CR103">2003</xref>; Castelo-Branco et al. <xref ref-type="bibr" rid="CR11">2002</xref>) or temporal hypotheses (McKeown et al. <xref ref-type="bibr" rid="CR32">1998</xref>; Calhoun et al. <xref ref-type="bibr" rid="CR102">2004</xref>; Moritz et al. <xref ref-type="bibr" rid="CR105">2003</xref>). Spatial templates were obtained as masks in which voxels belonging to key regions were set to 1 and all other voxels to 0. Separate spatial templates were generated for visual, auditory, and posterior parietal cortex from an independent dataset (van de Ven et al. <xref ref-type="bibr" rid="CR53">2004</xref>). Temporal hypotheses comprised the haemodynamically convolved sequences of unimodal (visual or auditory) or bimodal experimental conditions. Clusters were selected according to maximum spatial and temporal correlations with spatial templates of the two unimodal (bilateral auditory cortex, bilateral visual cortex) and bimodal candidate regions (posterior parietal cortex). This selection procedure yielded a single unique cluster for each of the unimodal sensory modalities and a single bimodal cluster that was correlated with unimodal as well as bimodal stimulus conditions (see Electronic Supplementary Material). We then computed intersections between these between-subject maps in order to define candidate regions for AV integration that served as ROIs for the analysis of experiment 2 (Fig. <xref rid="Fig1" ref-type="fig">1</xref>a, right column). For each cluster, the activation profiles of the clustered connectivity modes were averaged to obtain a group-level activation profile.</p></sec><sec id="Sec10"><title>Hypothesis-testing analysis of ROIs in experiment 2</title><p>For the statistical analysis of experiment 2, we employed conventional hypothesis testing using multiple linear regression of voxel time courses of the ROIs as defined in experiment 1. For every voxel, the time course was regressed on a set of dummy-coded predictors representing the five experimental conditions. To account for the shape and delay of the hemodynamic response (Boynton et al. <xref ref-type="bibr" rid="CR8">1996</xref>), the predictor time courses (box-car functions) were convolved with a gamma function. We used group-based conjunction analyses (a fixed effects model with separate subject predictors) on the data of experiment 2, which were spatially restricted to the ROIs obtained on the basis of experiment 1 to effectively test the potential role of these ROIs in the context of AV object perception. More specifically, we employed the so-called max-criterion (i.e., AV > max[A, V]; e.g., Beauchamp <xref ref-type="bibr" rid="CR6">2005b</xref>) to test for multisensory integration defined as enhanced activation during bimodal stimulation. Although most widely used in neuroimaging analyses of multisensory integration, and therefore our choice in this context, its validity for computational and psychophysical research is debated (Angelaki et al. <xref ref-type="bibr" rid="CR2">2009</xref>). The ROI activation profiles were visualized using bar plots of the group-based regression coefficients (beta estimates) for each experimental condition.</p></sec></sec></sec><sec id="Sec11"><title>Results</title><sec id="Sec12"><title>Experiment 1 (sICA)</title><p>We detected three between-subject clusters that appeared to be involved in sensory processing (Fig. <xref rid="Fig3" ref-type="fig">3</xref>). Two of them reflected unisensory processing based on their respective prominent spatial coverage of unisensory cortices and associated time courses. The spatial distribution of the auditory cluster, which ranked third in the intra-cluster similarity rating (Fig. <xref rid="Fig3" ref-type="fig">3</xref>a; FDR-corrected visualization threshold, <italic>t</italic> = 2.74) included superior–lateral parts of the temporal lobes. The right-hand panels of Fig. <xref rid="Fig3" ref-type="fig">3</xref> show the time courses of the respective IC clusters. The time course peaked on blocks of auditory as well as AV stimulation. The spatial distribution of the visual cluster, which ranked second (Fig. <xref rid="Fig3" ref-type="fig">3</xref>b; corrected visualization threshold <italic>t</italic> = 2.54) included bilateral occipital and posterior parietal cortices. The associated time course peaked on blocks of visual as well as AV stimulation. Finally, only one of the lower-ranked IC clusters (ranked 7th; corrected visualization threshold <italic>t</italic> = 3.44) showed a prominent spatial distribution and time course that could be associated to AV processing (Fig. <xref rid="Fig3" ref-type="fig">3</xref>c) and contained bilateral posterior parietal and left prefrontal cortex. The temporal associations of these three IC clusters to the experimental paradigm were further quantified by submitting the component time courses to a GLM with contrasts testing for both auditory or visual modality preference and AV integration (see Table <xref rid="Tab1" ref-type="table">1</xref> for statistical parameters). This analysis confirmed our tentative characterization of these IC clusters as auditory, visual, and AV, respectively.<fig id="Fig3"><label>Fig. 3</label><caption><p>Independent component <italic>IC</italic> clusters of interest. Three IC cluster maps with activations in predominantly auditory (<bold>a</bold>), visual (<bold>b</bold>), and heteromodal (<bold>c</bold>) cortices are shown with their respective averaged time courses. Data are projected on group-averaged anatomical images according to neurological convention, with Talairach coordinates (<italic>x</italic>, <italic>y</italic>, and <italic>z</italic>) for the main cluster in view. Left hemisphere depicted on the <italic>left of image</italic>. <italic>Graphs in the middle</italic> show the respective component time courses against the background of the experimental conditions. <italic>Graphs on the right</italic> show the time courses averaged over blocks of the same condition (twelve time points, starting from the start of the block)</p></caption><graphic xlink:href="221_2011_2669_Fig3_HTML" id="MO3"></graphic></fig><table-wrap id="Tab1"><label>Table 1</label><caption><p>Characterization and selection of independent components (ICs)</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left">IC</th><th align="left" colspan="2">A</th><th align="left" colspan="2">V</th><th align="left" colspan="2">CON > A</th><th align="left" colspan="2">CON > V</th><th align="left" colspan="2">INC > A</th><th align="left" colspan="2">INC > V</th><th align="left" colspan="2">MAX2-INC</th></tr><tr><th align="left">no</th><th align="left"><italic>t</italic></th><th align="left"><italic>P</italic></th><th align="left"><italic>t</italic></th><th align="left"><italic>P</italic></th><th align="left"><italic>t</italic></th><th align="left"><italic>P</italic></th><th align="left"><italic>t</italic></th><th align="left"><italic>P</italic></th><th align="left"><italic>t</italic></th><th align="left"><italic>P</italic></th><th align="left"><italic>t</italic></th><th align="left"><italic>P</italic></th><th align="left"><italic>t</italic></th><th align="left"><italic>P</italic></th></tr></thead><tbody><tr><td align="left">2</td><td char="." align="char">2.36</td><td char="." align="char">0.010</td><td char="." align="char">17.27</td><td char="." align="char">0.000</td><td char="." align="char">11.13</td><td char="." align="char">0.000</td><td char="." align="char">−0.35</td><td char="." align="char">0.637</td><td char="." align="char">10.83</td><td char="." align="char">0.000</td><td char="." align="char">−0.64</td><td char="." align="char">0.737</td><td char="." align="char">−0.64</td><td char="." align="char">0.737</td></tr><tr><td align="left">4</td><td char="." align="char">17.75</td><td char="." align="char">0.000</td><td char="." align="char">6.24</td><td char="." align="char">0.000</td><td char="." align="char">−1.26</td><td char="." align="char">0.895</td><td char="." align="char">7.59</td><td char="." align="char">0.000</td><td char="." align="char">−1.19</td><td char="." align="char">0.883</td><td char="." align="char">7.66</td><td char="." align="char">0.000</td><td char="." align="char">−1.19</td><td char="." align="char">0.883</td></tr><tr><td align="left">7</td><td char="." align="char">3.81</td><td char="." align="char">0.000</td><td char="." align="char">7.03</td><td char="." align="char">0.000</td><td char="." align="char">1.62</td><td char="." align="char">0.053</td><td char="." align="char">−0.86</td><td char="." align="char">0.806</td><td char="." align="char">4.25</td><td char="." align="char">0.000</td><td char="." align="char">1.77</td><td char="." align="char">0.039</td><td char="." align="char">1.77</td><td char="." align="char"><bold>0.039</bold></td></tr></tbody></table><table-wrap-foot><p>The three selected ICs as characterized by their time courses’ correspondence to a GLM with contrasts testing for auditory (<italic>A)</italic>, visual (<italic>V</italic>), and <italic>AV</italic> activation (congruent, CON; incongruent, INC). MAX2, max-criterion (A < AV > V). Bold value is significant as per the MAX-criterion</p></table-wrap-foot></table-wrap></p><p>We then identified regions of overlap between these group-level connectivity maps (Table <xref rid="Tab2" ref-type="table">2</xref>) in order to define a set of candidate ROIs potentially involved in AV integration. This resulted in a network of ROIs including bilateral superior temporal (pSTS), ventral occipito-temporal (VOT), ventro-medial occipital (VMO), posterior parietal (PPC), and prefrontal cortex (PFC) as well as left auditory (AC) and dorsal pre-motor cortex (dPMC) (Table <xref rid="Tab3" ref-type="table">3</xref>).<table-wrap id="Tab2"><label>Table 2</label><caption><p>Experiment 1: Regions of overlap between IC cluster maps 2 (visual), 4 (auditory), and 7 (AV)</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left"></th><th align="left"></th><th align="left">Visual</th><th align="left">Auditory</th><th align="left">AV</th></tr></thead><tbody><tr><td align="left">pSTS</td><td align="left">L</td><td align="left">x</td><td align="left">x</td><td align="left"></td></tr><tr><td align="left"></td><td align="left">R</td><td align="left">x</td><td align="left">x</td><td align="left"></td></tr><tr><td align="left">VOT</td><td align="left">L</td><td align="left">x</td><td align="left">x</td><td align="left">x</td></tr><tr><td align="left"></td><td align="left">R</td><td align="left">x</td><td align="left">x</td><td align="left"></td></tr><tr><td align="left">VMO</td><td align="left">L</td><td align="left">x</td><td align="left"></td><td align="left">x</td></tr><tr><td align="left"></td><td align="left">R</td><td align="left">x</td><td align="left"></td><td align="left">x</td></tr><tr><td align="left">PPC</td><td align="left">L</td><td align="left">x</td><td align="left"></td><td align="left">x</td></tr><tr><td align="left">PFC</td><td align="left">L</td><td align="left"></td><td align="left">x</td><td align="left">x</td></tr><tr><td align="left"></td><td align="left">R</td><td align="left"></td><td align="left">x</td><td align="left">x</td></tr></tbody></table><table-wrap-foot><p><italic>pSTS</italic> posterior superior temporal sulcus, <italic>VOT</italic> ventral occipito-temporal cortex, <italic>VMO</italic> ventro-medial occipital cortex, <italic>PPC</italic> posterior parietal cortex, <italic>PFC</italic> prefrontal cortex, <italic>L</italic> left hemisphere, <italic>R</italic> right hemisphere</p></table-wrap-foot></table-wrap><table-wrap id="Tab3"><label>Table 3</label><caption><p>Functional activation profiles of ROIs in experiment 2</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left">ROI</th><th align="left">Stat</th><th align="left">V > 0</th><th align="left">A > 0</th><th align="left">CON > V</th><th align="left">CON > A</th><th align="left">INL > V</th><th align="left">INL > A</th><th align="left">INH > V</th><th align="left">INH > A</th><th align="left">CON M4</th><th align="left">INL M4</th><th align="left">INH 4</th></tr></thead><tbody><tr><td align="left">Left_pSTS</td><td align="left"><italic>t</italic></td><td char="." align="char">10.4</td><td char="." align="char">7.2</td><td char="." align="char">2.8</td><td char="." align="char">5.2</td><td char="." align="char">5.5</td><td char="." align="char">7.9</td><td char="." align="char">4.4</td><td char="." align="char">6.8</td><td char="." align="char">2.8</td><td char="." align="char">5.5</td><td char="." align="char">4.4</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.005</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char"><bold>0.005</bold></td><td char="." align="char"><bold>0.000</bold></td><td char="." align="char"><bold>0.000</bold></td></tr><tr><td align="left">Right_pSTS</td><td align="left"><italic>t</italic></td><td char="." align="char">13.1</td><td char="." align="char">15.1</td><td char="." align="char">1.4</td><td char="." align="char">−0.1</td><td char="." align="char">5.0</td><td char="." align="char">3.5</td><td char="." align="char">5.1</td><td char="." align="char">3.6</td><td char="." align="char">−0.1</td><td char="." align="char">3.5</td><td char="." align="char">3.6</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.148</td><td char="." align="char">0.960</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.960</td><td char="." align="char"><bold>0.000</bold></td><td char="." align="char"><bold>0.000</bold></td></tr><tr><td align="left">Left_VOT</td><td align="left"><italic>t</italic></td><td char="." align="char">19.3</td><td char="." align="char">8.4</td><td char="." align="char">2.8</td><td char="." align="char">10.9</td><td char="." align="char">2.9</td><td char="." align="char">11.2</td><td char="." align="char">4.2</td><td char="." align="char">12.2</td><td char="." align="char">2.8</td><td char="." align="char">2.9</td><td char="." align="char">4.2</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.005</td><td char="." align="char">0.000</td><td char="." align="char">0.004</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char"><bold>0.005</bold></td><td char="." align="char"><bold>0.004</bold></td><td char="." align="char"><bold>0.000</bold></td></tr><tr><td align="left">Right_VOT</td><td align="left"><italic>t</italic></td><td char="." align="char">14.6</td><td char="." align="char">8.1</td><td char="." align="char">1.3</td><td char="." align="char">6.1</td><td char="." align="char">2.7</td><td char="." align="char">7.7</td><td char="." align="char">3.5</td><td char="." align="char">8.3</td><td char="." align="char">1.3</td><td char="." align="char">2.7</td><td char="." align="char">3.5</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.197</td><td char="." align="char">0.000</td><td char="." align="char">0.008</td><td char="." align="char">0.000</td><td char="." align="char">0.001</td><td char="." align="char">0.000</td><td char="." align="char">0.197</td><td char="." align="char"><bold>0.008</bold></td><td char="." align="char"><bold>0.001</bold></td></tr><tr><td align="left">Left_VMO</td><td align="left"><italic>t</italic></td><td char="." align="char">5.8</td><td char="." align="char">7.2</td><td char="." align="char">1.8</td><td char="." align="char">0.8</td><td char="." align="char">3.6</td><td char="." align="char">2.5</td><td char="." align="char">3.8</td><td char="." align="char">2.7</td><td char="." align="char">0.8</td><td char="." align="char">2.5</td><td char="." align="char">2.7</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.068</td><td char="." align="char">0.435</td><td char="." align="char">0.000</td><td char="." align="char">0.012</td><td char="." align="char">0.000</td><td char="." align="char">0.007</td><td char="." align="char">0.435</td><td char="." align="char"><bold>0.012</bold></td><td char="." align="char"><bold>0.007</bold></td></tr><tr><td align="left">Right_VMO</td><td align="left"><italic>t</italic></td><td char="." align="char">6.5</td><td char="." align="char">5.9</td><td char="." align="char">1.0</td><td char="." align="char">1.4</td><td char="." align="char">1.4</td><td char="." align="char">1.8</td><td char="." align="char">2.7</td><td char="." align="char">3.2</td><td char="." align="char">1.0</td><td char="." align="char">1.4</td><td char="." align="char">2.7</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.324</td><td char="." align="char">0.151</td><td char="." align="char">0.176</td><td char="." align="char">0.069</td><td char="." align="char">0.006</td><td char="." align="char">0.001</td><td char="." align="char">0.324</td><td char="." align="char">0.176</td><td char="." align="char"><bold>0.006</bold></td></tr><tr><td align="left">Left_PPC</td><td align="left"><italic>t</italic></td><td char="." align="char">12.5</td><td char="." align="char">6.4</td><td char="." align="char">−0.4</td><td char="." align="char">4.2</td><td char="." align="char">2.0</td><td char="." align="char">6.7</td><td char="." align="char">2.8</td><td char="." align="char">7.3</td><td char="." align="char">−0.4</td><td char="." align="char">2.0</td><td char="." align="char">2.8</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.717</td><td char="." align="char">0.000</td><td char="." align="char">0.049</td><td char="." align="char">0.000</td><td char="." align="char">0.005</td><td char="." align="char">0.000</td><td char="." align="char">0.717</td><td char="." align="char"><bold>0.049</bold></td><td char="." align="char"><bold>0.005</bold></td></tr><tr><td align="left">Right_PPC</td><td align="left"><italic>t</italic></td><td char="." align="char">12.3</td><td char="." align="char">9.4</td><td char="." align="char">−1.6</td><td char="." align="char">0.5</td><td char="." align="char">−0.1</td><td char="." align="char">2.1</td><td char="." align="char">0.8</td><td char="." align="char">2.9</td><td char="." align="char">−1.6</td><td char="." align="char">−0.1</td><td char="." align="char">0.8</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.110</td><td char="." align="char">0.615</td><td char="." align="char">0.906</td><td char="." align="char">0.040</td><td char="." align="char">0.433</td><td char="." align="char">0.004</td><td char="." align="char">0.615</td><td char="." align="char">0.906</td><td char="." align="char">0.433</td></tr><tr><td align="left">Left_PFC</td><td align="left"><italic>t</italic></td><td char="." align="char">10.5</td><td char="." align="char">13.4</td><td char="." align="char">1.5</td><td char="." align="char">−0.7</td><td char="." align="char">3.4</td><td char="." align="char">1.1</td><td char="." align="char">5.8</td><td char="." align="char">3.6</td><td char="." align="char">−0.7</td><td char="." align="char">1.1</td><td char="." align="char">3.6</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.126</td><td char="." align="char">0.511</td><td char="." align="char">0.001</td><td char="." align="char">0.267</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.511</td><td char="." align="char">0.267</td><td char="." align="char"><bold>0.000</bold></td></tr><tr><td align="left">Right_PFC</td><td align="left"><italic>t</italic></td><td char="." align="char">8.5</td><td char="." align="char">13.8</td><td char="." align="char">3.6</td><td char="." align="char">−0.3</td><td char="." align="char">3.6</td><td char="." align="char">−0.5</td><td char="." align="char">7.5</td><td char="." align="char">3.5</td><td char="." align="char">−0.3</td><td char="." align="char">−0.5</td><td char="." align="char">3.5</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.738</td><td char="." align="char">0.000</td><td char="." align="char">0.610</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.738</td><td char="." align="char">0.610</td><td char="." align="char"><bold>0.000</bold></td></tr><tr><td align="left">Left_AC</td><td align="left"><italic>t</italic></td><td char="." align="char">2.5</td><td char="." align="char">15.8</td><td char="." align="char">8.4</td><td char="." align="char">−1.6</td><td char="." align="char">9.7</td><td char="." align="char">−0.6</td><td char="." align="char">11.6</td><td char="." align="char">1.6</td><td char="." align="char">−1.6</td><td char="." align="char">−0.6</td><td char="." align="char">1.6</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.014</td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.119</td><td char="." align="char">0.000</td><td char="." align="char">0.540</td><td char="." align="char">0.000</td><td char="." align="char">0.101</td><td char="." align="char">0.119</td><td char="." align="char">0.540</td><td char="." align="char">0.101</td></tr><tr><td align="left">Left_dPMC</td><td align="left"><italic>t</italic></td><td char="." align="char">9.0</td><td char="." align="char">13.1</td><td char="." align="char">1.6</td><td char="." align="char">−1.4</td><td char="." align="char">1.7</td><td char="." align="char">−1.5</td><td char="." align="char">4.1</td><td char="." align="char">1.0</td><td char="." align="char">−1.4</td><td char="." align="char">−1.5</td><td char="." align="char">1.0</td></tr><tr><td align="left"></td><td align="left"><italic>P</italic></td><td char="." align="char">0.000</td><td char="." align="char">0.000</td><td char="." align="char">0.110</td><td char="." align="char">0.149</td><td char="." align="char">0.092</td><td char="." align="char">0.143</td><td char="." align="char">0.000</td><td char="." align="char">0.304</td><td char="." align="char">0.149</td><td char="." align="char">0.143</td><td char="." align="char">0.304</td></tr></tbody></table><table-wrap-foot><p>Results of the group GLM on data from experiment 2 for the ROIs as defined in experiment 1. The columns represent statistical contrasts for which <italic>t</italic> and <italic>P</italic> values are provided for each ROI. Wherever the extended max-criterion (M4, i.e., 0 < A < AV > V > 0) was found to be met, <italic>P</italic> values are highlighted. Bold values are significant as per the MAX-criterion</p><p><italic>A</italic> auditory, <italic>V</italic> visual, <italic>CON</italic> AV congruent, <italic>INL</italic> AV incongruent same category, <italic>INH</italic> AV incongruent different categories, <italic>pSTS</italic> posterior superior temporal sulcus, <italic>VOT</italic> ventral occipito-temporal cortex, <italic>VMO</italic> ventro-medial occipital cortex, <italic>PPC</italic> posterior parietal cortex, <italic>PFC</italic> prefrontal cortex, <italic>AC</italic> auditory cortex, <italic>dPMC</italic> dorsal pre-motor cortex</p></table-wrap-foot></table-wrap></p></sec><sec id="Sec13"><title>Experiment 2 (ROI-based analysis)</title><p>The AV candidate regions defined on the basis of experiment 1 served as ROIs for the analysis of experiment 2. Applying the max-criterion for AV integration (i.e., AV > max[A, V]; e.g., Beauchamp <xref ref-type="bibr" rid="CR6">2005b</xref>), we revealed integrative activation profiles (Fig. <xref rid="Fig4" ref-type="fig">4</xref>; for statistical parameters see Table <xref rid="Tab3" ref-type="table">3</xref>) for the highly incongruent AV stimulation in bilateral pSTS (left; <italic>t</italic> = 4.4, <italic>P</italic> < 0.000, right; <italic>t</italic> = 3.6, <italic>P</italic> < 0.000), VOT (left; <italic>t</italic> = 4.2, <italic>P</italic> < 0.000, right; <italic>t</italic> = 3.5, <italic>P</italic> = 0.001), VMO (left; <italic>t</italic> = 2.7, <italic>P</italic> = 0.007, right; <italic>t</italic> = 2.7, <italic>P</italic> = 0.006), and PFC (left; <italic>t</italic> = 3.6, <italic>P</italic> < 0.000, right; <italic>t</italic> = 3.5, <italic>P</italic> < 0.000) as well as in left PPC (<italic>t</italic> = 2.8, <italic>P</italic> = 0.005). Only a subsample of these, namely bilateral pSTS (left; <italic>t</italic> = 5.5, <italic>P</italic> < 0.000, right; <italic>t</italic> = 3.5, <italic>P</italic> < 0.000), VOT (left; <italic>t</italic> = 2.9, <italic>P</italic> = 0.004, right; <italic>t</italic> = 2.7, <italic>P</italic> = 0.008), left VMO (<italic>t</italic> = 2.5, <italic>P</italic> = 0.012) and left PPC (<italic>t</italic> = 2.0, <italic>P</italic> = 0.049) also met the criterion during incongruent same-category stimulation. Only the left pSTS (<italic>t</italic> = 2.8, <italic>P</italic> = 0.005) and left VOT (<italic>t</italic> = 2.8, <italic>P</italic> = 0.005) ROIs were found to meet the max-criterion during each type of AV stimulation including semantically congruent stimuli in particular.<fig id="Fig4"><label>Fig. 4</label><caption><p>Experiment 2: explicit statistical testing of hypothesized AV convergence regions. GLM-based group results of experiment 2 are shown for nine regions-of-interest (ROIs) as defined in experiment 1. Only ROIs are shown that met the max-criterion (i.e., AV > max[A, V]) for at least one of three AV conditions. The <italic>middle column</italic> shows the respective ROIs (colored in <italic>green</italic>) as projected on group-averaged anatomical data. The <italic>left</italic> and <italic>right</italic> columns depict the respective functional activation profiles of these ROIs by providing the GLM beta estimates for each experimental condition. <italic>Asterisks</italic> indicate the least significance level of all significant max-contrasts (*<0.05; **<0.01; ***<0.005)</p></caption><graphic xlink:href="221_2011_2669_Fig4_HTML" id="MO4"></graphic></fig></p></sec><sec id="Sec14"><title>GLM-based ROI definition (experiment 1) and analysis (experiment 2)</title><p>For comparison with the ICA-based ROI analysis, data of experiment 1 were also analyzed using a conventional whole-brain GLM, in which AV integration maps were computed using the max-criterion (AV > max[A, V]; <italic>t</italic> = 3.25 <italic>P</italic> < 0.05, cluster-size corr.; estimated cluster-size threshold = 281 voxels). Similar to the ICA approach, we corrected the GLM estimates for multiple comparisons using the FDR (<italic>q</italic> = 0.05). This procedure did not provide any significant results, which suggested that the ICA method had greater power in localizing candidate ROIs.</p><p>We followed up on this result by comparing the GLM and ICA methods in more detail. Direct comparison of the results of these methods is not a trivial issue because the underlying data come from different distributions (i.e., beta coefficients from time course analysis of the GLM and multivariate estimates from ICA). However, in both methods, the final statistical test is performed on the subject-level, with the GLM as well as the sogICA method culminating in a <italic>T</italic> test across participants. Thus, we compared the <italic>P</italic> values of the GLM and ICA results in two situations. Firstly, we equalized the number of visualized voxels of the GLM-estimated results to those of the ICA-based results and ascertained the visualization threshold and spatial overlap of the equalized GLM map with the ICA-based map. Spatial overlap was calculated as the proportion of overlapping voxels of the total amount of GLM voxels. These procedures resulted in a minimum visualization threshold of the GLM map of <italic>P</italic> = 0.012, uncorrected, which showed an overlap with the ICA-based map of 4.23%. Second, we applied cluster-size correction as an alternative method for multiple comparison correction (Forman et al. <xref ref-type="bibr" rid="CR17">1995</xref>). This procedure yielded three voxel clusters (compared to 9 ICA-based ROIs) that overlapped with the ICA-based ROIs (see Electronic Supplementary Material for further details). Thus, both post hoc comparisons between the two analysis methods showed a higher detection power for the ICA-based method.</p></sec></sec><sec id="Sec15"><title>Discussion</title><p>Group ICA of an AV fMRI data set allowed us to define an exclusive set of cortical candidate regions for AV integration from uni- and multisensory connectivity networks. An independent follow-up experiment further confirmed AV convergence in these regions. While left pSTS and VOT regions were found to integrate auditory and visual stimuli largely irrespective of their particular semantic relationship, PPC and PFC regions showed a parametric sensitivity to semantically incongruent AV stimuli. We thus showed and validated sensory convergence in functional networks of uni- and multisensory brain regions. In the following paragraphs, we first discuss these findings with regard to their potential implications for our understanding of multisensory object perception and discuss the possible methodological implications for multisensory neuroimaging research.</p><sec id="Sec16"><title>The human cortical network for object-related AV convergence</title><p>While the auditory and visual connectivity maps of experiment 1 (Fig. <xref rid="Fig3" ref-type="fig">3</xref>a, b) showed predominantly unisensory spatial activation patterns at least at a general level, both also included cortical regions belonging to ‘unisensory’ cortices traditionally designated to the processing of the other sensory modality. This might contribute to multisensory interactions observed at lower levels of the cortical processing hierarchy that have been reported based on a variety of methodologies ranging from invasive electrophysiology in non-human primates to human neuroimaging approaches enabling either temporal or spatial high-resolution measurements (Belardinelli et al. <xref ref-type="bibr" rid="CR7">2004</xref>; Baier et al. <xref ref-type="bibr" rid="CR3">2006</xref>; Martuzzi et al. <xref ref-type="bibr" rid="CR31">2007</xref>; Meienbrock et al. <xref ref-type="bibr" rid="CR34">2007</xref>; Eckert et al. <xref ref-type="bibr" rid="CR15">2008</xref>; see Driver and Noesselt <xref ref-type="bibr" rid="CR14">2008</xref> for a recent review) and manipulation of an additive factor such as temporal correspondence (Noesselt et al. <xref ref-type="bibr" rid="CR38">2007</xref>).</p><p>In classical physiological studies, another criterion for multisensory integration findings is superadditivity, where the response to bimodal stimuli exceeds the sum of the responses to the unimodal stimuli. So far, only few fMRI studies managed to obtain such an effect. The lack of such a strong difference in this study may be due to several reasons. This study used optimal stimuli, whereas degraded stimuli, in accordance with the inverse-effectiveness principle (Stein and Meredith <xref ref-type="bibr" rid="CR46">1993</xref>) can evoke stronger multisensory integration responses (see e.g., Stevenson et al. <xref ref-type="bibr" rid="CR47">2007</xref>). The spatiotemporal alignment of the auditory and visual stimulation was found to be another factor of importance in this regard (Werner and Noppeney <xref ref-type="bibr" rid="CR57">2010b</xref>). Additionally, the usage of an additive factor in the design may increase sensitivity to superadditive responses (Stevenson et al. <xref ref-type="bibr" rid="CR48">2009</xref>).</p><p>Group ICA of experiment 1 revealed multisensory candidate regions in left VOT and pSTS that demonstrated robust AV convergence effects during experiment 2, irrespective of the exact semantic relation between the auditory and visual stimulus components. While activations of pSTS and neighboring regions belong to the most frequently reported fMRI findings regarding AV integration (Beauchamp et al. <xref ref-type="bibr" rid="CR100">2004</xref>; van Atteveldt et al. <xref ref-type="bibr" rid="CR51">2004</xref>; Hein et al. <xref ref-type="bibr" rid="CR22">2007</xref>; Naumer et al. <xref ref-type="bibr" rid="CR37">2009</xref>; Werner and Noppeney <xref ref-type="bibr" rid="CR56">2010a</xref>; see also Doehrmann and Naumer <xref ref-type="bibr" rid="CR12">2008</xref> for a recent review), the significance of these findings has recently been questioned (Hocking and Price <xref ref-type="bibr" rid="CR24">2008</xref>) and the exact role of this particular region still remains under debate. Please note that our conjunction-of-contrasts approach (i.e., the max-criterion) is conceptually similar to whole-brain analyses in previous multisensory fMRI studies (e.g., Beauchamp et al. <xref ref-type="bibr" rid="CR100">2004</xref>; van Atteveldt et al. <xref ref-type="bibr" rid="CR51">2004</xref>), which first calculated the overlap of unisensory maps as a way to map candidate sites for multisensory integration and subsequently performed comparisons between bi- versus unimodal experimental conditions within these candidate regions. The findings from our GLM-based whole-brain analysis correspond to the finding of AV integration in these studies.</p><p>All three PFC and PPC ROIs appeared to be more strongly activated (but this was not supported by a post hoc ANOVA, <italic>F</italic> = 0.1352, <italic>P</italic> > 0.05) when the stimuli in the two modalities were semantically incongruent and parametrically increasing the level of semantic incongruency (i.e., the conceptual distance between the auditory and visual stimulus components). This suggests that the fronto-parietal network is likely concerned with higher-level (cognitive rather than perceptual) AV processing, when a certain amount of stimulus abstraction has already been achieved (van Atteveldt et al. <xref ref-type="bibr" rid="CR51">2004</xref>; Hein et al. <xref ref-type="bibr" rid="CR22">2007</xref>; Doehrmann and Naumer <xref ref-type="bibr" rid="CR12">2008</xref>; Naumer et al. <xref ref-type="bibr" rid="CR37">2009</xref>; Werner and Noppeney <xref ref-type="bibr" rid="CR56">2010a</xref>). An effective connectivity study (Noppeney et al. <xref ref-type="bibr" rid="CR39">2008</xref>) using a crossmodal priming paradigm has shed some light on the (hierarchical) roles of these congruency-sensitive integration sites, suggesting that their activation during incongruent stimulation constitutes unsuppressed input from low-level regions. Another distinction of several integrative regions can be made on the basis of what stimulus types affect them, as shown in a study in which irrelevant auditory cues affected the perception and processing of visual motion stimuli (Sadaghiani et al. <xref ref-type="bibr" rid="CR44">2009</xref>).</p></sec><sec id="Sec17"><title>How ICA-based analysis can contribute to multisensory fMRI research</title><p>We employed a two-step fMRI data analysis approach to investigate object-related AV convergence in human cerebral cortex. This approach combined <italic>hypothesis</italic>-<italic>generating</italic> ICA used to define a widely distributed set of AV candidate regions (experiment 1) and the <italic>hypothesis</italic>-<italic>testing</italic> GLM as employed to explicitly test the hypothesized sites of AV convergence using established statistical criteria (experiment 2). Even though there is a continuing debate about both the inclusion and the particular roles of diverse brain regions (Calvert <xref ref-type="bibr" rid="CR10">2001</xref>; Beauchamp <xref ref-type="bibr" rid="CR6">2005b</xref>; Hocking and Price <xref ref-type="bibr" rid="CR24">2008</xref>; Stevenson et al. <xref ref-type="bibr" rid="CR48">2009</xref>), there is a growing consensus that object-related multisensory integration critically involves distributed processing, presumably within a multi-level hierarchy of brain regions (Amedi et al. <xref ref-type="bibr" rid="CR1">2005</xref>; Doehrmann and Naumer <xref ref-type="bibr" rid="CR12">2008</xref>; Driver and Noesselt <xref ref-type="bibr" rid="CR14">2008</xref>; Naumer and Kaiser <xref ref-type="bibr" rid="CR36">2010</xref>). The use of sICA appears to be of particular value for <italic>human</italic> multisensory research, as it provides a robust <italic>non</italic>-<italic>invasive</italic> measure of neural coactivation. The use of an IC grouping method, such as the hierarchical clustering method applied here, does not only facilitate the generalization to the population level but also precludes the potential effects of local minima in ICA (Himberg et al. <xref ref-type="bibr" rid="CR23">2004</xref>). However, as sICA is a data-driven approach, which can be used for the generation of specific hypotheses (Castelo-Branco et al. <xref ref-type="bibr" rid="CR11">2002</xref>), it is recommended to complement it by explicit statistical hypothesis testing based on independent data. Interestingly, increased attention to data-driven methods such as sICA has already been given in the context of complex and ecologically valid environmental perception (van de Ven et al. <xref ref-type="bibr" rid="CR53">2004</xref>, <xref ref-type="bibr" rid="CR54">2008</xref>, <xref ref-type="bibr" rid="CR55">2009</xref>; Bartels and Zeki <xref ref-type="bibr" rid="CR4">2005</xref>; Esposito et al. <xref ref-type="bibr" rid="CR16">2005</xref>; Malinen et al. <xref ref-type="bibr" rid="CR30">2007</xref>) of which multisensory object perception can be regarded as another prominent example. In addition, the clustering approach of single-subject decompositions within the sogICA framework essentially provides a <italic>random effects</italic> approach that is similar to its GLM-based counterpart and allowed us to compare their detection power in our study. Thus, we are confident that independent statistical testing of hypotheses generated using sICA might provide important results for the debate on rivaling models of multisensory integration in the human brain.</p><p>We demonstrated that sICA is able to effectively reveal a comprehensive ensemble of candidate regions for AV convergence. These are less likely detected in whole-brain GLM contrasts (e.g., AV > max[A, V]) such as the one we computed and reported here for comparison (see Electronic Supplementary Material for details). An attempt to compare our two-step method directly with a classical whole-brain GLM approach resulted in a lack of results for the latter when using the similar correction criterion of FDR, and a disadvantage in detection (three sites as compared two nine) and specificity (only one of the whole-brain GLM detected regions showed a significant ROI-based integration effect) when using the more liberal threshold. While multivariate sICA also allows the detection and removal of typical fMRI-related artifacts (Thomas et al. <xref ref-type="bibr" rid="CR50">2002</xref>; Liao et al. <xref ref-type="bibr" rid="CR28">2006</xref>; see also Electronic Supplementary Material) its increased sensitivity in the detection of functionally coupled multisensory networks is mainly due to the fact that this method makes implicit use of functional connectivity information in the data via its <italic>one time course per map</italic> constraint.</p></sec><sec id="Sec18"><title>Potential limitations and future directions</title><p>This study aimed at comprehensively revealing the human cortical network involved in object-related AV integration. As the experimentally manipulated dimension of integration—semantic congruency—could not be directly compared to multisensory convergence based on spatio-temporal proximity, we were not able to differentiate further between diverse hierarchical levels of multisensory convergence. In order to achieve a more precise functional characterization of the reported clusters in unisensory cortices, future studies should include topographic (i.e., tonotopic and retinotopic) mappings. Finally, measurements of <italic>effective connectivity</italic>, as provided by methods such as dynamic causal modelling (DCM; Friston et al. <xref ref-type="bibr" rid="CR19">2003</xref>; Werner and Noppeney <xref ref-type="bibr" rid="CR56">2010a</xref>) should enable the determination of interdependencies between the diverse components of the described cortical network.</p></sec></sec><sec id="Sec19"><title>Conclusion</title><p>The combination of <italic>hypothesis</italic>-<italic>generating</italic> group ICA and <italic>hypothesis</italic>-<italic>testing</italic> ROI-based GLM analysis of fMRI data allowed us to reveal the distributed cortical network of multisensory convergence regions involved in human AV object perception. Our findings support the assumption of a coordinated interplay between lower- and higher-level cortical regions specialized for distinct sub-processes of human AV object perception and demonstrate how sICA can be fruitfully applied in multisensory neuroimaging research.</p></sec><sec sec-type="supplementary-material"><sec id="AppESM1"><title>Electronic supplementary material</title><supplementary-material id="d28e2733" content-type="local-data"><p>Below is the link to the electronic supplementary material.
</p><media xlink:href="221_2011_2669_MOESM1_ESM.doc" id="MOESM1" mimetype="application" mime-subtype="msword"><caption><p>Supplementary material 1 (DOC 1147 kb)</p></caption></media></supplementary-material></sec></sec></body><back><ack><p>This work was supported by the Bundesministerium für Bildung und Forschung (Brain Imaging Center Frankfurt; BMBF DLR 01GO0508); the Hessisches Ministerium für Wissenschaft und Kultur (LOEWE Forschungsschwerpunkt Neuronale Koordination Frankfurt); The Netherlands Organization for Scientific Research; and the Max Planck Society. We are grateful to Ariane Meienbrock for the development of the auditory stimulation setup, and Giancarlo Valente for helpful statistical suggestions. Correspondence should be addressed to M.J.Naumer@med.uni-frankfurt.de.</p><p><bold>Open Access</bold> This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.</p></ack><ref-list id="Bib1"><title>References</title><ref id="CR1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Amedi</surname><given-names>A</given-names></name><name><surname>Kriegstein</surname><given-names>K</given-names></name><name><surname>Atteveldt</surname><given-names>NM</given-names></name><name><surname>Beauchamp</surname><given-names>MS</given-names></name><name><surname>Naumer</surname><given-names>MJ</given-names></name></person-group><article-title>Functional imaging of human crossmodal identification and object recognition</article-title><source>Exp Brain Res</source><year>2005</year><volume>166</volume><fpage>559</fpage><pub-id pub-id-type="doi">10.1007/s00221-005-2396-5</pub-id><pub-id pub-id-type="pmid">16028028</pub-id></mixed-citation></ref><ref id="CR2"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Angelaki</surname><given-names>DE</given-names></name><name><surname>Gu</surname><given-names>Y</given-names></name><name><surname>DeAngelis</surname><given-names>GC</given-names></name></person-group><article-title>Multisensory integration: psychophysics, neurophysiology, and computation</article-title><source>Curr Opin Neurobiol</source><year>2009</year><volume>19</volume><fpage>452</fpage><lpage>458</lpage><pub-id pub-id-type="doi">10.1016/j.conb.2009.06.008</pub-id><pub-id pub-id-type="pmid">19616425</pub-id></mixed-citation></ref><ref id="CR3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Baier</surname><given-names>B</given-names></name><name><surname>Kleinschmidt</surname><given-names>A</given-names></name><name><surname>Müller</surname><given-names>NG</given-names></name></person-group><article-title>Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information</article-title><source>J Neurosci</source><year>2006</year><volume>26</volume><fpage>12260</fpage><pub-id pub-id-type="doi">10.1523/JNEUROSCI.1457-06.2006</pub-id><pub-id pub-id-type="pmid">17122051</pub-id></mixed-citation></ref><ref id="CR4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bartels</surname><given-names>A</given-names></name><name><surname>Zeki</surname><given-names>S</given-names></name></person-group><article-title>The chronoarchitecture of the cerebral cortex</article-title><source>Phil Trans R Soc B Biol Sci</source><year>2005</year><volume>360</volume><fpage>733</fpage><pub-id pub-id-type="doi">10.1098/rstb.2005.1627</pub-id></mixed-citation></ref><ref id="CR5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beauchamp</surname><given-names>MS</given-names></name></person-group><article-title>See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex</article-title><source>Curr Opin Neurobiol</source><year>2005</year><volume>15</volume><fpage>145</fpage><pub-id pub-id-type="doi">10.1016/j.conb.2005.03.011</pub-id><pub-id pub-id-type="pmid">15831395</pub-id></mixed-citation></ref><ref id="CR6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beauchamp</surname><given-names>MS</given-names></name></person-group><article-title>Statistical criteria in fMRI studies of multisensory integration</article-title><source>Neuroinformatics</source><year>2005</year><volume>3</volume><fpage>93</fpage><lpage>113</lpage><pub-id pub-id-type="doi">10.1385/NI:3:2:093</pub-id><pub-id pub-id-type="pmid">15988040</pub-id></mixed-citation></ref><ref id="CR100"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beauchamp</surname><given-names>MS</given-names></name><name><surname>Lee</surname><given-names>KE</given-names></name><name><surname>Argall</surname><given-names>BD</given-names></name><name><surname>Martin</surname><given-names>A</given-names></name></person-group><article-title>Integration of auditory and visual information about objects in superior temporal sulcus</article-title><source>Neuron</source><year>2004</year><volume>41</volume><issue>5</issue><fpage>809</fpage><lpage>823</lpage><pub-id pub-id-type="doi">10.1016/S0896-6273(04)00070-4</pub-id><pub-id pub-id-type="pmid">15003179</pub-id></mixed-citation></ref><ref id="CR7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Belardinelli</surname><given-names>MO</given-names></name><name><surname>Sestieri</surname><given-names>C</given-names></name><name><surname>Di Matteo</surname><given-names>R</given-names></name><name><surname>Delogu</surname><given-names>F</given-names></name><name><surname>Del Gratta</surname><given-names>C</given-names></name><name><surname>Ferretti</surname><given-names>A</given-names></name><name><surname>Caulo</surname><given-names>M</given-names></name><name><surname>Tartaro</surname><given-names>A</given-names></name><name><surname>Romani</surname><given-names>GL</given-names></name></person-group><article-title>Audio-visual crossmodal interactions in environmental perception: an fMRI investigation</article-title><source>Cogn Process</source><year>2004</year><volume>5</volume><fpage>167</fpage><lpage>174</lpage></mixed-citation></ref><ref id="CR101"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bell</surname><given-names>AJ</given-names></name><name><surname>Sejnowski</surname><given-names>TJ</given-names></name></person-group><article-title>An information-maximization approach to blind separation and blind deconvolution</article-title><source>Neural Comput</source><year>1995</year><volume>7</volume><fpage>1129</fpage><lpage>1159</lpage><pub-id pub-id-type="doi">10.1162/neco.1995.7.6.1129</pub-id><pub-id pub-id-type="pmid">7584893</pub-id></mixed-citation></ref><ref id="CR8"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Boynton</surname><given-names>GM</given-names></name><name><surname>Engel</surname><given-names>SA</given-names></name><name><surname>Glover</surname><given-names>GH</given-names></name><name><surname>Heeger</surname><given-names>DJ</given-names></name></person-group><article-title>Linear systems analysis of functional magnetic resonance imaging in human V1</article-title><source>J Neurosci</source><year>1996</year><volume>16</volume><fpage>4207</fpage><lpage>4221</lpage><pub-id pub-id-type="pmid">8753882</pub-id></mixed-citation></ref><ref id="CR9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Calhoun</surname><given-names>VD</given-names></name><name><surname>Adali</surname><given-names>T</given-names></name><name><surname>Pearlson</surname><given-names>GD</given-names></name><name><surname>Pekar</surname><given-names>JJ</given-names></name></person-group><article-title>Spatial and temporal independent component analysis of functional MRI data containing a pair of task-related wave-forms</article-title><source>Hum Brain Mapp</source><year>2001</year><volume>13</volume><fpage>43</fpage><lpage>53</lpage><pub-id pub-id-type="doi">10.1002/hbm.1024</pub-id><pub-id pub-id-type="pmid">11284046</pub-id></mixed-citation></ref><ref id="CR102"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Calhoun</surname><given-names>V</given-names></name><name><surname>Adali</surname><given-names>T</given-names></name><name><surname>Pekar</surname><given-names>J</given-names></name></person-group><article-title>A method for comparing group fMRI data using independent component analysis: application to visual, motor and visuomotor tasks</article-title><source>Magn Reson Imaging</source><year>2004</year><volume>22</volume><issue>9</issue><fpage>1181</fpage><lpage>1191</lpage><pub-id pub-id-type="doi">10.1016/j.mri.2004.09.004</pub-id><pub-id pub-id-type="pmid">15607089</pub-id></mixed-citation></ref><ref id="CR10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Calvert</surname><given-names>G</given-names></name></person-group><article-title>Crossmodal processing in the human brain: insights from functional neuroimaging studies</article-title><source>Cereb Cortex</source><year>2001</year><volume>11</volume><fpage>1110</fpage><lpage>1123</lpage><pub-id pub-id-type="doi">10.1093/cercor/11.12.1110</pub-id><pub-id pub-id-type="pmid">11709482</pub-id></mixed-citation></ref><ref id="CR11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Castelo-Branco</surname><given-names>M</given-names></name><name><surname>Formisano</surname><given-names>E</given-names></name><name><surname>Backes</surname><given-names>W</given-names></name><name><surname>Zanella</surname><given-names>F</given-names></name><name><surname>Neuenschwander</surname><given-names>S</given-names></name><name><surname>Singer</surname><given-names>W</given-names></name><name><surname>Goebel</surname><given-names>R</given-names></name></person-group><article-title>Activity patterns in human motion-sensitive areas depend on the interpretation of global motion</article-title><source>Proc Natl Acad Sci USA</source><year>2002</year><volume>99</volume><fpage>13914</fpage><lpage>13919</lpage><pub-id pub-id-type="doi">10.1073/pnas.202049999</pub-id><pub-id pub-id-type="pmid">12368476</pub-id></mixed-citation></ref><ref id="CR12"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Doehrmann</surname><given-names>O</given-names></name><name><surname>Naumer</surname><given-names>MJ</given-names></name></person-group><article-title>Semantics and the multisensory brain: how meaning modulates processes of audio-visual integration</article-title><source>Brain Res</source><year>2008</year><volume>1242</volume><fpage>136</fpage><lpage>150</lpage><pub-id pub-id-type="doi">10.1016/j.brainres.2008.03.071</pub-id><pub-id pub-id-type="pmid">18479672</pub-id></mixed-citation></ref><ref id="CR13"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Doehrmann</surname><given-names>O</given-names></name><name><surname>Weigelt</surname><given-names>S</given-names></name><name><surname>Altmann</surname><given-names>CF</given-names></name><name><surname>Kaiser</surname><given-names>J</given-names></name><name><surname>Naumer</surname><given-names>MJ</given-names></name></person-group><article-title>Audio-visual fMRI adaptation reveals multisensory integration effects in object-related sensory cortices</article-title><source>J Neurosci</source><year>2010</year><volume>30</volume><fpage>3370</fpage><lpage>3379</lpage><pub-id pub-id-type="doi">10.1523/JNEUROSCI.5074-09.2010</pub-id><pub-id pub-id-type="pmid">20203196</pub-id></mixed-citation></ref><ref id="CR14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Driver</surname><given-names>J</given-names></name><name><surname>Noesselt</surname><given-names>T</given-names></name></person-group><article-title>Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments</article-title><source>Neuron</source><year>2008</year><volume>57</volume><fpage>11</fpage><pub-id pub-id-type="doi">10.1016/j.neuron.2007.12.013</pub-id><pub-id pub-id-type="pmid">18184561</pub-id></mixed-citation></ref><ref id="CR15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eckert</surname><given-names>MA</given-names></name><name><surname>Kamdar</surname><given-names>NV</given-names></name><name><surname>Chang</surname><given-names>CE</given-names></name><name><surname>Beckmann</surname><given-names>CF</given-names></name><name><surname>Greicius</surname><given-names>MD</given-names></name><name><surname>Menon</surname><given-names>V</given-names></name></person-group><article-title>A cross-modal system linking primary auditory and visual cortices: evidence from intrinsic fMRI connectivity analysis</article-title><source>Hum Brain Mapp</source><year>2008</year><volume>29</volume><fpage>848</fpage><lpage>857</lpage><pub-id pub-id-type="doi">10.1002/hbm.20560</pub-id><pub-id pub-id-type="pmid">18412133</pub-id></mixed-citation></ref><ref id="CR16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Esposito</surname><given-names>F</given-names></name><name><surname>Scarabino</surname><given-names>T</given-names></name><name><surname>Hyvärinen</surname><given-names>A</given-names></name><name><surname>Himberg</surname><given-names>J</given-names></name><name><surname>Formisano</surname><given-names>E</given-names></name><name><surname>Comani</surname><given-names>S</given-names></name><name><surname>Tedeschi</surname><given-names>G</given-names></name><name><surname>Goebel</surname><given-names>R</given-names></name><name><surname>Seifritz</surname><given-names>E</given-names></name><name><surname>Di Salle</surname><given-names>F</given-names></name></person-group><article-title>Independent component analysis of fMRI group studies by self-organizing clustering</article-title><source>NeuroImage</source><year>2005</year><volume>25</volume><fpage>193</fpage><pub-id pub-id-type="doi">10.1016/j.neuroimage.2004.10.042</pub-id><pub-id pub-id-type="pmid">15734355</pub-id></mixed-citation></ref><ref id="CR17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Forman</surname><given-names>SD</given-names></name><name><surname>Cohen</surname><given-names>JD</given-names></name><name><surname>Fitzgerald</surname><given-names>M</given-names></name><name><surname>Eddy</surname><given-names>WF</given-names></name><name><surname>Mintun</surname><given-names>MA</given-names></name><name><surname>Noll</surname><given-names>DC</given-names></name></person-group><article-title>Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold</article-title><source>Magn Reson Med</source><year>1995</year><volume>33</volume><fpage>636</fpage><lpage>647</lpage><pub-id pub-id-type="doi">10.1002/mrm.1910330508</pub-id><pub-id pub-id-type="pmid">7596267</pub-id></mixed-citation></ref><ref id="CR18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Friston</surname><given-names>KJ</given-names></name><name><surname>Frith</surname><given-names>CD</given-names></name><name><surname>Liddle</surname><given-names>PF</given-names></name><name><surname>Frackowiak</surname><given-names>RS</given-names></name></person-group><article-title>Functional connectivity: the principal-component analysis of large (PET) data sets</article-title><source>J Cereb Blood Flow Metab</source><year>1993</year><volume>13</volume><fpage>5</fpage><lpage>14</lpage><pub-id pub-id-type="doi">10.1038/jcbfm.1993.4</pub-id><pub-id pub-id-type="pmid">8417010</pub-id></mixed-citation></ref><ref id="CR19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Friston</surname><given-names>KJ</given-names></name><name><surname>Harrison</surname><given-names>L</given-names></name><name><surname>Penny</surname><given-names>W</given-names></name></person-group><article-title>Dynamic causal modelling</article-title><source>NeuroImage</source><year>2003</year><volume>19</volume><fpage>1273</fpage><pub-id pub-id-type="doi">10.1016/S1053-8119(03)00202-7</pub-id><pub-id pub-id-type="pmid">12948688</pub-id></mixed-citation></ref><ref id="CR21"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ghazanfar</surname><given-names>A</given-names></name><name><surname>Schroeder</surname><given-names>C</given-names></name></person-group><article-title>Is neocortex essentially multisensory?</article-title><source>Trends Cogn Sci</source><year>2006</year><volume>10</volume><fpage>278</fpage><pub-id pub-id-type="doi">10.1016/j.tics.2006.04.008</pub-id><pub-id pub-id-type="pmid">16713325</pub-id></mixed-citation></ref><ref id="CR103"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Greicius</surname><given-names>MD</given-names></name><name><surname>Krasnow</surname><given-names>B</given-names></name><name><surname>Reiss</surname><given-names>AL</given-names></name><name><surname>Menon</surname><given-names>V</given-names></name></person-group><article-title>Functional connectivity in the resting brain: a network analysis of the default mode hypothesis</article-title><source>Proc Natl Acad Sci USA</source><year>2003</year><volume>100</volume><issue>1</issue><fpage>253</fpage><lpage>258</lpage><pub-id pub-id-type="doi">10.1073/pnas.0135058100</pub-id><pub-id pub-id-type="pmid">12506194</pub-id></mixed-citation></ref><ref id="CR22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hein</surname><given-names>G</given-names></name><name><surname>Doehrmann</surname><given-names>O</given-names></name><name><surname>Müller</surname><given-names>NG</given-names></name><name><surname>Kaiser</surname><given-names>J</given-names></name><name><surname>Muckli</surname><given-names>L</given-names></name><name><surname>Naumer</surname><given-names>MJ</given-names></name></person-group><article-title>Object familiarity and semantic congruency modulate responses in cortical audio-visual integration areas</article-title><source>J Neurosci</source><year>2007</year><volume>27</volume><fpage>7881</fpage><lpage>7887</lpage><pub-id pub-id-type="doi">10.1523/JNEUROSCI.1740-07.2007</pub-id><pub-id pub-id-type="pmid">17652579</pub-id></mixed-citation></ref><ref id="CR23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Himberg</surname><given-names>J</given-names></name><name><surname>Hyvärinen</surname><given-names>A</given-names></name><name><surname>Esposito</surname><given-names>F</given-names></name></person-group><article-title>Validating the independent components of neuroimaging time series via clustering and visualization</article-title><source>NeuroImage</source><year>2004</year><volume>22</volume><fpage>1214</fpage><lpage>1222</lpage><pub-id pub-id-type="doi">10.1016/j.neuroimage.2004.03.027</pub-id><pub-id pub-id-type="pmid">15219593</pub-id></mixed-citation></ref><ref id="CR24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hocking</surname><given-names>J</given-names></name><name><surname>Price</surname><given-names>CJ</given-names></name></person-group><article-title>The role of the posterior superior temporal sulcus in audiovisual processing</article-title><source>Cereb Cortex</source><year>2008</year><volume>18</volume><fpage>2439</fpage><lpage>2449</lpage><pub-id pub-id-type="doi">10.1093/cercor/bhn007</pub-id><pub-id pub-id-type="pmid">18281303</pub-id></mixed-citation></ref><ref id="CR25"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hyvärinen</surname><given-names>A</given-names></name></person-group><article-title>Fast and robust fixed-point algorithms for independent component analysis</article-title><source>IEEE Trans Neural Netw</source><year>1999</year><volume>10</volume><fpage>626</fpage><lpage>634</lpage><pub-id pub-id-type="doi">10.1109/72.761722</pub-id><pub-id pub-id-type="pmid">18252563</pub-id></mixed-citation></ref><ref id="CR26"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kayser</surname><given-names>C</given-names></name><name><surname>Logothetis</surname><given-names>NK</given-names></name></person-group><article-title>Do early sensory cortices integrate cross-modal information?</article-title><source>Brain Struct Funct</source><year>2007</year><volume>212</volume><fpage>121</fpage><pub-id pub-id-type="doi">10.1007/s00429-007-0154-0</pub-id><pub-id pub-id-type="pmid">17717687</pub-id></mixed-citation></ref><ref id="CR27"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Lewis</surname><given-names>JW</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Naumer</surname><given-names>MJ</given-names></name><name><surname>Kaiser</surname><given-names>J</given-names></name></person-group><article-title>Audio-visual perception of everyday natural objects–Hemodynamic studies in humans</article-title><source>Multisensory object perception in the primate brain</source><year>2010</year><publisher-loc>New York</publisher-loc><publisher-name>Springer</publisher-name><fpage>155</fpage><lpage>190</lpage></mixed-citation></ref><ref id="CR28"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Liao</surname><given-names>R</given-names></name><name><surname>McKeown</surname><given-names>MJ</given-names></name><name><surname>Krolik</surname><given-names>JL</given-names></name></person-group><article-title>Isolation and minimization of head motion-induced signal variations in fMRI data using independent component analysis</article-title><source>Magn Reson Med</source><year>2006</year><volume>55</volume><fpage>1396</fpage><lpage>1413</lpage><pub-id pub-id-type="doi">10.1002/mrm.20893</pub-id><pub-id pub-id-type="pmid">16676336</pub-id></mixed-citation></ref><ref id="CR29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Macaluso</surname><given-names>E</given-names></name></person-group><article-title>Multisensory processing in sensory-specific cortical areas</article-title><source>Neuroscientist</source><year>2006</year><volume>12</volume><fpage>327</fpage><pub-id pub-id-type="doi">10.1177/1073858406287908</pub-id><pub-id pub-id-type="pmid">16840709</pub-id></mixed-citation></ref><ref id="CR30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Malinen</surname><given-names>S</given-names></name><name><surname>Hlushchuk</surname><given-names>Y</given-names></name><name><surname>Hari</surname><given-names>R</given-names></name></person-group><article-title>Towards natural stimulation in fMRI—issues of data analysis</article-title><source>NeuroImage</source><year>2007</year><volume>35</volume><fpage>131</fpage><pub-id pub-id-type="doi">10.1016/j.neuroimage.2006.11.015</pub-id><pub-id pub-id-type="pmid">17208459</pub-id></mixed-citation></ref><ref id="CR31"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Martuzzi</surname><given-names>R</given-names></name><name><surname>Murray</surname><given-names>MM</given-names></name><name><surname>Michel</surname><given-names>C</given-names></name><name><surname>Thiran</surname><given-names>J</given-names></name><name><surname>Maeder</surname><given-names>P</given-names></name><name><surname>Clarke</surname><given-names>S</given-names></name><name><surname>Meuli</surname><given-names>RA</given-names></name></person-group><article-title>Multisensory interactions within human primary cortices revealed by BOLD dynamics</article-title><source>Cereb Cortex</source><year>2007</year><volume>17</volume><fpage>1672</fpage><lpage>1679</lpage><pub-id pub-id-type="doi">10.1093/cercor/bhl077</pub-id><pub-id pub-id-type="pmid">16968869</pub-id></mixed-citation></ref><ref id="CR32"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McKeown</surname><given-names>MJ</given-names></name><name><surname>Makeig</surname><given-names>S</given-names></name><name><surname>Brown</surname><given-names>GG</given-names></name><name><surname>Jung</surname><given-names>TP</given-names></name><name><surname>Kindermann</surname><given-names>SS</given-names></name><name><surname>Bell</surname><given-names>AJ</given-names></name><name><surname>Sejnowski</surname><given-names>TJ</given-names></name></person-group><article-title>Analysis of fMRI data by blind separation into independent spatial components</article-title><source>Hum Brain Mapp</source><year>1998</year><volume>6</volume><fpage>160</fpage><lpage>188</lpage><pub-id pub-id-type="doi">10.1002/(SICI)1097-0193(1998)6:3<160::AID-HBM5>3.0.CO;2-1</pub-id><pub-id pub-id-type="pmid">9673671</pub-id></mixed-citation></ref><ref id="CR34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meienbrock</surname><given-names>A</given-names></name><name><surname>Naumer</surname><given-names>MJ</given-names></name><name><surname>Doehrmann</surname><given-names>O</given-names></name><name><surname>Singer</surname><given-names>W</given-names></name><name><surname>Muckli</surname><given-names>L</given-names></name></person-group><article-title>Retinotopic effects during spatial audio-visual integration</article-title><source>Neuropsychologia</source><year>2007</year><volume>45</volume><fpage>531</fpage><pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2006.05.018</pub-id><pub-id pub-id-type="pmid">16797610</pub-id></mixed-citation></ref><ref id="CR35"><mixed-citation publication-type="other">Meyer GF, Wuerger S, Greenlee M (In press) Interactions between auditory and visual semantic stimulus classes: evidence for common processing networks for speech and body actions. J Cogn Neurosci</mixed-citation></ref><ref id="CR105"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moritz</surname><given-names>CH</given-names></name><name><surname>Rogers</surname><given-names>BP</given-names></name><name><surname>Meyerand</surname><given-names>ME</given-names></name></person-group><article-title>Power spectrum ranked independent component analysis of a periodic fMRI complex motor paradigm</article-title><source>Hum Brain Mapp</source><year>2003</year><volume>18</volume><issue>2</issue><fpage>111</fpage><lpage>122</lpage><pub-id pub-id-type="doi">10.1002/hbm.10081</pub-id><pub-id pub-id-type="pmid">12518291</pub-id></mixed-citation></ref><ref id="CR36"><mixed-citation publication-type="book"><person-group person-group-type="editor"><name><surname>Naumer</surname><given-names>MJ</given-names></name><name><surname>Kaiser</surname><given-names>J</given-names></name></person-group><source>Multisensory object perception in the primate brain</source><year>2010</year><publisher-loc>New York</publisher-loc><publisher-name>Springer</publisher-name></mixed-citation></ref><ref id="CR37"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Naumer</surname><given-names>MJ</given-names></name><name><surname>Doehrmann</surname><given-names>O</given-names></name><name><surname>Müller</surname><given-names>NG</given-names></name><name><surname>Muckli</surname><given-names>L</given-names></name><name><surname>Kaiser</surname><given-names>J</given-names></name><name><surname>Hein</surname><given-names>G</given-names></name></person-group><article-title>Cortical plasticity of audio-visual object representations</article-title><source>Cereb Cortex</source><year>2009</year><volume>19</volume><fpage>1641</fpage><lpage>1653</lpage><pub-id pub-id-type="doi">10.1093/cercor/bhn200</pub-id><pub-id pub-id-type="pmid">19015373</pub-id></mixed-citation></ref><ref id="CR38"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Noesselt</surname><given-names>T</given-names></name><name><surname>Rieder</surname><given-names>JW</given-names></name><name><surname>Schoenfeld</surname><given-names>MA</given-names></name><name><surname>Kanowski</surname><given-names>M</given-names></name><name><surname>Hinrichs</surname><given-names>H</given-names></name><name><surname>Heinze</surname><given-names>HJ</given-names></name><name><surname>Driver</surname><given-names>J</given-names></name></person-group><article-title>Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices</article-title><source>J Neurosci</source><year>2007</year><volume>27</volume><fpage>11431</fpage><lpage>11441</lpage><pub-id pub-id-type="doi">10.1523/JNEUROSCI.2252-07.2007</pub-id><pub-id pub-id-type="pmid">17942738</pub-id></mixed-citation></ref><ref id="CR39"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Noppeney</surname><given-names>U</given-names></name><name><surname>Josephs</surname><given-names>O</given-names></name><name><surname>Hocking</surname><given-names>J</given-names></name><name><surname>Price</surname><given-names>CJ</given-names></name><name><surname>Friston</surname><given-names>KJ</given-names></name></person-group><article-title>The effect of prior visual information on recognition of speech and sounds</article-title><source>Cereb Cortex</source><year>2008</year><volume>18</volume><fpage>598</fpage><lpage>609</lpage><pub-id pub-id-type="doi">10.1093/cercor/bhm091</pub-id><pub-id pub-id-type="pmid">17617658</pub-id></mixed-citation></ref><ref id="CR40"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Noppeney</surname><given-names>U</given-names></name><name><surname>Ostwald</surname><given-names>D</given-names></name><name><surname>Werner</surname><given-names>S</given-names></name></person-group><article-title>Perceptual decisions formed by accumulation of audiovisual evidence in prefrontal cortex</article-title><source>J Neurosci</source><year>2010</year><volume>30</volume><fpage>7434</fpage><lpage>7446</lpage><pub-id pub-id-type="doi">10.1523/JNEUROSCI.0455-10.2010</pub-id><pub-id pub-id-type="pmid">20505110</pub-id></mixed-citation></ref><ref id="CR41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rajapakse</surname><given-names>JC</given-names></name><name><surname>Tan</surname><given-names>CL</given-names></name><name><surname>Zheng</surname><given-names>X</given-names></name><name><surname>Mukhopadhyay</surname><given-names>S</given-names></name><name><surname>Yang</surname><given-names>K</given-names></name></person-group><article-title>Exploratory analysis of brain connectivity with ICA</article-title><source>IEEE Eng Med Biol Mag</source><year>2006</year><volume>25</volume><fpage>102</fpage><lpage>111</lpage><pub-id pub-id-type="doi">10.1109/MEMB.2006.1607674</pub-id><pub-id pub-id-type="pmid">16568942</pub-id></mixed-citation></ref><ref id="CR43"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rogers</surname><given-names>BP</given-names></name><name><surname>Morgan</surname><given-names>VL</given-names></name><name><surname>Newton</surname><given-names>AT</given-names></name><name><surname>Gore</surname><given-names>JC</given-names></name></person-group><article-title>Assessing functional connectivity in the human brain by fMRI</article-title><source>Magn Reson Imaging</source><year>2007</year><volume>25</volume><fpage>1347</fpage><lpage>1357</lpage><pub-id pub-id-type="doi">10.1016/j.mri.2007.03.007</pub-id><pub-id pub-id-type="pmid">17499467</pub-id></mixed-citation></ref><ref id="CR44"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sadaghiani</surname><given-names>S</given-names></name><name><surname>Maier</surname><given-names>JX</given-names></name><name><surname>Noppeney</surname><given-names>U</given-names></name></person-group><article-title>Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processes</article-title><source>J Neurosci</source><year>2009</year><volume>29</volume><fpage>6490</fpage><lpage>6499</lpage><pub-id pub-id-type="doi">10.1523/JNEUROSCI.5437-08.2009</pub-id><pub-id pub-id-type="pmid">19458220</pub-id></mixed-citation></ref><ref id="CR45"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schroeder</surname><given-names>CE</given-names></name><name><surname>Foxe</surname><given-names>JJ</given-names></name></person-group><article-title>Multisensory contributions to low-level, `unisensory’ processing</article-title><source>Curr Opin Neurobiol</source><year>2005</year><volume>15</volume><fpage>454</fpage><pub-id pub-id-type="doi">10.1016/j.conb.2005.06.008</pub-id><pub-id pub-id-type="pmid">16019202</pub-id></mixed-citation></ref><ref id="CR46"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Stein</surname><given-names>BE</given-names></name><name><surname>Meredith</surname><given-names>MA</given-names></name></person-group><source>The merging of the senses</source><year>1993</year><publisher-loc>Cambridge</publisher-loc><publisher-name>MIT Press</publisher-name></mixed-citation></ref><ref id="CR47"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stevenson</surname><given-names>R</given-names></name><name><surname>Geoghegan</surname><given-names>M</given-names></name><name><surname>James</surname><given-names>T</given-names></name></person-group><article-title>Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects</article-title><source>Exp Brain Res</source><year>2007</year><volume>179</volume><issue>1</issue><fpage>85</fpage><lpage>95</lpage><pub-id pub-id-type="doi">10.1007/s00221-006-0770-6</pub-id><pub-id pub-id-type="pmid">17109108</pub-id></mixed-citation></ref><ref id="CR48"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stevenson</surname><given-names>RA</given-names></name><name><surname>Kim</surname><given-names>S</given-names></name><name><surname>James</surname><given-names>TW</given-names></name></person-group><article-title>An additive-factors design to disambiguate neuronal and areal convergence: measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI</article-title><source>Exp Brain Res</source><year>2009</year><volume>198</volume><fpage>183</fpage><lpage>194</lpage><pub-id pub-id-type="doi">10.1007/s00221-009-1783-8</pub-id><pub-id pub-id-type="pmid">19352638</pub-id></mixed-citation></ref><ref id="CR49"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Talairach</surname><given-names>J</given-names></name><name><surname>Tournoux</surname><given-names>P</given-names></name></person-group><source>Co-planar stereotaxic atlas of the human brain</source><year>1998</year><publisher-loc>New York</publisher-loc><publisher-name>Thieme Medical</publisher-name></mixed-citation></ref><ref id="CR50"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Thomas</surname><given-names>CG</given-names></name><name><surname>Harshman</surname><given-names>RA</given-names></name><name><surname>Menon</surname><given-names>RS</given-names></name></person-group><article-title>Noise reduction in BOLD-based fMRI using component analysis</article-title><source>Neuroimage</source><year>2002</year><volume>17</volume><fpage>1521</fpage><lpage>1537</lpage><pub-id pub-id-type="doi">10.1006/nimg.2002.1200</pub-id><pub-id pub-id-type="pmid">12414291</pub-id></mixed-citation></ref><ref id="CR51"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Atteveldt</surname><given-names>NM</given-names></name><name><surname>Formisano</surname><given-names>E</given-names></name><name><surname>Goebel</surname><given-names>R</given-names></name><name><surname>Blomert</surname><given-names>L</given-names></name></person-group><article-title>Integration of letters and speech sounds in the human brain</article-title><source>Neuron</source><year>2004</year><volume>43</volume><fpage>271</fpage><lpage>282</lpage><pub-id pub-id-type="doi">10.1016/j.neuron.2004.06.025</pub-id><pub-id pub-id-type="pmid">15260962</pub-id></mixed-citation></ref><ref id="CR52"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Atteveldt</surname><given-names>NM</given-names></name><name><surname>Blau</surname><given-names>VC</given-names></name><name><surname>Blomert</surname><given-names>L</given-names></name><name><surname>Goebel</surname><given-names>R</given-names></name></person-group><article-title>fMR-adaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex</article-title><source>BMC Neuroscience</source><year>2010</year><volume>11</volume><fpage>11</fpage><pub-id pub-id-type="doi">10.1186/1471-2202-11-11</pub-id><pub-id pub-id-type="pmid">20122260</pub-id></mixed-citation></ref><ref id="CR53"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ven</surname><given-names>VG</given-names></name><name><surname>Formisano</surname><given-names>E</given-names></name><name><surname>Prvulovic</surname><given-names>D</given-names></name><name><surname>Roeder</surname><given-names>CH</given-names></name><name><surname>Linden</surname><given-names>DEJ</given-names></name></person-group><article-title>Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest</article-title><source>Hum Brain Mapp</source><year>2004</year><volume>22</volume><fpage>165</fpage><lpage>178</lpage><pub-id pub-id-type="doi">10.1002/hbm.20022</pub-id><pub-id pub-id-type="pmid">15195284</pub-id></mixed-citation></ref><ref id="CR54"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ven</surname><given-names>VG</given-names></name><name><surname>Bledowski</surname><given-names>C</given-names></name><name><surname>Prvulovic</surname><given-names>D</given-names></name><name><surname>Goebel</surname><given-names>R</given-names></name><name><surname>Formisano</surname><given-names>E</given-names></name><name><surname>Linden</surname><given-names>DEJ</given-names></name><name><surname>Di Salle</surname><given-names>F</given-names></name><name><surname>Esposito</surname><given-names>F</given-names></name></person-group><article-title>Visual target modulation of functional connectivity networks revealed by self-organizing group ICA</article-title><source>Hum Brain Mapp</source><year>2008</year><volume>29</volume><fpage>1450</fpage><lpage>1461</lpage><pub-id pub-id-type="doi">10.1002/hbm.20479</pub-id><pub-id pub-id-type="pmid">17990304</pub-id></mixed-citation></ref><ref id="CR55"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ven</surname><given-names>V</given-names></name><name><surname>Esposito</surname><given-names>F</given-names></name><name><surname>Christoffels</surname><given-names>IK</given-names></name></person-group><article-title>Neural network of speech monitoring overlaps with overt speech production and comprehension networks: a sequential spatial and temporal ICA study</article-title><source>Neuroimage</source><year>2009</year><volume>47</volume><fpage>1982</fpage><lpage>1991</lpage><pub-id pub-id-type="doi">10.1016/j.neuroimage.2009.05.057</pub-id><pub-id pub-id-type="pmid">19481159</pub-id></mixed-citation></ref><ref id="CR56"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Werner</surname><given-names>S</given-names></name><name><surname>Noppeney</surname><given-names>U</given-names></name></person-group><article-title>Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization</article-title><source>J Neurosci</source><year>2010</year><volume>30</volume><fpage>2662</fpage><lpage>2675</lpage><pub-id pub-id-type="doi">10.1523/JNEUROSCI.5091-09.2010</pub-id><pub-id pub-id-type="pmid">20164350</pub-id></mixed-citation></ref><ref id="CR57"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Werner</surname><given-names>S</given-names></name><name><surname>Noppeney</surname><given-names>U</given-names></name></person-group><article-title>Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization</article-title><source>Cereb Cortex</source><year>2010</year><volume>20</volume><issue>8</issue><fpage>1829</fpage><lpage>1842</lpage><pub-id pub-id-type="doi">10.1093/cercor/bhp248</pub-id><pub-id pub-id-type="pmid">19923200</pub-id></mixed-citation></ref></ref-list><fn-group><fn><p>The authors Marcus J. Naumer, Jasper van den Bosch and Michael Wibral contributed equally.</p></fn></fn-group></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000808 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000808 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Pmc
|étape= Curation
|type= RBID
|clé= PMC:3155044
|texte= Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:21503649" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |