The roles of physical and physiological simultaneity in audiovisual multisensory facilitation
Identifieur interne : 002B68 ( Ncbi/Merge ); précédent : 002B67; suivant : 002B69The roles of physical and physiological simultaneity in audiovisual multisensory facilitation
Auteurs : Lynnette M. Leone ; Mark E. MccourtSource :
- i-Perception [ 2041-6695 ] ; 2013.
Abstract
A series of experiments measured the audiovisual stimulus onset asynchrony (SOAAV), yielding facilitative multisensory integration. We evaluated (1) the range of SOAAV over which facilitation occurred when unisensory stimuli were weak; (2) whether the range of SOAAV producing facilitation supported the hypothesis that physiological simultaneity of unisensory activity governs multisensory facilitation; and (3) whether AV multisensory facilitation depended on relative stimulus intensity. We compared response-time distributions to unisensory auditory (A) and visual (V) stimuli with those to AV stimuli over a wide range (300 and 20 ms increments) of SOAAV, across four conditions of varying stimulus intensity. In condition 1, the intensity of unisensory stimuli was adjusted such that
Url:
DOI: 10.1068/i0532
PubMed: 24349682
PubMed Central: 3859565
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 002003
- to stream Pmc, to step Curation: 002003
- to stream Pmc, to step Checkpoint: 000F53
Links to Exploration step
PMC:3859565Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">The roles of physical and physiological simultaneity in audiovisual multisensory facilitation</title><author><name sortKey="Leone, Lynnette M" sort="Leone, Lynnette M" uniqKey="Leone L" first="Lynnette M." last="Leone">Lynnette M. Leone</name></author><author><name sortKey="Mccourt, Mark E" sort="Mccourt, Mark E" uniqKey="Mccourt M" first="Mark E." last="Mccourt">Mark E. Mccourt</name></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">24349682</idno><idno type="pmc">3859565</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3859565</idno><idno type="RBID">PMC:3859565</idno><idno type="doi">10.1068/i0532</idno><date when="2013">2013</date><idno type="wicri:Area/Pmc/Corpus">002003</idno><idno type="wicri:Area/Pmc/Curation">002003</idno><idno type="wicri:Area/Pmc/Checkpoint">000F53</idno><idno type="wicri:Area/Ncbi/Merge">002B68</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">The roles of physical and physiological simultaneity in audiovisual multisensory facilitation</title><author><name sortKey="Leone, Lynnette M" sort="Leone, Lynnette M" uniqKey="Leone L" first="Lynnette M." last="Leone">Lynnette M. Leone</name></author><author><name sortKey="Mccourt, Mark E" sort="Mccourt, Mark E" uniqKey="Mccourt M" first="Mark E." last="Mccourt">Mark E. Mccourt</name></author></analytic><series><title level="j">i-Perception</title><idno type="eISSN">2041-6695</idno><imprint><date when="2013">2013</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>A series of experiments measured the audiovisual stimulus onset asynchrony (SOA<sub>AV</sub>), yielding facilitative multisensory integration. We evaluated (1) the range of SOA<sub>AV</sub> over which facilitation occurred when unisensory stimuli were weak; (2) whether the range of SOA<sub>AV</sub> producing facilitation supported the hypothesis that physiological simultaneity of unisensory activity governs multisensory facilitation; and (3) whether AV multisensory facilitation depended on relative stimulus intensity. We compared response-time distributions to unisensory auditory (A) and visual (V) stimuli with those to AV stimuli over a wide range (300 and 20 ms increments) of SOA<sub>AV</sub>, across four conditions of varying stimulus intensity. In condition 1, the intensity of unisensory stimuli was adjusted such that <italic>d</italic>′ ≈ 2. In condition 2, V stimulus intensity was increased (<italic>d</italic>′ > 4), while A stimulus intensity was as in condition 1. In condition 3, A stimulus intensity was increased (<italic>d</italic>′ > 4) while V stimulus intensity was as in condition 1. In condition 4, both A and V stimulus intensities were increased to clearly suprathreshold levels (<italic>d</italic>′ > 4). Across all conditions of stimulus intensity, significant multisensory facilitation occurred exclusively for simultaneously presented A and V stimuli. In addition, facilitation increased as stimulus intensity increased, in disagreement with inverse effectiveness. These results indicate that the requirements for facilitative multisensory integration include both physical and physiological simultaneity.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Alvarado, J C" uniqKey="Alvarado J">J. C. Alvarado</name></author><author><name sortKey="Vaughan, J W" uniqKey="Vaughan J">J. W. Vaughan</name></author><author><name sortKey="Stanford, T R" uniqKey="Stanford T">T. R. Stanford</name></author><author><name sortKey="Stein, B E" uniqKey="Stein B">B. E. Stein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Barlow, R B" uniqKey="Barlow R">R. B. Barlow</name></author><author><name sortKey="Snodderly, D M" uniqKey="Snodderly D">D. M. Snodderly</name></author><author><name sortKey="Swadlow, H A" uniqKey="Swadlow H">H. A. Swadlow</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Callan, D E" uniqKey="Callan D">D. E. Callan</name></author><author><name sortKey="Callan, A M" uniqKey="Callan A">A. M. Callan</name></author><author><name sortKey="Kroos, C" uniqKey="Kroos C">C. Kroos</name></author><author><name sortKey="Vatikiotis Bateson, E" uniqKey="Vatikiotis Bateson E">E. Vatikiotis-Bateson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Calvert, G A" uniqKey="Calvert G">G. A. Calvert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Campbell, F W" uniqKey="Campbell F">F. W. Campbell</name></author><author><name sortKey="Green, D G" uniqKey="Green D">D. G. Green</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Celesia, G G" uniqKey="Celesia G">G. G. Celesia</name></author><author><name sortKey="Puletti, F" uniqKey="Puletti F">F. Puletti</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Clark, V P" uniqKey="Clark V">V. P. Clark</name></author><author><name sortKey="Hillyard, S A" uniqKey="Hillyard S">S. A. Hillyard</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Diederich, A" uniqKey="Diederich A">A. Diederich</name></author><author><name sortKey="Colonius, H" uniqKey="Colonius H">H. Colonius</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eggermont, J J" uniqKey="Eggermont J">J. J. Eggermont</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Foster, D H" uniqKey="Foster D">D. H. Foster</name></author><author><name sortKey="Bischof, W F" uniqKey="Bischof W">W. F. Bischof</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author><author><name sortKey="Simpson, G V" uniqKey="Simpson G">G. V. Simpson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author><author><name sortKey="Strugstad, E C" uniqKey="Strugstad E">E. C. Strugstad</name></author><author><name sortKey="Sehatpour, P" uniqKey="Sehatpour P">P. Sehatpour</name></author><author><name sortKey="Molholm, S" uniqKey="Molholm S">S. Molholm</name></author><author><name sortKey="Pasieka, W" uniqKey="Pasieka W">W. Pasieka</name></author><author><name sortKey="Schroeder, C E" uniqKey="Schroeder C">C. E. Schroeder</name></author><author><name sortKey="Mccourt, M E" uniqKey="Mccourt M">M. E. McCourt</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Frassinetti, F" uniqKey="Frassinetti F">F. Frassinetti</name></author><author><name sortKey="Bolognini, N" uniqKey="Bolognini N">N. Bolognini</name></author><author><name sortKey="Ladavas, E" uniqKey="Ladavas E">E. Ladàvas</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Giard, M H" uniqKey="Giard M">M. H. Giard</name></author><author><name sortKey="Peronnet, F" uniqKey="Peronnet F">F. Peronnet</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hershenson, M" uniqKey="Hershenson M">M. Hershenson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Holmes, N P" uniqKey="Holmes N">N. P. Holmes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Holmes, N P" uniqKey="Holmes N">N. P. Holmes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Holmes, N P" uniqKey="Holmes N">N. P. Holmes</name></author><author><name sortKey="Spence, C" uniqKey="Spence C">C. Spence</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Iacoboni, M" uniqKey="Iacoboni M">M. Iacoboni</name></author><author><name sortKey="Zaidel, E" uniqKey="Zaidel E">E. Zaidel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jas Kowski, P" uniqKey="Jas Kowski P">P. Jas´kowski</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jeffress, L A" uniqKey="Jeffress L">L. A. Jeffress</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Jeffreys, D A" uniqKey="Jeffreys D">D. A. Jeffreys</name></author><author><name sortKey="Axford, J G" uniqKey="Axford J">J. G. Axford</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lakatos, P" uniqKey="Lakatos P">P. Lakatos</name></author><author><name sortKey="Chen, C M" uniqKey="Chen C">C. M. Chen</name></author><author><name sortKey="O Connell, M N" uniqKey="O Connell M">M. N. O'Connell</name></author><author><name sortKey="Mills, A" uniqKey="Mills A">A. Mills</name></author><author><name sortKey="Schroeder, C E" uniqKey="Schroeder C">C. E. Schroeder</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Legge, G E" uniqKey="Legge G">G. E. Legge</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mansfield, R J W" uniqKey="Mansfield R">R. J. W. Mansfield</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Maunsell, J H R" uniqKey="Maunsell J">J. H. R. Maunsell</name></author><author><name sortKey="Ghose, G M" uniqKey="Ghose G">G. M. Ghose</name></author><author><name sortKey="Assad, J A" uniqKey="Assad J">J. A. Assad</name></author><author><name sortKey="Mcadams, C J" uniqKey="Mcadams C">C. J. McAdams</name></author><author><name sortKey="Boudreau, C E" uniqKey="Boudreau C">C. E. Boudreau</name></author><author><name sortKey="Noerager, B D" uniqKey="Noerager B">B. D. Noerager</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meredith, M A" uniqKey="Meredith M">M. A. Meredith</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meredith, M A" uniqKey="Meredith M">M. A. Meredith</name></author><author><name sortKey="Allman, B" uniqKey="Allman B">B. Allman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meredith, M A" uniqKey="Meredith M">M. A. Meredith</name></author><author><name sortKey="Nemitz, J W" uniqKey="Nemitz J">J. W. Nemitz</name></author><author><name sortKey="Stein, B E" uniqKey="Stein B">B. E. Stein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Meredith, M A" uniqKey="Meredith M">M. A. Meredith</name></author><author><name sortKey="Stein, B E" uniqKey="Stein B">B. E. Stein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Miller, J" uniqKey="Miller J">J. Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Miller, J" uniqKey="Miller J">J. Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Miniussi, C" uniqKey="Miniussi C">C. Miniussi</name></author><author><name sortKey="Girelli, M" uniqKey="Girelli M">M. Girelli</name></author><author><name sortKey="Marzi, C A" uniqKey="Marzi C">C. A. Marzi</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Molholm, S" uniqKey="Molholm S">S. Molholm</name></author><author><name sortKey="Ritter, W" uniqKey="Ritter W">W. Ritter</name></author><author><name sortKey="Murray, M M" uniqKey="Murray M">M. M. Murray</name></author><author><name sortKey="Javitt, D C" uniqKey="Javitt D">D. C. Javitt</name></author><author><name sortKey="Schroeder, C E" uniqKey="Schroeder C">C. E. Schroeder</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Molholm, S" uniqKey="Molholm S">S. Molholm</name></author><author><name sortKey="Sehatpour, P" uniqKey="Sehatpour P">P. Sehatpour</name></author><author><name sortKey="Mehta, A D" uniqKey="Mehta A">A. D. Mehta</name></author><author><name sortKey="Shpaner, M" uniqKey="Shpaner M">M. Shpaner</name></author><author><name sortKey="Gomez Ramirez, M" uniqKey="Gomez Ramirez M">M. Gomez-Ramirez</name></author><author><name sortKey="Ortigue, S" uniqKey="Ortigue S">S. Ortigue</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mordkoff, J T" uniqKey="Mordkoff J">J. T. Mordkoff</name></author><author><name sortKey="Yantis, S" uniqKey="Yantis S">S. Yantis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Murray, M M" uniqKey="Murray M">M. M. Murray</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author><author><name sortKey="Higgins, B A" uniqKey="Higgins B">B. A. Higgins</name></author><author><name sortKey="Javitt, D C" uniqKey="Javitt D">D. C. Javitt</name></author><author><name sortKey="Schroeder, C E" uniqKey="Schroeder C">C. E. Schroeder</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Otto, T U" uniqKey="Otto T">T. U. Otto</name></author><author><name sortKey="Mamassian, P" uniqKey="Mamassian P">P. Mamassian</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Phillips, D P" uniqKey="Phillips D">D. P. Phillips</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pieron, H" uniqKey="Pieron H">H. Piéron</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Prestrude, A M" uniqKey="Prestrude A">A. M. Prestrude</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Raab, D H" uniqKey="Raab D">D. H. Raab</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ross, L A" uniqKey="Ross L">L. A. Ross</name></author><author><name sortKey="Saint Amour, D" uniqKey="Saint Amour D">D. Saint-Amour</name></author><author><name sortKey="Leavitt, V M" uniqKey="Leavitt V">V. M. Leavitt</name></author><author><name sortKey="Javitt, D C" uniqKey="Javitt D">D. C. Javitt</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Roufs, J A J" uniqKey="Roufs J">J. A. J. Roufs</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Senkowski, D" uniqKey="Senkowski D">D. Senkowski</name></author><author><name sortKey="Saint Amour, D" uniqKey="Saint Amour D">D. Saint-Amour</name></author><author><name sortKey="Hofle, M" uniqKey="Hofle M">M. Höfle</name></author><author><name sortKey="Foxe, J J" uniqKey="Foxe J">J. J. Foxe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Serino, A" uniqKey="Serino A">A. Serino</name></author><author><name sortKey="Farne, A" uniqKey="Farne A">A. Farnè</name></author><author><name sortKey="Rinaldesi, M L" uniqKey="Rinaldesi M">M. L. Rinaldesi</name></author><author><name sortKey="Haggard, P" uniqKey="Haggard P">P. Haggard</name></author><author><name sortKey="Ladavas, E" uniqKey="Ladavas E">E. Làdavas</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Song, S" uniqKey="Song S">S. Song</name></author><author><name sortKey="Miller, K D" uniqKey="Miller K">K. D. Miller</name></author><author><name sortKey="Abbott, L F" uniqKey="Abbott L">L. F. Abbott</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stein, B E" uniqKey="Stein B">B. E. Stein</name></author><author><name sortKey="Meredith, M A" uniqKey="Meredith M">M. A. Meredith</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stufflebeam, S M" uniqKey="Stufflebeam S">S. M. Stufflebeam</name></author><author><name sortKey="Poeppel, D" uniqKey="Poeppel D">D. Poeppel</name></author><author><name sortKey="Rowley, H A" uniqKey="Rowley H">H. A. Rowley</name></author><author><name sortKey="Roberts, T P L" uniqKey="Roberts T">T. P. L. Roberts</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Supek, S" uniqKey="Supek S">S. Supek</name></author><author><name sortKey="Aines, C J" uniqKey="Aines C">C. J. Aines</name></author><author><name sortKey="Ranken, D" uniqKey="Ranken D">D. Ranken</name></author><author><name sortKey="Best, E" uniqKey="Best E">E. Best</name></author><author><name sortKey="Flynn, E R" uniqKey="Flynn E">E. R. Flynn</name></author><author><name sortKey="Wood, C C" uniqKey="Wood C">C. C. Wood</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Turrigiano, G G" uniqKey="Turrigiano G">G. G. Turrigiano</name></author><author><name sortKey="Leslie, K R" uniqKey="Leslie K">K. R. Leslie</name></author><author><name sortKey="Desai, N S" uniqKey="Desai N">N. S. Desai</name></author><author><name sortKey="Rutherford, L C" uniqKey="Rutherford L">L. C. Rutherford</name></author><author><name sortKey="Nelson, S B" uniqKey="Nelson S">S. B. Nelson</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Iperception</journal-id><journal-id journal-id-type="iso-abbrev">Iperception</journal-id><journal-id journal-id-type="publisher-id">pmed</journal-id><journal-title-group><journal-title>i-Perception</journal-title></journal-title-group><issn pub-type="epub">2041-6695</issn><publisher><publisher-name>Pion</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">24349682</article-id><article-id pub-id-type="pmc">3859565</article-id><article-id pub-id-type="doi">10.1068/i0532</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>The roles of physical and physiological simultaneity in audiovisual multisensory facilitation</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Leone</surname><given-names>Lynnette M.</given-names></name><aff>Center for Visual and Cognitive Neuroscience, Department of Psychology, NDSU Department 2765, P.O. Box 6050, College of Science and Mathematics, North Dakota State University, Fargo, ND 58105-6050, USA; e-mail:<email>lynnette.leone@ndsu.edu</email></aff></contrib><contrib contrib-type="author"><name><surname>McCourt</surname><given-names>Mark E.</given-names></name><xref ref-type="corresp" rid="cor1">∗</xref><aff>Center for Visual and Cognitive Neuroscience, Department of Psychology, NDSU Department 2765, P.O. Box 6050, College of Science and Mathematics, North Dakota State University, Fargo, ND 58105-6050, USA; e-mail:<email>mark.mccourt@ndsu.edu</email></aff></contrib></contrib-group><author-notes><corresp id="cor1"><label>∗</label>Corresponding author.</corresp></author-notes><pub-date pub-type="collection"><year>2013</year></pub-date><pub-date pub-type="epub"><day>03</day><month>6</month><year>2013</year></pub-date><volume>4</volume><issue>4</issue><issue-title>Special Issue: Multisensory Perception</issue-title><fpage>213</fpage><lpage>228</lpage><history><date date-type="received"><day>15</day><month>4</month><year>2013</year></date><date date-type="rev-recd"><day>12</day><month>12</month><year>2012</year></date></history><permissions><copyright-statement>Copyright 2013 L M Leone, M E McCourt</copyright-statement><copyright-year>2013</copyright-year><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by-nc-nd/3.0/"><license-p>This open-access article is distributed under a Creative Commons Licence, which permits noncommercial use, distribution, and reproduction, provided the original author(s) and source are credited and no alterations are made.</license-p></license></permissions><abstract><p>A series of experiments measured the audiovisual stimulus onset asynchrony (SOA<sub>AV</sub>), yielding facilitative multisensory integration. We evaluated (1) the range of SOA<sub>AV</sub> over which facilitation occurred when unisensory stimuli were weak; (2) whether the range of SOA<sub>AV</sub> producing facilitation supported the hypothesis that physiological simultaneity of unisensory activity governs multisensory facilitation; and (3) whether AV multisensory facilitation depended on relative stimulus intensity. We compared response-time distributions to unisensory auditory (A) and visual (V) stimuli with those to AV stimuli over a wide range (300 and 20 ms increments) of SOA<sub>AV</sub>, across four conditions of varying stimulus intensity. In condition 1, the intensity of unisensory stimuli was adjusted such that <italic>d</italic>′ ≈ 2. In condition 2, V stimulus intensity was increased (<italic>d</italic>′ > 4), while A stimulus intensity was as in condition 1. In condition 3, A stimulus intensity was increased (<italic>d</italic>′ > 4) while V stimulus intensity was as in condition 1. In condition 4, both A and V stimulus intensities were increased to clearly suprathreshold levels (<italic>d</italic>′ > 4). Across all conditions of stimulus intensity, significant multisensory facilitation occurred exclusively for simultaneously presented A and V stimuli. In addition, facilitation increased as stimulus intensity increased, in disagreement with inverse effectiveness. These results indicate that the requirements for facilitative multisensory integration include both physical and physiological simultaneity.</p></abstract><kwd-group><kwd>multisensory integration</kwd><kwd>neural coactivation</kwd><kwd>inverse effectiveness</kwd><kwd>race model</kwd><kwd>simultaneity</kwd><kwd>reaction time</kwd><kwd>d′</kwd></kwd-group></article-meta></front><body><sec id="s1"><label>1</label><title>Introduction</title><sec id="s1.1"><label>1.1</label><title>Multisensory integration</title><p>Meredith (<xref ref-type="bibr" rid="R27">2002</xref>) identified two classes of multisensory convergence: areal and neuronal. Areal convergence occurs when unisensory neurons from different modalities merely coexist within a brain region but do not interact. Neuronal convergence occurs when unisensory neurons from two or more modalities make synaptic contact onto recipient “multisensory” neurons. Multisensory integration occurs when the response of multisensory neurons to convergent unisensory input differs qualitatively and quantitatively from that elicited by the individual unisensory inputs alone (Calvert, <xref ref-type="bibr" rid="R4">2001</xref>).</p></sec><sec id="s1.2"><label>1.2</label><title>The redundant signals effect</title><p>A well-known behavioral manifestation of facilitative multisensory integration is the decrease in response time (RT) to pairings of unisensory stimuli presented over multiple sensory channels, where RT to the multisensory combination is faster than to either unisensory signal alone. This enhancement in the speed of processing has been termed the “redundant signals effect,” or RSE (Miller, <xref ref-type="bibr" rid="R31">1982</xref>). The RSE is not an exclusively multisensory phenomenon because it also occurs when the redundant signals occur within a single sensory modality (Iacoboni & Zaidel, <xref ref-type="bibr" rid="R19">2003</xref>; Miller, <xref ref-type="bibr" rid="R32">1986</xref>; Miniussi, Girelli, & Marzi, <xref ref-type="bibr" rid="R33">1998</xref>; Molholm et al., <xref ref-type="bibr" rid="R34">2002</xref>; Mordkoff & Yantis, <xref ref-type="bibr" rid="R36">1991</xref>; Murray, Foxe, Higgins, Javitt, & Schroeder, <xref ref-type="bibr" rid="R37">2001</xref>; Supek et al., <xref ref-type="bibr" rid="R50">1999</xref>), but this paradigm has been widely employed in multisensory research.</p><p>Miller (<xref ref-type="bibr" rid="R31">1982</xref>) compared two models that could potentially account for the RSE: separate activation or “race” models and neural coactivation models. Race models assume that each unisensory (redundant) signal is processed independently, such that on each trial the channel that processes the stimulus most quickly, and thus initiates the overt response, “wins” the race. According to race models, redundancy gains can result solely from statistical probability summation and no neural interaction between the activated sensory channels is <italic>required</italic> (although such interactions are not ruled out). In contrast, neural coactivation models posit that signals from each unisensory channel interact in order to initiate the response. Coactivation across the two channels accumulates until a response criterion is reached, which can occur before the same criterion is reached by activation within either individual channel.</p><p>Miller (<xref ref-type="bibr" rid="R31">1982</xref>) derived a mathematical inequality describing the race model that specifies an upper limit on the cumulative probability (CP) of obtaining speeded RT to redundant stimuli. Miller's inequality asserts that the CP of obtaining the fastest responses to redundant signals must be less than or equal to the CP of obtaining the fastest responses to individual stimuli. Specifically, the race model states that for pairs of stimuli, i.e., auditory (A) and visual (V), at a given AV stimulus onset asynchrony (SOA<sub>AV</sub>), at a given response latency (<italic>t</italic>), that
<disp-formula id="FD1"><label>(1)</label><mml:math id="M001"><mml:mstyle displaystyle="true"><mml:mrow><mml:mi>CP</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>RT</mml:mi><mml:mo><</mml:mo><mml:mi>t</mml:mi><mml:mo>|</mml:mo><mml:mi>AV</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>≤</mml:mo><mml:mi>CP</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>RT</mml:mi><mml:mo><</mml:mo><mml:mi>t</mml:mi><mml:mo>−</mml:mo><mml:msub><mml:mi>SOA</mml:mi><mml:mrow><mml:mi>AV</mml:mi></mml:mrow></mml:msub><mml:mo>|</mml:mo><mml:mi mathvariant="normal">A</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>+</mml:mo><mml:mi>CP</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>RT</mml:mi><mml:mo><</mml:mo><mml:mi>t</mml:mi><mml:mo>|</mml:mo><mml:mi mathvariant="normal">V</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>,</mml:mo></mml:mrow></mml:mstyle></mml:math></disp-formula>where A is delayed relative to V, and
<disp-formula id="FD2"><label>(2)</label><mml:math id="M002"><mml:mstyle displaystyle="true"><mml:mrow><mml:mi>CP</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>RT</mml:mi><mml:mo><</mml:mo><mml:mi>t</mml:mi><mml:mo>|</mml:mo><mml:mi>AV</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>≤</mml:mo><mml:mi>CP</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>RT</mml:mi><mml:mo><</mml:mo><mml:mi>t</mml:mi><mml:mo>|</mml:mo><mml:mi mathvariant="normal">A</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>+</mml:mo><mml:mi>CP</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>RT</mml:mi><mml:mo><</mml:mo><mml:mi>t</mml:mi><mml:mo>−</mml:mo><mml:msub><mml:mi>SOA</mml:mi><mml:mrow><mml:mi>AV</mml:mi></mml:mrow></mml:msub><mml:mo>|</mml:mo><mml:mi mathvariant="normal">V</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>,</mml:mo></mml:mrow></mml:mstyle></mml:math></disp-formula>where V is delayed relative to A. CP(RT < <italic>t</italic>|AV) is the CP of obtaining an RT faster than time (<italic>t</italic>) in response to the presentation of the A <italic>and</italic> V stimuli. This CP must be less than or equal to the sum of the CPs of obtaining RTs faster than time in response to the individual unisensory stimuli, CP(RT < <italic>t</italic> − SOA<sub>AV</sub> | A) + CP(RT < <italic>T</italic> | V) or CP(RT < <italic>t</italic> | A) + CP(RT < <italic>t</italic> − SOA<sub>AV</sub> | V). Violations of Miller's inequality signify that probability summation cannot account for decreased RTs in response to redundant signals and implies that neural coactivation has occurred. The evidence that neural coactivation is a causal mechanism for the AV RSE comes from numerous behavioral and electrophysiological studies (Giard & Peronnet, <xref ref-type="bibr" rid="R14">1999</xref>; Miller, <xref ref-type="bibr" rid="R31">1982</xref>, <xref ref-type="bibr" rid="R32">1986</xref>; Molholm et al., <xref ref-type="bibr" rid="R34">2002</xref>, <xref ref-type="bibr" rid="R35">2006</xref>; see, however, Otto & Mamassian, <xref ref-type="bibr" rid="R38">2012</xref>, for a challenge to this standard interpretation).</p></sec><sec id="s1.3"><label>1.3</label><title>The “rules” of multisensory integration: Spatial, temporal, and intensive</title><p>Unisensory stimuli that are closely aligned in space (the “spatial rule”) and time (the “temporal rule”) are more likely to produce multisensory response facilitation than are stimuli that are temporally and/or spatially disparate, where the latter may even result in response suppression (Holmes & Spence, <xref ref-type="bibr" rid="R18">2005</xref>; Meredith & Allman, <xref ref-type="bibr" rid="R28">2009</xref>; Meredith & Stein, <xref ref-type="bibr" rid="R30">1986</xref>; Meredith, Nemitz, & Stein, <xref ref-type="bibr" rid="R29">1987</xref>). Response facilitation may be especially robust for weak (i.e. near threshold) unisensory stimuli (the “inverse effectiveness rule”). Inverse effectiveness is most conspicuous in the responses of multisensory neurons in the superior colliculus (Meredith & Stein, <xref ref-type="bibr" rid="R30">1986</xref>).</p><sec id="s1.3.1"><label>1.3.1</label><title>The inverse effectiveness rule</title><p>Results from both behavioral and electrophysiological studies have been interpreted to support the inverse effectiveness rule (Callan, Callan, Kroos, & Vatikiotis-Bateson, <xref ref-type="bibr" rid="R3">2001</xref>; Diederich & Colonius, <xref ref-type="bibr" rid="R8">2004</xref>; Frassinetti, Bolognini, & Làdavas, <xref ref-type="bibr" rid="R13">2002</xref>; Lakatos, Chen, O'Connell, Mills, & Schroeder, <xref ref-type="bibr" rid="R23">2007</xref>; Serino, Farnè, Rinaldesi, Haggard, & Làdavas, <xref ref-type="bibr" rid="R46">2007</xref>; Senkowski, Saint-Amour, Höfle, & Foxe, <xref ref-type="bibr" rid="R45">2011</xref>). The generality of the inverse effectiveness rule has recently been questioned on the grounds that previous studies sampled an insufficient or incorrect range of stimulus intensities to critically test this hypothesis (Holmes, <xref ref-type="bibr" rid="R16">2007</xref>, <xref ref-type="bibr" rid="R17">2009</xref>; Leavitt, Javitt, & Foxe, 2007; Ross, Saint-Amour, Leavitt, Javitt, & Foxe, <xref ref-type="bibr" rid="R43">2007</xref>). Studies employing a range of stimulus intensities, whose results have been described as “generally consistent” with the inverse effectiveness rule (Lakatos et al., <xref ref-type="bibr" rid="R23">2007</xref>), report maximal multisensory facilitation at intermediate (not the lowest) levels of stimulus intensity. Other studies (Senkowski et al., <xref ref-type="bibr" rid="R45">2011</xref>), while testing a wide range of stimulus intensities, may still not have sampled at the lowest end of the perceptible intensity continuum.</p></sec><sec id="s1.3.2"><label>1.3.2</label><title>The temporal rule: Physiological simultaneity</title><p>Stimuli are intrinsically processed at different rates by different sensory modalities. For example, human auditory evoked cortical potentials onset as early as 10 ms (Celesia & Puletti, <xref ref-type="bibr" rid="R6">1971</xref>) whereas the C1 component of the visual evoked potential, which reflects activity in early retinotopically mapped visual areas (V1/V2), onsets much later at 45–60 ms (Clark & Hillyard, <xref ref-type="bibr" rid="R7">1996</xref>; Foxe & Simpson, <xref ref-type="bibr" rid="R11">2002</xref>; Foxe et al., <xref ref-type="bibr" rid="R12">2008</xref>; Jeffreys & Axford, <xref ref-type="bibr" rid="R22">1972</xref>; Murray et al., <xref ref-type="bibr" rid="R37">2001</xref>). In addition to processing speed differences between sensory channels due to intrinsic factors such as unequal pathway length, dissimilar axonal conduction velocity and/or variations in synaptic complexity, there is the variable influence of stimulus intensity. Simple RT is inversely related to stimulus intensity, a phenomenon known as Piéron's law (Jas´kowski, <xref ref-type="bibr" rid="R20">1985</xref>; Mansfield, <xref ref-type="bibr" rid="R25">1973</xref>; Piéron, <xref ref-type="bibr" rid="R40">1952</xref>; Prestrude, <xref ref-type="bibr" rid="R41">1971</xref>; Roufs, <xref ref-type="bibr" rid="R44">1963</xref>), and intensity-dependent variations in the latency of neural activity occur in the primate visual system (Barlow, Snodderly, & Swadlow, <xref ref-type="bibr" rid="R2">1978</xref>; Maunsell et al., <xref ref-type="bibr" rid="R26">1999</xref>) and in the auditory system of both cat (Eggermont, <xref ref-type="bibr" rid="R9">1998</xref>; Phillips, <xref ref-type="bibr" rid="R39">1998</xref>) and human (Stufflebeam, Poeppel, Rowley, & Roberts, <xref ref-type="bibr" rid="R49">1998</xref>).</p><p>There is general agreement that multisensory facilitation requires that the neural activity evoked by unisensory stimuli converge synchronously onto multisensory coincidence detectors—that is, that the unisensory inputs must exhibit physiological simultaneity (Hershenson, <xref ref-type="bibr" rid="R15">1962</xref>; Miller, <xref ref-type="bibr" rid="R32">1986</xref>; Raab, <xref ref-type="bibr" rid="R42">1962</xref>). A direct example is that multisensory neurons in the cat's superior colliculus exhibit optimal multisensory integration when the activity elicited by unisensory stimulation occurs at roughly the same post-stimulus latency (Stein & Meredith, <xref ref-type="bibr" rid="R48">1993</xref>). Likewise, human behavioral data indirectly suggest that multisensory facilitation of simple RT occurs at stimulus onset asynchronies (SOAs) corresponding to the difference in simple RT to the unisensory stimuli, where this RT difference is presumed to reflect the difference in intrinsic processing speed (Diederich & Colonius, <xref ref-type="bibr" rid="R8">2004</xref>; Hershenson, <xref ref-type="bibr" rid="R15">1962</xref>; Miller, <xref ref-type="bibr" rid="R32">1986</xref>). If optimal multisensory facilitation requires the synchronous convergence of unisensory signals onto a multisensory coincidence detector, and if the post-stimulus latency of evoked activity depends on stimulus intensity, then changes in the relative intensities of the component unisensory visual and auditory stimuli should cause systematic changes in the SOA<sub>AV</sub> at which optimal multisensory facilitation (neural coactivation) occurs.</p></sec></sec><sec id="s1.4"><label>1.4</label><title>The present experiment</title><p>We measure how the optimal SOA<sub>AV</sub> for multisensory integration (as indexed by violations of the race model) depends on both absolute and relative unisensory stimulus intensities. An evaluation of the dependence of optimal SOA<sub>AV</sub> on <italic>absolute</italic> stimulus intensity addresses the validity and generality of the inverse effectiveness rule, while its dependence on <italic>relative</italic> stimulus intensity tests the predictions of the strong version of the physiological simultaneity hypothesis.</p></sec></sec><sec id="s2"><label>2</label><title>Condition 1</title><p>Condition 1 measured the range of SOA<sub>AV</sub> over which neural coactivation occurs for two relatively weak unisensory stimuli.</p><sec id="s2.1"><label>2.1</label><title>Method</title><sec id="s2.1.1"><label>2.1.1</label><title>Participants</title><p>Participants (<italic>n</italic> = 4; two male; mean age = 31 years) possessed normal (or corrected to normal) vision and normal hearing. All experiments were conducted in accordance with the Code of Ethics of the World Medical Association (Declaration of Helsinki) for experiments involving humans. Prior to their participation in the study, all participants provided written informed consent. All procedures were approved by the institutional review board of North Dakota State University.</p></sec><sec id="s2.1.2"><label>2.1.2</label><title>Stimuli and apparatus</title><p>Visual stimuli were circular Gabor patches which, when viewed from 114 cm, possessed a spatial frequency of 1 cycles/degree and a Gaussian envelope with a standard deviation of 1°. Gabor patches were centered at 2.25° eccentricity from fixation in the upper left visual quadrant (<xref ref-type="fig" rid="F1">Figure 1</xref>). Stimuli were presented on a CRT (mean luminance = 60 cd/m<sup>2</sup>; monitor refresh rate = 100 Hz). Gabor contrast for individual participants ranged between 1% and 4% across all conditions (see individual conditions for details). For condition 1, Gabor contrast ranged from 1.0% to 1.7%. Visual stimulus duration was 100 ms.</p><fig id="F1" orientation="portrait" position="float"><label>Figure 1.</label><caption><p>Visual stimuli were circular Gabor patches (1%–4% contrast) which possessed a spatial frequency of 1 cycle/degree and a Gaussian envelope with a standard deviation of 1°. Gabor patches were centered at 2.25° eccentricity from fixation (cross) in the upper left visual quadrant. Scale bar = 1°.</p></caption><graphic xlink:href="i-perception-4-213-g0001"></graphic></fig><p>The auditory stimulus was a 1-KHz pure tone of variable loudness (range = 31.1–49.0 dB<sub>A</sub>) presented via a speaker approximately co-located with the visual stimuli. Auditory stimulus duration was 100 ms.</p></sec><sec id="s2.1.3"><label>2.1.3</label><title>Procedure</title><sec id="s2.1.3.1"><label>2.1.3.1</label><title>Pretest.</title><p>Prior to the experiment, all participants completed a pretest designed to equate the detectability of the unisensory stimuli. The pretest paradigm was a single-interval go/no-go signal detection task. Participants responded via button press as quickly and accurately as possible to the detection of any A or V stimulus. Participants performed 15 blocks of trials for a total of 30 trials per stimulus condition. Each block consisted of a total of 50 trials: 24 unisensory A stimuli (2 × 12 levels of dB attenuation), 24 unisensory V stimuli (2 × 12 contrasts), and 2 catch (no-signal) trials.</p><p>Sensitivity (<italic>d</italic>′) was calculated according to the equation <italic>d</italic>′ = <italic>Z</italic><sub>H</sub> − <italic>Z</italic><sub>FA</sub>, where <italic>Z</italic><sub>H</sub> denotes the <italic>Z</italic>-transformed hit rate (hits/signal trials) and <italic>Z</italic><sub>FA</sub> denotes the <italic>Z</italic>-transformed false-alarm rate (false alarms/no-signal trials). Nonlinear least-squares regression to a logistic function interpolated stimulus intensities yielding criterion performance (<italic>d</italic>′ ≈ 2).</p></sec><sec id="s2.1.3.2"><label>2.1.3.2</label><title>Experiment.</title><p>A single-interval go/no-go signal detection task was employed. Trials commenced with the appearance of a fixation cross. After a variable interval (1,000–2,000 ms), the first stimulus (S1) was presented. The second stimulus (S2) was presented following a variable SOA. Participants responded via button press as quickly and accurately as possible to the detection of any stimulus. RT was recorded to the nearest millisecond. Trials terminated after subject response or after 1,500 ms. <xref ref-type="fig" rid="F2">Figure 2</xref> illustrates the sequence of events in multisensory trials.</p><fig id="F2" orientation="portrait" position="float"><label>Figure 2.</label><caption><p>Multisensory trials commenced with the appearance of a fixation cross. After a variable interval (1,000–2,000 ms) the first stimulus (S1) was presented. The second stimulus (S2) was presented following a variable SOA. Participants responded via button press as quickly and accurately as possible to the detection of any stimulus. Response time (RT) was recorded to the nearest millisecond. Trials terminated after subject response or after 1,500 ms.</p></caption><graphic xlink:href="i-perception-4-213-g0002"></graphic></fig><p>Participants completed a total of 34 blocks of 75 trials each, for a grand total of 2,550 trials. Each block included 9 V trials, 9 A trials, 9 no-stimulus catch trials, and 3 AV trials at each of 16 SOAs ranging (in 20-ms increments) from − 100 ms (A→V) to 200 ms (V→A). Each subject's RT distribution was trimmed to exclude outliers (e.g., 100 ms > RT > 1,000 ms). The trimmed RT distributions possessed nearly equal numbers of trials contributed by each subject and subsequent analyses in all experimental conditions were conducted on RT distributions pooled across participants.</p><p>The intensities of the unisensory stimuli were adjusted (as necessary) after every 18 trials to ensure a mean sensitivity of <italic>d</italic>′ ≈ 2, which corresponds to an 87% correct response rate in a two-alternative forced-choice task, where 75% correct is typically taken as threshold performance. Thus, stimuli in condition 1 were sufficiently strong that participants could reliably detect them, while sufficiently weak that performance in this condition could be meaningfully contrasted to that observed in subsequent experimental conditions where stimuli were highly suprathreshold (<italic>d</italic>′ > 4; 99.9% correct response rate).</p></sec></sec><sec id="s2.1.4"><label>2.1.4</label><title>Data analysis</title><sec id="s2.1.4.1"><label>2.1.4.1</label><title>Multisensory response facilitation/inhibition.</title><p>To test whether RTs to multisensory stimuli were significantly faster (or slower) than RTs to unisensory stimuli, mean RT in all 16 SOA<sub>AV</sub> conditions was compared with the fastest (and slowest) mean unisensory RTs (A or V) using independent samples <italic>t</italic>-tests.</p></sec><sec id="s2.1.4.2"><label>2.1.4.2</label><title>Multisensory sensitivity enhancement.</title><p>Mean sensitivity (<italic>d</italic>′) at each SOA<sub>AV</sub> was calculated using a bootstrapping procedure (Foster & Bischof, <xref ref-type="bibr" rid="R10">1991</xref>). Response distributions for each SOA<sub>AV</sub> condition (hits) were combined with an equal size sample taken at random from the no-signal condition (false alarms). The distribution of hits and false alarms was exhaustively sampled (with replacement, 1,000 iterations) to generate sampling distributions of <italic>d</italic>′ from which means and standard errors were obtained.</p></sec><sec id="s2.1.4.3"><label>2.1.4.3</label><title>Neural coactivation (Miller's inequality analysis).</title><p>RT data were trimmed (100 ms > RT > 1,000 ms) and cumulative distribution functions (CDFs) were created for each stimulus condition (A, V, AV). Sampling distributions were bootstrapped by exhaustively resampling each CDF (with replacement, 1,000 iterations). A sampling distribution of Miller's inequality values was generated by subtracting the multisensory CDF predicted by probability summation, AV<sub>P</sub> = (A + V), from the CDF observed for each multisensory condition at each iteration such that MI<sub>f</sub> = AV − AV<sub>P</sub>, where MI<sub>f</sub> indicates facilitative MI. This process yielded a mean value (and standard error) of Miller's inequality for each SOA<sub>AV</sub>. <xref ref-type="fig" rid="F8">Figures 8(c) and (d)</xref>, condition 4, provide a graphic illustration of CDF comparisons between unisensory and simultaneous multisensory conditions.</p></sec></sec></sec><sec id="s2.2"><label>2.2</label><title>Results and discussion</title><sec id="s2.2.1"><label>2.2.1</label><title>Multisensory response facilitation/inhibition</title><p>Mean RTs for condition 1 are plotted as a function of SOA<sub>AV</sub> in <xref ref-type="fig" rid="F3">Figure 3 (a)</xref>. While possessing equally detectable stimulus intensities (<italic>d</italic>′ ≈ 2), mean RT to the unisensory A stimulus was nevertheless faster (424.6 ms) than to the unisensory V stimulus (431.9 ms). This difference in RT did not reach significance (<italic>t</italic><sub>1831</sub> = − 1.206, <italic>p</italic> = 0.228) and likely reflects the shorter latency of auditory versus visual cortical responses (Celesia & Puletti, <xref ref-type="bibr" rid="R6">1971</xref>; Jeffreys & Axford, <xref ref-type="bibr" rid="R22">1972</xref>). To assess whether multisensory stimulation produced response <italic>facilitation</italic>, mean RT in each AV condition was compared with that in the <italic>fastest</italic> unisensory condition (A). Green bars identify those AV SOAs where results of independent samples <italic>t</italic>-tests indicated that significant multisensory response enhancement occurred. Significant response facilitation occurred at SOA<sub>AV</sub> values of − 60, − 40, − 20, 0, 20, and 40 ms (<italic>t</italic><sub>1303</sub> = − 2.891, <italic>p</italic> = 0.004; <italic>t</italic><sub>1303</sub> = − 2.944, <italic>p</italic> = 0.003; <italic>t</italic><sub>1295</sub> = − 3.560, <italic>p</italic> < 0.001; <italic>t</italic><sub>1288</sub> = − 4.620, <italic>p</italic> < 0.001; <italic>t</italic><sub>1303</sub> = − 2.933, <italic>p</italic> = 0.003; and <italic>t</italic><sub>1290</sub> = − 1.957, <italic>p</italic> = 0.051; respectively). To assess whether multisensory stimulation might produce response <italic>inhibition</italic>, mean RT in AV conditions was compared with that in the <italic>slowest</italic> unisensory condition (V). Red bars indicate that significant response inhibition occurred at SOA<sub>AV</sub> of 140, 160, 180, and 200 ms (<italic>t</italic><sub>1293</sub> = 2.712, <italic>p</italic> = 0.007; <italic>t</italic><sub>1298</sub> = 2.626, <italic>p</italic> = 0.009; <italic>t</italic><sub>1295</sub> = 2.141, <italic>p</italic> = 0.032; and <italic>t</italic><sub>1298</sub> = 4.100, <italic>p</italic> < 0.001; respectively).</p><fig id="F3" orientation="portrait" position="float"><label>Figure 3.</label><caption><p>Mean RTs in the four experimental conditions plotted as a function of SOA<sub>AV</sub>. Mean RT in each AV condition was compared with that in the <italic>fastest</italic> unisensory condition (A or V). Green bars identify those AV SOAs where results of independent samples <italic>t</italic>-tests indicated that significant multisensory response enhancement occurred. Mean RT in each AV condition was also compared with that in the <italic>slowest</italic> unisensory condition (A or V). Red bars identify those AV SOAs for which significant multisensory response inhibition occurred.</p></caption><graphic xlink:href="i-perception-4-213-g0003"></graphic></fig></sec><sec id="s2.2.2"><label>2.2.2</label><title>Multisensory sensitivity enhancement</title><p>If sensitivities to the unisensory A and V stimuli combine probabilistically then the sensitivity in multisensory (AV) conditions (<italic>d</italic>′<sub>AVp</sub>) should equal the quadratic sum of the unisensory sensitivities (Campbell & Green, <xref ref-type="bibr" rid="R5">1965</xref>; Legge, <xref ref-type="bibr" rid="R24">1984</xref>):
<disp-formula id="FD3"><label>(3)</label><mml:math id="M003"><mml:mstyle displaystyle="true"><mml:mrow><mml:msubsup><mml:mi>d</mml:mi><mml:mrow><mml:mi>AVp</mml:mi></mml:mrow><mml:mrow><mml:mo>′</mml:mo></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msqrt><mml:mrow><mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mi>d</mml:mi><mml:mrow><mml:mi>Ao</mml:mi></mml:mrow><mml:mrow><mml:mo>′</mml:mo></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>+</mml:mo><mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mi>d</mml:mi><mml:mrow><mml:mi>Vo</mml:mi></mml:mrow><mml:mrow><mml:mo>′</mml:mo></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:msqrt></mml:mrow></mml:mstyle></mml:math></disp-formula>.</p><p><xref ref-type="fig" rid="F4">Figure 4</xref> plots the mean bootstrapped values of observed sensitivity (<italic>d</italic>′<sub>AVo</sub>, ±2 and ±3 SEM) in all 16 multisensory conditions as a function of SOA<sub>AV</sub>. The average observed unisensory sensitivities were <italic>d</italic>′<sub>Ao</sub> = 1.911, and <italic>d</italic>′<sub>Vo</sub> = 1.910, and the multisensory sensitivity predicted by probability summation (<italic>d</italic>′<sub>AVp</sub> = 2.699) is plotted as a horizontal line. Although there is a significant multisensory facilitation of mean RT, sensitivity to multisensory stimuli does not differ significantly (<italic>p</italic> > 0.01) from that predicted by probability summation at any SOA<sub>AV</sub>.</p><fig id="F4" orientation="portrait" position="float"><label>Figure 4.</label><caption><p>Mean bootstrapped values of observed sensitivity (<italic>d</italic>′<sub>AVo</sub>, ±2 and ±3 SEM) in all 16 multisensory conditions as a function of SOA<sub>AV</sub>. The average observed unisensory sensitivities were <italic>d</italic>′<sub>Ao</sub> = 1.911 and <italic>d</italic>′<sub>Vo</sub> = 1.910, and the multisensory sensitivity predicted by probability summation (<italic>d</italic>′<sub>AVp</sub> = 2.699) is plotted as a horizontal line. Although there is a significant multisensory facilitation of mean RT, sensitivity to multisensory stimuli does not differ significantly (<italic>p</italic> > 0.01) from that predicted by probability summation at any SOA<sub>AV</sub>.</p></caption><graphic xlink:href="i-perception-4-213-g0004"></graphic></fig></sec><sec id="s2.2.3"><label>2.2.3</label><title>Neural coactivation (Miller's inequality analysis)</title><p><xref ref-type="fig" rid="F5">Figure 5(a)</xref> spectrum codes the value of Miller's inequality as a function of RT and SOA<sub>AV</sub>. <xref ref-type="fig" rid="F5">Figure 5 (b)</xref> is a magnified view of the region exhibiting significant (<italic>p</italic> < 0.05) violations of the race model (positive values). Noteworthy is that positive values of the inequality occur exclusively at an SOA<sub>AV</sub> value of 0 ms (physical simultaneity), across a range of RT (200–325 ms) with a peak value (0.0360) occurring at 292 ms (<xref ref-type="fig" rid="F5">Figure 5c</xref>).</p><fig id="F5" orientation="portrait" position="float"><label>Figure 5.</label><caption><p>Test of the race model for condition 1. Panel (a) shows spectrum-coded mean values of Miller's inequality as a function of RT and SOA<sub>AV</sub>. Panel (b) shows a magnified view of the region exhibiting a significant (<italic>p</italic> < 0.05) violation of the race model that occurred exclusively at an SOA<sub>AV</sub> of 0 ms. Panel (c) plots the mean value (thick line) and 95% confidence intervals (thin lines) for Miller's inequality as a function of RT for simultaneous SOA<sub>AV</sub>.</p></caption><graphic xlink:href="i-perception-4-213-g0005"></graphic></fig></sec></sec></sec><sec id="s3"><label>3</label><title>Condition 2</title><p>Condition 2 was designed to reveal how changing the intensity of the V stimulus might influence its integration with the relatively weak A stimulus. Specifically, we tested whether increasing the contrast of the V stimulus caused a change in the optimal SOA<sub>AV</sub> for multisensory integration relative to condition 1. If physiological simultaneity determines multisensory facilitation, then increasing the intensity of the V stimulus (which increases the speed of visual processing and reduces mean RT to V stimuli) should shift the optimal SOA<sub>AV</sub> to more negative values such that, relative to condition 1, the A stimulus will now need to be presented earlier in time with respect to the V stimulus. Conversely, the optimal SOA<sub>AV</sub> will remain unchanged if physical simultaneity is critical for multisensory integration.</p><sec id="s3.1"><label>3.1</label><title>Method</title><p>The participants in condition 2 were the same as in condition 1. The experimental methods and procedures were as in condition 1 except that V stimulus contrast was increased to levels producing a criterion sensitivity of <italic>d</italic>′ > 4 for each participant (contrast range = 3.4%–4.0%). To ensure this criterion sensitivity, <italic>d</italic>′ was calculated for unisensory A and V stimuli after every 18 trials throughout the experiment and V stimulus contrast and A stimulus intensity were adjusted as necessary.</p></sec><sec id="s3.2"><label>3.2</label><title>Results and discussion</title><sec id="s3.2.1"><label>3.2.1</label><title>Multisensory response facilitation/inhibition</title><p>Mean RTs in condition 2 are plotted as a function of SOA<sub>AV</sub> in <xref ref-type="fig" rid="F3">Figure 3 (b)</xref>. As expected, mean RT to the unisensory V stimulus was now significantly faster (315.8 ms) than to the unisensory A stimulus (450.0 ms) (<italic>t</italic><sub>1984</sub> = − 25.158, <italic>p</italic> < 0.001). This highly significant reversal in the relative speed of responses to A and V stimuli reflects the approximately threefold increase in V stimulus contrast relative to condition 1, and is an illustration of Piéron's law. To assess whether multisensory stimulation produced response facilitation, mean RT in AV conditions was compared with that in the fastest unisensory condition (V). The green bars indicate that significant response facilitation occurred at SOA<sub>AV</sub> values of 0 and 20 ms (<italic>t</italic><sub>1597</sub> = − 2.272, <italic>p</italic> = 0.023 and <italic>t</italic><sub>1597</sub> = − 2.160, <italic>p</italic> = 0.031, respectively). There was no multisensory response inhibition at any SOA<sub>AV</sub>.</p></sec><sec id="s3.2.2"><label>3.2.2</label><title>Neural coactivation (Miller's inequality analysis)</title><p><xref ref-type="fig" rid="F6">Figure 6(a)</xref> spectrum codes the values of Miller's inequality as a function of RT and SOA<sub>AV</sub> for condition 2. A magnified view of the region exhibiting significant (<italic>p</italic> < 0.05) violations of the race model is shown in <xref ref-type="fig" rid="F6">Figure 6 (b)</xref>. As in condition 1, significant violations of Miller's inequality occurred for physically simultaneous A and V stimuli, as well as at an SOA<sub>AV</sub> of 20 ms. At an SOA<sub>AV</sub> of 0 ms (<xref ref-type="fig" rid="F6">Figure 6c</xref>), violations occurred for physically simultaneous stimuli across a range of RT (217–290 ms), with a peak at 244 ms. The fact that the greatest violations of Miller's inequality occur when unisensory stimuli are physically simultaneous is clearly incompatible with the strong version of the physiological simultaneity hypothesis, which posits that neural coactivation should occur at an SOA that closely corresponds to the difference in mean RT to the unisensory stimuli. The results of condition 2 also clearly show that neural coactivation can occur when a more rapidly processed stimulus (V) precedes a more slowly processed stimulus (A). The results of condition 2 are also inconsistent with the inverse effectiveness rule, because increasing the intensity of the V stimulus actually increased the magnitude of the violation of Miller's inequality (0.0360 vs. 0.0530 in conditions 1 and 2, respectively).</p><fig id="F6" orientation="portrait" position="float"><label>Figure 6.</label><caption><p>Test of the race model for condition 2. Panel (a) shows spectrum-coded mean values of Miller's inequality as a function of RT and SOA<sub>AV</sub>. Panel (b) shows a magnified view of the region exhibiting significant (<italic>p</italic> < 0.05) violations of the race model that occurred at SOA<sub>AV</sub> values of 0 and 20 ms. Panel (c) plots the mean value (thick line) and 95% confidence intervals (thin lines) for Miller's inequality as a function of RT for simultaneous SOA<sub>AV</sub>.</p></caption><graphic xlink:href="i-perception-4-213-g0006"></graphic></fig></sec></sec></sec><sec id="s4"><label>4</label><title>Condition 3</title><p>Condition 3 is complimentary to condition 2 and was designed to reveal how changing the intensity of the A stimulus might influence its integration with a relatively weak V stimulus. Specifically, we tested whether increasing the intensity (loudness) of the A stimulus caused a change in the optimal SOA<sub>AV</sub> for multisensory integration relative to condition 1. Again, if physiological simultaneity is necessary for multisensory facilitation, then increasing the intensity of the A stimulus (which will increase the speed of auditory processing and reduce mean RT to A stimuli) should shift the optimal SOA<sub>AV</sub> for neural coactivation to more positive values such that, relative to condition 1, the V stimulus would need to be presented earlier with respect to the A stimulus. Conversely, the optimal SOA<sub>AV</sub> will not change if physical simultaneity determines multisensory integration.</p><sec id="s4.1"><label>4.1</label><title>Method</title><p>The participants in condition 3 were the same as in conditions 1 and 2. The experimental methods and procedures were as in condition 1, except that A stimulus intensity was increased to levels producing a criterion sensitivity <italic>d</italic>′ > 4 (intensity range = 44.5–49.0 dB<sub>A</sub>). In order to ensure criterion sensitivity, <italic>d</italic>′ was calculated for unisensory A and V stimuli after every 18 trials throughout the experiment and V stimulus contrast and A stimulus intensity were adjusted as necessary.</p></sec><sec id="s4.2"><label>4.2</label><title>Results and discussion</title><sec id="s4.2.1"><label>4.2.1</label><title>Multisensory response facilitation/inhibition</title><p>Mean RTs in condition 3 are plotted as a function of SOA<sub>AV</sub> in <xref ref-type="fig" rid="F3">Figure 3 (c)</xref>. As expected, mean RT to the unisensory A stimulus (301.5 ms) was significantly faster than that to the unisensory V stimulus (441.7 ms) (<italic>t</italic><sub>1978</sub> = − 32.247, <italic>p</italic> < 0.001). The significantly faster mean response to the intense A stimulus in condition 3, relative to conditions 1 and 2, is another illustration of Piéron's law. To assess whether multisensory stimulation produced response facilitation, mean RT in AV conditions was compared with that in the fastest unisensory condition (A). Green bars indicate that significant response facilitation occurred at SOA<sub>AV</sub> values of − 20 and 0 ms (<italic>t</italic><sub>1619</sub> = − 2.340, <italic>p</italic> = 0.019; <italic>t</italic><sub>1616</sub> = − 4.145, <italic>p</italic> < 0.001, respectively). There was no multisensory response inhibition at any SOA<sub>AV</sub>.</p></sec><sec id="s4.2.2"><label>4.2.2</label><title>Neural coactivation (Miller's inequality analysis)</title><p><xref ref-type="fig" rid="F7">Figure 7(a)</xref> spectrum codes the values of Miller's inequality as a function of RT and SOA<sub>AV</sub> for condition 3. A magnified view of the region exhibiting significant violations of the race model is shown in <xref ref-type="fig" rid="F7">Figure 7 (b)</xref>. At an SOA<sub>AV</sub> of 0 ms (<xref ref-type="fig" rid="F7">Figure 7c</xref>), positive values of Miller's inequality occur across a range of RT (192–330 ms), with a peak at 288 ms. As in conditions 1 and 2, significant violations of Miller's inequality occurred for physically simultaneous A and V stimuli, as well as at an SOA<sub>AV</sub> of − 20 and − 40 ms. Once again, the fact that violations of Miller's inequality have the greatest magnitude when unisensory stimuli are physically simultaneous is clearly incompatible with the strong version of the physiological simultaneity hypothesis, and the results of condition 3 confirm that neural coactivation can occur when a more rapidly processed stimulus (A) precedes the more slowly processed stimulus (V). The results of condition 3 are also inconsistent with the inverse effectiveness rule, because increasing the intensity of the A stimulus significantly <italic>increased</italic> the magnitude of the violation of Miller's inequality (0.0360 vs. 0.1113 in conditions 1 and 3, respectively).</p><fig id="F7" orientation="portrait" position="float"><label>Figure 7.</label><caption><p>Test of the race model for condition 3. Panel (a) shows spectrum-coded mean values of Miller's inequality as a function of RT and SOA<sub>AV</sub>. Panel (b) shows a magnified view of the region exhibiting significant (<italic>p</italic> < 0.05) violations of the race model, which occurred at SOA<sub>AV</sub> values of − 40, − 20, and 0 ms. Panel (c) plots the mean value (thick line) and 95% confidence intervals (thin lines) for Miller's inequality as a function of RT for simultaneous SOA<sub>AV</sub>.</p></caption><graphic xlink:href="i-perception-4-213-g0007"></graphic></fig></sec></sec></sec><sec id="s5"><label>5</label><title>Condition 4</title><p>Finally, condition 4 tested whether increasing the intensities of <italic>both</italic> A and V stimuli to clearly suprathreshold levels (<italic>d</italic>′ > 4) would result in a pattern of optimal SOA<sub>AV</sub> for multisensory integration that resembled that of condition 1.</p><sec id="s5.1"><label>5.1</label><title>Method</title><p>The participants in condition 4 were the same as in condition 1. The experimental paradigm replicated condition 1 with the following exception. Both V and A stimuli were increased in intensity to levels producing criterion sensitivities of <italic>d</italic>′ > 4.</p></sec><sec id="s5.2"><label>5.2</label><title>Results and discussion</title><sec id="s5.2.1"><label>5.2.1</label><title>Multisensory response facilitation/inhibition</title><p>Mean RTs in condition 4 are plotted as a function of SOA<sub>AV</sub> in <xref ref-type="fig" rid="F3">Figure 3 (d)</xref>. As in condition 1, mean RT to the unisensory A stimulus was significantly faster (286.3 ms) than that to the unisensory V stimulus (316.7 ms) (<italic>t</italic><sub>2402</sub> = −8.74, <italic>p</italic> < 0.01). The significantly faster mean responses to the highly suprathreshold A and V stimuli in condition 4, relative to condition 1 (<italic>t</italic><sub>2121</sub> = −28.338, <italic>p</italic> < 0.01 and <italic>t</italic><sub>2112</sub> = −26.030, <italic>p</italic> < 0.01, respectively), again illustrate Piéron's law. To assess whether multisensory stimulation produced response facilitation, mean RT in AV conditions was compared with that in the fastest unisensory condition (A). The green bars indicate that significant response facilitation occurred at SOA<sub>AV</sub> values of −80, −20, and 0 ms (<italic>t</italic><sub>1613</sub> = −2.03, <italic>p</italic> = 0.043; <italic>t</italic><sub>1613</sub> = −2.67, <italic>p</italic> = 0.008; and <italic>t</italic><sub>1610</sub> = −5.72, <italic>p</italic> < 0.001, respectively). There was no multisensory response inhibition at any SOA<sub>AV</sub>.</p></sec><sec id="s5.2.2"><label>5.2.2</label><title>Neural coactivation (Miller's inequality analysis)</title><p><xref ref-type="fig" rid="F8">Figure 8(a)</xref> spectrum codes the values of Miller's inequality as a function of RT and SOA<sub>AV</sub> for condition 4. A magnified view of the region exhibiting significant violations of the race model is shown in <xref ref-type="fig" rid="F8">Figure 8 (b)</xref>. As in condition 3, positive values of Miller's inequality occurred for SOA<sub>AV</sub> − 20 and 0 ms, a result that is incompatible with the strong version of the physiological simultaneity hypothesis. At an SOA<sub>AV</sub> of 0 ms, positive values of Miller's inequality occur across a range of RT (171–257 ms), with a peak at 232 ms. The results of condition 4 are directly contradictory to the inverse effectiveness rule, because increasing the intensity of both unisensory stimuli significantly <italic>increased</italic> the magnitude of the violation of Miller's inequality (0.0360 vs. 0.1678 in conditions 1 and 4, respectively).</p><fig id="F8" orientation="portrait" position="float"><label>Figure 8.</label><caption><p>Test of the race model for condition 4. Panel (a) shows spectrum-coded mean values of Miller's inequality as a function of RT and SOA<sub>AV</sub>. Panel (b) shows a magnified view of the region exhibiting significant (<italic>p</italic> < 0.05) violations of the race model, which occurred at SOA<sub>AV</sub> values of −20 and 0 ms. Panel (c) plots the mean value (thick line) and 95% confidence intervals (thin lines) for Miller's inequality as a function of RT for simultaneous SOA<sub>AV</sub>. Panel (c) shows the CP distributions for the two unisensory conditions (A: purple; V: blue) and their sum (A + V: black), which is the CP distribution predicted by the race model. The CP distribution observed for AV stimulation at an SOA<sub>AV</sub> of 0 ms (AV<sub>o</sub>) is shown in red. Panel (d) plots the mean value (thick line) and 95% confidence intervals (thin lines) for Miller's inequality as a function of RT for simultaneous SOA<sub>AV</sub>.</p></caption><graphic xlink:href="i-perception-4-213-g0008"></graphic></fig><p><xref ref-type="fig" rid="F8">Figures 8(c) and (d)</xref> illustrate how the RT data were analyzed in order to compute values of Miller's inequality and establish confidence intervals. CP distributions as a function of RT were constructed for the A (purple) and V (blue) unisensory stimulus conditions, and for their multisensory combination, AV<sub>o</sub>, at all values of SOA<sub>AV</sub> (SOA<sub>AV</sub> = 0 ms is shown in red). The sum of the CP distributions for the unisensory conditions (A + V) is the CP predicted by the race model (black). The value of Miller's inequality is computed at each value of RT by subtraction: CP(AV<sub>o</sub>) − CP(A + V). When the CP of observed RT exceeds that predicted by the race model, the value of Miller's inequality is positive. These violations are represented by the segment of the AV<sub>o</sub> CP distribution that lies above the (A + V) CP distribution in <xref ref-type="fig" rid="F8">Figure 8 (c)</xref>. Miller's inequality is plotted (thick line) as a function of RT (from 150 to 350 ms) in <xref ref-type="fig" rid="F8">Figure 8 (d)</xref>. Confidence intervals were derived by a bootstrapping procedure (Foster & Bischof, <xref ref-type="bibr" rid="R10">1991</xref>) where the AV<sub>o</sub> and A + V CP distributions were sampled exhaustively with replacement to generate a sampling distribution of Miller's inequality (<italic>N</italic> = 1,000). Thin lines in <xref ref-type="fig" rid="F5">Figures 5</xref>–<xref ref-type="fig" rid="F7">7(c)</xref> and <xref ref-type="fig" rid="F8">8(d)</xref> plot 95% confidence intervals for the value of Miller's inequality.</p></sec></sec></sec><sec id="s6"><label>6</label><title>General discussion</title><p>Taken together, the results of the four experimental conditions reveal that audiovisual multisensory facilitation, as indexed by significant violations of the race model, occurs only over a narrow range of stimulus onset asynchronies which invariably includes physical simultaneity. Manipulations of stimulus intensity that changed the speed of unisensory processing, as revealed by significant alterations of mean RT, had no influence on the range of SOA<sub>AV</sub> over which multisensory interaction occurred. Moreover, when the range of SOA<sub>AV</sub> over which significant violations of the race model occurred did extend beyond physical simultaneity (condition 2: 20 ms; condition 3: −20 and −40 ms; condition 4: −20 ms), the extension was such that the more rapidly processed stimulus needed to <italic>precede</italic> the more slowly processed stimulus, a result that is, in fact, opposite to the strong version of the physiological simultaneity hypothesis (Hershenson, <xref ref-type="bibr" rid="R15">1962</xref>), which predicts that the <italic>more slowly processed stimulus</italic> should need a “head start” in order to arrive at some central site simultaneously with a more rapidly processed stimulus. It should be noted that violations of Miller's inequality at all non-zero SOAs were smaller than those at simultaneity. Finally, there was a surprising lack of evidence for multisensory facilitation with respect to sensitivity (<italic>d</italic>′).</p><sec id="s6.1"><label>6.1</label><title>Inverse effectiveness</title><p>Although the rule of inverse effectiveness has sometimes been upheld as a universally observed characteristic of multisensory integration (Lakatos et al., <xref ref-type="bibr" rid="R23">2007</xref>; Meredith & Stein, <xref ref-type="bibr" rid="R30">1986</xref>), a number of studies have reported findings that are inconsistent with this rule (Lakatos et al., <xref ref-type="bibr" rid="R23">2007</xref>; Ross et al., <xref ref-type="bibr" rid="R43">2007</xref>). Our results likewise do not support the inverse effectiveness rule because the magnitude of the violations of Miller's inequality we observed generally increased with increasing stimulus intensity (at SOA<sub>AV</sub> = 0 ms: 0.0360, 0.0530, 0.1113, and 0.1678 in conditions 1–4, respectively). Our results are, however, consistent with a reinterpretation (Holmes, <xref ref-type="bibr" rid="R16">2007</xref>) of the results of Alvarado, Vaughan, Stanford, and Stein (<xref ref-type="bibr" rid="R1">2007</xref>), who showed that whereas multisensory enhancement in neurons in the cat's superior colliculus obeyed the rule of inverse effectiveness when analyzed in terms of <italic>relative</italic> spike rate increase, they demonstrated the behavior we observe, viz., increasing effectiveness with increasing stimulus intensity, when analyzed in terms of <italic>absolute</italic> spike rates. On the contrary, the range of SOA<sub>AV</sub> over which statistically significant decreases in simple mean RT occur is wider for the weakest stimuli (condition 1) than for the other conditions (<xref ref-type="fig" rid="F3">Figure 3</xref>), but increases in the time window of integration is not what is typically meant by inverse effectiveness.</p></sec><sec id="s6.2"><label>6.2</label><title>Intensity-adjusted latency coding</title><p>Although physiological activity resulting from two unisensory signals must simultaneously converge on a multisensory “coincidence detector” for facilitative MI to occur, we find that such facilitation occurs nearly exclusively for physically simultaneous multisensory occurrences, independent of factors that differentially affect unisensory processing time, such as stimulus intensity. This makes sense from an ecological perspective, for if multisensory facilitation has aided survival, the advantage it confers must be the enhanced processing of genuine physical events (e.g., the sights and sounds of predators or prey which, because they have a common cause, are physically simultaneous), not merely to physiological simultaneities some (potentially large) fraction of which are accidental. Although the evolutionary advantage of this result is undeniable, the mechanism whereby it is accomplished is unclear.</p><p>Consider the case in which facilitative MI occurs at a coincidence detector where the response latencies for a given pair of simultaneously presented unisensory stimuli are exactly equal. Varying the relative intensities (and hence the processing speed) of the physically simultaneous unisensory stimuli will cause their physiological responses to convergence at this detector asynchronously, and yet we find that physically simultaneous stimuli integrate despite variations in intensity. Conversely, the physically asynchronous occurrence of two unisensory stimuli can, depending on their relative intensity, result in spuriously coincident physiological responses that nevertheless fail to result in facilitation. This suggests that the time of arrival at multisensory sites must be corrected for latency differences caused by adventitious variations in stimulus intensity. In other words, the system must “take account” of differences in physiological response latency that are unrelated to true unisensory SOA in order to reject false correspondences. It is well known that neural networks can undergo Hebbian learning, wherein the strength of synaptic connections is modified based on experience. The biophysical bases of temporal coincidence detection could involve mechanisms of spike-time dependent synaptic plasticity (Song, Miller, & Abbott, <xref ref-type="bibr" rid="R47">2000</xref>) and/or synaptic scaling (Turrigiano, Leslie, Desai, Rutherford, & Nelson, <xref ref-type="bibr" rid="R51">1998</xref>). Our novel idea that synapses might additionally be “tuned” to particular stimulus intensities is purely speculative. In short, however, physiological response simultaneity is a necessary but not sufficient condition for facilitative MI.</p><p>One possible mechanism for achieving this outcome is shown in <xref ref-type="fig" rid="F9">Figure 9</xref>. Assume a neural network of AV coincidence detectors (labeled 1–5 in <xref ref-type="fig" rid="F9">Figure 9</xref>) which integrate unisensory inputs (i.e., fire) exclusively when A and V inputs arrive synchronously, thus reflecting the necessary condition of physiological simultaneity. The coincidence detectors receive input from both A and V sensory receptors via delay lines and are thus place coded (Jeffress, <xref ref-type="bibr" rid="R21">1948</xref>). A given afferent A or V signal ultimately supplies input to the entire network of coincidence detectors at a continuum of latencies. In Jeffress' (<xref ref-type="bibr" rid="R21">1948</xref>) theory of binaural sound localization, differences in the <italic>time of arrival</italic> of sound at the two ears (the interaural time difference) result in physiological convergence that varies in location within the network of coincidence detectors such that the spatial location of the sound source is read out by the relative spatial location of the activated coincidence detector. This explanation can be adapted to explain our results.</p><fig id="F9" orientation="portrait" position="float"><label>Figure 9.</label><caption><p>An illustration of how learned associations (Bayesian priors) between physical simultaneity and relative stimulus intensity might be represented in a place-coded delay line network of coincidence detectors. Panels (a–c) refer to situations where physically simultaneous A and V events vary in relative intensity. In panel (a), the A and V inputs are of nominally equivalent relative intensity (denoted by the similar size of the delay lines, lettering, and the circular input and synaptic symbols), and the afferent signals (coded red) converge synchronously on and activate coincidence detector 3 (red). In panels (b) and (c), simultaneous A and V events vary in intensity. The more intense stimulus (thick line) propagates through the network more rapidly than the less intense stimulus (thin line), and their signals thus converge on coincidence detectors 1 or 5. Panel (d) illustrates two inputs of nominal equivalent intensity where the visual stimulus is delayed in time of onset relative to the auditory stimulus (represented here as added pathway length).</p></caption><graphic xlink:href="i-perception-4-213-g0009"></graphic></fig><p>We begin by assuming that organisms have ubiquitous access to the physiological activity generated by <italic>genuinely simultaneous multisensory events</italic> in their environment, that is, that they have access to ground truth. Thus, over the course of their development organisms will accrue robust Bayesian priors with respect to multisensory convergence. The class of multisensory stimulation for which exact latency/intensity information is known results from self-generated events. For example, tapping an object with the hand (or a tool), or throwing a projectile whose impact with a nearby surface produces both visual and auditory consequences, etc., produces afferent visual, auditory, and haptic/kinesthetic signals of known common origin. Because these signals routinely vary in intensity, the latencies at which these signals converge at multisensory coincidence detectors can, over repeated stimulation, result in the accumulation of intensity-adjusted probability distributions that form the basis for computing the posterior probability that any set of incoming multisensory signals have a common origin.</p><p>One way in which the Bayesian priors could be instantiated in a delay-line network is illustrated in <xref ref-type="fig" rid="F9">Figure 9</xref>.</p><p><xref ref-type="fig" rid="F9">Figures 9(a–c)</xref> refer to situations where physically simultaneous A and V events vary in relative intensity. In <xref ref-type="fig" rid="F9">Figure 9 (a)</xref>, the A and V inputs are of nominally equivalent relative intensity (denoted by the similar size of the delay lines, lettering, and the circular input and synaptic symbols), and the afferent signals (coded red) converge synchronously on and activate coincidence detector 3 (red). No other coincidence detector receives simultaneous input. <xref ref-type="fig" rid="F9">Figures 9(b) and (c)</xref> describe situations where simultaneous A and V events vary in intensity. The more intense stimuli (thick lines) propagate through the network more rapidly than the less intense stimuli (thin lines), and their signals thus converge on coincidence detector 1 or 5. Because we are assuming that in each case the physical origin of the afferent signals is known to have been common, physical stimulus synchrony can be disambiguated and correctly read out by the network only if the coincidence detectors are trained (learn) to fire when the constituent inputs possess the appropriate relative intensities. Thus, in <xref ref-type="fig" rid="F9">Figure 9 (d)</xref>, two inputs of nominal equivalent intensity are illustrated where the visual stimulus is delayed in time of onset relative to the auditory stimulus (represented here as added pathway length). Being of nominal equivalent intensity, the two signals propagate through the network at similar speeds and converge on coincidence detector 4. However, because this coincidence detector has “learned” that physically simultaneous A and V events only converge at its location when they possess unequal intensities (intensity tuning is indicated by the sizes of the circular synaptic contacts), it rejects this physiological simultaneity as spurious and does not integrate. Animations demonstrating the four conditions of <xref ref-type="fig" rid="F9">Figure 9</xref> are available as a supplementary flash file.</p></sec></sec></body><back><ack><p>This work was supported by grants NIH P20 GM103505 (MEM) and R03 AG022638 (MEM). The National Institute of General Medical Sciences (NIGMS) and the National Institute on Aging (NIA) are components of the National Institutes of Health (NIH). The contents of this report are solely the responsibility of the authors and do not necessarily reflect the official views of the NIH, NIGMS or NIA. The authors thank Huanzhong (Dan) Gu for assistance with computer programming and data analysis, and Dr. Jeff Miller for his thoughtful critique of an early draft of this manuscript.</p></ack><ref-list><title>References</title><ref id="R1"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alvarado</surname><given-names>J. C.</given-names></name><name><surname>Vaughan</surname><given-names>J. W.</given-names></name><name><surname>Stanford</surname><given-names>T. R.</given-names></name><name><surname>Stein</surname><given-names>B. E.</given-names></name></person-group><year>2007</year><article-title>Multisensory versus unisensory integration: Contrasting modes in the superior colliculus</article-title><source>Journal of Neurophysiology</source><volume>97</volume><fpage>3193</fpage><lpage>3205</lpage><pub-id pub-id-type="doi">10.1152/jn.00018.2007</pub-id><pub-id pub-id-type="pmid">17329632</pub-id></element-citation></ref><ref id="R2"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Barlow</surname><given-names>R. B.</given-names></name><name><surname>Snodderly</surname><given-names>D. M.</given-names></name><name><surname>Swadlow</surname><given-names>H. A.</given-names></name></person-group><year>1978</year><article-title>Intensity coding in primate visual system</article-title><source>Experimental Brain Research</source><volume>31</volume><fpage>163</fpage><lpage>177</lpage><pub-id pub-id-type="doi">10.1007/BF00237597</pub-id><pub-id pub-id-type="pmid">415894</pub-id></element-citation></ref><ref id="R3"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Callan</surname><given-names>D. E.</given-names></name><name><surname>Callan</surname><given-names>A. M.</given-names></name><name><surname>Kroos</surname><given-names>C.</given-names></name><name><surname>Vatikiotis-Bateson</surname><given-names>E.</given-names></name></person-group><year>2001</year><article-title>Multimodal contribution to speech perception revealed by independent component analysis: A single sweep EEG case study</article-title><source>Cognitive Brain Research</source><volume>10</volume><fpage>349</fpage><lpage>353</lpage><pub-id pub-id-type="doi">10.1016/S0926-6410(00)00054-9</pub-id><pub-id pub-id-type="pmid">11167060</pub-id></element-citation></ref><ref id="R4"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Calvert</surname><given-names>G. A.</given-names></name></person-group><year>2001</year><article-title>Crossmodal processing in the human brain: Insights from functional neuroimaging studies</article-title><source>Cerebral Cortex</source><volume>11</volume><fpage>1110</fpage><lpage>1123</lpage><pub-id pub-id-type="doi">10.1093/cercor/11.12.1110</pub-id><pub-id pub-id-type="pmid">11709482</pub-id></element-citation></ref><ref id="R5"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Campbell</surname><given-names>F. W.</given-names></name><name><surname>Green</surname><given-names>D. G.</given-names></name></person-group><year>1965</year><article-title>Monocular vs. binocular visual acuity</article-title><source>Nature</source><volume>208</volume><fpage>191</fpage><lpage>192</lpage><pub-id pub-id-type="doi">10.1038/208191a0</pub-id><pub-id pub-id-type="pmid">5884255</pub-id></element-citation></ref><ref id="R6"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Celesia</surname><given-names>G. G.</given-names></name><name><surname>Puletti</surname><given-names>F.</given-names></name></person-group><year>1971</year><article-title>Auditory input to the human cortex during states of drowsiness and surgical anesthesia</article-title><source>Electroencephalography and Clinical Neurophysiology</source><volume>31</volume><fpage>603</fpage><lpage>609</lpage><pub-id pub-id-type="doi">10.1016/0013-4694(71)90076-9</pub-id><pub-id pub-id-type="pmid">4111483</pub-id></element-citation></ref><ref id="R7"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Clark</surname><given-names>V. P.</given-names></name><name><surname>Hillyard</surname><given-names>S. A.</given-names></name></person-group><year>1996</year><article-title>Spatial selective attention affects early extrastriate but not striate components of the visual evoked potential</article-title><source>Journal of Cognitive Neuroscience</source><volume>8</volume><fpage>387</fpage><lpage>402</lpage><pub-id pub-id-type="doi">10.1162/jocn.1996.8.5.387</pub-id><pub-id pub-id-type="pmid">23961943</pub-id></element-citation></ref><ref id="R8"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Diederich</surname><given-names>A.</given-names></name><name><surname>Colonius</surname><given-names>H.</given-names></name></person-group><year>2004</year><article-title>Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time</article-title><source>Perception and Psychophysics</source><volume>66</volume><fpage>1388</fpage><lpage>1404</lpage><pub-id pub-id-type="doi">10.3758/BF03195006</pub-id><pub-id pub-id-type="pmid">15813202</pub-id></element-citation></ref><ref id="R9"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eggermont</surname><given-names>J. J.</given-names></name></person-group><year>1998</year><article-title>Azimuth coding in primary auditory cortex of the cat: Relative latency and interspike interval representation</article-title><source>Journal of Neurophysiology</source><volume>80</volume><fpage>2151</fpage><lpage>2161</lpage><pub-id pub-id-type="pmid">9772268</pub-id></element-citation></ref><ref id="R10"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Foster</surname><given-names>D. H.</given-names></name><name><surname>Bischof</surname><given-names>W. F.</given-names></name></person-group><year>1991</year><article-title>Bootstrap estimates of the statistical accuracy of thresholds obtained from psychometric functions</article-title><source>Spatial Vision</source><volume>11</volume><fpage>135</fpage><lpage>139</lpage><pub-id pub-id-type="pmid">18095395</pub-id></element-citation></ref><ref id="R11"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Foxe</surname><given-names>J. J.</given-names></name><name><surname>Simpson</surname><given-names>G. V.</given-names></name></person-group><year>2002</year><article-title>Flow of activation from V1 to frontal cortex in humans: A framework for defining “early” visual processing</article-title><source>Experimental Brain Research</source><volume>142</volume><fpage>139</fpage><lpage>150</lpage><pub-id pub-id-type="doi">10.1007/s00221-001-0906-7</pub-id></element-citation></ref><ref id="R12"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Foxe</surname><given-names>J. J.</given-names></name><name><surname>Strugstad</surname><given-names>E. C.</given-names></name><name><surname>Sehatpour</surname><given-names>P.</given-names></name><name><surname>Molholm</surname><given-names>S.</given-names></name><name><surname>Pasieka</surname><given-names>W.</given-names></name><name><surname>Schroeder</surname><given-names>C. E.</given-names></name><name><surname>McCourt</surname><given-names>M. E.</given-names></name></person-group><year>2008</year><article-title>Parvocellular and magnocellular contributions to the initial generators of the visual evoked potential: High-density electrical mapping of the “C1” component</article-title><source>Brain Topography</source><volume>21</volume><fpage>11</fpage><lpage>21</lpage><pub-id pub-id-type="doi">10.1007/s10548-008-0063-4</pub-id><pub-id pub-id-type="pmid">18784997</pub-id></element-citation></ref><ref id="R13"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frassinetti</surname><given-names>F.</given-names></name><name><surname>Bolognini</surname><given-names>N.</given-names></name><name><surname>Ladàvas</surname><given-names>E.</given-names></name></person-group><year>2002</year><article-title>Enhancement of visual perception by crossmodal visuo–auditory interaction</article-title><source>Experimental Brain Research</source><volume>147</volume><fpage>332</fpage><lpage>343</lpage><pub-id pub-id-type="doi">10.1007/s00221-002-1262-y</pub-id><pub-id pub-id-type="pmid">12428141</pub-id></element-citation></ref><ref id="R14"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Giard</surname><given-names>M. H.</given-names></name><name><surname>Peronnet</surname><given-names>F.</given-names></name></person-group><year>1999</year><article-title>Auditory–visual integration during multi-modal object recognition in humans: A behavioral and electrophysiological study</article-title><source>Journal of Cognitive Neuroscience</source><volume>11</volume><fpage>473</fpage><lpage>490</lpage><pub-id pub-id-type="doi">10.1162/089892999563544</pub-id><pub-id pub-id-type="pmid">10511637</pub-id></element-citation></ref><ref id="R15"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hershenson</surname><given-names>M.</given-names></name></person-group><year>1962</year><article-title>Reaction time as a measure of intersensory facilitation</article-title><source>Journal of Experimental Psychology</source><volume>63</volume><fpage>289</fpage><lpage>293</lpage><pub-id pub-id-type="doi">10.1037/h0039516</pub-id><pub-id pub-id-type="pmid">13906889</pub-id></element-citation></ref><ref id="R16"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Holmes</surname><given-names>N. P.</given-names></name></person-group><year>2007</year><article-title>The law of inverse effectiveness in neurons and behavior: Multisensory integration versus normal variability</article-title><source>Neuropsychologia</source><volume>45</volume><fpage>3340</fpage><lpage>3345</lpage><pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2007.05.025</pub-id><pub-id pub-id-type="pmid">17663007</pub-id></element-citation></ref><ref id="R17"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Holmes</surname><given-names>N. P.</given-names></name></person-group><year>2009</year><article-title>The principle of inverse effectiveness in multisensory integration: Some statistical considerations</article-title><source>Brain Topography</source><volume>21</volume><fpage>168</fpage><lpage>176</lpage><pub-id pub-id-type="doi">10.1007/s10548-009-0097-2</pub-id><pub-id pub-id-type="pmid">19404728</pub-id></element-citation></ref><ref id="R18"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Holmes</surname><given-names>N. P.</given-names></name><name><surname>Spence</surname><given-names>C.</given-names></name></person-group><year>2005</year><article-title>Multisensory integration: Space, time and superadditivity</article-title><source>Current Biology</source><volume>15</volume><fpage>R762</fpage><lpage>R764</lpage><pub-id pub-id-type="doi">10.1016/j.cub.2005.08.058</pub-id><pub-id pub-id-type="pmid">16169476</pub-id></element-citation></ref><ref id="R19"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Iacoboni</surname><given-names>M.</given-names></name><name><surname>Zaidel</surname><given-names>E.</given-names></name></person-group><year>2003</year><article-title>Interhemispheric visuo-motor integration in humans: The effect of redundant targets</article-title><source>European Journal of Neuroscience</source><volume>17</volume><fpage>1981</fpage><lpage>1986</lpage><pub-id pub-id-type="doi">10.1046/j.1460-9568.2003.02602.x</pub-id><pub-id pub-id-type="pmid">12752798</pub-id></element-citation></ref><ref id="R20"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jas´kowski</surname><given-names>P.</given-names></name></person-group><year>1985</year><article-title>The effect of visual adaptation on simple motor reaction time: Pt. 1</article-title><source>Studia Psychologica</source><volume>27</volume><fpage>191</fpage><lpage>201</lpage></element-citation></ref><ref id="R21"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jeffress</surname><given-names>L. A.</given-names></name></person-group><year>1948</year><article-title>A place theory of sound localization</article-title><source>Journal of Comparative and Physiological Psychology</source><volume>41</volume><fpage>35</fpage><lpage>39</lpage><pub-id pub-id-type="doi">10.1037/h0061495</pub-id><pub-id pub-id-type="pmid">18904764</pub-id></element-citation></ref><ref id="R22"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jeffreys</surname><given-names>D. A.</given-names></name><name><surname>Axford</surname><given-names>J. G.</given-names></name></person-group><year>1972</year><article-title>Source locations of pattern-specific components of human visual evoked potentials. II. Component of extrastriate cortical origin</article-title><source>Experimental Brain Research</source><volume>16</volume><fpage>22</fpage><lpage>40</lpage><pub-id pub-id-type="doi">10.1007/BF00233372</pub-id><pub-id pub-id-type="pmid">4646540</pub-id></element-citation></ref><ref id="R23"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lakatos</surname><given-names>P.</given-names></name><name><surname>Chen</surname><given-names>C. M.</given-names></name><name><surname>O'Connell</surname><given-names>M. N.</given-names></name><name><surname>Mills</surname><given-names>A.</given-names></name><name><surname>Schroeder</surname><given-names>C. E.</given-names></name></person-group><year>2007</year><article-title>Neuronal oscillations and multisensory interaction in primary auditory cortex</article-title><source>Neuron</source><volume>53</volume><fpage>279</fpage><lpage>292</lpage><pub-id pub-id-type="doi">10.1016/j.neuron.2006.12.011</pub-id><pub-id pub-id-type="pmid">17224408</pub-id></element-citation></ref><ref id="R24"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Legge</surname><given-names>G. E.</given-names></name></person-group><year>1984</year><article-title>Binocular contrast summation II. Quadratic summation</article-title><source>Vision Research</source><volume>24</volume><fpage>385</fpage><lpage>394</lpage><pub-id pub-id-type="doi">10.1016/0042-6989(84)90064-6</pub-id><pub-id pub-id-type="pmid">6740959</pub-id></element-citation></ref><ref id="R25"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mansfield</surname><given-names>R. J. W.</given-names></name></person-group><year>1973</year><article-title>Latency functions in human vision</article-title><source>Vision Research</source><volume>13</volume><fpage>2219</fpage><lpage>2234</lpage><pub-id pub-id-type="doi">10.1016/0042-6989(73)90224-1</pub-id><pub-id pub-id-type="pmid">4771191</pub-id></element-citation></ref><ref id="R26"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Maunsell</surname><given-names>J. H. R.</given-names></name><name><surname>Ghose</surname><given-names>G. M.</given-names></name><name><surname>Assad</surname><given-names>J. A.</given-names></name><name><surname>McAdams</surname><given-names>C. J.</given-names></name><name><surname>Boudreau</surname><given-names>C. E.</given-names></name><name><surname>Noerager</surname><given-names>B. D.</given-names></name></person-group><year>1999</year><article-title>Visual response latencies of magnocellular and parvocellular LGN neurons in macaque monkeys</article-title><source>Visual Neuroscience</source><volume>16</volume><fpage>1</fpage><lpage>14</lpage><pub-id pub-id-type="pmid">10022474</pub-id></element-citation></ref><ref id="R27"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meredith</surname><given-names>M. A.</given-names></name></person-group><year>2002</year><article-title>On the neuronal basis for multisensory convergence: A brief overview</article-title><source>Cognitive Brain Research</source><volume>14</volume><fpage>1</fpage><lpage>40</lpage><pub-id pub-id-type="doi">10.1016/S0926-6410(02)00059-9</pub-id><pub-id pub-id-type="pmid">12063124</pub-id></element-citation></ref><ref id="R28"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meredith</surname><given-names>M. A.</given-names></name><name><surname>Allman</surname><given-names>B.</given-names></name></person-group><year>2009</year><article-title>Subthreshold processing in cat auditory cortex</article-title><source>NeuroReport</source><volume>20</volume><fpage>126</fpage><lpage>131</lpage><pub-id pub-id-type="doi">10.1097/WNR.0b013e32831d7bb6</pub-id><pub-id pub-id-type="pmid">19057421</pub-id></element-citation></ref><ref id="R29"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meredith</surname><given-names>M. A.</given-names></name><name><surname>Nemitz</surname><given-names>J. W.</given-names></name><name><surname>Stein</surname><given-names>B. E.</given-names></name></person-group><year>1987</year><article-title>Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors</article-title><source>Journal of Neuroscience</source><volume>7</volume><fpage>3215</fpage><lpage>3229</lpage><pub-id pub-id-type="pmid">3668625</pub-id></element-citation></ref><ref id="R30"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meredith</surname><given-names>M. A.</given-names></name><name><surname>Stein</surname><given-names>B. E.</given-names></name></person-group><year>1986</year><article-title>Visual auditory and somatosensory convergence on cells in superior colliculus results in multisensory integration</article-title><source>Journal of Neuroscience</source><volume>56</volume><fpage>640</fpage><lpage>662</lpage></element-citation></ref><ref id="R31"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Miller</surname><given-names>J.</given-names></name></person-group><year>1982</year><article-title>Divided attention: Evidence for coactivation with redundant signals</article-title><source>Cognitive Psychology</source><volume>14</volume><fpage>247</fpage><lpage>279</lpage><pub-id pub-id-type="doi">10.1016/0010-0285(82)90010-X</pub-id><pub-id pub-id-type="pmid">7083803</pub-id></element-citation></ref><ref id="R32"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Miller</surname><given-names>J.</given-names></name></person-group><year>1986</year><article-title>Timecourse of coactivation in bimodal divided attention</article-title><source>Perception and Psychophysics</source><volume>40</volume><fpage>331</fpage><lpage>343</lpage><pub-id pub-id-type="doi">10.3758/BF03203025</pub-id><pub-id pub-id-type="pmid">3786102</pub-id></element-citation></ref><ref id="R33"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Miniussi</surname><given-names>C.</given-names></name><name><surname>Girelli</surname><given-names>M.</given-names></name><name><surname>Marzi</surname><given-names>C. A.</given-names></name></person-group><year>1998</year><article-title>Neural site of the redundant target effect: Electrophysiological evidence</article-title><source>Journal of Cognitive Neuroscience</source><volume>10</volume><fpage>216</fpage><lpage>225</lpage><pub-id pub-id-type="doi">10.1162/089892998562663</pub-id><pub-id pub-id-type="pmid">9555108</pub-id></element-citation></ref><ref id="R34"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Molholm</surname><given-names>S.</given-names></name><name><surname>Ritter</surname><given-names>W.</given-names></name><name><surname>Murray</surname><given-names>M. M.</given-names></name><name><surname>Javitt</surname><given-names>D. C.</given-names></name><name><surname>Schroeder</surname><given-names>C. E.</given-names></name><name><surname>Foxe</surname><given-names>J. J.</given-names></name></person-group><year>2002</year><article-title>Multisensory auditory–visual interactions during early sensory processing in humans: A high-density electrical mapping study</article-title><source>Cognitive Brain Research</source><volume>14</volume><fpage>115</fpage><lpage>128</lpage><pub-id pub-id-type="doi">10.1016/S0926-6410(02)00066-6</pub-id><pub-id pub-id-type="pmid">12063135</pub-id></element-citation></ref><ref id="R35"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Molholm</surname><given-names>S.</given-names></name><name><surname>Sehatpour</surname><given-names>P.</given-names></name><name><surname>Mehta</surname><given-names>A. D.</given-names></name><name><surname>Shpaner</surname><given-names>M.</given-names></name><name><surname>Gomez-Ramirez</surname><given-names>M.</given-names></name><name><surname>Ortigue</surname><given-names>S.</given-names></name><name><surname>Foxe</surname><given-names>J. J.</given-names></name></person-group><year>2006</year><article-title>Audio–visual multisensory integration in superior parietal lobule revealed by human intracranial recordings</article-title><source>Journal of Neurophysiology</source><volume>96</volume><fpage>721</fpage><lpage>729</lpage><pub-id pub-id-type="doi">10.1152/jn.00285.2006</pub-id><pub-id pub-id-type="pmid">16687619</pub-id></element-citation></ref><ref id="R36"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mordkoff</surname><given-names>J. T.</given-names></name><name><surname>Yantis</surname><given-names>S.</given-names></name></person-group><year>1991</year><article-title>An interactive race model of divided attention</article-title><source>Journal of Experimental Psychology</source><volume>17</volume><issue>2</issue><fpage>520</fpage><lpage>538</lpage><pub-id pub-id-type="doi">10.1037/0096-1523.17.2.520</pub-id><pub-id pub-id-type="pmid">1830090</pub-id></element-citation></ref><ref id="R37"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Murray</surname><given-names>M. M.</given-names></name><name><surname>Foxe</surname><given-names>J. J.</given-names></name><name><surname>Higgins</surname><given-names>B. A.</given-names></name><name><surname>Javitt</surname><given-names>D. C.</given-names></name><name><surname>Schroeder</surname><given-names>C. E.</given-names></name></person-group><year>2001</year><article-title>Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: A high-density electrical mapping study</article-title><source>Neuropsychologia</source><volume>39</volume><fpage>828</fpage><lpage>844</lpage><pub-id pub-id-type="doi">10.1016/S0028-3932(01)00004-5</pub-id><pub-id pub-id-type="pmid">11369406</pub-id></element-citation></ref><ref id="R38"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Otto</surname><given-names>T. U.</given-names></name><name><surname>Mamassian</surname><given-names>P.</given-names></name></person-group><year>2012</year><article-title>Noise and correlations in parallel perceptual decision making</article-title><source>Current Biology</source><volume>22</volume><fpage>1</fpage><lpage>6</lpage><pub-id pub-id-type="doi">10.1016/j.cub.2012.05.031</pub-id><pub-id pub-id-type="pmid">22197242</pub-id></element-citation></ref><ref id="R39"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Phillips</surname><given-names>D. P.</given-names></name></person-group><year>1998</year><article-title>Factors shaping the response latencies of neurons in the cat's auditory cortex</article-title><source>Behavioural Brain Research</source><volume>93</volume><fpage>33</fpage><lpage>41</lpage><pub-id pub-id-type="doi">10.1016/S0166-4328(97)00139-3</pub-id><pub-id pub-id-type="pmid">9659984</pub-id></element-citation></ref><ref id="R40"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Piéron</surname><given-names>H.</given-names></name></person-group><year>1952</year><source>The Sensations: Their Functions, Processes and Mechanisms</source><publisher-loc>London</publisher-loc><publisher-name>Frederick Muller Ltd</publisher-name></element-citation></ref><ref id="R41"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Prestrude</surname><given-names>A. M.</given-names></name></person-group><year>1971</year><article-title>Visual latencies at photopic levels of retinal illuminance</article-title><source>Vision Research</source><volume>11</volume><fpage>351</fpage><lpage>361</lpage><pub-id pub-id-type="doi">10.1016/0042-6989(71)90246-X</pub-id><pub-id pub-id-type="pmid">5091834</pub-id></element-citation></ref><ref id="R42"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Raab</surname><given-names>D. H.</given-names></name></person-group><year>1962</year><article-title>Statistical facilitation of simple reaction times</article-title><source>Transactions of the New York Academy of Sciences</source><volume>24</volume><fpage>574</fpage><lpage>590</lpage><pub-id pub-id-type="doi">10.1111/j.2164-0947.1962.tb01433.x</pub-id><pub-id pub-id-type="pmid">14489538</pub-id></element-citation></ref><ref id="R43"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ross</surname><given-names>L. A.</given-names></name><name><surname>Saint-Amour</surname><given-names>D.</given-names></name><name><surname>Leavitt</surname><given-names>V. M.</given-names></name><name><surname>Javitt</surname><given-names>D. C.</given-names></name><name><surname>Foxe</surname><given-names>J. J.</given-names></name></person-group><year>2007</year><article-title>Do you see what I'm saying? Exploring visual enhancement of speech comprehension in noisy environments</article-title><source>Cerebral Cortex</source><volume>17</volume><fpage>1147</fpage><lpage>1153</lpage><pub-id pub-id-type="doi">10.1093/cercor/bhl024</pub-id><pub-id pub-id-type="pmid">16785256</pub-id></element-citation></ref><ref id="R44"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Roufs</surname><given-names>J. A. J.</given-names></name></person-group><year>1963</year><article-title>Perception lag as a function of stimulus luminance</article-title><source>Vision Research</source><volume>3</volume><fpage>81</fpage><lpage>91</lpage><pub-id pub-id-type="doi">10.1016/0042-6989(63)90070-1</pub-id></element-citation></ref><ref id="R45"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Senkowski</surname><given-names>D.</given-names></name><name><surname>Saint-Amour</surname><given-names>D.</given-names></name><name><surname>Höfle</surname><given-names>M.</given-names></name><name><surname>Foxe</surname><given-names>J. J.</given-names></name></person-group><year>2011</year><article-title>Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness</article-title><source>NeuroImage</source><volume>56</volume><fpage>2200</fpage><lpage>2208</lpage><pub-id pub-id-type="doi">10.1016/j.neuroimage.2011.03.075</pub-id><pub-id pub-id-type="pmid">21497200</pub-id></element-citation></ref><ref id="R46"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Serino</surname><given-names>A.</given-names></name><name><surname>Farnè</surname><given-names>A.</given-names></name><name><surname>Rinaldesi</surname><given-names>M. L.</given-names></name><name><surname>Haggard</surname><given-names>P.</given-names></name><name><surname>Làdavas</surname><given-names>E.</given-names></name></person-group><year>2007</year><article-title>Can vision of the body ameliorate impaired somatosensory function?</article-title><source>Neuropsychologia</source><volume>45</volume><fpage>1101</fpage><lpage>1107</lpage><pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2006.09.013</pub-id><pub-id pub-id-type="pmid">17101158</pub-id></element-citation></ref><ref id="R47"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Song</surname><given-names>S.</given-names></name><name><surname>Miller</surname><given-names>K. D.</given-names></name><name><surname>Abbott</surname><given-names>L. F.</given-names></name></person-group><year>2000</year><article-title>Competitive Hebbian learning through spike-timing-dependent synaptic plasticity</article-title><source>Nature Neuroscience</source><volume>3</volume><fpage>919</fpage><lpage>926</lpage><pub-id pub-id-type="doi">10.1038/78829</pub-id></element-citation></ref><ref id="R48"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Stein</surname><given-names>B. E.</given-names></name><name><surname>Meredith</surname><given-names>M. A.</given-names></name></person-group><year>1993</year><source>The Merging of the Senses</source><publisher-loc>Cambridge</publisher-loc><publisher-name>MIT Press</publisher-name></element-citation></ref><ref id="R49"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stufflebeam</surname><given-names>S. M.</given-names></name><name><surname>Poeppel</surname><given-names>D.</given-names></name><name><surname>Rowley</surname><given-names>H. A.</given-names></name><name><surname>Roberts</surname><given-names>T. P. L.</given-names></name></person-group><year>1998</year><article-title>Peri-threshold encoding of stimulus frequency and intensity in the M100 latency</article-title><source>NeuroReport</source><volume>9</volume><fpage>91</fpage><lpage>94</lpage><pub-id pub-id-type="pmid">9592054</pub-id></element-citation></ref><ref id="R50"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Supek</surname><given-names>S.</given-names></name><name><surname>Aines</surname><given-names>C. J.</given-names></name><name><surname>Ranken</surname><given-names>D.</given-names></name><name><surname>Best</surname><given-names>E.</given-names></name><name><surname>Flynn</surname><given-names>E. R.</given-names></name><name><surname>Wood</surname><given-names>C. C.</given-names></name></person-group><year>1999</year><article-title>Single vs. paired visual stimuli: Superposition of early neuromagnetic responses and retinotopy in extrastriate cortex in humans</article-title><source>Brain Research</source><volume>830</volume><fpage>43</fpage><lpage>55</lpage><pub-id pub-id-type="doi">10.1016/S0006-8993(99)01316-5</pub-id><pub-id pub-id-type="pmid">10350559</pub-id></element-citation></ref><ref id="R51"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Turrigiano</surname><given-names>G. G.</given-names></name><name><surname>Leslie</surname><given-names>K. R.</given-names></name><name><surname>Desai</surname><given-names>N. S.</given-names></name><name><surname>Rutherford</surname><given-names>L. C.</given-names></name><name><surname>Nelson</surname><given-names>S. B.</given-names></name></person-group><year>1998</year><article-title>Activity-dependent scaling of quantal amplitude in neocortical neurons</article-title><source>Nature</source><volume>391</volume><fpage>892</fpage><lpage>896</lpage><pub-id pub-id-type="doi">10.1038/36103</pub-id><pub-id pub-id-type="pmid">9495341</pub-id></element-citation></ref></ref-list></back></pmc><affiliations><list></list><tree><noCountry><name sortKey="Leone, Lynnette M" sort="Leone, Lynnette M" uniqKey="Leone L" first="Lynnette M." last="Leone">Lynnette M. Leone</name><name sortKey="Mccourt, Mark E" sort="Mccourt, Mark E" uniqKey="Mccourt M" first="Mark E." last="Mccourt">Mark E. Mccourt</name></noCountry></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Ncbi/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002B68 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd -nk 002B68 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= HapticV1
|flux= Ncbi
|étape= Merge
|type= RBID
|clé= PMC:3859565
|texte= The roles of physical and physiological simultaneity in audiovisual multisensory facilitation
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/RBID.i -Sk "pubmed:24349682" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd \
| NlmPubMed2Wicri -a HapticV1
| This area was generated with Dilib version V0.6.23. |  |